Nov 18 16:59:10 user nova-compute[74743]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74743) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74743) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74743) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 18 16:59:10 user nova-compute[74743]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:59:10 user nova-compute[74743]: INFO nova.virt.driver [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 18 16:59:10 user nova-compute[74743]: INFO nova.compute.provider_config [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] Acquiring lock "singleton_lock" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] Acquired lock "singleton_lock" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] Releasing lock "singleton_lock" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] Full set of CONF: {{(pid=74743) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] ******************************************************************************** {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] Configuration options gathered from: {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] ================================================================================ {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] allow_resize_to_same_host      = True {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] arq_binding_timeout            = 300 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] backdoor_port                  = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] backdoor_socket                = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] block_device_allocate_retries  = 300 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] block_device_allocate_retries_interval = 5 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cert                           = self.pem {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] compute_monitors               = [] {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] config_dir                     = [] {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] config_drive_format            = iso9660 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] config_source                  = [] {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] console_host                   = user {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] control_exchange               = nova {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cpu_allocation_ratio           = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] daemon                         = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] debug                          = True {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] default_access_ip_network_name = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] default_availability_zone      = nova {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] default_ephemeral_format       = ext4 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] default_green_pool_size        = 1000 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] default_schedule_zone          = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] disk_allocation_ratio          = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] enable_new_services            = True {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] enabled_apis                   = ['osapi_compute'] {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] enabled_ssl_apis               = [] {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] flat_injected                  = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] force_config_drive             = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] force_raw_images               = True {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] graceful_shutdown_timeout      = 5 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] heal_instance_info_cache_interval = 60 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] host                           = user {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] instance_build_timeout         = 0 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] instance_delete_interval       = 300 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] instance_format                = [instance: %(uuid)s]  {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] instance_name_template         = instance-%08x {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] instance_usage_audit           = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] instance_usage_audit_period    = month {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] internal_service_availability_zone = internal {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] key                            = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] live_migration_retry_count     = 30 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] log_config_append              = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] log_dir                        = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] log_file                       = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] log_options                    = True {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] log_rotate_interval            = 1 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] log_rotate_interval_type       = days {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] log_rotation_type              = none {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] long_rpc_timeout               = 1800 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] max_concurrent_builds          = 10 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] max_concurrent_live_migrations = 1 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] max_concurrent_snapshots       = 5 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] max_local_block_devices        = 3 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] max_logfile_count              = 30 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] max_logfile_size_mb            = 200 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] maximum_instance_delete_attempts = 5 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] metadata_listen                = 0.0.0.0 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] metadata_listen_port           = 8775 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] metadata_workers               = 3 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] migrate_max_retries            = -1 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] mkisofs_cmd                    = genisoimage {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] my_ip                          = 10.0.0.210 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] network_allocate_retries       = 0 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] osapi_compute_listen_port      = 8774 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] osapi_compute_unique_server_name_scope =  {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] osapi_compute_workers          = 3 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] password_length                = 12 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] periodic_enable                = True {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] periodic_fuzzy_delay           = 60 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] pointer_model                  = ps2mouse {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] preallocate_images             = none {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] publish_errors                 = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] pybasedir                      = /opt/stack/nova {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] ram_allocation_ratio           = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] rate_limit_burst               = 0 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] rate_limit_except_level        = CRITICAL {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] rate_limit_interval            = 0 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] reboot_timeout                 = 0 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] reclaim_instance_interval      = 0 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] record                         = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] reimage_timeout_per_gb         = 60 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] report_interval                = 120 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] rescue_timeout                 = 0 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] reserved_host_cpus             = 0 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] reserved_host_disk_mb          = 0 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] reserved_host_memory_mb        = 512 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] reserved_huge_pages            = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] resize_confirm_window          = 0 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] resize_fs_using_block_device   = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] resume_guests_state_on_host_boot = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] rpc_response_timeout           = 60 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] run_external_periodic_tasks    = True {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] running_deleted_instance_action = reap {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] running_deleted_instance_poll_interval = 1800 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] running_deleted_instance_timeout = 0 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] scheduler_instance_sync_interval = 120 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] service_down_time              = 720 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] servicegroup_driver            = db {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] shelved_offload_time           = 0 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] shelved_poll_interval          = 3600 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] shutdown_timeout               = 0 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] source_is_ipv6                 = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] ssl_only                       = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] state_path                     = /opt/stack/data/nova {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] sync_power_state_interval      = 600 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] sync_power_state_pool_size     = 1000 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] syslog_log_facility            = LOG_USER {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] tempdir                        = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] timeout_nbd                    = 10 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] transport_url                  = **** {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] update_resources_interval      = 0 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] use_cow_images                 = True {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] use_eventlog                   = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] use_journal                    = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] use_json                       = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] use_rootwrap_daemon            = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] use_stderr                     = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] use_syslog                     = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vcpu_pin_set                   = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vif_plugging_is_fatal          = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vif_plugging_timeout           = 0 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] virt_mkfs                      = [] {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] volume_usage_poll_interval     = 0 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] watch_log_file                 = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] web                            = /usr/share/spice-html5 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_concurrency.disable_process_locking = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] api.auth_strategy              = keystone {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] api.compute_link_prefix        = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] api.dhcp_domain                = novalocal {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] api.enable_instance_password   = True {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] api.glance_link_prefix         = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] api.instance_list_per_project_cells = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] api.list_records_by_skipping_down_cells = True {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] api.local_metadata_per_cell    = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] api.max_limit                  = 1000 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] api.metadata_cache_expiration  = 15 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] api.neutron_default_tenant_id  = default {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] api.use_forwarded_for          = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] api.use_neutron_default_nets   = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] api.vendordata_dynamic_targets = [] {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] api.vendordata_jsonfile_path   = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cache.backend                  = dogpile.cache.memcached {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cache.backend_argument         = **** {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cache.config_prefix            = cache.oslo {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cache.dead_timeout             = 60.0 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cache.debug_cache_backend      = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cache.enable_retry_client      = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cache.enable_socket_keepalive  = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cache.enabled                  = True {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cache.expiration_time          = 600 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cache.hashclient_retry_attempts = 2 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cache.memcache_dead_retry      = 300 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cache.memcache_password        =  {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cache.memcache_pool_maxsize    = 10 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cache.memcache_sasl_enabled    = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cache.memcache_username        =  {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cache.proxies                  = [] {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cache.retry_attempts           = 2 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cache.retry_delay              = 0.0 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cache.socket_keepalive_count   = 1 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cache.socket_keepalive_idle    = 1 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cache.socket_keepalive_interval = 1 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cache.tls_allowed_ciphers      = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cache.tls_cafile               = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cache.tls_certfile             = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cache.tls_enabled              = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cache.tls_keyfile              = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cinder.auth_section            = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cinder.auth_type               = password {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cinder.cafile                  = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cinder.certfile                = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cinder.collect_timing          = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cinder.cross_az_attach         = True {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cinder.debug                   = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cinder.endpoint_template       = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cinder.http_retries            = 3 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cinder.insecure                = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cinder.keyfile                 = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cinder.os_region_name          = RegionOne {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cinder.split_loggers           = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cinder.timeout                 = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] compute.cpu_dedicated_set      = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] compute.cpu_shared_set         = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] compute.image_type_exclude_list = [] {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] compute.max_concurrent_disk_ops = 0 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] compute.max_disk_devices_to_attach = -1 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] compute.resource_provider_association_refresh = 300 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] compute.shutdown_retry_interval = 10 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] conductor.workers              = 3 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] console.allowed_origins        = [] {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] console.ssl_ciphers            = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] console.ssl_minimum_version    = default {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] consoleauth.token_ttl          = 600 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cyborg.cafile                  = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cyborg.certfile                = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cyborg.collect_timing          = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cyborg.connect_retries         = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cyborg.connect_retry_delay     = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cyborg.endpoint_override       = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cyborg.insecure                = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cyborg.keyfile                 = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cyborg.max_version             = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cyborg.min_version             = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cyborg.region_name             = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cyborg.service_name            = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cyborg.service_type            = accelerator {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cyborg.split_loggers           = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cyborg.status_code_retries     = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cyborg.status_code_retry_delay = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cyborg.timeout                 = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] cyborg.version                 = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] database.backend               = sqlalchemy {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] database.connection            = **** {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] database.connection_debug      = 0 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] database.connection_parameters =  {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] database.connection_recycle_time = 3600 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] database.connection_trace      = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] database.db_inc_retry_interval = True {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] database.db_max_retries        = 20 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] database.db_max_retry_interval = 10 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] database.db_retry_interval     = 1 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] database.max_overflow          = 50 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] database.max_pool_size         = 5 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] database.max_retries           = 10 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] database.mysql_wsrep_sync_wait = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] database.pool_timeout          = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] database.retry_interval        = 10 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] database.slave_connection      = **** {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] database.sqlite_synchronous    = True {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] api_database.backend           = sqlalchemy {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] api_database.connection        = **** {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] api_database.connection_debug  = 0 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] api_database.connection_parameters =  {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] api_database.connection_recycle_time = 3600 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] api_database.connection_trace  = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] api_database.db_inc_retry_interval = True {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] api_database.db_max_retries    = 20 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] api_database.db_max_retry_interval = 10 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] api_database.db_retry_interval = 1 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] api_database.max_overflow      = 50 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] api_database.max_pool_size     = 5 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] api_database.max_retries       = 10 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] api_database.pool_timeout      = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] api_database.retry_interval    = 10 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] api_database.slave_connection  = **** {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] api_database.sqlite_synchronous = True {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] devices.enabled_mdev_types     = [] {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] ephemeral_storage_encryption.enabled = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] glance.api_servers             = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] glance.cafile                  = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] glance.certfile                = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] glance.collect_timing          = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] glance.connect_retries         = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] glance.connect_retry_delay     = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] glance.debug                   = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] glance.default_trusted_certificate_ids = [] {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] glance.enable_certificate_validation = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] glance.enable_rbd_download     = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] glance.endpoint_override       = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] glance.insecure                = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] glance.keyfile                 = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] glance.max_version             = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] glance.min_version             = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] glance.num_retries             = 3 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] glance.rbd_ceph_conf           =  {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] glance.rbd_connect_timeout     = 5 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] glance.rbd_pool                =  {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] glance.rbd_user                =  {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] glance.region_name             = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] glance.service_name            = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] glance.service_type            = image {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] glance.split_loggers           = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] glance.status_code_retries     = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] glance.status_code_retry_delay = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] glance.timeout                 = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] glance.verify_glance_signatures = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] glance.version                 = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] guestfs.debug                  = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] hyperv.config_drive_cdrom      = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] hyperv.config_drive_inject_password = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] hyperv.enable_instance_metrics_collection = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] hyperv.enable_remotefx         = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] hyperv.instances_path_share    =  {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] hyperv.iscsi_initiator_list    = [] {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] hyperv.limit_cpu_features      = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] hyperv.power_state_check_timeframe = 60 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] hyperv.use_multipath_io        = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] hyperv.volume_attach_retry_count = 10 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] hyperv.vswitch_name            = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] mks.enabled                    = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] image_cache.manager_interval   = 2400 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] image_cache.precache_concurrency = 1 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] image_cache.remove_unused_base_images = True {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] image_cache.subdirectory_name  = _base {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] ironic.api_max_retries         = 60 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] ironic.api_retry_interval      = 2 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] ironic.auth_section            = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] ironic.auth_type               = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] ironic.cafile                  = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] ironic.certfile                = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] ironic.collect_timing          = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] ironic.conductor_group         = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] ironic.connect_retries         = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] ironic.connect_retry_delay     = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] ironic.endpoint_override       = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] ironic.insecure                = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] ironic.keyfile                 = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] ironic.max_version             = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] ironic.min_version             = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] ironic.peer_list               = [] {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] ironic.region_name             = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] ironic.serial_console_state_timeout = 10 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] ironic.service_name            = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] ironic.service_type            = baremetal {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] ironic.split_loggers           = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] ironic.status_code_retries     = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] ironic.status_code_retry_delay = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] ironic.timeout                 = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] ironic.version                 = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] key_manager.fixed_key          = **** {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] barbican.barbican_api_version  = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] barbican.barbican_endpoint     = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] barbican.barbican_endpoint_type = public {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] barbican.barbican_region_name  = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] barbican.cafile                = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] barbican.certfile              = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] barbican.collect_timing        = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] barbican.insecure              = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] barbican.keyfile               = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] barbican.number_of_retries     = 60 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] barbican.retry_delay           = 1 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] barbican.send_service_user_token = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] barbican.split_loggers         = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] barbican.timeout               = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] barbican.verify_ssl            = True {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] barbican.verify_ssl_path       = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] barbican_service_user.auth_section = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] barbican_service_user.auth_type = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] barbican_service_user.cafile   = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] barbican_service_user.certfile = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] barbican_service_user.collect_timing = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] barbican_service_user.insecure = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] barbican_service_user.keyfile  = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] barbican_service_user.split_loggers = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] barbican_service_user.timeout  = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vault.approle_role_id          = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vault.approle_secret_id        = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vault.cafile                   = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vault.certfile                 = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vault.collect_timing           = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vault.insecure                 = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vault.keyfile                  = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vault.kv_mountpoint            = secret {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vault.kv_path                  = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vault.kv_version               = 2 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vault.namespace                = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vault.root_token_id            = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vault.split_loggers            = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vault.ssl_ca_crt_file          = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vault.timeout                  = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vault.use_ssl                  = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] keystone.auth_section          = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] keystone.auth_type             = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] keystone.cafile                = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] keystone.certfile              = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] keystone.collect_timing        = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] keystone.connect_retries       = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] keystone.connect_retry_delay   = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] keystone.endpoint_override     = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] keystone.insecure              = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] keystone.keyfile               = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] keystone.max_version           = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] keystone.min_version           = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] keystone.region_name           = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] keystone.service_name          = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] keystone.service_type          = identity {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] keystone.split_loggers         = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] keystone.status_code_retries   = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] keystone.status_code_retry_delay = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] keystone.timeout               = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] keystone.version               = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.connection_uri         =  {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.cpu_mode               = custom {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: WARNING oslo_config.cfg [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.cpu_power_governor_high = performance {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.cpu_power_governor_low = powersave {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.cpu_power_management   = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.device_detach_attempts = 8 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.device_detach_timeout  = 20 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.disk_cachemodes        = [] {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.disk_prefix            = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.enabled_perf_events    = [] {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.file_backed_memory     = 0 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.gid_maps               = [] {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.hw_disk_discard        = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.hw_machine_type        = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.images_rbd_glance_store_name =  {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.images_rbd_pool        = rbd {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.images_type            = default {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.images_volume_group    = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.inject_key             = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.inject_partition       = -2 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.inject_password        = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.iscsi_iface            = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.iser_use_multipath     = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.live_migration_bandwidth = 0 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.live_migration_downtime = 500 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.live_migration_inbound_addr = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.live_migration_permit_post_copy = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.live_migration_scheme  = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.live_migration_timeout_action = abort {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.live_migration_tunnelled = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: WARNING oslo_config.cfg [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 18 16:59:10 user nova-compute[74743]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 18 16:59:10 user nova-compute[74743]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 18 16:59:10 user nova-compute[74743]: and ``live_migration_inbound_addr`` respectively.
Nov 18 16:59:10 user nova-compute[74743]: ).  Its value may be silently ignored in the future.
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.live_migration_with_native_tls = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.max_queues             = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.nfs_mount_options      = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.num_memory_encrypted_guests = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.num_pcie_ports         = 0 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.pmem_namespaces        = [] {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.quobyte_client_cfg     = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.rbd_secret_uuid        = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.rbd_user               = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.remote_filesystem_transport = ssh {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.rescue_image_id        = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.rescue_kernel_id       = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.rescue_ramdisk_id      = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.rx_queue_size          = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.smbfs_mount_options    =  {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.snapshot_compression   = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.snapshot_image_format  = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.sparse_logical_volumes = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.swtpm_enabled          = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.swtpm_group            = tss {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.swtpm_user             = tss {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.sysinfo_serial         = unique {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.tb_cache_size          = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.tx_queue_size          = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.uid_maps               = [] {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.use_virtio_for_bridges = True {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.virt_type              = kvm {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.volume_clear           = zero {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.volume_clear_size      = 0 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.volume_use_multipath   = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.vzstorage_cache_path   = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.vzstorage_mount_user   = stack {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] neutron.auth_section           = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] neutron.auth_type              = password {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] neutron.cafile                 = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] neutron.certfile               = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] neutron.collect_timing         = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] neutron.connect_retries        = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] neutron.connect_retry_delay    = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] neutron.default_floating_pool  = public {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] neutron.endpoint_override      = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] neutron.extension_sync_interval = 600 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] neutron.http_retries           = 3 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] neutron.insecure               = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] neutron.keyfile                = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] neutron.max_version            = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] neutron.min_version            = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] neutron.ovs_bridge             = br-int {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] neutron.physnets               = [] {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] neutron.region_name            = RegionOne {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] neutron.service_metadata_proxy = True {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] neutron.service_name           = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] neutron.service_type           = network {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] neutron.split_loggers          = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] neutron.status_code_retries    = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] neutron.status_code_retry_delay = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] neutron.timeout                = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] neutron.version                = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] notifications.bdms_in_notifications = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] notifications.default_level    = INFO {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] notifications.notification_format = unversioned {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] notifications.notify_on_state_change = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] pci.alias                      = [] {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] pci.device_spec                = [] {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] pci.report_in_placement        = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] placement.auth_section         = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] placement.auth_type            = password {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] placement.cafile               = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] placement.certfile             = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] placement.collect_timing       = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] placement.connect_retries      = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] placement.connect_retry_delay  = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] placement.default_domain_id    = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] placement.default_domain_name  = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] placement.domain_id            = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] placement.domain_name          = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] placement.endpoint_override    = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] placement.insecure             = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] placement.keyfile              = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] placement.max_version          = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] placement.min_version          = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] placement.password             = **** {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] placement.project_domain_id    = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] placement.project_domain_name  = Default {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] placement.project_id           = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] placement.project_name         = service {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] placement.region_name          = RegionOne {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] placement.service_name         = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:10 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] placement.service_type         = placement {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] placement.split_loggers        = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] placement.status_code_retries  = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] placement.status_code_retry_delay = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] placement.system_scope         = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] placement.timeout              = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] placement.trust_id             = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] placement.user_domain_id       = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] placement.user_domain_name     = Default {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] placement.user_id              = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] placement.username             = placement {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] placement.version              = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] quota.cores                    = 20 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] quota.count_usage_from_placement = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] quota.injected_file_content_bytes = 10240 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] quota.injected_file_path_length = 255 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] quota.injected_files           = 5 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] quota.instances                = 10 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] quota.key_pairs                = 100 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] quota.metadata_items           = 128 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] quota.ram                      = 51200 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] quota.recheck_quota            = True {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] quota.server_group_members     = 10 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] quota.server_groups            = 10 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] rdp.enabled                    = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] scheduler.image_metadata_prefilter = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] scheduler.max_attempts         = 3 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] scheduler.max_placement_results = 1000 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] scheduler.query_placement_for_image_type_support = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] scheduler.workers              = 3 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] filter_scheduler.host_subset_size = 1 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] filter_scheduler.isolated_hosts = [] {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] filter_scheduler.isolated_images = [] {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] filter_scheduler.pci_in_placement = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] filter_scheduler.track_instance_changes = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] metrics.required               = True {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] metrics.weight_multiplier      = 1.0 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] metrics.weight_setting         = [] {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] serial_console.enabled         = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] serial_console.port_range      = 10000:20000 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] serial_console.serialproxy_port = 6083 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] service_user.auth_section      = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] service_user.auth_type         = password {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] service_user.cafile            = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] service_user.certfile          = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] service_user.collect_timing    = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] service_user.insecure          = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] service_user.keyfile           = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] service_user.send_service_user_token = True {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] service_user.split_loggers     = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] service_user.timeout           = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] spice.agent_enabled            = True {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] spice.enabled                  = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] spice.html5proxy_port          = 6082 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] spice.image_compression        = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] spice.jpeg_compression         = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] spice.playback_compression     = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] spice.server_listen            = 127.0.0.1 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] spice.streaming_mode           = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] spice.zlib_compression         = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] upgrade_levels.baseapi         = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] upgrade_levels.compute         = auto {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] upgrade_levels.conductor       = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] upgrade_levels.scheduler       = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vendordata_dynamic_auth.auth_section = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vendordata_dynamic_auth.auth_type = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vendordata_dynamic_auth.cafile = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vendordata_dynamic_auth.certfile = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vendordata_dynamic_auth.insecure = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vendordata_dynamic_auth.keyfile = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vendordata_dynamic_auth.timeout = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vmware.api_retry_count         = 10 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vmware.ca_file                 = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vmware.cache_prefix            = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vmware.cluster_name            = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vmware.connection_pool_size    = 10 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vmware.console_delay_seconds   = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vmware.datastore_regex         = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vmware.host_ip                 = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vmware.host_password           = **** {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vmware.host_port               = 443 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vmware.host_username           = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vmware.insecure                = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vmware.integration_bridge      = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vmware.maximum_objects         = 100 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vmware.pbm_default_policy      = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vmware.pbm_enabled             = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vmware.pbm_wsdl_location       = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vmware.serial_port_proxy_uri   = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vmware.serial_port_service_uri = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vmware.task_poll_interval      = 0.5 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vmware.use_linked_clone        = True {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vmware.vnc_keymap              = en-us {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vmware.vnc_port                = 5900 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vmware.vnc_port_total          = 10000 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vnc.auth_schemes               = ['none'] {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vnc.enabled                    = True {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vnc.novncproxy_port            = 6080 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vnc.server_listen              = 0.0.0.0 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vnc.vencrypt_ca_certs          = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vnc.vencrypt_client_cert       = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vnc.vencrypt_client_key        = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] workarounds.disable_rootwrap   = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] workarounds.enable_numa_live_migration = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] workarounds.libvirt_disable_apic = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] wsgi.client_socket_timeout     = 900 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] wsgi.default_pool_size         = 1000 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] wsgi.keep_alive                = True {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] wsgi.max_header_line           = 16384 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] wsgi.ssl_ca_file               = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] wsgi.ssl_cert_file             = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] wsgi.ssl_key_file              = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] wsgi.tcp_keepidle              = 600 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] zvm.ca_file                    = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] zvm.cloud_connector_url        = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] zvm.reachable_timeout          = 300 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_policy.enforce_new_defaults = True {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_policy.enforce_scope      = True {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_policy.policy_default_rule = default {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_policy.policy_file        = policy.yaml {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] profiler.connection_string     = messaging:// {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] profiler.enabled               = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] profiler.es_doc_type           = notification {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] profiler.es_scroll_size        = 10000 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] profiler.es_scroll_time        = 2m {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] profiler.filter_error_trace    = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] profiler.hmac_keys             = **** {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] profiler.sentinel_service_name = mymaster {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] profiler.socket_timeout        = 0.1 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] profiler.trace_requests        = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] profiler.trace_sqlalchemy      = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] profiler_jaeger.process_tags   = {} {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] profiler_jaeger.service_name_prefix = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] profiler_otlp.service_name_prefix = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] remote_debug.host              = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] remote_debug.port              = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_messaging_rabbit.ssl      = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_messaging_notifications.retry = -1 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_limit.auth_section        = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_limit.auth_type           = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_limit.cafile              = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_limit.certfile            = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_limit.collect_timing      = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_limit.connect_retries     = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_limit.connect_retry_delay = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_limit.endpoint_id         = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_limit.endpoint_override   = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_limit.insecure            = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_limit.keyfile             = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_limit.max_version         = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_limit.min_version         = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_limit.region_name         = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_limit.service_name        = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_limit.service_type        = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_limit.split_loggers       = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_limit.status_code_retries = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_limit.status_code_retry_delay = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_limit.timeout             = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_limit.valid_interfaces    = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_limit.version             = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_reports.file_event_handler = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] oslo_reports.log_dir           = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vif_plug_ovs_privileged.group  = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] vif_plug_ovs_privileged.user   = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] os_vif_linux_bridge.flat_interface = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] os_vif_ovs.isolate_vif         = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] os_vif_ovs.per_port_bridge     = False {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] os_brick.lock_path             = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] privsep_osbrick.capabilities   = [21] {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] privsep_osbrick.group          = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] privsep_osbrick.helper_command = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] privsep_osbrick.user           = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] nova_sys_admin.group           = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] nova_sys_admin.helper_command  = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] nova_sys_admin.user            = None {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG oslo_service.service [None req-1372b5e1-6815-4662-b6fe-96c5166c7368 None None] ******************************************************************************** {{(pid=74743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 18 16:59:11 user nova-compute[74743]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 18 16:59:11 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Connecting to libvirt: qemu:///system {{(pid=74743) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7ffb39a76410> {{(pid=74743) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 18 16:59:11 user nova-compute[74743]: libvirt:  error : internal error: could not initialize domain event timer
Nov 18 16:59:11 user nova-compute[74743]: WARNING nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 18 16:59:11 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7ffb39a76410> {{(pid=74743) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Starting native event thread {{(pid=74743) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Starting green dispatch thread {{(pid=74743) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 18 16:59:11 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Starting connection event dispatch thread {{(pid=74743) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 18 16:59:11 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Connection event '1' reason 'None'
Nov 18 16:59:11 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 18 16:59:11 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.mount [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Initialising _HostMountState generation 0 {{(pid=74743) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 18 16:59:18 user nova-compute[74743]: INFO nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Libvirt host capabilities <capabilities>
Nov 18 16:59:18 user nova-compute[74743]:   <host>
Nov 18 16:59:18 user nova-compute[74743]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 18 16:59:18 user nova-compute[74743]:     <cpu>
Nov 18 16:59:18 user nova-compute[74743]:       <arch>x86_64</arch>
Nov 18 16:59:18 user nova-compute[74743]:       <model>IvyBridge-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <vendor>Intel</vendor>
Nov 18 16:59:18 user nova-compute[74743]:       <microcode version='1070'/>
Nov 18 16:59:18 user nova-compute[74743]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 18 16:59:18 user nova-compute[74743]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature name='ss'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature name='vmx'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature name='pcid'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature name='osxsave'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature name='hypervisor'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature name='arat'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature name='tsc_adjust'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature name='md-clear'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature name='stibp'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature name='arch-capabilities'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature name='ssbd'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature name='invtsc'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature name='rsba'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature name='skip-l1dfl-vmentry'/>
Nov 18 16:59:18 user nova-compute[74743]:       <pages unit='KiB' size='4'/>
Nov 18 16:59:18 user nova-compute[74743]:       <pages unit='KiB' size='2048'/>
Nov 18 16:59:18 user nova-compute[74743]:     </cpu>
Nov 18 16:59:18 user nova-compute[74743]:     <power_management>
Nov 18 16:59:18 user nova-compute[74743]:       <suspend_mem/>
Nov 18 16:59:18 user nova-compute[74743]:       <suspend_disk/>
Nov 18 16:59:18 user nova-compute[74743]:       <suspend_hybrid/>
Nov 18 16:59:18 user nova-compute[74743]:     </power_management>
Nov 18 16:59:18 user nova-compute[74743]:     <iommu support='no'/>
Nov 18 16:59:18 user nova-compute[74743]:     <migration_features>
Nov 18 16:59:18 user nova-compute[74743]:       <live/>
Nov 18 16:59:18 user nova-compute[74743]:       <uri_transports>
Nov 18 16:59:18 user nova-compute[74743]:         <uri_transport>tcp</uri_transport>
Nov 18 16:59:18 user nova-compute[74743]:         <uri_transport>rdma</uri_transport>
Nov 18 16:59:18 user nova-compute[74743]:       </uri_transports>
Nov 18 16:59:18 user nova-compute[74743]:     </migration_features>
Nov 18 16:59:18 user nova-compute[74743]:     <topology>
Nov 18 16:59:18 user nova-compute[74743]:       <cells num='2'>
Nov 18 16:59:18 user nova-compute[74743]:         <cell id='0'>
Nov 18 16:59:18 user nova-compute[74743]:           <memory unit='KiB'>8140616</memory>
Nov 18 16:59:18 user nova-compute[74743]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 18 16:59:18 user nova-compute[74743]:           <pages unit='KiB' size='2048'>0</pages>
Nov 18 16:59:18 user nova-compute[74743]:           <distances>
Nov 18 16:59:18 user nova-compute[74743]:             <sibling id='0' value='10'/>
Nov 18 16:59:18 user nova-compute[74743]:             <sibling id='1' value='20'/>
Nov 18 16:59:18 user nova-compute[74743]:           </distances>
Nov 18 16:59:18 user nova-compute[74743]:           <cpus num='6'>
Nov 18 16:59:18 user nova-compute[74743]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 18 16:59:18 user nova-compute[74743]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 18 16:59:18 user nova-compute[74743]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 18 16:59:18 user nova-compute[74743]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 18 16:59:18 user nova-compute[74743]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 18 16:59:18 user nova-compute[74743]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 18 16:59:18 user nova-compute[74743]:           </cpus>
Nov 18 16:59:18 user nova-compute[74743]:         </cell>
Nov 18 16:59:18 user nova-compute[74743]:         <cell id='1'>
Nov 18 16:59:18 user nova-compute[74743]:           <memory unit='KiB'>8255068</memory>
Nov 18 16:59:18 user nova-compute[74743]:           <pages unit='KiB' size='4'>2063767</pages>
Nov 18 16:59:18 user nova-compute[74743]:           <pages unit='KiB' size='2048'>0</pages>
Nov 18 16:59:18 user nova-compute[74743]:           <distances>
Nov 18 16:59:18 user nova-compute[74743]:             <sibling id='0' value='20'/>
Nov 18 16:59:18 user nova-compute[74743]:             <sibling id='1' value='10'/>
Nov 18 16:59:18 user nova-compute[74743]:           </distances>
Nov 18 16:59:18 user nova-compute[74743]:           <cpus num='6'>
Nov 18 16:59:18 user nova-compute[74743]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 18 16:59:18 user nova-compute[74743]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 18 16:59:18 user nova-compute[74743]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 18 16:59:18 user nova-compute[74743]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 18 16:59:18 user nova-compute[74743]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 18 16:59:18 user nova-compute[74743]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 18 16:59:18 user nova-compute[74743]:           </cpus>
Nov 18 16:59:18 user nova-compute[74743]:         </cell>
Nov 18 16:59:18 user nova-compute[74743]:       </cells>
Nov 18 16:59:18 user nova-compute[74743]:     </topology>
Nov 18 16:59:18 user nova-compute[74743]:     <cache>
Nov 18 16:59:18 user nova-compute[74743]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 18 16:59:18 user nova-compute[74743]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 18 16:59:18 user nova-compute[74743]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 18 16:59:18 user nova-compute[74743]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 18 16:59:18 user nova-compute[74743]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 18 16:59:18 user nova-compute[74743]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 18 16:59:18 user nova-compute[74743]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 18 16:59:18 user nova-compute[74743]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 18 16:59:18 user nova-compute[74743]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 18 16:59:18 user nova-compute[74743]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 18 16:59:18 user nova-compute[74743]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 18 16:59:18 user nova-compute[74743]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 18 16:59:18 user nova-compute[74743]:     </cache>
Nov 18 16:59:18 user nova-compute[74743]:     <secmodel>
Nov 18 16:59:18 user nova-compute[74743]:       <model>apparmor</model>
Nov 18 16:59:18 user nova-compute[74743]:       <doi>0</doi>
Nov 18 16:59:18 user nova-compute[74743]:     </secmodel>
Nov 18 16:59:18 user nova-compute[74743]:     <secmodel>
Nov 18 16:59:18 user nova-compute[74743]:       <model>dac</model>
Nov 18 16:59:18 user nova-compute[74743]:       <doi>0</doi>
Nov 18 16:59:18 user nova-compute[74743]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 18 16:59:18 user nova-compute[74743]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 18 16:59:18 user nova-compute[74743]:     </secmodel>
Nov 18 16:59:18 user nova-compute[74743]:   </host>
Nov 18 16:59:18 user nova-compute[74743]:   <guest>
Nov 18 16:59:18 user nova-compute[74743]:     <os_type>hvm</os_type>
Nov 18 16:59:18 user nova-compute[74743]:     <arch name='alpha'>
Nov 18 16:59:18 user nova-compute[74743]:       <wordsize>64</wordsize>
Nov 18 16:59:18 user nova-compute[74743]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='4'>clipper</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <domain type='qemu'/>
Nov 18 16:59:18 user nova-compute[74743]:     </arch>
Nov 18 16:59:18 user nova-compute[74743]:     <features>
Nov 18 16:59:18 user nova-compute[74743]:       <cpuselection/>
Nov 18 16:59:18 user nova-compute[74743]:       <deviceboot/>
Nov 18 16:59:18 user nova-compute[74743]:       <disksnapshot default='on' toggle='no'/>
Nov 18 16:59:18 user nova-compute[74743]:     </features>
Nov 18 16:59:18 user nova-compute[74743]:   </guest>
Nov 18 16:59:18 user nova-compute[74743]:   <guest>
Nov 18 16:59:18 user nova-compute[74743]:     <os_type>hvm</os_type>
Nov 18 16:59:18 user nova-compute[74743]:     <arch name='armv6l'>
Nov 18 16:59:18 user nova-compute[74743]:       <wordsize>32</wordsize>
Nov 18 16:59:18 user nova-compute[74743]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>integratorcp</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>borzoi</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>spitz</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2'>nuri</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2'>musca-b1</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>versatileab</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>kzm</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2'>musca-a</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2'>smdkc210</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>sx1</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>z2</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>tosa</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='4'>sabrelite</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>realview-eb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>n810</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>n800</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>versatilepb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>terrier</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>mainstone</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='4'>midway</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>musicpal</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>microbit</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>cubieboard</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>verdex</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>netduino2</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='4'>raspi2b</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>cheetah</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='4'>highbank</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>akita</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>connex</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>collie</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>raspi0</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <domain type='qemu'/>
Nov 18 16:59:18 user nova-compute[74743]:     </arch>
Nov 18 16:59:18 user nova-compute[74743]:     <features>
Nov 18 16:59:18 user nova-compute[74743]:       <cpuselection/>
Nov 18 16:59:18 user nova-compute[74743]:       <deviceboot/>
Nov 18 16:59:18 user nova-compute[74743]:       <disksnapshot default='on' toggle='no'/>
Nov 18 16:59:18 user nova-compute[74743]:     </features>
Nov 18 16:59:18 user nova-compute[74743]:   </guest>
Nov 18 16:59:18 user nova-compute[74743]:   <guest>
Nov 18 16:59:18 user nova-compute[74743]:     <os_type>hvm</os_type>
Nov 18 16:59:18 user nova-compute[74743]:     <arch name='armv7l'>
Nov 18 16:59:18 user nova-compute[74743]:       <wordsize>32</wordsize>
Nov 18 16:59:18 user nova-compute[74743]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>integratorcp</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>borzoi</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>spitz</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2'>nuri</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2'>musca-b1</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>versatileab</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>kzm</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2'>musca-a</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2'>smdkc210</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>sx1</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>z2</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>tosa</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='4'>sabrelite</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>realview-eb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>n810</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>n800</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>versatilepb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>terrier</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>mainstone</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='4'>midway</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>musicpal</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>microbit</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>cubieboard</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>verdex</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>netduino2</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='4'>raspi2b</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>cheetah</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='4'>highbank</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>akita</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>connex</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>collie</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>raspi0</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <domain type='qemu'/>
Nov 18 16:59:18 user nova-compute[74743]:     </arch>
Nov 18 16:59:18 user nova-compute[74743]:     <features>
Nov 18 16:59:18 user nova-compute[74743]:       <cpuselection/>
Nov 18 16:59:18 user nova-compute[74743]:       <deviceboot/>
Nov 18 16:59:18 user nova-compute[74743]:       <disksnapshot default='on' toggle='no'/>
Nov 18 16:59:18 user nova-compute[74743]:     </features>
Nov 18 16:59:18 user nova-compute[74743]:   </guest>
Nov 18 16:59:18 user nova-compute[74743]:   <guest>
Nov 18 16:59:18 user nova-compute[74743]:     <os_type>hvm</os_type>
Nov 18 16:59:18 user nova-compute[74743]:     <arch name='aarch64'>
Nov 18 16:59:18 user nova-compute[74743]:       <wordsize>64</wordsize>
Nov 18 16:59:18 user nova-compute[74743]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>integratorcp</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>borzoi</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>spitz</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2'>nuri</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2'>musca-b1</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>versatileab</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>kzm</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2'>musca-a</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2'>smdkc210</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>sx1</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>z2</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>tosa</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='4'>sabrelite</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>realview-eb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>n810</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>n800</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>versatilepb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>terrier</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>mainstone</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='4'>midway</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>musicpal</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>microbit</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>cubieboard</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>verdex</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>netduino2</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='4'>raspi3b</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='4'>raspi2b</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>cheetah</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='4'>highbank</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>akita</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>connex</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>collie</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>raspi0</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <domain type='qemu'/>
Nov 18 16:59:18 user nova-compute[74743]:     </arch>
Nov 18 16:59:18 user nova-compute[74743]:     <features>
Nov 18 16:59:18 user nova-compute[74743]:       <acpi default='on' toggle='yes'/>
Nov 18 16:59:18 user nova-compute[74743]:       <cpuselection/>
Nov 18 16:59:18 user nova-compute[74743]:       <deviceboot/>
Nov 18 16:59:18 user nova-compute[74743]:       <disksnapshot default='on' toggle='no'/>
Nov 18 16:59:18 user nova-compute[74743]:     </features>
Nov 18 16:59:18 user nova-compute[74743]:   </guest>
Nov 18 16:59:18 user nova-compute[74743]:   <guest>
Nov 18 16:59:18 user nova-compute[74743]:     <os_type>hvm</os_type>
Nov 18 16:59:18 user nova-compute[74743]:     <arch name='cris'>
Nov 18 16:59:18 user nova-compute[74743]:       <wordsize>32</wordsize>
Nov 18 16:59:18 user nova-compute[74743]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <domain type='qemu'/>
Nov 18 16:59:18 user nova-compute[74743]:     </arch>
Nov 18 16:59:18 user nova-compute[74743]:     <features>
Nov 18 16:59:18 user nova-compute[74743]:       <cpuselection/>
Nov 18 16:59:18 user nova-compute[74743]:       <deviceboot/>
Nov 18 16:59:18 user nova-compute[74743]:       <disksnapshot default='on' toggle='no'/>
Nov 18 16:59:18 user nova-compute[74743]:     </features>
Nov 18 16:59:18 user nova-compute[74743]:   </guest>
Nov 18 16:59:18 user nova-compute[74743]:   <guest>
Nov 18 16:59:18 user nova-compute[74743]:     <os_type>hvm</os_type>
Nov 18 16:59:18 user nova-compute[74743]:     <arch name='i686'>
Nov 18 16:59:18 user nova-compute[74743]:       <wordsize>32</wordsize>
Nov 18 16:59:18 user nova-compute[74743]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>x-remote</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>isapc</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>microvm</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <domain type='qemu'/>
Nov 18 16:59:18 user nova-compute[74743]:       <domain type='kvm'/>
Nov 18 16:59:18 user nova-compute[74743]:     </arch>
Nov 18 16:59:18 user nova-compute[74743]:     <features>
Nov 18 16:59:18 user nova-compute[74743]:       <pae/>
Nov 18 16:59:18 user nova-compute[74743]:       <nonpae/>
Nov 18 16:59:18 user nova-compute[74743]:       <acpi default='on' toggle='yes'/>
Nov 18 16:59:18 user nova-compute[74743]:       <apic default='on' toggle='no'/>
Nov 18 16:59:18 user nova-compute[74743]:       <cpuselection/>
Nov 18 16:59:18 user nova-compute[74743]:       <deviceboot/>
Nov 18 16:59:18 user nova-compute[74743]:       <disksnapshot default='on' toggle='no'/>
Nov 18 16:59:18 user nova-compute[74743]:     </features>
Nov 18 16:59:18 user nova-compute[74743]:   </guest>
Nov 18 16:59:18 user nova-compute[74743]:   <guest>
Nov 18 16:59:18 user nova-compute[74743]:     <os_type>hvm</os_type>
Nov 18 16:59:18 user nova-compute[74743]:     <arch name='m68k'>
Nov 18 16:59:18 user nova-compute[74743]:       <wordsize>32</wordsize>
Nov 18 16:59:18 user nova-compute[74743]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>an5206</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>q800</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>next-cube</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <domain type='qemu'/>
Nov 18 16:59:18 user nova-compute[74743]:     </arch>
Nov 18 16:59:18 user nova-compute[74743]:     <features>
Nov 18 16:59:18 user nova-compute[74743]:       <cpuselection/>
Nov 18 16:59:18 user nova-compute[74743]:       <deviceboot/>
Nov 18 16:59:18 user nova-compute[74743]:       <disksnapshot default='on' toggle='no'/>
Nov 18 16:59:18 user nova-compute[74743]:     </features>
Nov 18 16:59:18 user nova-compute[74743]:   </guest>
Nov 18 16:59:18 user nova-compute[74743]:   <guest>
Nov 18 16:59:18 user nova-compute[74743]:     <os_type>hvm</os_type>
Nov 18 16:59:18 user nova-compute[74743]:     <arch name='microblaze'>
Nov 18 16:59:18 user nova-compute[74743]:       <wordsize>32</wordsize>
Nov 18 16:59:18 user nova-compute[74743]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <domain type='qemu'/>
Nov 18 16:59:18 user nova-compute[74743]:     </arch>
Nov 18 16:59:18 user nova-compute[74743]:     <features>
Nov 18 16:59:18 user nova-compute[74743]:       <cpuselection/>
Nov 18 16:59:18 user nova-compute[74743]:       <deviceboot/>
Nov 18 16:59:18 user nova-compute[74743]:       <disksnapshot default='on' toggle='no'/>
Nov 18 16:59:18 user nova-compute[74743]:     </features>
Nov 18 16:59:18 user nova-compute[74743]:   </guest>
Nov 18 16:59:18 user nova-compute[74743]:   <guest>
Nov 18 16:59:18 user nova-compute[74743]:     <os_type>hvm</os_type>
Nov 18 16:59:18 user nova-compute[74743]:     <arch name='microblazeel'>
Nov 18 16:59:18 user nova-compute[74743]:       <wordsize>32</wordsize>
Nov 18 16:59:18 user nova-compute[74743]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <domain type='qemu'/>
Nov 18 16:59:18 user nova-compute[74743]:     </arch>
Nov 18 16:59:18 user nova-compute[74743]:     <features>
Nov 18 16:59:18 user nova-compute[74743]:       <cpuselection/>
Nov 18 16:59:18 user nova-compute[74743]:       <deviceboot/>
Nov 18 16:59:18 user nova-compute[74743]:       <disksnapshot default='on' toggle='no'/>
Nov 18 16:59:18 user nova-compute[74743]:     </features>
Nov 18 16:59:18 user nova-compute[74743]:   </guest>
Nov 18 16:59:18 user nova-compute[74743]:   <guest>
Nov 18 16:59:18 user nova-compute[74743]:     <os_type>hvm</os_type>
Nov 18 16:59:18 user nova-compute[74743]:     <arch name='mips'>
Nov 18 16:59:18 user nova-compute[74743]:       <wordsize>32</wordsize>
Nov 18 16:59:18 user nova-compute[74743]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='16'>malta</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>mipssim</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <domain type='qemu'/>
Nov 18 16:59:18 user nova-compute[74743]:     </arch>
Nov 18 16:59:18 user nova-compute[74743]:     <features>
Nov 18 16:59:18 user nova-compute[74743]:       <cpuselection/>
Nov 18 16:59:18 user nova-compute[74743]:       <deviceboot/>
Nov 18 16:59:18 user nova-compute[74743]:       <disksnapshot default='on' toggle='no'/>
Nov 18 16:59:18 user nova-compute[74743]:     </features>
Nov 18 16:59:18 user nova-compute[74743]:   </guest>
Nov 18 16:59:18 user nova-compute[74743]:   <guest>
Nov 18 16:59:18 user nova-compute[74743]:     <os_type>hvm</os_type>
Nov 18 16:59:18 user nova-compute[74743]:     <arch name='mipsel'>
Nov 18 16:59:18 user nova-compute[74743]:       <wordsize>32</wordsize>
Nov 18 16:59:18 user nova-compute[74743]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='16'>malta</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>mipssim</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <domain type='qemu'/>
Nov 18 16:59:18 user nova-compute[74743]:     </arch>
Nov 18 16:59:18 user nova-compute[74743]:     <features>
Nov 18 16:59:18 user nova-compute[74743]:       <cpuselection/>
Nov 18 16:59:18 user nova-compute[74743]:       <deviceboot/>
Nov 18 16:59:18 user nova-compute[74743]:       <disksnapshot default='on' toggle='no'/>
Nov 18 16:59:18 user nova-compute[74743]:     </features>
Nov 18 16:59:18 user nova-compute[74743]:   </guest>
Nov 18 16:59:18 user nova-compute[74743]:   <guest>
Nov 18 16:59:18 user nova-compute[74743]:     <os_type>hvm</os_type>
Nov 18 16:59:18 user nova-compute[74743]:     <arch name='mips64'>
Nov 18 16:59:18 user nova-compute[74743]:       <wordsize>64</wordsize>
Nov 18 16:59:18 user nova-compute[74743]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='16'>malta</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>mipssim</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>pica61</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>magnum</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <domain type='qemu'/>
Nov 18 16:59:18 user nova-compute[74743]:     </arch>
Nov 18 16:59:18 user nova-compute[74743]:     <features>
Nov 18 16:59:18 user nova-compute[74743]:       <cpuselection/>
Nov 18 16:59:18 user nova-compute[74743]:       <deviceboot/>
Nov 18 16:59:18 user nova-compute[74743]:       <disksnapshot default='on' toggle='no'/>
Nov 18 16:59:18 user nova-compute[74743]:     </features>
Nov 18 16:59:18 user nova-compute[74743]:   </guest>
Nov 18 16:59:18 user nova-compute[74743]:   <guest>
Nov 18 16:59:18 user nova-compute[74743]:     <os_type>hvm</os_type>
Nov 18 16:59:18 user nova-compute[74743]:     <arch name='mips64el'>
Nov 18 16:59:18 user nova-compute[74743]:       <wordsize>64</wordsize>
Nov 18 16:59:18 user nova-compute[74743]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='16'>malta</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>mipssim</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>pica61</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>magnum</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='16'>boston</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <domain type='qemu'/>
Nov 18 16:59:18 user nova-compute[74743]:     </arch>
Nov 18 16:59:18 user nova-compute[74743]:     <features>
Nov 18 16:59:18 user nova-compute[74743]:       <cpuselection/>
Nov 18 16:59:18 user nova-compute[74743]:       <deviceboot/>
Nov 18 16:59:18 user nova-compute[74743]:       <disksnapshot default='on' toggle='no'/>
Nov 18 16:59:18 user nova-compute[74743]:     </features>
Nov 18 16:59:18 user nova-compute[74743]:   </guest>
Nov 18 16:59:18 user nova-compute[74743]:   <guest>
Nov 18 16:59:18 user nova-compute[74743]:     <os_type>hvm</os_type>
Nov 18 16:59:18 user nova-compute[74743]:     <arch name='ppc'>
Nov 18 16:59:18 user nova-compute[74743]:       <wordsize>32</wordsize>
Nov 18 16:59:18 user nova-compute[74743]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>g3beige</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>mac99</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='32'>ppce500</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>pegasos2</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>sam460ex</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>bamboo</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>40p</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>ref405ep</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>taihu</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <domain type='qemu'/>
Nov 18 16:59:18 user nova-compute[74743]:     </arch>
Nov 18 16:59:18 user nova-compute[74743]:     <features>
Nov 18 16:59:18 user nova-compute[74743]:       <cpuselection/>
Nov 18 16:59:18 user nova-compute[74743]:       <deviceboot/>
Nov 18 16:59:18 user nova-compute[74743]:       <disksnapshot default='on' toggle='no'/>
Nov 18 16:59:18 user nova-compute[74743]:     </features>
Nov 18 16:59:18 user nova-compute[74743]:   </guest>
Nov 18 16:59:18 user nova-compute[74743]:   <guest>
Nov 18 16:59:18 user nova-compute[74743]:     <os_type>hvm</os_type>
Nov 18 16:59:18 user nova-compute[74743]:     <arch name='ppc64'>
Nov 18 16:59:18 user nova-compute[74743]:       <wordsize>64</wordsize>
Nov 18 16:59:18 user nova-compute[74743]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2048'>powernv9</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>taihu</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2048'>powernv10</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='32'>ppce500</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>40p</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>pegasos2</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>bamboo</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>g3beige</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>mac99</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>sam460ex</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>ref405ep</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2048'>powernv8</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <domain type='qemu'/>
Nov 18 16:59:18 user nova-compute[74743]:     </arch>
Nov 18 16:59:18 user nova-compute[74743]:     <features>
Nov 18 16:59:18 user nova-compute[74743]:       <cpuselection/>
Nov 18 16:59:18 user nova-compute[74743]:       <deviceboot/>
Nov 18 16:59:18 user nova-compute[74743]:       <disksnapshot default='on' toggle='no'/>
Nov 18 16:59:18 user nova-compute[74743]:     </features>
Nov 18 16:59:18 user nova-compute[74743]:   </guest>
Nov 18 16:59:18 user nova-compute[74743]:   <guest>
Nov 18 16:59:18 user nova-compute[74743]:     <os_type>hvm</os_type>
Nov 18 16:59:18 user nova-compute[74743]:     <arch name='ppc64le'>
Nov 18 16:59:18 user nova-compute[74743]:       <wordsize>64</wordsize>
Nov 18 16:59:18 user nova-compute[74743]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2048'>powernv9</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>taihu</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2048'>powernv10</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='32'>ppce500</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>40p</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>pegasos2</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>bamboo</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>g3beige</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>mac99</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>sam460ex</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>ref405ep</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2048'>powernv8</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <domain type='qemu'/>
Nov 18 16:59:18 user nova-compute[74743]:     </arch>
Nov 18 16:59:18 user nova-compute[74743]:     <features>
Nov 18 16:59:18 user nova-compute[74743]:       <cpuselection/>
Nov 18 16:59:18 user nova-compute[74743]:       <deviceboot/>
Nov 18 16:59:18 user nova-compute[74743]:       <disksnapshot default='on' toggle='no'/>
Nov 18 16:59:18 user nova-compute[74743]:     </features>
Nov 18 16:59:18 user nova-compute[74743]:   </guest>
Nov 18 16:59:18 user nova-compute[74743]:   <guest>
Nov 18 16:59:18 user nova-compute[74743]:     <os_type>hvm</os_type>
Nov 18 16:59:18 user nova-compute[74743]:     <arch name='riscv32'>
Nov 18 16:59:18 user nova-compute[74743]:       <wordsize>32</wordsize>
Nov 18 16:59:18 user nova-compute[74743]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='8'>spike</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>opentitan</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='5'>sifive_u</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>sifive_e</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='8'>virt</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <domain type='qemu'/>
Nov 18 16:59:18 user nova-compute[74743]:     </arch>
Nov 18 16:59:18 user nova-compute[74743]:     <features>
Nov 18 16:59:18 user nova-compute[74743]:       <cpuselection/>
Nov 18 16:59:18 user nova-compute[74743]:       <deviceboot/>
Nov 18 16:59:18 user nova-compute[74743]:       <disksnapshot default='on' toggle='no'/>
Nov 18 16:59:18 user nova-compute[74743]:     </features>
Nov 18 16:59:18 user nova-compute[74743]:   </guest>
Nov 18 16:59:18 user nova-compute[74743]:   <guest>
Nov 18 16:59:18 user nova-compute[74743]:     <os_type>hvm</os_type>
Nov 18 16:59:18 user nova-compute[74743]:     <arch name='riscv64'>
Nov 18 16:59:18 user nova-compute[74743]:       <wordsize>64</wordsize>
Nov 18 16:59:18 user nova-compute[74743]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='8'>spike</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='5'>sifive_u</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>shakti_c</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>sifive_e</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='8'>virt</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <domain type='qemu'/>
Nov 18 16:59:18 user nova-compute[74743]:     </arch>
Nov 18 16:59:18 user nova-compute[74743]:     <features>
Nov 18 16:59:18 user nova-compute[74743]:       <cpuselection/>
Nov 18 16:59:18 user nova-compute[74743]:       <deviceboot/>
Nov 18 16:59:18 user nova-compute[74743]:       <disksnapshot default='on' toggle='no'/>
Nov 18 16:59:18 user nova-compute[74743]:     </features>
Nov 18 16:59:18 user nova-compute[74743]:   </guest>
Nov 18 16:59:18 user nova-compute[74743]:   <guest>
Nov 18 16:59:18 user nova-compute[74743]:     <os_type>hvm</os_type>
Nov 18 16:59:18 user nova-compute[74743]:     <arch name='s390x'>
Nov 18 16:59:18 user nova-compute[74743]:       <wordsize>64</wordsize>
Nov 18 16:59:18 user nova-compute[74743]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <domain type='qemu'/>
Nov 18 16:59:18 user nova-compute[74743]:     </arch>
Nov 18 16:59:18 user nova-compute[74743]:     <features>
Nov 18 16:59:18 user nova-compute[74743]:       <cpuselection/>
Nov 18 16:59:18 user nova-compute[74743]:       <deviceboot/>
Nov 18 16:59:18 user nova-compute[74743]:       <disksnapshot default='on' toggle='no'/>
Nov 18 16:59:18 user nova-compute[74743]:     </features>
Nov 18 16:59:18 user nova-compute[74743]:   </guest>
Nov 18 16:59:18 user nova-compute[74743]:   <guest>
Nov 18 16:59:18 user nova-compute[74743]:     <os_type>hvm</os_type>
Nov 18 16:59:18 user nova-compute[74743]:     <arch name='sh4'>
Nov 18 16:59:18 user nova-compute[74743]:       <wordsize>32</wordsize>
Nov 18 16:59:18 user nova-compute[74743]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>shix</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>r2d</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <domain type='qemu'/>
Nov 18 16:59:18 user nova-compute[74743]:     </arch>
Nov 18 16:59:18 user nova-compute[74743]:     <features>
Nov 18 16:59:18 user nova-compute[74743]:       <cpuselection/>
Nov 18 16:59:18 user nova-compute[74743]:       <deviceboot/>
Nov 18 16:59:18 user nova-compute[74743]:       <disksnapshot default='on' toggle='no'/>
Nov 18 16:59:18 user nova-compute[74743]:     </features>
Nov 18 16:59:18 user nova-compute[74743]:   </guest>
Nov 18 16:59:18 user nova-compute[74743]:   <guest>
Nov 18 16:59:18 user nova-compute[74743]:     <os_type>hvm</os_type>
Nov 18 16:59:18 user nova-compute[74743]:     <arch name='sh4eb'>
Nov 18 16:59:18 user nova-compute[74743]:       <wordsize>64</wordsize>
Nov 18 16:59:18 user nova-compute[74743]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>shix</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>r2d</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <domain type='qemu'/>
Nov 18 16:59:18 user nova-compute[74743]:     </arch>
Nov 18 16:59:18 user nova-compute[74743]:     <features>
Nov 18 16:59:18 user nova-compute[74743]:       <cpuselection/>
Nov 18 16:59:18 user nova-compute[74743]:       <deviceboot/>
Nov 18 16:59:18 user nova-compute[74743]:       <disksnapshot default='on' toggle='no'/>
Nov 18 16:59:18 user nova-compute[74743]:     </features>
Nov 18 16:59:18 user nova-compute[74743]:   </guest>
Nov 18 16:59:18 user nova-compute[74743]:   <guest>
Nov 18 16:59:18 user nova-compute[74743]:     <os_type>hvm</os_type>
Nov 18 16:59:18 user nova-compute[74743]:     <arch name='sparc'>
Nov 18 16:59:18 user nova-compute[74743]:       <wordsize>32</wordsize>
Nov 18 16:59:18 user nova-compute[74743]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>SS-5</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='4'>SS-20</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>LX</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>SS-4</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='4'>SS-10</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>Voyager</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <domain type='qemu'/>
Nov 18 16:59:18 user nova-compute[74743]:     </arch>
Nov 18 16:59:18 user nova-compute[74743]:     <features>
Nov 18 16:59:18 user nova-compute[74743]:       <cpuselection/>
Nov 18 16:59:18 user nova-compute[74743]:       <deviceboot/>
Nov 18 16:59:18 user nova-compute[74743]:       <disksnapshot default='on' toggle='no'/>
Nov 18 16:59:18 user nova-compute[74743]:     </features>
Nov 18 16:59:18 user nova-compute[74743]:   </guest>
Nov 18 16:59:18 user nova-compute[74743]:   <guest>
Nov 18 16:59:18 user nova-compute[74743]:     <os_type>hvm</os_type>
Nov 18 16:59:18 user nova-compute[74743]:     <arch name='sparc64'>
Nov 18 16:59:18 user nova-compute[74743]:       <wordsize>64</wordsize>
Nov 18 16:59:18 user nova-compute[74743]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>sun4u</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>niagara</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>sun4v</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <domain type='qemu'/>
Nov 18 16:59:18 user nova-compute[74743]:     </arch>
Nov 18 16:59:18 user nova-compute[74743]:     <features>
Nov 18 16:59:18 user nova-compute[74743]:       <cpuselection/>
Nov 18 16:59:18 user nova-compute[74743]:       <deviceboot/>
Nov 18 16:59:18 user nova-compute[74743]:       <disksnapshot default='on' toggle='no'/>
Nov 18 16:59:18 user nova-compute[74743]:     </features>
Nov 18 16:59:18 user nova-compute[74743]:   </guest>
Nov 18 16:59:18 user nova-compute[74743]:   <guest>
Nov 18 16:59:18 user nova-compute[74743]:     <os_type>hvm</os_type>
Nov 18 16:59:18 user nova-compute[74743]:     <arch name='x86_64'>
Nov 18 16:59:18 user nova-compute[74743]:       <wordsize>64</wordsize>
Nov 18 16:59:18 user nova-compute[74743]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>x-remote</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='1'>isapc</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>microvm</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <domain type='qemu'/>
Nov 18 16:59:18 user nova-compute[74743]:       <domain type='kvm'/>
Nov 18 16:59:18 user nova-compute[74743]:     </arch>
Nov 18 16:59:18 user nova-compute[74743]:     <features>
Nov 18 16:59:18 user nova-compute[74743]:       <acpi default='on' toggle='yes'/>
Nov 18 16:59:18 user nova-compute[74743]:       <apic default='on' toggle='no'/>
Nov 18 16:59:18 user nova-compute[74743]:       <cpuselection/>
Nov 18 16:59:18 user nova-compute[74743]:       <deviceboot/>
Nov 18 16:59:18 user nova-compute[74743]:       <disksnapshot default='on' toggle='no'/>
Nov 18 16:59:18 user nova-compute[74743]:     </features>
Nov 18 16:59:18 user nova-compute[74743]:   </guest>
Nov 18 16:59:18 user nova-compute[74743]:   <guest>
Nov 18 16:59:18 user nova-compute[74743]:     <os_type>hvm</os_type>
Nov 18 16:59:18 user nova-compute[74743]:     <arch name='xtensa'>
Nov 18 16:59:18 user nova-compute[74743]:       <wordsize>32</wordsize>
Nov 18 16:59:18 user nova-compute[74743]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='4'>sim</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='32'>kc705</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='32'>ml605</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='32'>virt</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='32'>lx200</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='32'>lx60</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <domain type='qemu'/>
Nov 18 16:59:18 user nova-compute[74743]:     </arch>
Nov 18 16:59:18 user nova-compute[74743]:     <features>
Nov 18 16:59:18 user nova-compute[74743]:       <cpuselection/>
Nov 18 16:59:18 user nova-compute[74743]:       <deviceboot/>
Nov 18 16:59:18 user nova-compute[74743]:       <disksnapshot default='on' toggle='no'/>
Nov 18 16:59:18 user nova-compute[74743]:     </features>
Nov 18 16:59:18 user nova-compute[74743]:   </guest>
Nov 18 16:59:18 user nova-compute[74743]:   <guest>
Nov 18 16:59:18 user nova-compute[74743]:     <os_type>hvm</os_type>
Nov 18 16:59:18 user nova-compute[74743]:     <arch name='xtensaeb'>
Nov 18 16:59:18 user nova-compute[74743]:       <wordsize>32</wordsize>
Nov 18 16:59:18 user nova-compute[74743]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='4'>sim</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='32'>kc705</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='32'>ml605</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='32'>virt</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='32'>lx200</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='32'>lx60</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 18 16:59:18 user nova-compute[74743]:       <domain type='qemu'/>
Nov 18 16:59:18 user nova-compute[74743]:     </arch>
Nov 18 16:59:18 user nova-compute[74743]:     <features>
Nov 18 16:59:18 user nova-compute[74743]:       <cpuselection/>
Nov 18 16:59:18 user nova-compute[74743]:       <deviceboot/>
Nov 18 16:59:18 user nova-compute[74743]:       <disksnapshot default='on' toggle='no'/>
Nov 18 16:59:18 user nova-compute[74743]:     </features>
Nov 18 16:59:18 user nova-compute[74743]:   </guest>
Nov 18 16:59:18 user nova-compute[74743]: </capabilities>
Nov 18 16:59:18 user nova-compute[74743]: 
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74743) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74743) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74743) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74743) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74743) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74743) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74743) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74743) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74743) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74743) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74743) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Getting domain capabilities for i686 via machine types: {'pc', 'ubuntu', 'q35', 'ubuntu-q35'} {{(pid=74743) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 18 16:59:18 user nova-compute[74743]: <domainCapabilities>
Nov 18 16:59:18 user nova-compute[74743]:   <path>/usr/bin/qemu-system-i386</path>
Nov 18 16:59:18 user nova-compute[74743]:   <domain>kvm</domain>
Nov 18 16:59:18 user nova-compute[74743]:   <machine>pc-i440fx-6.2</machine>
Nov 18 16:59:18 user nova-compute[74743]:   <arch>i686</arch>
Nov 18 16:59:18 user nova-compute[74743]:   <vcpu max='255'/>
Nov 18 16:59:18 user nova-compute[74743]:   <iothreads supported='yes'/>
Nov 18 16:59:18 user nova-compute[74743]:   <os supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:     <enum name='firmware'/>
Nov 18 16:59:18 user nova-compute[74743]:     <loader supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 18 16:59:18 user nova-compute[74743]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 18 16:59:18 user nova-compute[74743]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 18 16:59:18 user nova-compute[74743]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 18 16:59:18 user nova-compute[74743]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='type'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>rom</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>pflash</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='readonly'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>yes</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>no</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='secure'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>no</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </loader>
Nov 18 16:59:18 user nova-compute[74743]:   </os>
Nov 18 16:59:18 user nova-compute[74743]:   <cpu>
Nov 18 16:59:18 user nova-compute[74743]:     <mode name='host-passthrough' supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='hostPassthroughMigratable'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>off</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </mode>
Nov 18 16:59:18 user nova-compute[74743]:     <mode name='maximum' supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='maximumMigratable'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>on</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>off</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </mode>
Nov 18 16:59:18 user nova-compute[74743]:     <mode name='host-model' supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <vendor>Intel</vendor>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='ss'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='vmx'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='pcid'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='hypervisor'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='arat'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='tsc_adjust'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='umip'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='md-clear'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='stibp'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='arch-capabilities'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='ssbd'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='ibpb'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='ibrs'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='amd-stibp'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='amd-ssbd'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='disable' name='erms'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='disable' name='xsaveopt'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='disable' name='lm'/>
Nov 18 16:59:18 user nova-compute[74743]:     </mode>
Nov 18 16:59:18 user nova-compute[74743]:     <mode name='custom' supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>qemu64</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>qemu32</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>phenom</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>pentium3</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>pentium2</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>pentium</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>n270</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>kvm64</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>kvm32</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>coreduo</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>core2duo</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>athlon</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Westmere-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Westmere</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Snowridge</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Skylake-Server</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Skylake-Client</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>SandyBridge</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Penryn</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Opteron_G5</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Opteron_G4</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Opteron_G3</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Opteron_G2</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Opteron_G1</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Nehalem-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Nehalem</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>IvyBridge</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Icelake-Server</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Haswell-noTSX</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Haswell-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Haswell</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>EPYC-Rome</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>EPYC-Milan</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>EPYC-IBPB</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>EPYC</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Dhyana</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Cooperlake</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Conroe</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Cascadelake-Server</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Broadwell-noTSX</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Broadwell-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Broadwell</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>486</model>
Nov 18 16:59:18 user nova-compute[74743]:     </mode>
Nov 18 16:59:18 user nova-compute[74743]:   </cpu>
Nov 18 16:59:18 user nova-compute[74743]:   <memoryBacking supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:     <enum name='sourceType'>
Nov 18 16:59:18 user nova-compute[74743]:       <value>file</value>
Nov 18 16:59:18 user nova-compute[74743]:       <value>anonymous</value>
Nov 18 16:59:18 user nova-compute[74743]:       <value>memfd</value>
Nov 18 16:59:18 user nova-compute[74743]:     </enum>
Nov 18 16:59:18 user nova-compute[74743]:   </memoryBacking>
Nov 18 16:59:18 user nova-compute[74743]:   <devices>
Nov 18 16:59:18 user nova-compute[74743]:     <disk supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='diskDevice'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>disk</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>cdrom</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>floppy</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>lun</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='bus'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>ide</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>fdc</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>scsi</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>usb</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>sata</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='model'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio-transitional</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio-non-transitional</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </disk>
Nov 18 16:59:18 user nova-compute[74743]:     <graphics supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='type'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>sdl</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>vnc</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>spice</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>egl-headless</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </graphics>
Nov 18 16:59:18 user nova-compute[74743]:     <video supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='modelType'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>vga</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>cirrus</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>vmvga</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>qxl</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>none</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>bochs</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>ramfb</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </video>
Nov 18 16:59:18 user nova-compute[74743]:     <hostdev supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='mode'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>subsystem</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='startupPolicy'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>default</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>mandatory</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>requisite</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>optional</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='subsysType'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>usb</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>pci</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>scsi</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='capsType'/>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='pciBackend'/>
Nov 18 16:59:18 user nova-compute[74743]:     </hostdev>
Nov 18 16:59:18 user nova-compute[74743]:     <rng supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='model'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio-transitional</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio-non-transitional</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='backendModel'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>random</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>egd</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>builtin</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </rng>
Nov 18 16:59:18 user nova-compute[74743]:     <filesystem supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='driverType'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>path</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>handle</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtiofs</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </filesystem>
Nov 18 16:59:18 user nova-compute[74743]:     <tpm supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='model'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>tpm-tis</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>tpm-crb</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='backendModel'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>passthrough</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>emulator</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </tpm>
Nov 18 16:59:18 user nova-compute[74743]:   </devices>
Nov 18 16:59:18 user nova-compute[74743]:   <features>
Nov 18 16:59:18 user nova-compute[74743]:     <gic supported='no'/>
Nov 18 16:59:18 user nova-compute[74743]:     <vmcoreinfo supported='yes'/>
Nov 18 16:59:18 user nova-compute[74743]:     <genid supported='yes'/>
Nov 18 16:59:18 user nova-compute[74743]:     <backingStoreInput supported='yes'/>
Nov 18 16:59:18 user nova-compute[74743]:     <backup supported='yes'/>
Nov 18 16:59:18 user nova-compute[74743]:     <sev supported='no'/>
Nov 18 16:59:18 user nova-compute[74743]:   </features>
Nov 18 16:59:18 user nova-compute[74743]: </domainCapabilities>
Nov 18 16:59:18 user nova-compute[74743]:  {{(pid=74743) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 18 16:59:18 user nova-compute[74743]: <domainCapabilities>
Nov 18 16:59:18 user nova-compute[74743]:   <path>/usr/bin/qemu-system-i386</path>
Nov 18 16:59:18 user nova-compute[74743]:   <domain>kvm</domain>
Nov 18 16:59:18 user nova-compute[74743]:   <machine>pc-i440fx-jammy</machine>
Nov 18 16:59:18 user nova-compute[74743]:   <arch>i686</arch>
Nov 18 16:59:18 user nova-compute[74743]:   <vcpu max='255'/>
Nov 18 16:59:18 user nova-compute[74743]:   <iothreads supported='yes'/>
Nov 18 16:59:18 user nova-compute[74743]:   <os supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:     <enum name='firmware'/>
Nov 18 16:59:18 user nova-compute[74743]:     <loader supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 18 16:59:18 user nova-compute[74743]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 18 16:59:18 user nova-compute[74743]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 18 16:59:18 user nova-compute[74743]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 18 16:59:18 user nova-compute[74743]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='type'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>rom</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>pflash</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='readonly'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>yes</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>no</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='secure'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>no</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </loader>
Nov 18 16:59:18 user nova-compute[74743]:   </os>
Nov 18 16:59:18 user nova-compute[74743]:   <cpu>
Nov 18 16:59:18 user nova-compute[74743]:     <mode name='host-passthrough' supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='hostPassthroughMigratable'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>off</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </mode>
Nov 18 16:59:18 user nova-compute[74743]:     <mode name='maximum' supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='maximumMigratable'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>on</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>off</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </mode>
Nov 18 16:59:18 user nova-compute[74743]:     <mode name='host-model' supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <vendor>Intel</vendor>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='ss'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='vmx'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='pcid'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='hypervisor'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='arat'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='tsc_adjust'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='umip'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='md-clear'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='stibp'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='arch-capabilities'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='ssbd'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='ibpb'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='ibrs'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='amd-stibp'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='amd-ssbd'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='disable' name='erms'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='disable' name='xsaveopt'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='disable' name='lm'/>
Nov 18 16:59:18 user nova-compute[74743]:     </mode>
Nov 18 16:59:18 user nova-compute[74743]:     <mode name='custom' supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>qemu64</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>qemu32</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>phenom</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>pentium3</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>pentium2</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>pentium</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>n270</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>kvm64</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>kvm32</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>coreduo</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>core2duo</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>athlon</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Westmere-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Westmere</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Snowridge</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Skylake-Server</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Skylake-Client</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>SandyBridge</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Penryn</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Opteron_G5</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Opteron_G4</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Opteron_G3</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Opteron_G2</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Opteron_G1</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Nehalem-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Nehalem</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>IvyBridge</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Icelake-Server</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Haswell-noTSX</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Haswell-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Haswell</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>EPYC-Rome</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>EPYC-Milan</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>EPYC-IBPB</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>EPYC</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Dhyana</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Cooperlake</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Conroe</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Cascadelake-Server</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Broadwell-noTSX</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Broadwell-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Broadwell</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>486</model>
Nov 18 16:59:18 user nova-compute[74743]:     </mode>
Nov 18 16:59:18 user nova-compute[74743]:   </cpu>
Nov 18 16:59:18 user nova-compute[74743]:   <memoryBacking supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:     <enum name='sourceType'>
Nov 18 16:59:18 user nova-compute[74743]:       <value>file</value>
Nov 18 16:59:18 user nova-compute[74743]:       <value>anonymous</value>
Nov 18 16:59:18 user nova-compute[74743]:       <value>memfd</value>
Nov 18 16:59:18 user nova-compute[74743]:     </enum>
Nov 18 16:59:18 user nova-compute[74743]:   </memoryBacking>
Nov 18 16:59:18 user nova-compute[74743]:   <devices>
Nov 18 16:59:18 user nova-compute[74743]:     <disk supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='diskDevice'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>disk</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>cdrom</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>floppy</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>lun</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='bus'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>ide</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>fdc</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>scsi</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>usb</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>sata</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='model'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio-transitional</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio-non-transitional</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </disk>
Nov 18 16:59:18 user nova-compute[74743]:     <graphics supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='type'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>sdl</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>vnc</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>spice</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>egl-headless</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </graphics>
Nov 18 16:59:18 user nova-compute[74743]:     <video supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='modelType'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>vga</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>cirrus</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>vmvga</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>qxl</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>none</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>bochs</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>ramfb</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </video>
Nov 18 16:59:18 user nova-compute[74743]:     <hostdev supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='mode'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>subsystem</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='startupPolicy'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>default</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>mandatory</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>requisite</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>optional</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='subsysType'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>usb</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>pci</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>scsi</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='capsType'/>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='pciBackend'/>
Nov 18 16:59:18 user nova-compute[74743]:     </hostdev>
Nov 18 16:59:18 user nova-compute[74743]:     <rng supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='model'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio-transitional</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio-non-transitional</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='backendModel'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>random</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>egd</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>builtin</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </rng>
Nov 18 16:59:18 user nova-compute[74743]:     <filesystem supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='driverType'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>path</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>handle</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtiofs</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </filesystem>
Nov 18 16:59:18 user nova-compute[74743]:     <tpm supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='model'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>tpm-tis</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>tpm-crb</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='backendModel'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>passthrough</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>emulator</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </tpm>
Nov 18 16:59:18 user nova-compute[74743]:   </devices>
Nov 18 16:59:18 user nova-compute[74743]:   <features>
Nov 18 16:59:18 user nova-compute[74743]:     <gic supported='no'/>
Nov 18 16:59:18 user nova-compute[74743]:     <vmcoreinfo supported='yes'/>
Nov 18 16:59:18 user nova-compute[74743]:     <genid supported='yes'/>
Nov 18 16:59:18 user nova-compute[74743]:     <backingStoreInput supported='yes'/>
Nov 18 16:59:18 user nova-compute[74743]:     <backup supported='yes'/>
Nov 18 16:59:18 user nova-compute[74743]:     <sev supported='no'/>
Nov 18 16:59:18 user nova-compute[74743]:   </features>
Nov 18 16:59:18 user nova-compute[74743]: </domainCapabilities>
Nov 18 16:59:18 user nova-compute[74743]:  {{(pid=74743) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 18 16:59:18 user nova-compute[74743]: <domainCapabilities>
Nov 18 16:59:18 user nova-compute[74743]:   <path>/usr/bin/qemu-system-i386</path>
Nov 18 16:59:18 user nova-compute[74743]:   <domain>kvm</domain>
Nov 18 16:59:18 user nova-compute[74743]:   <machine>pc-q35-6.2</machine>
Nov 18 16:59:18 user nova-compute[74743]:   <arch>i686</arch>
Nov 18 16:59:18 user nova-compute[74743]:   <vcpu max='288'/>
Nov 18 16:59:18 user nova-compute[74743]:   <iothreads supported='yes'/>
Nov 18 16:59:18 user nova-compute[74743]:   <os supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:     <enum name='firmware'/>
Nov 18 16:59:18 user nova-compute[74743]:     <loader supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 18 16:59:18 user nova-compute[74743]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 18 16:59:18 user nova-compute[74743]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 18 16:59:18 user nova-compute[74743]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 18 16:59:18 user nova-compute[74743]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='type'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>rom</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>pflash</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='readonly'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>yes</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>no</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='secure'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>no</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </loader>
Nov 18 16:59:18 user nova-compute[74743]:   </os>
Nov 18 16:59:18 user nova-compute[74743]:   <cpu>
Nov 18 16:59:18 user nova-compute[74743]:     <mode name='host-passthrough' supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='hostPassthroughMigratable'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>off</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </mode>
Nov 18 16:59:18 user nova-compute[74743]:     <mode name='maximum' supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='maximumMigratable'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>on</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>off</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </mode>
Nov 18 16:59:18 user nova-compute[74743]:     <mode name='host-model' supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <vendor>Intel</vendor>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='ss'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='vmx'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='pcid'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='hypervisor'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='arat'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='tsc_adjust'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='umip'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='md-clear'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='stibp'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='arch-capabilities'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='ssbd'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='ibpb'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='ibrs'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='amd-stibp'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='amd-ssbd'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='disable' name='erms'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='disable' name='xsaveopt'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='disable' name='lm'/>
Nov 18 16:59:18 user nova-compute[74743]:     </mode>
Nov 18 16:59:18 user nova-compute[74743]:     <mode name='custom' supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>qemu64</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>qemu32</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>phenom</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>pentium3</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>pentium2</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>pentium</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>n270</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>kvm64</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>kvm32</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>coreduo</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>core2duo</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>athlon</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Westmere-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Westmere</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Snowridge</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Skylake-Server</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Skylake-Client</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>SandyBridge</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Penryn</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Opteron_G5</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Opteron_G4</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Opteron_G3</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Opteron_G2</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Opteron_G1</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Nehalem-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Nehalem</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>IvyBridge</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Icelake-Server</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Haswell-noTSX</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Haswell-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Haswell</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>EPYC-Rome</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>EPYC-Milan</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>EPYC-IBPB</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>EPYC</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Dhyana</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Cooperlake</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Conroe</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Cascadelake-Server</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Broadwell-noTSX</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Broadwell-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Broadwell</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>486</model>
Nov 18 16:59:18 user nova-compute[74743]:     </mode>
Nov 18 16:59:18 user nova-compute[74743]:   </cpu>
Nov 18 16:59:18 user nova-compute[74743]:   <memoryBacking supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:     <enum name='sourceType'>
Nov 18 16:59:18 user nova-compute[74743]:       <value>file</value>
Nov 18 16:59:18 user nova-compute[74743]:       <value>anonymous</value>
Nov 18 16:59:18 user nova-compute[74743]:       <value>memfd</value>
Nov 18 16:59:18 user nova-compute[74743]:     </enum>
Nov 18 16:59:18 user nova-compute[74743]:   </memoryBacking>
Nov 18 16:59:18 user nova-compute[74743]:   <devices>
Nov 18 16:59:18 user nova-compute[74743]:     <disk supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='diskDevice'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>disk</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>cdrom</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>floppy</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>lun</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='bus'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>fdc</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>scsi</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>usb</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>sata</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='model'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio-transitional</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio-non-transitional</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </disk>
Nov 18 16:59:18 user nova-compute[74743]:     <graphics supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='type'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>sdl</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>vnc</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>spice</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>egl-headless</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </graphics>
Nov 18 16:59:18 user nova-compute[74743]:     <video supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='modelType'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>vga</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>cirrus</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>vmvga</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>qxl</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>none</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>bochs</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>ramfb</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </video>
Nov 18 16:59:18 user nova-compute[74743]:     <hostdev supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='mode'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>subsystem</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='startupPolicy'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>default</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>mandatory</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>requisite</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>optional</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='subsysType'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>usb</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>pci</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>scsi</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='capsType'/>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='pciBackend'/>
Nov 18 16:59:18 user nova-compute[74743]:     </hostdev>
Nov 18 16:59:18 user nova-compute[74743]:     <rng supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='model'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio-transitional</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio-non-transitional</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='backendModel'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>random</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>egd</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>builtin</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </rng>
Nov 18 16:59:18 user nova-compute[74743]:     <filesystem supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='driverType'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>path</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>handle</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtiofs</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </filesystem>
Nov 18 16:59:18 user nova-compute[74743]:     <tpm supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='model'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>tpm-tis</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>tpm-crb</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='backendModel'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>passthrough</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>emulator</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </tpm>
Nov 18 16:59:18 user nova-compute[74743]:   </devices>
Nov 18 16:59:18 user nova-compute[74743]:   <features>
Nov 18 16:59:18 user nova-compute[74743]:     <gic supported='no'/>
Nov 18 16:59:18 user nova-compute[74743]:     <vmcoreinfo supported='yes'/>
Nov 18 16:59:18 user nova-compute[74743]:     <genid supported='yes'/>
Nov 18 16:59:18 user nova-compute[74743]:     <backingStoreInput supported='yes'/>
Nov 18 16:59:18 user nova-compute[74743]:     <backup supported='yes'/>
Nov 18 16:59:18 user nova-compute[74743]:     <sev supported='no'/>
Nov 18 16:59:18 user nova-compute[74743]:   </features>
Nov 18 16:59:18 user nova-compute[74743]: </domainCapabilities>
Nov 18 16:59:18 user nova-compute[74743]:  {{(pid=74743) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 18 16:59:18 user nova-compute[74743]: <domainCapabilities>
Nov 18 16:59:18 user nova-compute[74743]:   <path>/usr/bin/qemu-system-i386</path>
Nov 18 16:59:18 user nova-compute[74743]:   <domain>kvm</domain>
Nov 18 16:59:18 user nova-compute[74743]:   <machine>pc-q35-jammy</machine>
Nov 18 16:59:18 user nova-compute[74743]:   <arch>i686</arch>
Nov 18 16:59:18 user nova-compute[74743]:   <vcpu max='288'/>
Nov 18 16:59:18 user nova-compute[74743]:   <iothreads supported='yes'/>
Nov 18 16:59:18 user nova-compute[74743]:   <os supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:     <enum name='firmware'/>
Nov 18 16:59:18 user nova-compute[74743]:     <loader supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 18 16:59:18 user nova-compute[74743]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 18 16:59:18 user nova-compute[74743]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 18 16:59:18 user nova-compute[74743]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 18 16:59:18 user nova-compute[74743]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='type'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>rom</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>pflash</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='readonly'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>yes</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>no</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='secure'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>no</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </loader>
Nov 18 16:59:18 user nova-compute[74743]:   </os>
Nov 18 16:59:18 user nova-compute[74743]:   <cpu>
Nov 18 16:59:18 user nova-compute[74743]:     <mode name='host-passthrough' supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='hostPassthroughMigratable'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>off</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </mode>
Nov 18 16:59:18 user nova-compute[74743]:     <mode name='maximum' supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='maximumMigratable'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>on</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>off</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </mode>
Nov 18 16:59:18 user nova-compute[74743]:     <mode name='host-model' supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <vendor>Intel</vendor>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='ss'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='vmx'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='pcid'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='hypervisor'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='arat'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='tsc_adjust'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='umip'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='md-clear'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='stibp'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='arch-capabilities'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='ssbd'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='ibpb'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='ibrs'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='amd-stibp'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='amd-ssbd'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='disable' name='erms'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='disable' name='xsaveopt'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='disable' name='lm'/>
Nov 18 16:59:18 user nova-compute[74743]:     </mode>
Nov 18 16:59:18 user nova-compute[74743]:     <mode name='custom' supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>qemu64</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>qemu32</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>phenom</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>pentium3</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>pentium2</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>pentium</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>n270</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>kvm64</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>kvm32</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>coreduo</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>core2duo</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>athlon</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Westmere-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Westmere</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Snowridge</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Skylake-Server</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Skylake-Client</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>SandyBridge</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Penryn</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Opteron_G5</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Opteron_G4</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Opteron_G3</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Opteron_G2</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Opteron_G1</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Nehalem-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Nehalem</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>IvyBridge</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Icelake-Server</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Haswell-noTSX</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Haswell-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Haswell</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>EPYC-Rome</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>EPYC-Milan</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>EPYC-IBPB</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>EPYC</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Dhyana</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Cooperlake</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Conroe</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Cascadelake-Server</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Broadwell-noTSX</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Broadwell-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Broadwell</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>486</model>
Nov 18 16:59:18 user nova-compute[74743]:     </mode>
Nov 18 16:59:18 user nova-compute[74743]:   </cpu>
Nov 18 16:59:18 user nova-compute[74743]:   <memoryBacking supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:     <enum name='sourceType'>
Nov 18 16:59:18 user nova-compute[74743]:       <value>file</value>
Nov 18 16:59:18 user nova-compute[74743]:       <value>anonymous</value>
Nov 18 16:59:18 user nova-compute[74743]:       <value>memfd</value>
Nov 18 16:59:18 user nova-compute[74743]:     </enum>
Nov 18 16:59:18 user nova-compute[74743]:   </memoryBacking>
Nov 18 16:59:18 user nova-compute[74743]:   <devices>
Nov 18 16:59:18 user nova-compute[74743]:     <disk supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='diskDevice'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>disk</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>cdrom</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>floppy</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>lun</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='bus'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>fdc</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>scsi</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>usb</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>sata</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='model'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio-transitional</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio-non-transitional</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </disk>
Nov 18 16:59:18 user nova-compute[74743]:     <graphics supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='type'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>sdl</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>vnc</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>spice</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>egl-headless</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </graphics>
Nov 18 16:59:18 user nova-compute[74743]:     <video supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='modelType'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>vga</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>cirrus</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>vmvga</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>qxl</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>none</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>bochs</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>ramfb</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </video>
Nov 18 16:59:18 user nova-compute[74743]:     <hostdev supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='mode'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>subsystem</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='startupPolicy'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>default</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>mandatory</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>requisite</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>optional</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='subsysType'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>usb</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>pci</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>scsi</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='capsType'/>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='pciBackend'/>
Nov 18 16:59:18 user nova-compute[74743]:     </hostdev>
Nov 18 16:59:18 user nova-compute[74743]:     <rng supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='model'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio-transitional</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio-non-transitional</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='backendModel'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>random</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>egd</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>builtin</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </rng>
Nov 18 16:59:18 user nova-compute[74743]:     <filesystem supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='driverType'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>path</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>handle</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtiofs</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </filesystem>
Nov 18 16:59:18 user nova-compute[74743]:     <tpm supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='model'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>tpm-tis</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>tpm-crb</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='backendModel'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>passthrough</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>emulator</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </tpm>
Nov 18 16:59:18 user nova-compute[74743]:   </devices>
Nov 18 16:59:18 user nova-compute[74743]:   <features>
Nov 18 16:59:18 user nova-compute[74743]:     <gic supported='no'/>
Nov 18 16:59:18 user nova-compute[74743]:     <vmcoreinfo supported='yes'/>
Nov 18 16:59:18 user nova-compute[74743]:     <genid supported='yes'/>
Nov 18 16:59:18 user nova-compute[74743]:     <backingStoreInput supported='yes'/>
Nov 18 16:59:18 user nova-compute[74743]:     <backup supported='yes'/>
Nov 18 16:59:18 user nova-compute[74743]:     <sev supported='no'/>
Nov 18 16:59:18 user nova-compute[74743]:   </features>
Nov 18 16:59:18 user nova-compute[74743]: </domainCapabilities>
Nov 18 16:59:18 user nova-compute[74743]:  {{(pid=74743) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74743) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74743) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74743) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74743) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74743) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74743) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74743) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74743) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74743) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74743) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74743) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74743) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74743) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74743) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74743) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74743) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74743) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=74743) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74743) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74743) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74743) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=74743) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74743) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74743) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74743) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74743) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74743) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74743) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74743) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74743) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74743) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74743) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74743) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74743) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74743) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74743) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74743) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74743) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'ubuntu', 'q35', 'ubuntu-q35'} {{(pid=74743) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 18 16:59:18 user nova-compute[74743]: <domainCapabilities>
Nov 18 16:59:18 user nova-compute[74743]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 18 16:59:18 user nova-compute[74743]:   <domain>kvm</domain>
Nov 18 16:59:18 user nova-compute[74743]:   <machine>pc-i440fx-6.2</machine>
Nov 18 16:59:18 user nova-compute[74743]:   <arch>x86_64</arch>
Nov 18 16:59:18 user nova-compute[74743]:   <vcpu max='255'/>
Nov 18 16:59:18 user nova-compute[74743]:   <iothreads supported='yes'/>
Nov 18 16:59:18 user nova-compute[74743]:   <os supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:     <enum name='firmware'>
Nov 18 16:59:18 user nova-compute[74743]:       <value>efi</value>
Nov 18 16:59:18 user nova-compute[74743]:     </enum>
Nov 18 16:59:18 user nova-compute[74743]:     <loader supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='type'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>rom</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>pflash</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='readonly'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>yes</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>no</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='secure'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>no</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </loader>
Nov 18 16:59:18 user nova-compute[74743]:   </os>
Nov 18 16:59:18 user nova-compute[74743]:   <cpu>
Nov 18 16:59:18 user nova-compute[74743]:     <mode name='host-passthrough' supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='hostPassthroughMigratable'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>on</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>off</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </mode>
Nov 18 16:59:18 user nova-compute[74743]:     <mode name='maximum' supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='maximumMigratable'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>on</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>off</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </mode>
Nov 18 16:59:18 user nova-compute[74743]:     <mode name='host-model' supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <vendor>Intel</vendor>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='ss'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='vmx'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='pcid'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='hypervisor'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='arat'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='tsc_adjust'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='umip'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='md-clear'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='stibp'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='arch-capabilities'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='ssbd'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='invtsc'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='ibpb'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='ibrs'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='amd-stibp'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='amd-ssbd'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='rsba'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='pschange-mc-no'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='disable' name='erms'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='disable' name='xsaveopt'/>
Nov 18 16:59:18 user nova-compute[74743]:     </mode>
Nov 18 16:59:18 user nova-compute[74743]:     <mode name='custom' supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>qemu64</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>qemu32</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>phenom</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>pentium3</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>pentium2</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>pentium</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>n270</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>kvm64</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>kvm32</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>coreduo</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>core2duo</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>athlon</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>Westmere-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>Westmere</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Snowridge</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Skylake-Server</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Skylake-Client</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>SandyBridge</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>Penryn</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Opteron_G5</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Opteron_G4</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Opteron_G3</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Opteron_G2</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>Opteron_G1</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>Nehalem</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>IvyBridge</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Icelake-Server</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Haswell-noTSX</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Haswell-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Haswell</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>EPYC-Rome</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>EPYC-Milan</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>EPYC-IBPB</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>EPYC</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Dhyana</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Cooperlake</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>Conroe</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Cascadelake-Server</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Broadwell-noTSX</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Broadwell-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Broadwell</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>486</model>
Nov 18 16:59:18 user nova-compute[74743]:     </mode>
Nov 18 16:59:18 user nova-compute[74743]:   </cpu>
Nov 18 16:59:18 user nova-compute[74743]:   <memoryBacking supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:     <enum name='sourceType'>
Nov 18 16:59:18 user nova-compute[74743]:       <value>file</value>
Nov 18 16:59:18 user nova-compute[74743]:       <value>anonymous</value>
Nov 18 16:59:18 user nova-compute[74743]:       <value>memfd</value>
Nov 18 16:59:18 user nova-compute[74743]:     </enum>
Nov 18 16:59:18 user nova-compute[74743]:   </memoryBacking>
Nov 18 16:59:18 user nova-compute[74743]:   <devices>
Nov 18 16:59:18 user nova-compute[74743]:     <disk supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='diskDevice'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>disk</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>cdrom</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>floppy</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>lun</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='bus'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>ide</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>fdc</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>scsi</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>usb</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>sata</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='model'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio-transitional</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio-non-transitional</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </disk>
Nov 18 16:59:18 user nova-compute[74743]:     <graphics supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='type'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>sdl</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>vnc</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>spice</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>egl-headless</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </graphics>
Nov 18 16:59:18 user nova-compute[74743]:     <video supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='modelType'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>vga</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>cirrus</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>vmvga</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>qxl</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>none</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>bochs</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>ramfb</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </video>
Nov 18 16:59:18 user nova-compute[74743]:     <hostdev supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='mode'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>subsystem</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='startupPolicy'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>default</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>mandatory</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>requisite</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>optional</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='subsysType'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>usb</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>pci</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>scsi</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='capsType'/>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='pciBackend'/>
Nov 18 16:59:18 user nova-compute[74743]:     </hostdev>
Nov 18 16:59:18 user nova-compute[74743]:     <rng supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='model'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio-transitional</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio-non-transitional</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='backendModel'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>random</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>egd</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>builtin</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </rng>
Nov 18 16:59:18 user nova-compute[74743]:     <filesystem supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='driverType'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>path</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>handle</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtiofs</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </filesystem>
Nov 18 16:59:18 user nova-compute[74743]:     <tpm supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='model'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>tpm-tis</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>tpm-crb</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='backendModel'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>passthrough</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>emulator</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </tpm>
Nov 18 16:59:18 user nova-compute[74743]:   </devices>
Nov 18 16:59:18 user nova-compute[74743]:   <features>
Nov 18 16:59:18 user nova-compute[74743]:     <gic supported='no'/>
Nov 18 16:59:18 user nova-compute[74743]:     <vmcoreinfo supported='yes'/>
Nov 18 16:59:18 user nova-compute[74743]:     <genid supported='yes'/>
Nov 18 16:59:18 user nova-compute[74743]:     <backingStoreInput supported='yes'/>
Nov 18 16:59:18 user nova-compute[74743]:     <backup supported='yes'/>
Nov 18 16:59:18 user nova-compute[74743]:     <sev supported='no'/>
Nov 18 16:59:18 user nova-compute[74743]:   </features>
Nov 18 16:59:18 user nova-compute[74743]: </domainCapabilities>
Nov 18 16:59:18 user nova-compute[74743]:  {{(pid=74743) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 18 16:59:18 user nova-compute[74743]: <domainCapabilities>
Nov 18 16:59:18 user nova-compute[74743]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 18 16:59:18 user nova-compute[74743]:   <domain>kvm</domain>
Nov 18 16:59:18 user nova-compute[74743]:   <machine>pc-i440fx-jammy</machine>
Nov 18 16:59:18 user nova-compute[74743]:   <arch>x86_64</arch>
Nov 18 16:59:18 user nova-compute[74743]:   <vcpu max='255'/>
Nov 18 16:59:18 user nova-compute[74743]:   <iothreads supported='yes'/>
Nov 18 16:59:18 user nova-compute[74743]:   <os supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:     <enum name='firmware'>
Nov 18 16:59:18 user nova-compute[74743]:       <value>efi</value>
Nov 18 16:59:18 user nova-compute[74743]:     </enum>
Nov 18 16:59:18 user nova-compute[74743]:     <loader supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='type'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>rom</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>pflash</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='readonly'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>yes</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>no</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='secure'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>no</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </loader>
Nov 18 16:59:18 user nova-compute[74743]:   </os>
Nov 18 16:59:18 user nova-compute[74743]:   <cpu>
Nov 18 16:59:18 user nova-compute[74743]:     <mode name='host-passthrough' supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='hostPassthroughMigratable'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>on</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>off</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </mode>
Nov 18 16:59:18 user nova-compute[74743]:     <mode name='maximum' supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='maximumMigratable'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>on</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>off</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </mode>
Nov 18 16:59:18 user nova-compute[74743]:     <mode name='host-model' supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <vendor>Intel</vendor>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='ss'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='vmx'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='pcid'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='hypervisor'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='arat'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='tsc_adjust'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='umip'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='md-clear'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='stibp'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='arch-capabilities'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='ssbd'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='invtsc'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='ibpb'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='ibrs'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='amd-stibp'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='amd-ssbd'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='rsba'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='pschange-mc-no'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='disable' name='erms'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='disable' name='xsaveopt'/>
Nov 18 16:59:18 user nova-compute[74743]:     </mode>
Nov 18 16:59:18 user nova-compute[74743]:     <mode name='custom' supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>qemu64</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>qemu32</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>phenom</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>pentium3</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>pentium2</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>pentium</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>n270</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>kvm64</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>kvm32</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>coreduo</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>core2duo</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>athlon</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>Westmere-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>Westmere</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Snowridge</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Skylake-Server</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Skylake-Client</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>SandyBridge</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>Penryn</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Opteron_G5</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Opteron_G4</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Opteron_G3</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Opteron_G2</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>Opteron_G1</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>Nehalem</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>IvyBridge</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Icelake-Server</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Haswell-noTSX</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Haswell-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Haswell</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>EPYC-Rome</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>EPYC-Milan</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>EPYC-IBPB</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>EPYC</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Dhyana</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Cooperlake</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>Conroe</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Cascadelake-Server</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Broadwell-noTSX</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Broadwell-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Broadwell</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>486</model>
Nov 18 16:59:18 user nova-compute[74743]:     </mode>
Nov 18 16:59:18 user nova-compute[74743]:   </cpu>
Nov 18 16:59:18 user nova-compute[74743]:   <memoryBacking supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:     <enum name='sourceType'>
Nov 18 16:59:18 user nova-compute[74743]:       <value>file</value>
Nov 18 16:59:18 user nova-compute[74743]:       <value>anonymous</value>
Nov 18 16:59:18 user nova-compute[74743]:       <value>memfd</value>
Nov 18 16:59:18 user nova-compute[74743]:     </enum>
Nov 18 16:59:18 user nova-compute[74743]:   </memoryBacking>
Nov 18 16:59:18 user nova-compute[74743]:   <devices>
Nov 18 16:59:18 user nova-compute[74743]:     <disk supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='diskDevice'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>disk</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>cdrom</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>floppy</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>lun</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='bus'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>ide</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>fdc</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>scsi</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>usb</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>sata</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='model'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio-transitional</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio-non-transitional</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </disk>
Nov 18 16:59:18 user nova-compute[74743]:     <graphics supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='type'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>sdl</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>vnc</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>spice</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>egl-headless</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </graphics>
Nov 18 16:59:18 user nova-compute[74743]:     <video supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='modelType'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>vga</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>cirrus</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>vmvga</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>qxl</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>none</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>bochs</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>ramfb</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </video>
Nov 18 16:59:18 user nova-compute[74743]:     <hostdev supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='mode'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>subsystem</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='startupPolicy'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>default</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>mandatory</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>requisite</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>optional</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='subsysType'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>usb</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>pci</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>scsi</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='capsType'/>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='pciBackend'/>
Nov 18 16:59:18 user nova-compute[74743]:     </hostdev>
Nov 18 16:59:18 user nova-compute[74743]:     <rng supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='model'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio-transitional</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio-non-transitional</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='backendModel'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>random</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>egd</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>builtin</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </rng>
Nov 18 16:59:18 user nova-compute[74743]:     <filesystem supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='driverType'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>path</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>handle</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtiofs</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </filesystem>
Nov 18 16:59:18 user nova-compute[74743]:     <tpm supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='model'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>tpm-tis</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>tpm-crb</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='backendModel'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>passthrough</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>emulator</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </tpm>
Nov 18 16:59:18 user nova-compute[74743]:   </devices>
Nov 18 16:59:18 user nova-compute[74743]:   <features>
Nov 18 16:59:18 user nova-compute[74743]:     <gic supported='no'/>
Nov 18 16:59:18 user nova-compute[74743]:     <vmcoreinfo supported='yes'/>
Nov 18 16:59:18 user nova-compute[74743]:     <genid supported='yes'/>
Nov 18 16:59:18 user nova-compute[74743]:     <backingStoreInput supported='yes'/>
Nov 18 16:59:18 user nova-compute[74743]:     <backup supported='yes'/>
Nov 18 16:59:18 user nova-compute[74743]:     <sev supported='no'/>
Nov 18 16:59:18 user nova-compute[74743]:   </features>
Nov 18 16:59:18 user nova-compute[74743]: </domainCapabilities>
Nov 18 16:59:18 user nova-compute[74743]:  {{(pid=74743) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 18 16:59:18 user nova-compute[74743]: <domainCapabilities>
Nov 18 16:59:18 user nova-compute[74743]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 18 16:59:18 user nova-compute[74743]:   <domain>kvm</domain>
Nov 18 16:59:18 user nova-compute[74743]:   <machine>pc-q35-6.2</machine>
Nov 18 16:59:18 user nova-compute[74743]:   <arch>x86_64</arch>
Nov 18 16:59:18 user nova-compute[74743]:   <vcpu max='288'/>
Nov 18 16:59:18 user nova-compute[74743]:   <iothreads supported='yes'/>
Nov 18 16:59:18 user nova-compute[74743]:   <os supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:     <enum name='firmware'>
Nov 18 16:59:18 user nova-compute[74743]:       <value>efi</value>
Nov 18 16:59:18 user nova-compute[74743]:     </enum>
Nov 18 16:59:18 user nova-compute[74743]:     <loader supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 18 16:59:18 user nova-compute[74743]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 18 16:59:18 user nova-compute[74743]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='type'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>rom</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>pflash</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='readonly'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>yes</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>no</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='secure'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>yes</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>no</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </loader>
Nov 18 16:59:18 user nova-compute[74743]:   </os>
Nov 18 16:59:18 user nova-compute[74743]:   <cpu>
Nov 18 16:59:18 user nova-compute[74743]:     <mode name='host-passthrough' supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='hostPassthroughMigratable'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>on</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>off</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </mode>
Nov 18 16:59:18 user nova-compute[74743]:     <mode name='maximum' supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='maximumMigratable'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>on</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>off</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </mode>
Nov 18 16:59:18 user nova-compute[74743]:     <mode name='host-model' supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <vendor>Intel</vendor>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='ss'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='vmx'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='pcid'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='hypervisor'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='arat'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='tsc_adjust'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='umip'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='md-clear'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='stibp'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='arch-capabilities'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='ssbd'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='invtsc'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='ibpb'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='ibrs'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='amd-stibp'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='amd-ssbd'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='rsba'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='pschange-mc-no'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='disable' name='erms'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='disable' name='xsaveopt'/>
Nov 18 16:59:18 user nova-compute[74743]:     </mode>
Nov 18 16:59:18 user nova-compute[74743]:     <mode name='custom' supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>qemu64</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>qemu32</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>phenom</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>pentium3</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>pentium2</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>pentium</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>n270</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>kvm64</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>kvm32</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>coreduo</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>core2duo</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>athlon</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>Westmere-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>Westmere</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Snowridge</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Skylake-Server</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Skylake-Client</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>SandyBridge</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>Penryn</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Opteron_G5</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Opteron_G4</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Opteron_G3</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Opteron_G2</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>Opteron_G1</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>Nehalem</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>IvyBridge</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Icelake-Server</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Haswell-noTSX</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Haswell-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Haswell</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>EPYC-Rome</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>EPYC-Milan</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>EPYC-IBPB</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>EPYC</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Dhyana</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Cooperlake</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>Conroe</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Cascadelake-Server</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Broadwell-noTSX</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Broadwell-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Broadwell</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>486</model>
Nov 18 16:59:18 user nova-compute[74743]:     </mode>
Nov 18 16:59:18 user nova-compute[74743]:   </cpu>
Nov 18 16:59:18 user nova-compute[74743]:   <memoryBacking supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:     <enum name='sourceType'>
Nov 18 16:59:18 user nova-compute[74743]:       <value>file</value>
Nov 18 16:59:18 user nova-compute[74743]:       <value>anonymous</value>
Nov 18 16:59:18 user nova-compute[74743]:       <value>memfd</value>
Nov 18 16:59:18 user nova-compute[74743]:     </enum>
Nov 18 16:59:18 user nova-compute[74743]:   </memoryBacking>
Nov 18 16:59:18 user nova-compute[74743]:   <devices>
Nov 18 16:59:18 user nova-compute[74743]:     <disk supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='diskDevice'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>disk</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>cdrom</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>floppy</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>lun</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='bus'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>fdc</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>scsi</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>usb</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>sata</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='model'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio-transitional</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio-non-transitional</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </disk>
Nov 18 16:59:18 user nova-compute[74743]:     <graphics supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='type'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>sdl</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>vnc</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>spice</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>egl-headless</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </graphics>
Nov 18 16:59:18 user nova-compute[74743]:     <video supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='modelType'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>vga</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>cirrus</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>vmvga</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>qxl</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>none</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>bochs</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>ramfb</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </video>
Nov 18 16:59:18 user nova-compute[74743]:     <hostdev supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='mode'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>subsystem</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='startupPolicy'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>default</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>mandatory</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>requisite</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>optional</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='subsysType'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>usb</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>pci</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>scsi</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='capsType'/>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='pciBackend'/>
Nov 18 16:59:18 user nova-compute[74743]:     </hostdev>
Nov 18 16:59:18 user nova-compute[74743]:     <rng supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='model'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio-transitional</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio-non-transitional</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='backendModel'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>random</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>egd</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>builtin</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </rng>
Nov 18 16:59:18 user nova-compute[74743]:     <filesystem supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='driverType'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>path</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>handle</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtiofs</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </filesystem>
Nov 18 16:59:18 user nova-compute[74743]:     <tpm supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='model'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>tpm-tis</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>tpm-crb</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='backendModel'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>passthrough</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>emulator</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </tpm>
Nov 18 16:59:18 user nova-compute[74743]:   </devices>
Nov 18 16:59:18 user nova-compute[74743]:   <features>
Nov 18 16:59:18 user nova-compute[74743]:     <gic supported='no'/>
Nov 18 16:59:18 user nova-compute[74743]:     <vmcoreinfo supported='yes'/>
Nov 18 16:59:18 user nova-compute[74743]:     <genid supported='yes'/>
Nov 18 16:59:18 user nova-compute[74743]:     <backingStoreInput supported='yes'/>
Nov 18 16:59:18 user nova-compute[74743]:     <backup supported='yes'/>
Nov 18 16:59:18 user nova-compute[74743]:     <sev supported='no'/>
Nov 18 16:59:18 user nova-compute[74743]:   </features>
Nov 18 16:59:18 user nova-compute[74743]: </domainCapabilities>
Nov 18 16:59:18 user nova-compute[74743]:  {{(pid=74743) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 18 16:59:18 user nova-compute[74743]: <domainCapabilities>
Nov 18 16:59:18 user nova-compute[74743]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 18 16:59:18 user nova-compute[74743]:   <domain>kvm</domain>
Nov 18 16:59:18 user nova-compute[74743]:   <machine>pc-q35-jammy</machine>
Nov 18 16:59:18 user nova-compute[74743]:   <arch>x86_64</arch>
Nov 18 16:59:18 user nova-compute[74743]:   <vcpu max='288'/>
Nov 18 16:59:18 user nova-compute[74743]:   <iothreads supported='yes'/>
Nov 18 16:59:18 user nova-compute[74743]:   <os supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:     <enum name='firmware'>
Nov 18 16:59:18 user nova-compute[74743]:       <value>efi</value>
Nov 18 16:59:18 user nova-compute[74743]:     </enum>
Nov 18 16:59:18 user nova-compute[74743]:     <loader supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 18 16:59:18 user nova-compute[74743]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 18 16:59:18 user nova-compute[74743]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='type'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>rom</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>pflash</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='readonly'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>yes</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>no</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='secure'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>yes</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>no</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </loader>
Nov 18 16:59:18 user nova-compute[74743]:   </os>
Nov 18 16:59:18 user nova-compute[74743]:   <cpu>
Nov 18 16:59:18 user nova-compute[74743]:     <mode name='host-passthrough' supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='hostPassthroughMigratable'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>on</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>off</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </mode>
Nov 18 16:59:18 user nova-compute[74743]:     <mode name='maximum' supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='maximumMigratable'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>on</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>off</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </mode>
Nov 18 16:59:18 user nova-compute[74743]:     <mode name='host-model' supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <vendor>Intel</vendor>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='ss'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='vmx'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='pcid'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='hypervisor'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='arat'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='tsc_adjust'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='umip'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='md-clear'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='stibp'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='arch-capabilities'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='ssbd'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='invtsc'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='ibpb'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='ibrs'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='amd-stibp'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='amd-ssbd'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='rsba'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='require' name='pschange-mc-no'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='disable' name='erms'/>
Nov 18 16:59:18 user nova-compute[74743]:       <feature policy='disable' name='xsaveopt'/>
Nov 18 16:59:18 user nova-compute[74743]:     </mode>
Nov 18 16:59:18 user nova-compute[74743]:     <mode name='custom' supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>qemu64</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>qemu32</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>phenom</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>pentium3</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>pentium2</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>pentium</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>n270</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>kvm64</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>kvm32</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>coreduo</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>core2duo</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>athlon</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>Westmere-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>Westmere</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Snowridge</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Skylake-Server</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Skylake-Client</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>SandyBridge</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>Penryn</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Opteron_G5</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Opteron_G4</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Opteron_G3</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Opteron_G2</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>Opteron_G1</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>Nehalem</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>IvyBridge</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Icelake-Server</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Haswell-noTSX</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Haswell-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Haswell</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>EPYC-Rome</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>EPYC-Milan</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>EPYC-IBPB</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>EPYC</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Dhyana</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Cooperlake</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>Conroe</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Cascadelake-Server</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Broadwell-noTSX</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Broadwell-IBRS</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='no'>Broadwell</model>
Nov 18 16:59:18 user nova-compute[74743]:       <model usable='yes'>486</model>
Nov 18 16:59:18 user nova-compute[74743]:     </mode>
Nov 18 16:59:18 user nova-compute[74743]:   </cpu>
Nov 18 16:59:18 user nova-compute[74743]:   <memoryBacking supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:     <enum name='sourceType'>
Nov 18 16:59:18 user nova-compute[74743]:       <value>file</value>
Nov 18 16:59:18 user nova-compute[74743]:       <value>anonymous</value>
Nov 18 16:59:18 user nova-compute[74743]:       <value>memfd</value>
Nov 18 16:59:18 user nova-compute[74743]:     </enum>
Nov 18 16:59:18 user nova-compute[74743]:   </memoryBacking>
Nov 18 16:59:18 user nova-compute[74743]:   <devices>
Nov 18 16:59:18 user nova-compute[74743]:     <disk supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='diskDevice'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>disk</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>cdrom</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>floppy</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>lun</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='bus'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>fdc</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>scsi</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>usb</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>sata</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='model'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio-transitional</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio-non-transitional</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </disk>
Nov 18 16:59:18 user nova-compute[74743]:     <graphics supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='type'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>sdl</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>vnc</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>spice</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>egl-headless</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </graphics>
Nov 18 16:59:18 user nova-compute[74743]:     <video supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='modelType'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>vga</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>cirrus</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>vmvga</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>qxl</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>none</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>bochs</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>ramfb</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </video>
Nov 18 16:59:18 user nova-compute[74743]:     <hostdev supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='mode'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>subsystem</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='startupPolicy'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>default</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>mandatory</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>requisite</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>optional</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='subsysType'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>usb</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>pci</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>scsi</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='capsType'/>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='pciBackend'/>
Nov 18 16:59:18 user nova-compute[74743]:     </hostdev>
Nov 18 16:59:18 user nova-compute[74743]:     <rng supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='model'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio-transitional</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtio-non-transitional</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='backendModel'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>random</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>egd</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>builtin</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </rng>
Nov 18 16:59:18 user nova-compute[74743]:     <filesystem supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='driverType'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>path</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>handle</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>virtiofs</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </filesystem>
Nov 18 16:59:18 user nova-compute[74743]:     <tpm supported='yes'>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='model'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>tpm-tis</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>tpm-crb</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:       <enum name='backendModel'>
Nov 18 16:59:18 user nova-compute[74743]:         <value>passthrough</value>
Nov 18 16:59:18 user nova-compute[74743]:         <value>emulator</value>
Nov 18 16:59:18 user nova-compute[74743]:       </enum>
Nov 18 16:59:18 user nova-compute[74743]:     </tpm>
Nov 18 16:59:18 user nova-compute[74743]:   </devices>
Nov 18 16:59:18 user nova-compute[74743]:   <features>
Nov 18 16:59:18 user nova-compute[74743]:     <gic supported='no'/>
Nov 18 16:59:18 user nova-compute[74743]:     <vmcoreinfo supported='yes'/>
Nov 18 16:59:18 user nova-compute[74743]:     <genid supported='yes'/>
Nov 18 16:59:18 user nova-compute[74743]:     <backingStoreInput supported='yes'/>
Nov 18 16:59:18 user nova-compute[74743]:     <backup supported='yes'/>
Nov 18 16:59:18 user nova-compute[74743]:     <sev supported='no'/>
Nov 18 16:59:18 user nova-compute[74743]:   </features>
Nov 18 16:59:18 user nova-compute[74743]: </domainCapabilities>
Nov 18 16:59:18 user nova-compute[74743]:  {{(pid=74743) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74743) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74743) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74743) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74743) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Checking secure boot support for host arch (x86_64) {{(pid=74743) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Checking secure boot support for host arch (x86_64) {{(pid=74743) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Checking secure boot support for host arch (x86_64) {{(pid=74743) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Checking secure boot support for host arch (x86_64) {{(pid=74743) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Checking secure boot support for host arch (x86_64) {{(pid=74743) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 18 16:59:18 user nova-compute[74743]: INFO nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Secure Boot support detected
Nov 18 16:59:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] cpu compare xml: <cpu match="exact">
Nov 18 16:59:18 user nova-compute[74743]:   <model>Nehalem</model>
Nov 18 16:59:18 user nova-compute[74743]: </cpu>
Nov 18 16:59:18 user nova-compute[74743]:  {{(pid=74743) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 18 16:59:18 user nova-compute[74743]: INFO nova.virt.node [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Generated node identity 30e4d58a-2a6d-4032-8d01-e33007f4b2c8
Nov 18 16:59:18 user nova-compute[74743]: INFO nova.virt.node [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Wrote node identity 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 to /opt/stack/data/nova/compute_id
Nov 18 16:59:18 user nova-compute[74743]: WARNING nova.compute.manager [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Compute nodes ['30e4d58a-2a6d-4032-8d01-e33007f4b2c8'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 18 16:59:19 user nova-compute[74743]: INFO nova.compute.manager [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 18 16:59:19 user nova-compute[74743]: WARNING nova.compute.manager [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 18 16:59:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:59:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:59:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:59:19 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Auditing locally available compute resources for user (node: user) {{(pid=74743) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 16:59:19 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:59:19 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:59:19 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Hypervisor/Node resource view: name=user free_ram=10964MB free_disk=26.317493438720703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74743) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 16:59:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:59:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:59:19 user nova-compute[74743]: WARNING nova.compute.resource_tracker [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] No compute node record for user:30e4d58a-2a6d-4032-8d01-e33007f4b2c8: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 could not be found.
Nov 18 16:59:19 user nova-compute[74743]: INFO nova.compute.resource_tracker [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Compute node record created for user:user with uuid: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8
Nov 18 16:59:19 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 16:59:19 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 16:59:19 user nova-compute[74743]: INFO nova.scheduler.client.report [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] [req-78b8f621-5d03-4bae-81c0-377afff86488] Created resource provider record via placement API for resource provider with UUID 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 and name user.
Nov 18 16:59:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74743) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 18 16:59:19 user nova-compute[74743]: INFO nova.virt.libvirt.host [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] kernel doesn't support AMD SEV
Nov 18 16:59:19 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Updating inventory in ProviderTree for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 18 16:59:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 16:59:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Libvirt baseline CPU <cpu>
Nov 18 16:59:19 user nova-compute[74743]:   <arch>x86_64</arch>
Nov 18 16:59:19 user nova-compute[74743]:   <model>Nehalem</model>
Nov 18 16:59:19 user nova-compute[74743]:   <vendor>Intel</vendor>
Nov 18 16:59:19 user nova-compute[74743]:   <topology sockets="6" cores="1" threads="1"/>
Nov 18 16:59:19 user nova-compute[74743]: </cpu>
Nov 18 16:59:19 user nova-compute[74743]:  {{(pid=74743) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 18 16:59:19 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Updated inventory for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 18 16:59:19 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Updating resource provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 generation from 0 to 1 during operation: update_inventory {{(pid=74743) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 18 16:59:19 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Updating inventory in ProviderTree for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 18 16:59:19 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Updating resource provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 generation from 1 to 2 during operation: update_traits {{(pid=74743) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 18 16:59:19 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Compute_service record updated for user:user {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 16:59:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.629s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:59:19 user nova-compute[74743]: DEBUG nova.service [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Creating RPC server for service compute {{(pid=74743) start /opt/stack/nova/nova/service.py:182}}
Nov 18 16:59:20 user nova-compute[74743]: DEBUG nova.service [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] Join ServiceGroup membership for this service compute {{(pid=74743) start /opt/stack/nova/nova/service.py:199}}
Nov 18 16:59:20 user nova-compute[74743]: DEBUG nova.servicegroup.drivers.db [None req-e437917c-cf7e-4141-9a65-9e13e0f59d98 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74743) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 18 16:59:52 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._sync_power_states {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:59:52 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:00:10 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:00:10 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:00:10 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Starting heal instance info cache {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 17:00:10 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Rebuilding the list of instances to heal {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 17:00:10 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Didn't find any instances for network info cache update. {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 18 17:00:10 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:00:10 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:00:10 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:00:10 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:00:10 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:00:10 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:00:10 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74743) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 17:00:10 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:00:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:00:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:00:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:00:10 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Auditing locally available compute resources for user (node: user) {{(pid=74743) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 17:00:11 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:00:11 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:00:11 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Hypervisor/Node resource view: name=user free_ram=10392MB free_disk=26.22121810913086GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74743) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 17:00:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:00:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:00:11 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 17:00:11 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 17:00:11 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:00:11 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:00:11 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Compute_service record updated for user:user {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 17:00:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.126s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:01:11 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:01:11 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:01:11 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74743) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 17:01:11 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:01:11 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Starting heal instance info cache {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 17:01:11 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Rebuilding the list of instances to heal {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 17:01:11 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Didn't find any instances for network info cache update. {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 18 17:01:12 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:01:12 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:01:12 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:01:12 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:01:12 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:01:12 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:01:12 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:01:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:01:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:01:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:01:12 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Auditing locally available compute resources for user (node: user) {{(pid=74743) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 17:01:12 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:01:12 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:01:12 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Hypervisor/Node resource view: name=user free_ram=10335MB free_disk=26.285423278808594GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74743) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 17:01:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:01:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:01:12 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 17:01:12 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 17:01:12 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:01:12 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:01:12 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Compute_service record updated for user:user {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 17:01:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.140s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:02:11 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:02:11 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Starting heal instance info cache {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 17:02:11 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Rebuilding the list of instances to heal {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 17:02:11 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Didn't find any instances for network info cache update. {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 18 17:02:11 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:02:11 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74743) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 17:02:12 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:02:12 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:02:13 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:02:13 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:02:13 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:02:13 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:02:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:02:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:02:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:02:13 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Auditing locally available compute resources for user (node: user) {{(pid=74743) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 17:02:13 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:02:13 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:02:13 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Hypervisor/Node resource view: name=user free_ram=10342MB free_disk=26.037914276123047GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74743) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 17:02:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:02:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:02:13 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 17:02:13 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 17:02:13 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:02:13 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:02:13 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Compute_service record updated for user:user {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 17:02:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.155s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:02:14 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:03:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Acquiring lock "4cce1628-2dcb-40c7-abd4-6a327a432de3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:03:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "4cce1628-2dcb-40c7-abd4-6a327a432de3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:03:10 user nova-compute[74743]: DEBUG nova.compute.manager [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Starting instance... {{(pid=74743) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 17:03:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:03:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:03:10 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74743) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 17:03:10 user nova-compute[74743]: INFO nova.compute.claims [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Claim successful on node user
Nov 18 17:03:10 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:03:10 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:03:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.417s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:03:10 user nova-compute[74743]: DEBUG nova.compute.manager [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Start building networks asynchronously for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 17:03:11 user nova-compute[74743]: DEBUG nova.compute.manager [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Allocating IP information in the background. {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 17:03:11 user nova-compute[74743]: DEBUG nova.network.neutron [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] allocate_for_instance() {{(pid=74743) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 17:03:11 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 17:03:11 user nova-compute[74743]: DEBUG nova.compute.manager [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Start building block device mappings for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 17:03:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Acquiring lock "e9668e1c-1e8d-4dd7-8f58-d453db294557" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:03:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "e9668e1c-1e8d-4dd7-8f58-d453db294557" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:03:11 user nova-compute[74743]: DEBUG nova.compute.manager [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Start spawning the instance on the hypervisor. {{(pid=74743) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 17:03:11 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Creating instance directory {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 17:03:11 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Creating image(s)
Nov 18 17:03:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Acquiring lock "/opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:03:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "/opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:03:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "/opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:03:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Acquiring lock "c188b3a997bfafa42fa341f9dcc326545681eed9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:03:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:03:11 user nova-compute[74743]: DEBUG nova.compute.manager [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Starting instance... {{(pid=74743) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 17:03:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:03:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:03:11 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74743) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 17:03:11 user nova-compute[74743]: INFO nova.compute.claims [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Claim successful on node user
Nov 18 17:03:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9.part --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:03:12 user nova-compute[74743]: DEBUG nova.policy [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1470478a455242f9ad92eaf95dc6a2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c06dc8e7be46229750b8e283622c9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74743) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 17:03:12 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:03:12 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:03:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9.part --force-share --output=json" returned: 0 in 0.281s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:03:12 user nova-compute[74743]: DEBUG nova.virt.images [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] 9536f6cf-95c4-40e2-864a-09a91525678a was qcow2, converting to raw {{(pid=74743) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 18 17:03:12 user nova-compute[74743]: DEBUG nova.privsep.utils [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74743) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 18 17:03:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9.part /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9.converted {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:03:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.762s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:03:12 user nova-compute[74743]: DEBUG nova.compute.manager [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Start building networks asynchronously for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 17:03:12 user nova-compute[74743]: DEBUG nova.compute.manager [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Allocating IP information in the background. {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 17:03:12 user nova-compute[74743]: DEBUG nova.network.neutron [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] allocate_for_instance() {{(pid=74743) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 17:03:12 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 17:03:12 user nova-compute[74743]: DEBUG nova.compute.manager [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Start building block device mappings for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 17:03:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9.part /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9.converted" returned: 0 in 0.188s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:03:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9.converted --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:03:12 user nova-compute[74743]: DEBUG nova.compute.manager [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Start spawning the instance on the hypervisor. {{(pid=74743) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 17:03:12 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Creating instance directory {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 17:03:12 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Creating image(s)
Nov 18 17:03:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Acquiring lock "/opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:03:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "/opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:03:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "/opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:03:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Acquiring lock "c188b3a997bfafa42fa341f9dcc326545681eed9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:03:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9.converted --force-share --output=json" returned: 0 in 0.184s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:03:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.269s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:03:12 user nova-compute[74743]: INFO oslo.privsep.daemon [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpqj5pavjg/privsep.sock']
Nov 18 17:03:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.054s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:03:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:03:12 user sudo[83985]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpqj5pavjg/privsep.sock
Nov 18 17:03:12 user sudo[83985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 18 17:03:13 user nova-compute[74743]: DEBUG nova.policy [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1470478a455242f9ad92eaf95dc6a2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c06dc8e7be46229750b8e283622c9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74743) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 17:03:13 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:03:13 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:03:13 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:03:13 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Starting heal instance info cache {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 17:03:13 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Rebuilding the list of instances to heal {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 17:03:13 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Skipping network cache update for instance because it is Building. {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 18 17:03:13 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Skipping network cache update for instance because it is Building. {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 18 17:03:13 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Didn't find any instances for network info cache update. {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 18 17:03:13 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:03:13 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:03:13 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:03:13 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74743) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 17:03:14 user nova-compute[74743]: DEBUG nova.network.neutron [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Successfully created port: 28f81291-34bb-4a6f-890b-faea6ef8a385 {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:03:14 user sudo[83985]: pam_unix(sudo:session): session closed for user root
Nov 18 17:03:14 user nova-compute[74743]: INFO oslo.privsep.daemon [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Spawned new privsep daemon via rootwrap
Nov 18 17:03:14 user nova-compute[74743]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 18 17:03:14 user nova-compute[74743]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 18 17:03:14 user nova-compute[74743]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 18 17:03:14 user nova-compute[74743]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83988
Nov 18 17:03:14 user nova-compute[74743]: WARNING oslo_privsep.priv_context [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] privsep daemon already running
Nov 18 17:03:14 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:03:14 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:03:14 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:03:14 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:03:14 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.182s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:03:14 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Acquiring lock "c188b3a997bfafa42fa341f9dcc326545681eed9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:03:14 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:03:14 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:03:14 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.186s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:03:14 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Acquiring lock "c188b3a997bfafa42fa341f9dcc326545681eed9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:03:14 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.171s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:03:14 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk 1073741824 {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:03:14 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk 1073741824" returned: 0 in 0.042s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:03:14 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.216s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:03:14 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:03:14 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.212s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:03:14 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:03:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.180s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:03:15 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk. size=1073741824 {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 17:03:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:03:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.184s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:03:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk 1073741824 {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:03:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk 1073741824" returned: 0 in 0.055s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:03:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:03:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:03:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:03:15 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Cannot resize image /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk to a smaller size. {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 17:03:15 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Created local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 17:03:15 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Ensure instance console log exists: /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:03:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:03:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:03:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:03:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.178s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:03:15 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk. size=1073741824 {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 17:03:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:03:15 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:03:15 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:03:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:03:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:03:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:03:15 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Auditing locally available compute resources for user (node: user) {{(pid=74743) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 17:03:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:03:15 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Cannot resize image /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk to a smaller size. {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 17:03:15 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Created local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 17:03:15 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Ensure instance console log exists: /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:03:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:03:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:03:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:03:15 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:03:15 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:03:15 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Hypervisor/Node resource view: name=user free_ram=9433MB free_disk=26.016559600830078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74743) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 17:03:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:03:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:03:15 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 4cce1628-2dcb-40c7-abd4-6a327a432de3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:03:15 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance e9668e1c-1e8d-4dd7-8f58-d453db294557 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:03:15 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 17:03:15 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 17:03:16 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:03:16 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:03:16 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Compute_service record updated for user:user {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 17:03:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.392s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:03:16 user nova-compute[74743]: DEBUG nova.network.neutron [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Successfully updated port: 28f81291-34bb-4a6f-890b-faea6ef8a385 {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:03:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Acquiring lock "refresh_cache-4cce1628-2dcb-40c7-abd4-6a327a432de3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:03:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Acquired lock "refresh_cache-4cce1628-2dcb-40c7-abd4-6a327a432de3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:03:16 user nova-compute[74743]: DEBUG nova.network.neutron [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:03:16 user nova-compute[74743]: DEBUG nova.network.neutron [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Successfully created port: fcc120f5-04f4-4675-817c-5161cc09a972 {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:03:16 user nova-compute[74743]: DEBUG nova.network.neutron [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:03:16 user nova-compute[74743]: DEBUG nova.compute.manager [req-82497636-6984-4f42-af56-74a10823255e req-1ed9a8ca-b5df-41dc-b177-6915a766aefd service nova] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Received event network-changed-28f81291-34bb-4a6f-890b-faea6ef8a385 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:03:16 user nova-compute[74743]: DEBUG nova.compute.manager [req-82497636-6984-4f42-af56-74a10823255e req-1ed9a8ca-b5df-41dc-b177-6915a766aefd service nova] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Refreshing instance network info cache due to event network-changed-28f81291-34bb-4a6f-890b-faea6ef8a385. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:03:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-82497636-6984-4f42-af56-74a10823255e req-1ed9a8ca-b5df-41dc-b177-6915a766aefd service nova] Acquiring lock "refresh_cache-4cce1628-2dcb-40c7-abd4-6a327a432de3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:03:17 user nova-compute[74743]: DEBUG nova.network.neutron [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Updating instance_info_cache with network_info: [{"id": "28f81291-34bb-4a6f-890b-faea6ef8a385", "address": "fa:16:3e:47:f5:86", "network": {"id": "252343cc-f379-471d-a2c9-99b9a60ebcb4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25c06dc8e7be46229750b8e283622c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28f81291-34", "ovs_interfaceid": "28f81291-34bb-4a6f-890b-faea6ef8a385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:03:17 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Releasing lock "refresh_cache-4cce1628-2dcb-40c7-abd4-6a327a432de3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:03:17 user nova-compute[74743]: DEBUG nova.compute.manager [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Instance network_info: |[{"id": "28f81291-34bb-4a6f-890b-faea6ef8a385", "address": "fa:16:3e:47:f5:86", "network": {"id": "252343cc-f379-471d-a2c9-99b9a60ebcb4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25c06dc8e7be46229750b8e283622c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28f81291-34", "ovs_interfaceid": "28f81291-34bb-4a6f-890b-faea6ef8a385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 17:03:17 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-82497636-6984-4f42-af56-74a10823255e req-1ed9a8ca-b5df-41dc-b177-6915a766aefd service nova] Acquired lock "refresh_cache-4cce1628-2dcb-40c7-abd4-6a327a432de3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:03:17 user nova-compute[74743]: DEBUG nova.network.neutron [req-82497636-6984-4f42-af56-74a10823255e req-1ed9a8ca-b5df-41dc-b177-6915a766aefd service nova] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Refreshing network info cache for port 28f81291-34bb-4a6f-890b-faea6ef8a385 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:03:17 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Start _get_guest_xml network_info=[{"id": "28f81291-34bb-4a6f-890b-faea6ef8a385", "address": "fa:16:3e:47:f5:86", "network": {"id": "252343cc-f379-471d-a2c9-99b9a60ebcb4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25c06dc8e7be46229750b8e283622c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28f81291-34", "ovs_interfaceid": "28f81291-34bb-4a6f-890b-faea6ef8a385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '9536f6cf-95c4-40e2-864a-09a91525678a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:03:17 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:03:17 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:03:17 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:03:17 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:03:17 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:03:17 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:03:17 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:03:17 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:03:17 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:03:17 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:03:17 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:03:17 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:03:17 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:03:17 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:03:17 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:03:17 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:03:17 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:03:17 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:03:17 user nova-compute[74743]: DEBUG nova.privsep.utils [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74743) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 18 17:03:17 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:03:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1591726463',display_name='tempest-ServerRescueNegativeTestJSON-server-1591726463',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1591726463',id=1,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='25c06dc8e7be46229750b8e283622c9b',ramdisk_id='',reservation_id='r-x3cybepq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-732707405',owner_user_name='tempest-ServerRescueNegativeTestJSON-732707405-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:03:12Z,user_data=None,user_id='1470478a455242f9ad92eaf95dc6a2f4',uuid=4cce1628-2dcb-40c7-abd4-6a327a432de3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28f81291-34bb-4a6f-890b-faea6ef8a385", "address": "fa:16:3e:47:f5:86", "network": {"id": "252343cc-f379-471d-a2c9-99b9a60ebcb4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25c06dc8e7be46229750b8e283622c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28f81291-34", "ovs_interfaceid": "28f81291-34bb-4a6f-890b-faea6ef8a385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:03:17 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Converting VIF {"id": "28f81291-34bb-4a6f-890b-faea6ef8a385", "address": "fa:16:3e:47:f5:86", "network": {"id": "252343cc-f379-471d-a2c9-99b9a60ebcb4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25c06dc8e7be46229750b8e283622c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28f81291-34", "ovs_interfaceid": "28f81291-34bb-4a6f-890b-faea6ef8a385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:03:17 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:f5:86,bridge_name='br-int',has_traffic_filtering=True,id=28f81291-34bb-4a6f-890b-faea6ef8a385,network=Network(252343cc-f379-471d-a2c9-99b9a60ebcb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28f81291-34') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:03:17 user nova-compute[74743]: DEBUG nova.objects.instance [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lazy-loading 'pci_devices' on Instance uuid 4cce1628-2dcb-40c7-abd4-6a327a432de3 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:03:17 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:03:17 user nova-compute[74743]:   <uuid>4cce1628-2dcb-40c7-abd4-6a327a432de3</uuid>
Nov 18 17:03:17 user nova-compute[74743]:   <name>instance-00000001</name>
Nov 18 17:03:17 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:03:17 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:03:17 user nova-compute[74743]:   <metadata>
Nov 18 17:03:17 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:03:17 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:03:17 user nova-compute[74743]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1591726463</nova:name>
Nov 18 17:03:17 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:03:17</nova:creationTime>
Nov 18 17:03:17 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:03:17 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:03:17 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:03:17 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:03:17 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:03:17 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:03:17 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:03:17 user nova-compute[74743]:       <nova:owner>
Nov 18 17:03:17 user nova-compute[74743]:         <nova:user uuid="1470478a455242f9ad92eaf95dc6a2f4">tempest-ServerRescueNegativeTestJSON-732707405-project-member</nova:user>
Nov 18 17:03:17 user nova-compute[74743]:         <nova:project uuid="25c06dc8e7be46229750b8e283622c9b">tempest-ServerRescueNegativeTestJSON-732707405</nova:project>
Nov 18 17:03:17 user nova-compute[74743]:       </nova:owner>
Nov 18 17:03:17 user nova-compute[74743]:       <nova:root type="image" uuid="9536f6cf-95c4-40e2-864a-09a91525678a"/>
Nov 18 17:03:17 user nova-compute[74743]:       <nova:ports>
Nov 18 17:03:17 user nova-compute[74743]:         <nova:port uuid="28f81291-34bb-4a6f-890b-faea6ef8a385">
Nov 18 17:03:17 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 18 17:03:17 user nova-compute[74743]:         </nova:port>
Nov 18 17:03:17 user nova-compute[74743]:       </nova:ports>
Nov 18 17:03:17 user nova-compute[74743]:     </nova:instance>
Nov 18 17:03:17 user nova-compute[74743]:   </metadata>
Nov 18 17:03:17 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:03:17 user nova-compute[74743]:     <system>
Nov 18 17:03:17 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:03:17 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:03:17 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:03:17 user nova-compute[74743]:       <entry name="serial">4cce1628-2dcb-40c7-abd4-6a327a432de3</entry>
Nov 18 17:03:17 user nova-compute[74743]:       <entry name="uuid">4cce1628-2dcb-40c7-abd4-6a327a432de3</entry>
Nov 18 17:03:17 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:03:17 user nova-compute[74743]:     </system>
Nov 18 17:03:17 user nova-compute[74743]:   </sysinfo>
Nov 18 17:03:17 user nova-compute[74743]:   <os>
Nov 18 17:03:17 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:03:17 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:03:17 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:03:17 user nova-compute[74743]:   </os>
Nov 18 17:03:17 user nova-compute[74743]:   <features>
Nov 18 17:03:17 user nova-compute[74743]:     <acpi/>
Nov 18 17:03:17 user nova-compute[74743]:     <apic/>
Nov 18 17:03:17 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:03:17 user nova-compute[74743]:   </features>
Nov 18 17:03:17 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:03:17 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:03:17 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:03:17 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:03:17 user nova-compute[74743]:   </clock>
Nov 18 17:03:17 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:03:17 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:03:17 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:03:17 user nova-compute[74743]:   </cpu>
Nov 18 17:03:17 user nova-compute[74743]:   <devices>
Nov 18 17:03:17 user nova-compute[74743]:     <disk type="file" device="disk">
Nov 18 17:03:17 user nova-compute[74743]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 17:03:17 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk"/>
Nov 18 17:03:17 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:03:17 user nova-compute[74743]:     </disk>
Nov 18 17:03:17 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:03:17 user nova-compute[74743]:       <mac address="fa:16:3e:47:f5:86"/>
Nov 18 17:03:17 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:03:17 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:03:17 user nova-compute[74743]:       <target dev="tap28f81291-34"/>
Nov 18 17:03:17 user nova-compute[74743]:     </interface>
Nov 18 17:03:17 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:03:17 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/console.log" append="off"/>
Nov 18 17:03:17 user nova-compute[74743]:     </serial>
Nov 18 17:03:17 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:03:17 user nova-compute[74743]:     <video>
Nov 18 17:03:17 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:03:17 user nova-compute[74743]:     </video>
Nov 18 17:03:17 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:03:17 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:03:17 user nova-compute[74743]:     </rng>
Nov 18 17:03:17 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:03:17 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:03:17 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:03:17 user nova-compute[74743]:     </memballoon>
Nov 18 17:03:17 user nova-compute[74743]:   </devices>
Nov 18 17:03:17 user nova-compute[74743]: </domain>
Nov 18 17:03:17 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:03:17 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:03:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1591726463',display_name='tempest-ServerRescueNegativeTestJSON-server-1591726463',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1591726463',id=1,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='25c06dc8e7be46229750b8e283622c9b',ramdisk_id='',reservation_id='r-x3cybepq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-732707405',owner_user_name='tempest-ServerRescueNegativeTestJSON-732707405-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:03:12Z,user_data=None,user_id='1470478a455242f9ad92eaf95dc6a2f4',uuid=4cce1628-2dcb-40c7-abd4-6a327a432de3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28f81291-34bb-4a6f-890b-faea6ef8a385", "address": "fa:16:3e:47:f5:86", "network": {"id": "252343cc-f379-471d-a2c9-99b9a60ebcb4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25c06dc8e7be46229750b8e283622c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28f81291-34", "ovs_interfaceid": "28f81291-34bb-4a6f-890b-faea6ef8a385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:03:17 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Converting VIF {"id": "28f81291-34bb-4a6f-890b-faea6ef8a385", "address": "fa:16:3e:47:f5:86", "network": {"id": "252343cc-f379-471d-a2c9-99b9a60ebcb4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25c06dc8e7be46229750b8e283622c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28f81291-34", "ovs_interfaceid": "28f81291-34bb-4a6f-890b-faea6ef8a385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:03:17 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:f5:86,bridge_name='br-int',has_traffic_filtering=True,id=28f81291-34bb-4a6f-890b-faea6ef8a385,network=Network(252343cc-f379-471d-a2c9-99b9a60ebcb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28f81291-34') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:03:17 user nova-compute[74743]: DEBUG os_vif [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:f5:86,bridge_name='br-int',has_traffic_filtering=True,id=28f81291-34bb-4a6f-890b-faea6ef8a385,network=Network(252343cc-f379-471d-a2c9-99b9a60ebcb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28f81291-34') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:03:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Created schema index Interface.name {{(pid=74743) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 18 17:03:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Created schema index Port.name {{(pid=74743) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 18 17:03:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Created schema index Bridge.name {{(pid=74743) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 18 17:03:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:03:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [POLLOUT] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:03:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:03:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:03:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '799b3865-e430-5b07-8f8c-c6b668c6c595', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:03:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:03:17 user nova-compute[74743]: INFO oslo.privsep.daemon [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpwxx_adfi/privsep.sock']
Nov 18 17:03:17 user sudo[84027]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpwxx_adfi/privsep.sock
Nov 18 17:03:18 user sudo[84027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 18 17:03:18 user nova-compute[74743]: DEBUG nova.network.neutron [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Successfully updated port: fcc120f5-04f4-4675-817c-5161cc09a972 {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:03:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Acquiring lock "refresh_cache-e9668e1c-1e8d-4dd7-8f58-d453db294557" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:03:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Acquired lock "refresh_cache-e9668e1c-1e8d-4dd7-8f58-d453db294557" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:03:18 user nova-compute[74743]: DEBUG nova.network.neutron [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:03:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:18 user nova-compute[74743]: DEBUG nova.network.neutron [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:03:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:19 user nova-compute[74743]: DEBUG nova.compute.manager [req-d1747a3e-386d-425c-aaf4-625975a86956 req-0c868f38-0e20-46b3-8d4b-59e72128f841 service nova] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Received event network-changed-fcc120f5-04f4-4675-817c-5161cc09a972 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:03:19 user nova-compute[74743]: DEBUG nova.compute.manager [req-d1747a3e-386d-425c-aaf4-625975a86956 req-0c868f38-0e20-46b3-8d4b-59e72128f841 service nova] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Refreshing instance network info cache due to event network-changed-fcc120f5-04f4-4675-817c-5161cc09a972. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:03:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d1747a3e-386d-425c-aaf4-625975a86956 req-0c868f38-0e20-46b3-8d4b-59e72128f841 service nova] Acquiring lock "refresh_cache-e9668e1c-1e8d-4dd7-8f58-d453db294557" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:03:19 user nova-compute[74743]: DEBUG nova.network.neutron [req-82497636-6984-4f42-af56-74a10823255e req-1ed9a8ca-b5df-41dc-b177-6915a766aefd service nova] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Updated VIF entry in instance network info cache for port 28f81291-34bb-4a6f-890b-faea6ef8a385. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:03:19 user nova-compute[74743]: DEBUG nova.network.neutron [req-82497636-6984-4f42-af56-74a10823255e req-1ed9a8ca-b5df-41dc-b177-6915a766aefd service nova] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Updating instance_info_cache with network_info: [{"id": "28f81291-34bb-4a6f-890b-faea6ef8a385", "address": "fa:16:3e:47:f5:86", "network": {"id": "252343cc-f379-471d-a2c9-99b9a60ebcb4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25c06dc8e7be46229750b8e283622c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28f81291-34", "ovs_interfaceid": "28f81291-34bb-4a6f-890b-faea6ef8a385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:03:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-82497636-6984-4f42-af56-74a10823255e req-1ed9a8ca-b5df-41dc-b177-6915a766aefd service nova] Releasing lock "refresh_cache-4cce1628-2dcb-40c7-abd4-6a327a432de3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:03:19 user sudo[84027]: pam_unix(sudo:session): session closed for user root
Nov 18 17:03:19 user nova-compute[74743]: INFO oslo.privsep.daemon [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Spawned new privsep daemon via rootwrap
Nov 18 17:03:19 user nova-compute[74743]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 18 17:03:19 user nova-compute[74743]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 18 17:03:19 user nova-compute[74743]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 18 17:03:19 user nova-compute[74743]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84032
Nov 18 17:03:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:19 user nova-compute[74743]: DEBUG nova.network.neutron [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Updating instance_info_cache with network_info: [{"id": "fcc120f5-04f4-4675-817c-5161cc09a972", "address": "fa:16:3e:12:4a:34", "network": {"id": "252343cc-f379-471d-a2c9-99b9a60ebcb4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25c06dc8e7be46229750b8e283622c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc120f5-04", "ovs_interfaceid": "fcc120f5-04f4-4675-817c-5161cc09a972", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:03:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Releasing lock "refresh_cache-e9668e1c-1e8d-4dd7-8f58-d453db294557" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:03:19 user nova-compute[74743]: DEBUG nova.compute.manager [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Instance network_info: |[{"id": "fcc120f5-04f4-4675-817c-5161cc09a972", "address": "fa:16:3e:12:4a:34", "network": {"id": "252343cc-f379-471d-a2c9-99b9a60ebcb4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25c06dc8e7be46229750b8e283622c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc120f5-04", "ovs_interfaceid": "fcc120f5-04f4-4675-817c-5161cc09a972", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 17:03:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d1747a3e-386d-425c-aaf4-625975a86956 req-0c868f38-0e20-46b3-8d4b-59e72128f841 service nova] Acquired lock "refresh_cache-e9668e1c-1e8d-4dd7-8f58-d453db294557" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:03:19 user nova-compute[74743]: DEBUG nova.network.neutron [req-d1747a3e-386d-425c-aaf4-625975a86956 req-0c868f38-0e20-46b3-8d4b-59e72128f841 service nova] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Refreshing network info cache for port fcc120f5-04f4-4675-817c-5161cc09a972 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:03:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Start _get_guest_xml network_info=[{"id": "fcc120f5-04f4-4675-817c-5161cc09a972", "address": "fa:16:3e:12:4a:34", "network": {"id": "252343cc-f379-471d-a2c9-99b9a60ebcb4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25c06dc8e7be46229750b8e283622c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc120f5-04", "ovs_interfaceid": "fcc120f5-04f4-4675-817c-5161cc09a972", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '9536f6cf-95c4-40e2-864a-09a91525678a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:03:19 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:03:19 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:03:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:03:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:03:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:03:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:03:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:03:19 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:03:19 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:03:19 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:03:19 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:03:19 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:03:19 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:03:19 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:03:19 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:03:19 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:03:19 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:03:19 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:03:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:03:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1341409759',display_name='tempest-ServerRescueNegativeTestJSON-server-1341409759',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1341409759',id=2,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='25c06dc8e7be46229750b8e283622c9b',ramdisk_id='',reservation_id='r-pxylybnj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-732707405',owner_user_name='tempest-ServerRescueNegativeTestJSON-732707405-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:03:13Z,user_data=None,user_id='1470478a455242f9ad92eaf95dc6a2f4',uuid=e9668e1c-1e8d-4dd7-8f58-d453db294557,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fcc120f5-04f4-4675-817c-5161cc09a972", "address": "fa:16:3e:12:4a:34", "network": {"id": "252343cc-f379-471d-a2c9-99b9a60ebcb4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25c06dc8e7be46229750b8e283622c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc120f5-04", "ovs_interfaceid": "fcc120f5-04f4-4675-817c-5161cc09a972", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:03:19 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Converting VIF {"id": "fcc120f5-04f4-4675-817c-5161cc09a972", "address": "fa:16:3e:12:4a:34", "network": {"id": "252343cc-f379-471d-a2c9-99b9a60ebcb4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25c06dc8e7be46229750b8e283622c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc120f5-04", "ovs_interfaceid": "fcc120f5-04f4-4675-817c-5161cc09a972", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:03:19 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:4a:34,bridge_name='br-int',has_traffic_filtering=True,id=fcc120f5-04f4-4675-817c-5161cc09a972,network=Network(252343cc-f379-471d-a2c9-99b9a60ebcb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcc120f5-04') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:03:19 user nova-compute[74743]: DEBUG nova.objects.instance [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lazy-loading 'pci_devices' on Instance uuid e9668e1c-1e8d-4dd7-8f58-d453db294557 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:03:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:03:19 user nova-compute[74743]:   <uuid>e9668e1c-1e8d-4dd7-8f58-d453db294557</uuid>
Nov 18 17:03:19 user nova-compute[74743]:   <name>instance-00000002</name>
Nov 18 17:03:19 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:03:19 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:03:19 user nova-compute[74743]:   <metadata>
Nov 18 17:03:19 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:03:19 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:03:19 user nova-compute[74743]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1341409759</nova:name>
Nov 18 17:03:19 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:03:19</nova:creationTime>
Nov 18 17:03:19 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:03:19 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:03:19 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:03:19 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:03:19 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:03:19 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:03:19 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:03:19 user nova-compute[74743]:       <nova:owner>
Nov 18 17:03:19 user nova-compute[74743]:         <nova:user uuid="1470478a455242f9ad92eaf95dc6a2f4">tempest-ServerRescueNegativeTestJSON-732707405-project-member</nova:user>
Nov 18 17:03:19 user nova-compute[74743]:         <nova:project uuid="25c06dc8e7be46229750b8e283622c9b">tempest-ServerRescueNegativeTestJSON-732707405</nova:project>
Nov 18 17:03:19 user nova-compute[74743]:       </nova:owner>
Nov 18 17:03:19 user nova-compute[74743]:       <nova:root type="image" uuid="9536f6cf-95c4-40e2-864a-09a91525678a"/>
Nov 18 17:03:19 user nova-compute[74743]:       <nova:ports>
Nov 18 17:03:19 user nova-compute[74743]:         <nova:port uuid="fcc120f5-04f4-4675-817c-5161cc09a972">
Nov 18 17:03:19 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 18 17:03:19 user nova-compute[74743]:         </nova:port>
Nov 18 17:03:19 user nova-compute[74743]:       </nova:ports>
Nov 18 17:03:19 user nova-compute[74743]:     </nova:instance>
Nov 18 17:03:19 user nova-compute[74743]:   </metadata>
Nov 18 17:03:19 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:03:19 user nova-compute[74743]:     <system>
Nov 18 17:03:19 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:03:19 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:03:19 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:03:19 user nova-compute[74743]:       <entry name="serial">e9668e1c-1e8d-4dd7-8f58-d453db294557</entry>
Nov 18 17:03:19 user nova-compute[74743]:       <entry name="uuid">e9668e1c-1e8d-4dd7-8f58-d453db294557</entry>
Nov 18 17:03:19 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:03:19 user nova-compute[74743]:     </system>
Nov 18 17:03:19 user nova-compute[74743]:   </sysinfo>
Nov 18 17:03:19 user nova-compute[74743]:   <os>
Nov 18 17:03:19 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:03:19 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:03:19 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:03:19 user nova-compute[74743]:   </os>
Nov 18 17:03:19 user nova-compute[74743]:   <features>
Nov 18 17:03:19 user nova-compute[74743]:     <acpi/>
Nov 18 17:03:19 user nova-compute[74743]:     <apic/>
Nov 18 17:03:19 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:03:19 user nova-compute[74743]:   </features>
Nov 18 17:03:19 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:03:19 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:03:19 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:03:19 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:03:19 user nova-compute[74743]:   </clock>
Nov 18 17:03:19 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:03:19 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:03:19 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:03:19 user nova-compute[74743]:   </cpu>
Nov 18 17:03:19 user nova-compute[74743]:   <devices>
Nov 18 17:03:19 user nova-compute[74743]:     <disk type="file" device="disk">
Nov 18 17:03:19 user nova-compute[74743]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 17:03:19 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk"/>
Nov 18 17:03:19 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:03:19 user nova-compute[74743]:     </disk>
Nov 18 17:03:19 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:03:19 user nova-compute[74743]:       <mac address="fa:16:3e:12:4a:34"/>
Nov 18 17:03:19 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:03:19 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:03:19 user nova-compute[74743]:       <target dev="tapfcc120f5-04"/>
Nov 18 17:03:19 user nova-compute[74743]:     </interface>
Nov 18 17:03:19 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:03:19 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/console.log" append="off"/>
Nov 18 17:03:19 user nova-compute[74743]:     </serial>
Nov 18 17:03:19 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:03:19 user nova-compute[74743]:     <video>
Nov 18 17:03:19 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:03:19 user nova-compute[74743]:     </video>
Nov 18 17:03:19 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:03:19 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:03:19 user nova-compute[74743]:     </rng>
Nov 18 17:03:19 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:03:19 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:03:19 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:03:19 user nova-compute[74743]:     </memballoon>
Nov 18 17:03:19 user nova-compute[74743]:   </devices>
Nov 18 17:03:19 user nova-compute[74743]: </domain>
Nov 18 17:03:19 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:03:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:03:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1341409759',display_name='tempest-ServerRescueNegativeTestJSON-server-1341409759',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1341409759',id=2,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='25c06dc8e7be46229750b8e283622c9b',ramdisk_id='',reservation_id='r-pxylybnj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-732707405',owner_user_name='tempest-ServerRescueNegativeTestJSON-732707405-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:03:13Z,user_data=None,user_id='1470478a455242f9ad92eaf95dc6a2f4',uuid=e9668e1c-1e8d-4dd7-8f58-d453db294557,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fcc120f5-04f4-4675-817c-5161cc09a972", "address": "fa:16:3e:12:4a:34", "network": {"id": "252343cc-f379-471d-a2c9-99b9a60ebcb4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25c06dc8e7be46229750b8e283622c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc120f5-04", "ovs_interfaceid": "fcc120f5-04f4-4675-817c-5161cc09a972", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:03:19 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Converting VIF {"id": "fcc120f5-04f4-4675-817c-5161cc09a972", "address": "fa:16:3e:12:4a:34", "network": {"id": "252343cc-f379-471d-a2c9-99b9a60ebcb4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25c06dc8e7be46229750b8e283622c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc120f5-04", "ovs_interfaceid": "fcc120f5-04f4-4675-817c-5161cc09a972", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:03:19 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:4a:34,bridge_name='br-int',has_traffic_filtering=True,id=fcc120f5-04f4-4675-817c-5161cc09a972,network=Network(252343cc-f379-471d-a2c9-99b9a60ebcb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcc120f5-04') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:03:19 user nova-compute[74743]: DEBUG os_vif [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:4a:34,bridge_name='br-int',has_traffic_filtering=True,id=fcc120f5-04f4-4675-817c-5161cc09a972,network=Network(252343cc-f379-471d-a2c9-99b9a60ebcb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcc120f5-04') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:03:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:03:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:03:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '42d75c6a-451a-5467-aede-cbc6b475d5ca', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:03:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:03:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap28f81291-34, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:03:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap28f81291-34, col_values=(('qos', UUID('f786856d-9969-445b-b3e9-458a1b172f87')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:03:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap28f81291-34, col_values=(('external_ids', {'iface-id': '28f81291-34bb-4a6f-890b-faea6ef8a385', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:f5:86', 'vm-uuid': '4cce1628-2dcb-40c7-abd4-6a327a432de3'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:03:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:03:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:20 user nova-compute[74743]: INFO os_vif [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:f5:86,bridge_name='br-int',has_traffic_filtering=True,id=28f81291-34bb-4a6f-890b-faea6ef8a385,network=Network(252343cc-f379-471d-a2c9-99b9a60ebcb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28f81291-34')
Nov 18 17:03:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfcc120f5-04, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:03:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfcc120f5-04, col_values=(('qos', UUID('c6e0acc0-b48e-4c08-b58f-b1e2e8840ae7')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:03:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfcc120f5-04, col_values=(('external_ids', {'iface-id': 'fcc120f5-04f4-4675-817c-5161cc09a972', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:4a:34', 'vm-uuid': 'e9668e1c-1e8d-4dd7-8f58-d453db294557'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:03:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:03:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:20 user nova-compute[74743]: INFO os_vif [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:4a:34,bridge_name='br-int',has_traffic_filtering=True,id=fcc120f5-04f4-4675-817c-5161cc09a972,network=Network(252343cc-f379-471d-a2c9-99b9a60ebcb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcc120f5-04')
Nov 18 17:03:20 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:03:20 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] No VIF found with MAC fa:16:3e:47:f5:86, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:03:20 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:03:20 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] No VIF found with MAC fa:16:3e:12:4a:34, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:03:20 user nova-compute[74743]: DEBUG nova.network.neutron [req-d1747a3e-386d-425c-aaf4-625975a86956 req-0c868f38-0e20-46b3-8d4b-59e72128f841 service nova] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Updated VIF entry in instance network info cache for port fcc120f5-04f4-4675-817c-5161cc09a972. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:03:20 user nova-compute[74743]: DEBUG nova.network.neutron [req-d1747a3e-386d-425c-aaf4-625975a86956 req-0c868f38-0e20-46b3-8d4b-59e72128f841 service nova] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Updating instance_info_cache with network_info: [{"id": "fcc120f5-04f4-4675-817c-5161cc09a972", "address": "fa:16:3e:12:4a:34", "network": {"id": "252343cc-f379-471d-a2c9-99b9a60ebcb4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25c06dc8e7be46229750b8e283622c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc120f5-04", "ovs_interfaceid": "fcc120f5-04f4-4675-817c-5161cc09a972", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:03:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d1747a3e-386d-425c-aaf4-625975a86956 req-0c868f38-0e20-46b3-8d4b-59e72128f841 service nova] Releasing lock "refresh_cache-e9668e1c-1e8d-4dd7-8f58-d453db294557" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:03:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Acquiring lock "d30a49de-abf1-4985-8dc5-6f7f24d51d2f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:03:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Lock "d30a49de-abf1-4985-8dc5-6f7f24d51d2f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:03:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:22 user nova-compute[74743]: DEBUG nova.compute.manager [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Starting instance... {{(pid=74743) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 17:03:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:03:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:03:23 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74743) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 17:03:23 user nova-compute[74743]: INFO nova.compute.claims [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Claim successful on node user
Nov 18 17:03:23 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:03:23 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:03:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.722s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:03:23 user nova-compute[74743]: DEBUG nova.compute.manager [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Start building networks asynchronously for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 17:03:23 user nova-compute[74743]: DEBUG nova.compute.manager [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Allocating IP information in the background. {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 17:03:23 user nova-compute[74743]: DEBUG nova.network.neutron [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] allocate_for_instance() {{(pid=74743) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 17:03:23 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 17:03:23 user nova-compute[74743]: DEBUG nova.compute.manager [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Start building block device mappings for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 17:03:24 user nova-compute[74743]: DEBUG nova.policy [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6dc2a1332121452e8d468f97b041369e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59182c66c6724be494c78af579b03340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74743) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 17:03:24 user nova-compute[74743]: DEBUG nova.compute.manager [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Start spawning the instance on the hypervisor. {{(pid=74743) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 17:03:24 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Creating instance directory {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 17:03:24 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Creating image(s)
Nov 18 17:03:24 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Acquiring lock "/opt/stack/data/nova/instances/d30a49de-abf1-4985-8dc5-6f7f24d51d2f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:03:24 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Lock "/opt/stack/data/nova/instances/d30a49de-abf1-4985-8dc5-6f7f24d51d2f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:03:24 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Lock "/opt/stack/data/nova/instances/d30a49de-abf1-4985-8dc5-6f7f24d51d2f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:03:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:03:24 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.232s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:03:24 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Acquiring lock "c188b3a997bfafa42fa341f9dcc326545681eed9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:03:24 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:03:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:03:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.237s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:03:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/d30a49de-abf1-4985-8dc5-6f7f24d51d2f/disk 1073741824 {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:03:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/d30a49de-abf1-4985-8dc5-6f7f24d51d2f/disk 1073741824" returned: 0 in 0.051s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:03:24 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.295s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:03:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:03:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.212s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:03:24 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d30a49de-abf1-4985-8dc5-6f7f24d51d2f/disk. size=1073741824 {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 17:03:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d30a49de-abf1-4985-8dc5-6f7f24d51d2f/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:03:25 user nova-compute[74743]: DEBUG nova.compute.manager [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:03:25 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Guest created on hypervisor {{(pid=74743) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 17:03:25 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Instance spawned successfully.
Nov 18 17:03:25 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 17:03:25 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Found default for hw_cdrom_bus of ide {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:03:25 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Found default for hw_disk_bus of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:03:25 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Found default for hw_input_bus of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:03:25 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Found default for hw_pointer_model of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:03:25 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Found default for hw_video_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:03:25 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Found default for hw_vif_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:03:25 user nova-compute[74743]: DEBUG nova.compute.manager [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:03:25 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Guest created on hypervisor {{(pid=74743) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 17:03:25 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Instance spawned successfully.
Nov 18 17:03:25 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 17:03:25 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Found default for hw_cdrom_bus of ide {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:03:25 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Found default for hw_disk_bus of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:03:25 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Found default for hw_input_bus of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:03:25 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Found default for hw_pointer_model of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:03:25 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Found default for hw_video_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:03:25 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Found default for hw_vif_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:03:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d30a49de-abf1-4985-8dc5-6f7f24d51d2f/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:03:25 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Cannot resize image /opt/stack/data/nova/instances/d30a49de-abf1-4985-8dc5-6f7f24d51d2f/disk to a smaller size. {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 17:03:25 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Created local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 17:03:25 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Ensure instance console log exists: /opt/stack/data/nova/instances/d30a49de-abf1-4985-8dc5-6f7f24d51d2f/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:03:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:03:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:03:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:03:25 user nova-compute[74743]: DEBUG nova.network.neutron [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Successfully created port: de102d31-a76d-4945-a89a-bdc58bf0f3a6 {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:03:25 user nova-compute[74743]: INFO nova.compute.manager [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Took 12.44 seconds to spawn the instance on the hypervisor.
Nov 18 17:03:25 user nova-compute[74743]: DEBUG nova.compute.manager [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:03:25 user nova-compute[74743]: INFO nova.compute.manager [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Took 13.65 seconds to spawn the instance on the hypervisor.
Nov 18 17:03:25 user nova-compute[74743]: DEBUG nova.compute.manager [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:03:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:25 user nova-compute[74743]: INFO nova.compute.manager [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Took 13.65 seconds to build instance.
Nov 18 17:03:25 user nova-compute[74743]: INFO nova.compute.manager [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Took 15.00 seconds to build instance.
Nov 18 17:03:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-72c9076c-00cf-4f3e-891d-544566acb9b4 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "e9668e1c-1e8d-4dd7-8f58-d453db294557" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.809s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:03:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d44d5ffe-7402-4398-a346-a07425293775 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "4cce1628-2dcb-40c7-abd4-6a327a432de3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.226s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:03:28 user nova-compute[74743]: DEBUG nova.network.neutron [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Successfully updated port: de102d31-a76d-4945-a89a-bdc58bf0f3a6 {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:03:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Acquiring lock "refresh_cache-d30a49de-abf1-4985-8dc5-6f7f24d51d2f" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:03:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Acquired lock "refresh_cache-d30a49de-abf1-4985-8dc5-6f7f24d51d2f" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:03:28 user nova-compute[74743]: DEBUG nova.network.neutron [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:03:28 user nova-compute[74743]: DEBUG nova.compute.manager [req-947da98e-a5f7-47ee-bf03-c095429288a8 req-7f4388c9-5af1-4436-b315-c2ca5d49fbf5 service nova] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Received event network-changed-de102d31-a76d-4945-a89a-bdc58bf0f3a6 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:03:28 user nova-compute[74743]: DEBUG nova.compute.manager [req-947da98e-a5f7-47ee-bf03-c095429288a8 req-7f4388c9-5af1-4436-b315-c2ca5d49fbf5 service nova] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Refreshing instance network info cache due to event network-changed-de102d31-a76d-4945-a89a-bdc58bf0f3a6. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:03:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-947da98e-a5f7-47ee-bf03-c095429288a8 req-7f4388c9-5af1-4436-b315-c2ca5d49fbf5 service nova] Acquiring lock "refresh_cache-d30a49de-abf1-4985-8dc5-6f7f24d51d2f" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:03:28 user nova-compute[74743]: DEBUG nova.network.neutron [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:03:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:30 user nova-compute[74743]: DEBUG nova.network.neutron [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Updating instance_info_cache with network_info: [{"id": "de102d31-a76d-4945-a89a-bdc58bf0f3a6", "address": "fa:16:3e:cf:af:24", "network": {"id": "4b7bc82e-3fb4-4696-827e-095227957f6b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1107221061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59182c66c6724be494c78af579b03340", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde102d31-a7", "ovs_interfaceid": "de102d31-a76d-4945-a89a-bdc58bf0f3a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:03:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Releasing lock "refresh_cache-d30a49de-abf1-4985-8dc5-6f7f24d51d2f" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:03:30 user nova-compute[74743]: DEBUG nova.compute.manager [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Instance network_info: |[{"id": "de102d31-a76d-4945-a89a-bdc58bf0f3a6", "address": "fa:16:3e:cf:af:24", "network": {"id": "4b7bc82e-3fb4-4696-827e-095227957f6b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1107221061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59182c66c6724be494c78af579b03340", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde102d31-a7", "ovs_interfaceid": "de102d31-a76d-4945-a89a-bdc58bf0f3a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 17:03:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-947da98e-a5f7-47ee-bf03-c095429288a8 req-7f4388c9-5af1-4436-b315-c2ca5d49fbf5 service nova] Acquired lock "refresh_cache-d30a49de-abf1-4985-8dc5-6f7f24d51d2f" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:03:30 user nova-compute[74743]: DEBUG nova.network.neutron [req-947da98e-a5f7-47ee-bf03-c095429288a8 req-7f4388c9-5af1-4436-b315-c2ca5d49fbf5 service nova] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Refreshing network info cache for port de102d31-a76d-4945-a89a-bdc58bf0f3a6 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:03:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Start _get_guest_xml network_info=[{"id": "de102d31-a76d-4945-a89a-bdc58bf0f3a6", "address": "fa:16:3e:cf:af:24", "network": {"id": "4b7bc82e-3fb4-4696-827e-095227957f6b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1107221061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59182c66c6724be494c78af579b03340", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde102d31-a7", "ovs_interfaceid": "de102d31-a76d-4945-a89a-bdc58bf0f3a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '9536f6cf-95c4-40e2-864a-09a91525678a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:03:30 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:03:30 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:03:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:03:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:03:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:03:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:03:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:03:30 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:03:30 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:03:30 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:03:30 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:03:30 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:03:30 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:03:30 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:03:30 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:03:30 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:03:30 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:03:30 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:03:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:03:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-613349512',display_name='tempest-DeleteServersTestJSON-server-613349512',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-613349512',id=3,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59182c66c6724be494c78af579b03340',ramdisk_id='',reservation_id='r-692hrcsg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-65485011',owner_user_name='tempest-DeleteServersTestJSON-65485011-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:03:24Z,user_data=None,user_id='6dc2a1332121452e8d468f97b041369e',uuid=d30a49de-abf1-4985-8dc5-6f7f24d51d2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de102d31-a76d-4945-a89a-bdc58bf0f3a6", "address": "fa:16:3e:cf:af:24", "network": {"id": "4b7bc82e-3fb4-4696-827e-095227957f6b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1107221061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59182c66c6724be494c78af579b03340", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde102d31-a7", "ovs_interfaceid": "de102d31-a76d-4945-a89a-bdc58bf0f3a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:03:30 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Converting VIF {"id": "de102d31-a76d-4945-a89a-bdc58bf0f3a6", "address": "fa:16:3e:cf:af:24", "network": {"id": "4b7bc82e-3fb4-4696-827e-095227957f6b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1107221061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59182c66c6724be494c78af579b03340", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde102d31-a7", "ovs_interfaceid": "de102d31-a76d-4945-a89a-bdc58bf0f3a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:03:30 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:af:24,bridge_name='br-int',has_traffic_filtering=True,id=de102d31-a76d-4945-a89a-bdc58bf0f3a6,network=Network(4b7bc82e-3fb4-4696-827e-095227957f6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde102d31-a7') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:03:30 user nova-compute[74743]: DEBUG nova.objects.instance [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Lazy-loading 'pci_devices' on Instance uuid d30a49de-abf1-4985-8dc5-6f7f24d51d2f {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:03:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:03:30 user nova-compute[74743]:   <uuid>d30a49de-abf1-4985-8dc5-6f7f24d51d2f</uuid>
Nov 18 17:03:30 user nova-compute[74743]:   <name>instance-00000003</name>
Nov 18 17:03:30 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:03:30 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:03:30 user nova-compute[74743]:   <metadata>
Nov 18 17:03:30 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:03:30 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:03:30 user nova-compute[74743]:       <nova:name>tempest-DeleteServersTestJSON-server-613349512</nova:name>
Nov 18 17:03:30 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:03:30</nova:creationTime>
Nov 18 17:03:30 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:03:30 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:03:30 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:03:30 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:03:30 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:03:30 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:03:30 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:03:30 user nova-compute[74743]:       <nova:owner>
Nov 18 17:03:30 user nova-compute[74743]:         <nova:user uuid="6dc2a1332121452e8d468f97b041369e">tempest-DeleteServersTestJSON-65485011-project-member</nova:user>
Nov 18 17:03:30 user nova-compute[74743]:         <nova:project uuid="59182c66c6724be494c78af579b03340">tempest-DeleteServersTestJSON-65485011</nova:project>
Nov 18 17:03:30 user nova-compute[74743]:       </nova:owner>
Nov 18 17:03:30 user nova-compute[74743]:       <nova:root type="image" uuid="9536f6cf-95c4-40e2-864a-09a91525678a"/>
Nov 18 17:03:30 user nova-compute[74743]:       <nova:ports>
Nov 18 17:03:30 user nova-compute[74743]:         <nova:port uuid="de102d31-a76d-4945-a89a-bdc58bf0f3a6">
Nov 18 17:03:30 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 18 17:03:30 user nova-compute[74743]:         </nova:port>
Nov 18 17:03:30 user nova-compute[74743]:       </nova:ports>
Nov 18 17:03:30 user nova-compute[74743]:     </nova:instance>
Nov 18 17:03:30 user nova-compute[74743]:   </metadata>
Nov 18 17:03:30 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:03:30 user nova-compute[74743]:     <system>
Nov 18 17:03:30 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:03:30 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:03:30 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:03:30 user nova-compute[74743]:       <entry name="serial">d30a49de-abf1-4985-8dc5-6f7f24d51d2f</entry>
Nov 18 17:03:30 user nova-compute[74743]:       <entry name="uuid">d30a49de-abf1-4985-8dc5-6f7f24d51d2f</entry>
Nov 18 17:03:30 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:03:30 user nova-compute[74743]:     </system>
Nov 18 17:03:30 user nova-compute[74743]:   </sysinfo>
Nov 18 17:03:30 user nova-compute[74743]:   <os>
Nov 18 17:03:30 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:03:30 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:03:30 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:03:30 user nova-compute[74743]:   </os>
Nov 18 17:03:30 user nova-compute[74743]:   <features>
Nov 18 17:03:30 user nova-compute[74743]:     <acpi/>
Nov 18 17:03:30 user nova-compute[74743]:     <apic/>
Nov 18 17:03:30 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:03:30 user nova-compute[74743]:   </features>
Nov 18 17:03:30 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:03:30 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:03:30 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:03:30 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:03:30 user nova-compute[74743]:   </clock>
Nov 18 17:03:30 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:03:30 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:03:30 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:03:30 user nova-compute[74743]:   </cpu>
Nov 18 17:03:30 user nova-compute[74743]:   <devices>
Nov 18 17:03:30 user nova-compute[74743]:     <disk type="file" device="disk">
Nov 18 17:03:30 user nova-compute[74743]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 17:03:30 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/d30a49de-abf1-4985-8dc5-6f7f24d51d2f/disk"/>
Nov 18 17:03:30 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:03:30 user nova-compute[74743]:     </disk>
Nov 18 17:03:30 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:03:30 user nova-compute[74743]:       <mac address="fa:16:3e:cf:af:24"/>
Nov 18 17:03:30 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:03:30 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:03:30 user nova-compute[74743]:       <target dev="tapde102d31-a7"/>
Nov 18 17:03:30 user nova-compute[74743]:     </interface>
Nov 18 17:03:30 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:03:30 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/d30a49de-abf1-4985-8dc5-6f7f24d51d2f/console.log" append="off"/>
Nov 18 17:03:30 user nova-compute[74743]:     </serial>
Nov 18 17:03:30 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:03:30 user nova-compute[74743]:     <video>
Nov 18 17:03:30 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:03:30 user nova-compute[74743]:     </video>
Nov 18 17:03:30 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:03:30 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:03:30 user nova-compute[74743]:     </rng>
Nov 18 17:03:30 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:03:30 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:03:30 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:03:30 user nova-compute[74743]:     </memballoon>
Nov 18 17:03:30 user nova-compute[74743]:   </devices>
Nov 18 17:03:30 user nova-compute[74743]: </domain>
Nov 18 17:03:30 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:03:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:03:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-613349512',display_name='tempest-DeleteServersTestJSON-server-613349512',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-613349512',id=3,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59182c66c6724be494c78af579b03340',ramdisk_id='',reservation_id='r-692hrcsg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-65485011',owner_user_name='tempest-DeleteServersTestJSON-65485011-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:03:24Z,user_data=None,user_id='6dc2a1332121452e8d468f97b041369e',uuid=d30a49de-abf1-4985-8dc5-6f7f24d51d2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de102d31-a76d-4945-a89a-bdc58bf0f3a6", "address": "fa:16:3e:cf:af:24", "network": {"id": "4b7bc82e-3fb4-4696-827e-095227957f6b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1107221061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59182c66c6724be494c78af579b03340", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde102d31-a7", "ovs_interfaceid": "de102d31-a76d-4945-a89a-bdc58bf0f3a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:03:30 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Converting VIF {"id": "de102d31-a76d-4945-a89a-bdc58bf0f3a6", "address": "fa:16:3e:cf:af:24", "network": {"id": "4b7bc82e-3fb4-4696-827e-095227957f6b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1107221061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59182c66c6724be494c78af579b03340", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde102d31-a7", "ovs_interfaceid": "de102d31-a76d-4945-a89a-bdc58bf0f3a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:03:30 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:af:24,bridge_name='br-int',has_traffic_filtering=True,id=de102d31-a76d-4945-a89a-bdc58bf0f3a6,network=Network(4b7bc82e-3fb4-4696-827e-095227957f6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde102d31-a7') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:03:30 user nova-compute[74743]: DEBUG os_vif [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:af:24,bridge_name='br-int',has_traffic_filtering=True,id=de102d31-a76d-4945-a89a-bdc58bf0f3a6,network=Network(4b7bc82e-3fb4-4696-827e-095227957f6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde102d31-a7') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:03:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:03:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:03:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f82e2141-81a3-5b86-bc0a-11e3ae3c9109', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:03:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapde102d31-a7, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:03:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapde102d31-a7, col_values=(('qos', UUID('34ea50a9-ee5e-4015-97f6-cb9190290a93')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:03:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapde102d31-a7, col_values=(('external_ids', {'iface-id': 'de102d31-a76d-4945-a89a-bdc58bf0f3a6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:af:24', 'vm-uuid': 'd30a49de-abf1-4985-8dc5-6f7f24d51d2f'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:03:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:03:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:30 user nova-compute[74743]: INFO os_vif [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:af:24,bridge_name='br-int',has_traffic_filtering=True,id=de102d31-a76d-4945-a89a-bdc58bf0f3a6,network=Network(4b7bc82e-3fb4-4696-827e-095227957f6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde102d31-a7')
Nov 18 17:03:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:03:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] No VIF found with MAC fa:16:3e:cf:af:24, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:03:31 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquiring lock "c006a4ad-a8e2-4108-9af1-dec4dd53fcda" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:03:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "c006a4ad-a8e2-4108-9af1-dec4dd53fcda" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:03:32 user nova-compute[74743]: DEBUG nova.compute.manager [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Starting instance... {{(pid=74743) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 17:03:32 user nova-compute[74743]: DEBUG nova.network.neutron [req-947da98e-a5f7-47ee-bf03-c095429288a8 req-7f4388c9-5af1-4436-b315-c2ca5d49fbf5 service nova] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Updated VIF entry in instance network info cache for port de102d31-a76d-4945-a89a-bdc58bf0f3a6. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:03:32 user nova-compute[74743]: DEBUG nova.network.neutron [req-947da98e-a5f7-47ee-bf03-c095429288a8 req-7f4388c9-5af1-4436-b315-c2ca5d49fbf5 service nova] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Updating instance_info_cache with network_info: [{"id": "de102d31-a76d-4945-a89a-bdc58bf0f3a6", "address": "fa:16:3e:cf:af:24", "network": {"id": "4b7bc82e-3fb4-4696-827e-095227957f6b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1107221061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59182c66c6724be494c78af579b03340", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde102d31-a7", "ovs_interfaceid": "de102d31-a76d-4945-a89a-bdc58bf0f3a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:03:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-947da98e-a5f7-47ee-bf03-c095429288a8 req-7f4388c9-5af1-4436-b315-c2ca5d49fbf5 service nova] Releasing lock "refresh_cache-d30a49de-abf1-4985-8dc5-6f7f24d51d2f" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:03:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:03:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:03:32 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74743) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 17:03:32 user nova-compute[74743]: INFO nova.compute.claims [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Claim successful on node user
Nov 18 17:03:32 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:32 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:32 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:03:32 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:03:33 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.710s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:03:33 user nova-compute[74743]: DEBUG nova.compute.manager [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Start building networks asynchronously for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 17:03:33 user nova-compute[74743]: DEBUG nova.compute.manager [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Allocating IP information in the background. {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 17:03:33 user nova-compute[74743]: DEBUG nova.network.neutron [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] allocate_for_instance() {{(pid=74743) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 17:03:33 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 17:03:33 user nova-compute[74743]: DEBUG nova.compute.manager [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Start building block device mappings for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 17:03:33 user nova-compute[74743]: DEBUG nova.policy [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ce3e4cef47114a7c9327db639460d923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8f5850162c479b8d185e48c03be7d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74743) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 17:03:33 user nova-compute[74743]: DEBUG nova.compute.manager [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Start spawning the instance on the hypervisor. {{(pid=74743) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 17:03:33 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Creating instance directory {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 17:03:33 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Creating image(s)
Nov 18 17:03:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquiring lock "/opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:03:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "/opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:03:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "/opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:03:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:03:33 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:33 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.204s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:03:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquiring lock "c188b3a997bfafa42fa341f9dcc326545681eed9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:03:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:03:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:03:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.198s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:03:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk 1073741824 {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:03:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk 1073741824" returned: 0 in 0.080s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:03:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:03:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:03:34 user nova-compute[74743]: DEBUG nova.network.neutron [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Successfully created port: 999980cf-efd0-4b78-aa42-f4e80073b5a9 {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:03:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.242s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:03:34 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk. size=1073741824 {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 17:03:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:03:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:03:34 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Cannot resize image /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk to a smaller size. {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 17:03:34 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Created local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 17:03:34 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Ensure instance console log exists: /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:03:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:03:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:03:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:03:35 user nova-compute[74743]: DEBUG nova.compute.manager [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:03:35 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Guest created on hypervisor {{(pid=74743) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 17:03:35 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Instance spawned successfully.
Nov 18 17:03:35 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 17:03:35 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Found default for hw_cdrom_bus of ide {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:03:35 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Found default for hw_disk_bus of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:03:35 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Found default for hw_input_bus of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:03:35 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Found default for hw_pointer_model of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:03:35 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Found default for hw_video_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:03:35 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Found default for hw_vif_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:03:35 user nova-compute[74743]: INFO nova.compute.manager [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Took 11.29 seconds to spawn the instance on the hypervisor.
Nov 18 17:03:35 user nova-compute[74743]: DEBUG nova.compute.manager [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:03:35 user nova-compute[74743]: INFO nova.compute.manager [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Took 12.57 seconds to build instance.
Nov 18 17:03:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-295bf6b3-06ca-4d02-8bd0-d694d70380ff tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Lock "d30a49de-abf1-4985-8dc5-6f7f24d51d2f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.731s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:03:35 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:35 user nova-compute[74743]: DEBUG nova.network.neutron [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Successfully updated port: 999980cf-efd0-4b78-aa42-f4e80073b5a9 {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:03:36 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquiring lock "refresh_cache-c006a4ad-a8e2-4108-9af1-dec4dd53fcda" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:03:36 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquired lock "refresh_cache-c006a4ad-a8e2-4108-9af1-dec4dd53fcda" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:03:36 user nova-compute[74743]: DEBUG nova.network.neutron [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:03:36 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:36 user nova-compute[74743]: DEBUG nova.compute.manager [req-d3a6064c-ac74-419b-84c0-9713139aaf27 req-33055017-3b5e-4baf-a242-5b034c833153 service nova] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Received event network-changed-999980cf-efd0-4b78-aa42-f4e80073b5a9 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:03:36 user nova-compute[74743]: DEBUG nova.compute.manager [req-d3a6064c-ac74-419b-84c0-9713139aaf27 req-33055017-3b5e-4baf-a242-5b034c833153 service nova] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Refreshing instance network info cache due to event network-changed-999980cf-efd0-4b78-aa42-f4e80073b5a9. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:03:36 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d3a6064c-ac74-419b-84c0-9713139aaf27 req-33055017-3b5e-4baf-a242-5b034c833153 service nova] Acquiring lock "refresh_cache-c006a4ad-a8e2-4108-9af1-dec4dd53fcda" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:03:36 user nova-compute[74743]: DEBUG nova.network.neutron [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:03:37 user nova-compute[74743]: DEBUG nova.network.neutron [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Updating instance_info_cache with network_info: [{"id": "999980cf-efd0-4b78-aa42-f4e80073b5a9", "address": "fa:16:3e:e4:7e:f3", "network": {"id": "fd98f398-6576-449b-a737-887906eb6656", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668610993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb8f5850162c479b8d185e48c03be7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap999980cf-ef", "ovs_interfaceid": "999980cf-efd0-4b78-aa42-f4e80073b5a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:03:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Releasing lock "refresh_cache-c006a4ad-a8e2-4108-9af1-dec4dd53fcda" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:03:37 user nova-compute[74743]: DEBUG nova.compute.manager [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Instance network_info: |[{"id": "999980cf-efd0-4b78-aa42-f4e80073b5a9", "address": "fa:16:3e:e4:7e:f3", "network": {"id": "fd98f398-6576-449b-a737-887906eb6656", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668610993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb8f5850162c479b8d185e48c03be7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap999980cf-ef", "ovs_interfaceid": "999980cf-efd0-4b78-aa42-f4e80073b5a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 17:03:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d3a6064c-ac74-419b-84c0-9713139aaf27 req-33055017-3b5e-4baf-a242-5b034c833153 service nova] Acquired lock "refresh_cache-c006a4ad-a8e2-4108-9af1-dec4dd53fcda" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:03:37 user nova-compute[74743]: DEBUG nova.network.neutron [req-d3a6064c-ac74-419b-84c0-9713139aaf27 req-33055017-3b5e-4baf-a242-5b034c833153 service nova] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Refreshing network info cache for port 999980cf-efd0-4b78-aa42-f4e80073b5a9 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:03:37 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Start _get_guest_xml network_info=[{"id": "999980cf-efd0-4b78-aa42-f4e80073b5a9", "address": "fa:16:3e:e4:7e:f3", "network": {"id": "fd98f398-6576-449b-a737-887906eb6656", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668610993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb8f5850162c479b8d185e48c03be7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap999980cf-ef", "ovs_interfaceid": "999980cf-efd0-4b78-aa42-f4e80073b5a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '9536f6cf-95c4-40e2-864a-09a91525678a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:03:37 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:03:37 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:03:37 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:03:37 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:03:37 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:03:37 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:03:37 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:03:37 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:03:37 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:03:37 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:03:37 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:03:37 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:03:37 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:03:37 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:03:37 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:03:37 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:03:37 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:03:37 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:03:37 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:03:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-712226846',display_name='tempest-ServerActionsTestOtherA-server-712226846',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-712226846',id=4,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEVphqV0ovLOhWV5c4OtZaZAghiX4KqdCUzcXRNxI8zWTbqX3YOGnG7iLQKSTFxu3amDks//fytVOc70uGuSKqNKUeaE/kY0CmyGU71j0ZYQPWjJeA0I0UUP+FZUS4MWQ==',key_name='tempest-keypair-1212996543',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb8f5850162c479b8d185e48c03be7d3',ramdisk_id='',reservation_id='r-642m5qx1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-128885625',owner_user_name='tempest-ServerActionsTestOtherA-128885625-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:03:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce3e4cef47114a7c9327db639460d923',uuid=c006a4ad-a8e2-4108-9af1-dec4dd53fcda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "999980cf-efd0-4b78-aa42-f4e80073b5a9", "address": "fa:16:3e:e4:7e:f3", "network": {"id": "fd98f398-6576-449b-a737-887906eb6656", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668610993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb8f5850162c479b8d185e48c03be7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap999980cf-ef", "ovs_interfaceid": "999980cf-efd0-4b78-aa42-f4e80073b5a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:03:37 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Converting VIF {"id": "999980cf-efd0-4b78-aa42-f4e80073b5a9", "address": "fa:16:3e:e4:7e:f3", "network": {"id": "fd98f398-6576-449b-a737-887906eb6656", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668610993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb8f5850162c479b8d185e48c03be7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap999980cf-ef", "ovs_interfaceid": "999980cf-efd0-4b78-aa42-f4e80073b5a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:03:37 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:7e:f3,bridge_name='br-int',has_traffic_filtering=True,id=999980cf-efd0-4b78-aa42-f4e80073b5a9,network=Network(fd98f398-6576-449b-a737-887906eb6656),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap999980cf-ef') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:03:37 user nova-compute[74743]: DEBUG nova.objects.instance [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lazy-loading 'pci_devices' on Instance uuid c006a4ad-a8e2-4108-9af1-dec4dd53fcda {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:03:37 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:03:37 user nova-compute[74743]:   <uuid>c006a4ad-a8e2-4108-9af1-dec4dd53fcda</uuid>
Nov 18 17:03:37 user nova-compute[74743]:   <name>instance-00000004</name>
Nov 18 17:03:37 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:03:37 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:03:37 user nova-compute[74743]:   <metadata>
Nov 18 17:03:37 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:03:37 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:03:37 user nova-compute[74743]:       <nova:name>tempest-ServerActionsTestOtherA-server-712226846</nova:name>
Nov 18 17:03:37 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:03:37</nova:creationTime>
Nov 18 17:03:37 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:03:37 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:03:37 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:03:37 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:03:37 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:03:37 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:03:37 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:03:37 user nova-compute[74743]:       <nova:owner>
Nov 18 17:03:37 user nova-compute[74743]:         <nova:user uuid="ce3e4cef47114a7c9327db639460d923">tempest-ServerActionsTestOtherA-128885625-project-member</nova:user>
Nov 18 17:03:37 user nova-compute[74743]:         <nova:project uuid="fb8f5850162c479b8d185e48c03be7d3">tempest-ServerActionsTestOtherA-128885625</nova:project>
Nov 18 17:03:37 user nova-compute[74743]:       </nova:owner>
Nov 18 17:03:37 user nova-compute[74743]:       <nova:root type="image" uuid="9536f6cf-95c4-40e2-864a-09a91525678a"/>
Nov 18 17:03:37 user nova-compute[74743]:       <nova:ports>
Nov 18 17:03:37 user nova-compute[74743]:         <nova:port uuid="999980cf-efd0-4b78-aa42-f4e80073b5a9">
Nov 18 17:03:37 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 18 17:03:37 user nova-compute[74743]:         </nova:port>
Nov 18 17:03:37 user nova-compute[74743]:       </nova:ports>
Nov 18 17:03:37 user nova-compute[74743]:     </nova:instance>
Nov 18 17:03:37 user nova-compute[74743]:   </metadata>
Nov 18 17:03:37 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:03:37 user nova-compute[74743]:     <system>
Nov 18 17:03:37 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:03:37 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:03:37 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:03:37 user nova-compute[74743]:       <entry name="serial">c006a4ad-a8e2-4108-9af1-dec4dd53fcda</entry>
Nov 18 17:03:37 user nova-compute[74743]:       <entry name="uuid">c006a4ad-a8e2-4108-9af1-dec4dd53fcda</entry>
Nov 18 17:03:37 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:03:37 user nova-compute[74743]:     </system>
Nov 18 17:03:37 user nova-compute[74743]:   </sysinfo>
Nov 18 17:03:37 user nova-compute[74743]:   <os>
Nov 18 17:03:37 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:03:37 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:03:37 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:03:37 user nova-compute[74743]:   </os>
Nov 18 17:03:37 user nova-compute[74743]:   <features>
Nov 18 17:03:37 user nova-compute[74743]:     <acpi/>
Nov 18 17:03:37 user nova-compute[74743]:     <apic/>
Nov 18 17:03:37 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:03:37 user nova-compute[74743]:   </features>
Nov 18 17:03:37 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:03:37 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:03:37 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:03:37 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:03:37 user nova-compute[74743]:   </clock>
Nov 18 17:03:37 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:03:37 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:03:37 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:03:37 user nova-compute[74743]:   </cpu>
Nov 18 17:03:37 user nova-compute[74743]:   <devices>
Nov 18 17:03:37 user nova-compute[74743]:     <disk type="file" device="disk">
Nov 18 17:03:37 user nova-compute[74743]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 17:03:37 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk"/>
Nov 18 17:03:37 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:03:37 user nova-compute[74743]:     </disk>
Nov 18 17:03:37 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:03:37 user nova-compute[74743]:       <mac address="fa:16:3e:e4:7e:f3"/>
Nov 18 17:03:37 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:03:37 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:03:37 user nova-compute[74743]:       <target dev="tap999980cf-ef"/>
Nov 18 17:03:37 user nova-compute[74743]:     </interface>
Nov 18 17:03:37 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:03:37 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/console.log" append="off"/>
Nov 18 17:03:37 user nova-compute[74743]:     </serial>
Nov 18 17:03:37 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:03:37 user nova-compute[74743]:     <video>
Nov 18 17:03:37 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:03:37 user nova-compute[74743]:     </video>
Nov 18 17:03:37 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:03:37 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:03:37 user nova-compute[74743]:     </rng>
Nov 18 17:03:37 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:03:37 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:03:37 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:03:37 user nova-compute[74743]:     </memballoon>
Nov 18 17:03:37 user nova-compute[74743]:   </devices>
Nov 18 17:03:37 user nova-compute[74743]: </domain>
Nov 18 17:03:37 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:03:37 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:03:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-712226846',display_name='tempest-ServerActionsTestOtherA-server-712226846',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-712226846',id=4,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEVphqV0ovLOhWV5c4OtZaZAghiX4KqdCUzcXRNxI8zWTbqX3YOGnG7iLQKSTFxu3amDks//fytVOc70uGuSKqNKUeaE/kY0CmyGU71j0ZYQPWjJeA0I0UUP+FZUS4MWQ==',key_name='tempest-keypair-1212996543',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb8f5850162c479b8d185e48c03be7d3',ramdisk_id='',reservation_id='r-642m5qx1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-128885625',owner_user_name='tempest-ServerActionsTestOtherA-128885625-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:03:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce3e4cef47114a7c9327db639460d923',uuid=c006a4ad-a8e2-4108-9af1-dec4dd53fcda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "999980cf-efd0-4b78-aa42-f4e80073b5a9", "address": "fa:16:3e:e4:7e:f3", "network": {"id": "fd98f398-6576-449b-a737-887906eb6656", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668610993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb8f5850162c479b8d185e48c03be7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap999980cf-ef", "ovs_interfaceid": "999980cf-efd0-4b78-aa42-f4e80073b5a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:03:37 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Converting VIF {"id": "999980cf-efd0-4b78-aa42-f4e80073b5a9", "address": "fa:16:3e:e4:7e:f3", "network": {"id": "fd98f398-6576-449b-a737-887906eb6656", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668610993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb8f5850162c479b8d185e48c03be7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap999980cf-ef", "ovs_interfaceid": "999980cf-efd0-4b78-aa42-f4e80073b5a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:03:37 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:7e:f3,bridge_name='br-int',has_traffic_filtering=True,id=999980cf-efd0-4b78-aa42-f4e80073b5a9,network=Network(fd98f398-6576-449b-a737-887906eb6656),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap999980cf-ef') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:03:37 user nova-compute[74743]: DEBUG os_vif [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:7e:f3,bridge_name='br-int',has_traffic_filtering=True,id=999980cf-efd0-4b78-aa42-f4e80073b5a9,network=Network(fd98f398-6576-449b-a737-887906eb6656),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap999980cf-ef') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:03:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:03:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:03:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2aeb3a5e-d2d7-52b9-8957-f80e49102433', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:03:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:03:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap999980cf-ef, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:03:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap999980cf-ef, col_values=(('qos', UUID('5058523e-72f2-49b3-9b16-b6d64728aaa9')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:03:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap999980cf-ef, col_values=(('external_ids', {'iface-id': '999980cf-efd0-4b78-aa42-f4e80073b5a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:7e:f3', 'vm-uuid': 'c006a4ad-a8e2-4108-9af1-dec4dd53fcda'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:03:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:03:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:37 user nova-compute[74743]: INFO os_vif [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:7e:f3,bridge_name='br-int',has_traffic_filtering=True,id=999980cf-efd0-4b78-aa42-f4e80073b5a9,network=Network(fd98f398-6576-449b-a737-887906eb6656),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap999980cf-ef')
Nov 18 17:03:37 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:03:37 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] No VIF found with MAC fa:16:3e:e4:7e:f3, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:03:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:38 user nova-compute[74743]: DEBUG nova.compute.manager [req-23224e3d-8093-4003-bd44-a8fbea9ba0ce req-e69ea54e-63b0-4a8b-87dd-5a607946ce7d service nova] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Received event network-vif-plugged-28f81291-34bb-4a6f-890b-faea6ef8a385 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:03:38 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-23224e3d-8093-4003-bd44-a8fbea9ba0ce req-e69ea54e-63b0-4a8b-87dd-5a607946ce7d service nova] Acquiring lock "4cce1628-2dcb-40c7-abd4-6a327a432de3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:03:38 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-23224e3d-8093-4003-bd44-a8fbea9ba0ce req-e69ea54e-63b0-4a8b-87dd-5a607946ce7d service nova] Lock "4cce1628-2dcb-40c7-abd4-6a327a432de3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:03:38 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-23224e3d-8093-4003-bd44-a8fbea9ba0ce req-e69ea54e-63b0-4a8b-87dd-5a607946ce7d service nova] Lock "4cce1628-2dcb-40c7-abd4-6a327a432de3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:03:38 user nova-compute[74743]: DEBUG nova.compute.manager [req-23224e3d-8093-4003-bd44-a8fbea9ba0ce req-e69ea54e-63b0-4a8b-87dd-5a607946ce7d service nova] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] No waiting events found dispatching network-vif-plugged-28f81291-34bb-4a6f-890b-faea6ef8a385 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:03:38 user nova-compute[74743]: WARNING nova.compute.manager [req-23224e3d-8093-4003-bd44-a8fbea9ba0ce req-e69ea54e-63b0-4a8b-87dd-5a607946ce7d service nova] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Received unexpected event network-vif-plugged-28f81291-34bb-4a6f-890b-faea6ef8a385 for instance with vm_state active and task_state None.
Nov 18 17:03:38 user nova-compute[74743]: DEBUG nova.network.neutron [req-d3a6064c-ac74-419b-84c0-9713139aaf27 req-33055017-3b5e-4baf-a242-5b034c833153 service nova] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Updated VIF entry in instance network info cache for port 999980cf-efd0-4b78-aa42-f4e80073b5a9. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:03:38 user nova-compute[74743]: DEBUG nova.network.neutron [req-d3a6064c-ac74-419b-84c0-9713139aaf27 req-33055017-3b5e-4baf-a242-5b034c833153 service nova] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Updating instance_info_cache with network_info: [{"id": "999980cf-efd0-4b78-aa42-f4e80073b5a9", "address": "fa:16:3e:e4:7e:f3", "network": {"id": "fd98f398-6576-449b-a737-887906eb6656", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668610993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb8f5850162c479b8d185e48c03be7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap999980cf-ef", "ovs_interfaceid": "999980cf-efd0-4b78-aa42-f4e80073b5a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:03:38 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d3a6064c-ac74-419b-84c0-9713139aaf27 req-33055017-3b5e-4baf-a242-5b034c833153 service nova] Releasing lock "refresh_cache-c006a4ad-a8e2-4108-9af1-dec4dd53fcda" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:03:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:39 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Acquiring lock "55192f7b-5aaf-42e6-926a-cf9f43e460ca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:03:39 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Lock "55192f7b-5aaf-42e6-926a-cf9f43e460ca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.005s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:03:39 user nova-compute[74743]: DEBUG nova.compute.manager [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Starting instance... {{(pid=74743) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 17:03:39 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:03:39 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:03:39 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74743) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 17:03:39 user nova-compute[74743]: INFO nova.compute.claims [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Claim successful on node user
Nov 18 17:03:40 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:40 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:40 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:40 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:40 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:03:40 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:03:40 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.510s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:03:40 user nova-compute[74743]: DEBUG nova.compute.manager [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Start building networks asynchronously for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 17:03:40 user nova-compute[74743]: DEBUG nova.compute.manager [req-1206e035-386d-4821-ad8b-c41cef34da0e req-e8e166ee-eb63-471c-b474-84b8bc89be8e service nova] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Received event network-vif-plugged-28f81291-34bb-4a6f-890b-faea6ef8a385 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:03:40 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-1206e035-386d-4821-ad8b-c41cef34da0e req-e8e166ee-eb63-471c-b474-84b8bc89be8e service nova] Acquiring lock "4cce1628-2dcb-40c7-abd4-6a327a432de3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:03:40 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-1206e035-386d-4821-ad8b-c41cef34da0e req-e8e166ee-eb63-471c-b474-84b8bc89be8e service nova] Lock "4cce1628-2dcb-40c7-abd4-6a327a432de3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:03:40 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-1206e035-386d-4821-ad8b-c41cef34da0e req-e8e166ee-eb63-471c-b474-84b8bc89be8e service nova] Lock "4cce1628-2dcb-40c7-abd4-6a327a432de3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:03:40 user nova-compute[74743]: DEBUG nova.compute.manager [req-1206e035-386d-4821-ad8b-c41cef34da0e req-e8e166ee-eb63-471c-b474-84b8bc89be8e service nova] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] No waiting events found dispatching network-vif-plugged-28f81291-34bb-4a6f-890b-faea6ef8a385 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:03:40 user nova-compute[74743]: WARNING nova.compute.manager [req-1206e035-386d-4821-ad8b-c41cef34da0e req-e8e166ee-eb63-471c-b474-84b8bc89be8e service nova] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Received unexpected event network-vif-plugged-28f81291-34bb-4a6f-890b-faea6ef8a385 for instance with vm_state active and task_state None.
Nov 18 17:03:40 user nova-compute[74743]: DEBUG nova.compute.manager [req-1206e035-386d-4821-ad8b-c41cef34da0e req-e8e166ee-eb63-471c-b474-84b8bc89be8e service nova] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Received event network-vif-plugged-fcc120f5-04f4-4675-817c-5161cc09a972 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:03:40 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-1206e035-386d-4821-ad8b-c41cef34da0e req-e8e166ee-eb63-471c-b474-84b8bc89be8e service nova] Acquiring lock "e9668e1c-1e8d-4dd7-8f58-d453db294557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:03:40 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-1206e035-386d-4821-ad8b-c41cef34da0e req-e8e166ee-eb63-471c-b474-84b8bc89be8e service nova] Lock "e9668e1c-1e8d-4dd7-8f58-d453db294557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:03:40 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-1206e035-386d-4821-ad8b-c41cef34da0e req-e8e166ee-eb63-471c-b474-84b8bc89be8e service nova] Lock "e9668e1c-1e8d-4dd7-8f58-d453db294557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:03:40 user nova-compute[74743]: DEBUG nova.compute.manager [req-1206e035-386d-4821-ad8b-c41cef34da0e req-e8e166ee-eb63-471c-b474-84b8bc89be8e service nova] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] No waiting events found dispatching network-vif-plugged-fcc120f5-04f4-4675-817c-5161cc09a972 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:03:40 user nova-compute[74743]: WARNING nova.compute.manager [req-1206e035-386d-4821-ad8b-c41cef34da0e req-e8e166ee-eb63-471c-b474-84b8bc89be8e service nova] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Received unexpected event network-vif-plugged-fcc120f5-04f4-4675-817c-5161cc09a972 for instance with vm_state active and task_state None.
Nov 18 17:03:40 user nova-compute[74743]: DEBUG nova.compute.manager [req-1206e035-386d-4821-ad8b-c41cef34da0e req-e8e166ee-eb63-471c-b474-84b8bc89be8e service nova] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Received event network-vif-plugged-fcc120f5-04f4-4675-817c-5161cc09a972 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:03:40 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-1206e035-386d-4821-ad8b-c41cef34da0e req-e8e166ee-eb63-471c-b474-84b8bc89be8e service nova] Acquiring lock "e9668e1c-1e8d-4dd7-8f58-d453db294557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:03:40 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-1206e035-386d-4821-ad8b-c41cef34da0e req-e8e166ee-eb63-471c-b474-84b8bc89be8e service nova] Lock "e9668e1c-1e8d-4dd7-8f58-d453db294557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:03:40 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-1206e035-386d-4821-ad8b-c41cef34da0e req-e8e166ee-eb63-471c-b474-84b8bc89be8e service nova] Lock "e9668e1c-1e8d-4dd7-8f58-d453db294557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:03:40 user nova-compute[74743]: DEBUG nova.compute.manager [req-1206e035-386d-4821-ad8b-c41cef34da0e req-e8e166ee-eb63-471c-b474-84b8bc89be8e service nova] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] No waiting events found dispatching network-vif-plugged-fcc120f5-04f4-4675-817c-5161cc09a972 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:03:40 user nova-compute[74743]: WARNING nova.compute.manager [req-1206e035-386d-4821-ad8b-c41cef34da0e req-e8e166ee-eb63-471c-b474-84b8bc89be8e service nova] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Received unexpected event network-vif-plugged-fcc120f5-04f4-4675-817c-5161cc09a972 for instance with vm_state active and task_state None.
Nov 18 17:03:40 user nova-compute[74743]: DEBUG nova.compute.manager [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Allocating IP information in the background. {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 17:03:40 user nova-compute[74743]: DEBUG nova.network.neutron [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] allocate_for_instance() {{(pid=74743) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 17:03:40 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 17:03:40 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:40 user nova-compute[74743]: DEBUG nova.compute.manager [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Start building block device mappings for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 17:03:40 user nova-compute[74743]: DEBUG nova.policy [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '99af9f03493348bebcc384eb94d8ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c967f66b058543878a89b86b4791d5fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74743) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 17:03:40 user nova-compute[74743]: DEBUG nova.compute.manager [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Start spawning the instance on the hypervisor. {{(pid=74743) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 17:03:40 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Creating instance directory {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 17:03:40 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Creating image(s)
Nov 18 17:03:40 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Acquiring lock "/opt/stack/data/nova/instances/55192f7b-5aaf-42e6-926a-cf9f43e460ca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:03:40 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Lock "/opt/stack/data/nova/instances/55192f7b-5aaf-42e6-926a-cf9f43e460ca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:03:40 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Lock "/opt/stack/data/nova/instances/55192f7b-5aaf-42e6-926a-cf9f43e460ca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:03:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:03:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.262s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:03:41 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:41 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Acquiring lock "c188b3a997bfafa42fa341f9dcc326545681eed9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:03:41 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:03:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:03:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.303s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:03:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/55192f7b-5aaf-42e6-926a-cf9f43e460ca/disk 1073741824 {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:03:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/55192f7b-5aaf-42e6-926a-cf9f43e460ca/disk 1073741824" returned: 0 in 0.071s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:03:41 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.383s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:03:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:03:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.268s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:03:41 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Checking if we can resize image /opt/stack/data/nova/instances/55192f7b-5aaf-42e6-926a-cf9f43e460ca/disk. size=1073741824 {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 17:03:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55192f7b-5aaf-42e6-926a-cf9f43e460ca/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:03:42 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55192f7b-5aaf-42e6-926a-cf9f43e460ca/disk --force-share --output=json" returned: 0 in 0.304s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:03:42 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Cannot resize image /opt/stack/data/nova/instances/55192f7b-5aaf-42e6-926a-cf9f43e460ca/disk to a smaller size. {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 17:03:42 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Created local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 17:03:42 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Ensure instance console log exists: /opt/stack/data/nova/instances/55192f7b-5aaf-42e6-926a-cf9f43e460ca/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:03:42 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:03:42 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:03:42 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:03:42 user nova-compute[74743]: DEBUG nova.compute.manager [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:03:42 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Guest created on hypervisor {{(pid=74743) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 17:03:42 user nova-compute[74743]: DEBUG nova.network.neutron [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Successfully created port: 3fecf596-29c4-44af-bbe1-25589e8aa794 {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:03:42 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Instance spawned successfully.
Nov 18 17:03:42 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 17:03:42 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:42 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Found default for hw_cdrom_bus of ide {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:03:42 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Found default for hw_disk_bus of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:03:42 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Found default for hw_input_bus of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:03:42 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Found default for hw_pointer_model of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:03:42 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Found default for hw_video_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:03:42 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Found default for hw_vif_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:03:42 user nova-compute[74743]: INFO nova.compute.manager [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Took 9.15 seconds to spawn the instance on the hypervisor.
Nov 18 17:03:42 user nova-compute[74743]: DEBUG nova.compute.manager [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:03:42 user nova-compute[74743]: INFO nova.compute.manager [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Took 10.35 seconds to build instance.
Nov 18 17:03:42 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-10b7a164-6824-4666-92d3-9c5f9491fde3 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "c006a4ad-a8e2-4108-9af1-dec4dd53fcda" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.507s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:03:44 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:45 user nova-compute[74743]: DEBUG nova.network.neutron [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Successfully updated port: 3fecf596-29c4-44af-bbe1-25589e8aa794 {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:03:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Acquiring lock "refresh_cache-55192f7b-5aaf-42e6-926a-cf9f43e460ca" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:03:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Acquired lock "refresh_cache-55192f7b-5aaf-42e6-926a-cf9f43e460ca" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:03:45 user nova-compute[74743]: DEBUG nova.network.neutron [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:03:45 user nova-compute[74743]: DEBUG nova.compute.manager [req-2d97cfbc-99ea-459b-91be-d097f85305b0 req-75e660f2-5050-40e9-b608-ffa5514931c3 service nova] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Received event network-changed-3fecf596-29c4-44af-bbe1-25589e8aa794 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:03:45 user nova-compute[74743]: DEBUG nova.compute.manager [req-2d97cfbc-99ea-459b-91be-d097f85305b0 req-75e660f2-5050-40e9-b608-ffa5514931c3 service nova] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Refreshing instance network info cache due to event network-changed-3fecf596-29c4-44af-bbe1-25589e8aa794. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:03:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-2d97cfbc-99ea-459b-91be-d097f85305b0 req-75e660f2-5050-40e9-b608-ffa5514931c3 service nova] Acquiring lock "refresh_cache-55192f7b-5aaf-42e6-926a-cf9f43e460ca" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:03:45 user nova-compute[74743]: DEBUG nova.network.neutron [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:03:46 user nova-compute[74743]: DEBUG nova.network.neutron [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Updating instance_info_cache with network_info: [{"id": "3fecf596-29c4-44af-bbe1-25589e8aa794", "address": "fa:16:3e:1c:10:2b", "network": {"id": "7537df91-4e59-4569-88de-6dbbd9d5a4e4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1983739170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c967f66b058543878a89b86b4791d5fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fecf596-29", "ovs_interfaceid": "3fecf596-29c4-44af-bbe1-25589e8aa794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:03:46 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Releasing lock "refresh_cache-55192f7b-5aaf-42e6-926a-cf9f43e460ca" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:03:46 user nova-compute[74743]: DEBUG nova.compute.manager [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Instance network_info: |[{"id": "3fecf596-29c4-44af-bbe1-25589e8aa794", "address": "fa:16:3e:1c:10:2b", "network": {"id": "7537df91-4e59-4569-88de-6dbbd9d5a4e4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1983739170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c967f66b058543878a89b86b4791d5fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fecf596-29", "ovs_interfaceid": "3fecf596-29c4-44af-bbe1-25589e8aa794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 17:03:46 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-2d97cfbc-99ea-459b-91be-d097f85305b0 req-75e660f2-5050-40e9-b608-ffa5514931c3 service nova] Acquired lock "refresh_cache-55192f7b-5aaf-42e6-926a-cf9f43e460ca" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:03:46 user nova-compute[74743]: DEBUG nova.network.neutron [req-2d97cfbc-99ea-459b-91be-d097f85305b0 req-75e660f2-5050-40e9-b608-ffa5514931c3 service nova] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Refreshing network info cache for port 3fecf596-29c4-44af-bbe1-25589e8aa794 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:03:46 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Start _get_guest_xml network_info=[{"id": "3fecf596-29c4-44af-bbe1-25589e8aa794", "address": "fa:16:3e:1c:10:2b", "network": {"id": "7537df91-4e59-4569-88de-6dbbd9d5a4e4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1983739170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c967f66b058543878a89b86b4791d5fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fecf596-29", "ovs_interfaceid": "3fecf596-29c4-44af-bbe1-25589e8aa794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '9536f6cf-95c4-40e2-864a-09a91525678a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:03:46 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:03:46 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:03:46 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:03:46 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:03:46 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:03:46 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:03:46 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:03:46 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:03:46 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:03:46 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:03:46 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:03:46 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:03:46 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:03:46 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:03:46 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:03:46 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:03:46 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:03:46 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:03:46 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:03:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1823884685',display_name='tempest-VolumesAdminNegativeTest-server-1823884685',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1823884685',id=5,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGPP9lsksFArxs5iFHEi8PYNNWvHYUdLAawuA/+1ivjm+ignM6Cd64ss5YopxV/XhvvrnyE/R11ZJ1l1zaKGVNIZhPKveeZ3qoPb4hibnTVIXDBiAVztQNo6XMZlH4rItA==',key_name='tempest-keypair-863170876',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c967f66b058543878a89b86b4791d5fc',ramdisk_id='',reservation_id='r-946otidy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-18073692',owner_user_name='tempest-VolumesAdminNegativeTest-18073692-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:03:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99af9f03493348bebcc384eb94d8ea9a',uuid=55192f7b-5aaf-42e6-926a-cf9f43e460ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3fecf596-29c4-44af-bbe1-25589e8aa794", "address": "fa:16:3e:1c:10:2b", "network": {"id": "7537df91-4e59-4569-88de-6dbbd9d5a4e4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1983739170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c967f66b058543878a89b86b4791d5fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fecf596-29", "ovs_interfaceid": "3fecf596-29c4-44af-bbe1-25589e8aa794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:03:46 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Converting VIF {"id": "3fecf596-29c4-44af-bbe1-25589e8aa794", "address": "fa:16:3e:1c:10:2b", "network": {"id": "7537df91-4e59-4569-88de-6dbbd9d5a4e4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1983739170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c967f66b058543878a89b86b4791d5fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fecf596-29", "ovs_interfaceid": "3fecf596-29c4-44af-bbe1-25589e8aa794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:03:46 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:10:2b,bridge_name='br-int',has_traffic_filtering=True,id=3fecf596-29c4-44af-bbe1-25589e8aa794,network=Network(7537df91-4e59-4569-88de-6dbbd9d5a4e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fecf596-29') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:03:46 user nova-compute[74743]: DEBUG nova.objects.instance [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Lazy-loading 'pci_devices' on Instance uuid 55192f7b-5aaf-42e6-926a-cf9f43e460ca {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:03:46 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:03:46 user nova-compute[74743]:   <uuid>55192f7b-5aaf-42e6-926a-cf9f43e460ca</uuid>
Nov 18 17:03:46 user nova-compute[74743]:   <name>instance-00000005</name>
Nov 18 17:03:46 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:03:46 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:03:46 user nova-compute[74743]:   <metadata>
Nov 18 17:03:46 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:03:46 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:03:46 user nova-compute[74743]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1823884685</nova:name>
Nov 18 17:03:46 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:03:46</nova:creationTime>
Nov 18 17:03:46 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:03:46 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:03:46 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:03:46 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:03:46 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:03:46 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:03:46 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:03:46 user nova-compute[74743]:       <nova:owner>
Nov 18 17:03:46 user nova-compute[74743]:         <nova:user uuid="99af9f03493348bebcc384eb94d8ea9a">tempest-VolumesAdminNegativeTest-18073692-project-member</nova:user>
Nov 18 17:03:46 user nova-compute[74743]:         <nova:project uuid="c967f66b058543878a89b86b4791d5fc">tempest-VolumesAdminNegativeTest-18073692</nova:project>
Nov 18 17:03:46 user nova-compute[74743]:       </nova:owner>
Nov 18 17:03:46 user nova-compute[74743]:       <nova:root type="image" uuid="9536f6cf-95c4-40e2-864a-09a91525678a"/>
Nov 18 17:03:46 user nova-compute[74743]:       <nova:ports>
Nov 18 17:03:46 user nova-compute[74743]:         <nova:port uuid="3fecf596-29c4-44af-bbe1-25589e8aa794">
Nov 18 17:03:46 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 18 17:03:46 user nova-compute[74743]:         </nova:port>
Nov 18 17:03:46 user nova-compute[74743]:       </nova:ports>
Nov 18 17:03:46 user nova-compute[74743]:     </nova:instance>
Nov 18 17:03:46 user nova-compute[74743]:   </metadata>
Nov 18 17:03:46 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:03:46 user nova-compute[74743]:     <system>
Nov 18 17:03:46 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:03:46 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:03:46 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:03:46 user nova-compute[74743]:       <entry name="serial">55192f7b-5aaf-42e6-926a-cf9f43e460ca</entry>
Nov 18 17:03:46 user nova-compute[74743]:       <entry name="uuid">55192f7b-5aaf-42e6-926a-cf9f43e460ca</entry>
Nov 18 17:03:46 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:03:46 user nova-compute[74743]:     </system>
Nov 18 17:03:46 user nova-compute[74743]:   </sysinfo>
Nov 18 17:03:46 user nova-compute[74743]:   <os>
Nov 18 17:03:46 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:03:46 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:03:46 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:03:46 user nova-compute[74743]:   </os>
Nov 18 17:03:46 user nova-compute[74743]:   <features>
Nov 18 17:03:46 user nova-compute[74743]:     <acpi/>
Nov 18 17:03:46 user nova-compute[74743]:     <apic/>
Nov 18 17:03:46 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:03:46 user nova-compute[74743]:   </features>
Nov 18 17:03:46 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:03:46 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:03:46 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:03:46 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:03:46 user nova-compute[74743]:   </clock>
Nov 18 17:03:46 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:03:46 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:03:46 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:03:46 user nova-compute[74743]:   </cpu>
Nov 18 17:03:46 user nova-compute[74743]:   <devices>
Nov 18 17:03:46 user nova-compute[74743]:     <disk type="file" device="disk">
Nov 18 17:03:46 user nova-compute[74743]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 17:03:46 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/55192f7b-5aaf-42e6-926a-cf9f43e460ca/disk"/>
Nov 18 17:03:46 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:03:46 user nova-compute[74743]:     </disk>
Nov 18 17:03:46 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:03:46 user nova-compute[74743]:       <mac address="fa:16:3e:1c:10:2b"/>
Nov 18 17:03:46 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:03:46 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:03:46 user nova-compute[74743]:       <target dev="tap3fecf596-29"/>
Nov 18 17:03:46 user nova-compute[74743]:     </interface>
Nov 18 17:03:46 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:03:46 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/55192f7b-5aaf-42e6-926a-cf9f43e460ca/console.log" append="off"/>
Nov 18 17:03:46 user nova-compute[74743]:     </serial>
Nov 18 17:03:46 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:03:46 user nova-compute[74743]:     <video>
Nov 18 17:03:46 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:03:46 user nova-compute[74743]:     </video>
Nov 18 17:03:46 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:03:46 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:03:46 user nova-compute[74743]:     </rng>
Nov 18 17:03:46 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:03:46 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:03:46 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:03:46 user nova-compute[74743]:     </memballoon>
Nov 18 17:03:46 user nova-compute[74743]:   </devices>
Nov 18 17:03:46 user nova-compute[74743]: </domain>
Nov 18 17:03:46 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:03:46 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:03:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1823884685',display_name='tempest-VolumesAdminNegativeTest-server-1823884685',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1823884685',id=5,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGPP9lsksFArxs5iFHEi8PYNNWvHYUdLAawuA/+1ivjm+ignM6Cd64ss5YopxV/XhvvrnyE/R11ZJ1l1zaKGVNIZhPKveeZ3qoPb4hibnTVIXDBiAVztQNo6XMZlH4rItA==',key_name='tempest-keypair-863170876',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c967f66b058543878a89b86b4791d5fc',ramdisk_id='',reservation_id='r-946otidy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-18073692',owner_user_name='tempest-VolumesAdminNegativeTest-18073692-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:03:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99af9f03493348bebcc384eb94d8ea9a',uuid=55192f7b-5aaf-42e6-926a-cf9f43e460ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3fecf596-29c4-44af-bbe1-25589e8aa794", "address": "fa:16:3e:1c:10:2b", "network": {"id": "7537df91-4e59-4569-88de-6dbbd9d5a4e4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1983739170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c967f66b058543878a89b86b4791d5fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fecf596-29", "ovs_interfaceid": "3fecf596-29c4-44af-bbe1-25589e8aa794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:03:46 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Converting VIF {"id": "3fecf596-29c4-44af-bbe1-25589e8aa794", "address": "fa:16:3e:1c:10:2b", "network": {"id": "7537df91-4e59-4569-88de-6dbbd9d5a4e4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1983739170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c967f66b058543878a89b86b4791d5fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fecf596-29", "ovs_interfaceid": "3fecf596-29c4-44af-bbe1-25589e8aa794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:03:46 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:10:2b,bridge_name='br-int',has_traffic_filtering=True,id=3fecf596-29c4-44af-bbe1-25589e8aa794,network=Network(7537df91-4e59-4569-88de-6dbbd9d5a4e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fecf596-29') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:03:46 user nova-compute[74743]: DEBUG os_vif [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:10:2b,bridge_name='br-int',has_traffic_filtering=True,id=3fecf596-29c4-44af-bbe1-25589e8aa794,network=Network(7537df91-4e59-4569-88de-6dbbd9d5a4e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fecf596-29') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:03:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:03:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:03:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '327f4120-f493-59e0-a118-ecc70e19eea8', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:03:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3fecf596-29, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:03:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3fecf596-29, col_values=(('qos', UUID('8d347003-b3ef-4a1a-8759-a51c87e05494')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:03:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3fecf596-29, col_values=(('external_ids', {'iface-id': '3fecf596-29c4-44af-bbe1-25589e8aa794', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:10:2b', 'vm-uuid': '55192f7b-5aaf-42e6-926a-cf9f43e460ca'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:03:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:03:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:46 user nova-compute[74743]: INFO os_vif [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:10:2b,bridge_name='br-int',has_traffic_filtering=True,id=3fecf596-29c4-44af-bbe1-25589e8aa794,network=Network(7537df91-4e59-4569-88de-6dbbd9d5a4e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fecf596-29')
Nov 18 17:03:46 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:03:46 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] No VIF found with MAC fa:16:3e:1c:10:2b, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:03:47 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Acquiring lock "8e6111e9-59e9-4a30-870c-3d308a5d4936" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:03:47 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Lock "8e6111e9-59e9-4a30-870c-3d308a5d4936" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:03:47 user nova-compute[74743]: DEBUG nova.compute.manager [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Starting instance... {{(pid=74743) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 17:03:47 user nova-compute[74743]: DEBUG nova.network.neutron [req-2d97cfbc-99ea-459b-91be-d097f85305b0 req-75e660f2-5050-40e9-b608-ffa5514931c3 service nova] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Updated VIF entry in instance network info cache for port 3fecf596-29c4-44af-bbe1-25589e8aa794. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:03:47 user nova-compute[74743]: DEBUG nova.network.neutron [req-2d97cfbc-99ea-459b-91be-d097f85305b0 req-75e660f2-5050-40e9-b608-ffa5514931c3 service nova] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Updating instance_info_cache with network_info: [{"id": "3fecf596-29c4-44af-bbe1-25589e8aa794", "address": "fa:16:3e:1c:10:2b", "network": {"id": "7537df91-4e59-4569-88de-6dbbd9d5a4e4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1983739170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c967f66b058543878a89b86b4791d5fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fecf596-29", "ovs_interfaceid": "3fecf596-29c4-44af-bbe1-25589e8aa794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:03:47 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-2d97cfbc-99ea-459b-91be-d097f85305b0 req-75e660f2-5050-40e9-b608-ffa5514931c3 service nova] Releasing lock "refresh_cache-55192f7b-5aaf-42e6-926a-cf9f43e460ca" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:03:47 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:03:47 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:03:47 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74743) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 17:03:47 user nova-compute[74743]: INFO nova.compute.claims [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Claim successful on node user
Nov 18 17:03:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:48 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:03:48 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:03:48 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.108s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:03:48 user nova-compute[74743]: DEBUG nova.compute.manager [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Start building networks asynchronously for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 17:03:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:48 user nova-compute[74743]: DEBUG nova.compute.manager [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Allocating IP information in the background. {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 17:03:48 user nova-compute[74743]: DEBUG nova.network.neutron [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] allocate_for_instance() {{(pid=74743) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 17:03:48 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 18 17:03:48 user nova-compute[74743]: DEBUG nova.compute.manager [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Start building block device mappings for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 17:03:49 user nova-compute[74743]: DEBUG nova.policy [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2edb384cc4d249a2b07528a6e2d90ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16de5043b38d4b3f8b1eccc4fed18acb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74743) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 17:03:49 user nova-compute[74743]: DEBUG nova.compute.manager [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Start spawning the instance on the hypervisor. {{(pid=74743) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 17:03:49 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Creating instance directory {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 17:03:49 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Creating image(s)
Nov 18 17:03:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Acquiring lock "/opt/stack/data/nova/instances/8e6111e9-59e9-4a30-870c-3d308a5d4936/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:03:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Lock "/opt/stack/data/nova/instances/8e6111e9-59e9-4a30-870c-3d308a5d4936/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:03:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Lock "/opt/stack/data/nova/instances/8e6111e9-59e9-4a30-870c-3d308a5d4936/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:03:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Acquiring lock "d533b2f6dacc26adc738fb527040eb2b7eb1698d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:03:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Lock "d533b2f6dacc26adc738fb527040eb2b7eb1698d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:03:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d533b2f6dacc26adc738fb527040eb2b7eb1698d.part --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:03:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:50 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d533b2f6dacc26adc738fb527040eb2b7eb1698d.part --force-share --output=json" returned: 0 in 0.269s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:03:50 user nova-compute[74743]: DEBUG nova.virt.images [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] 322d9677-06f7-4b08-be88-9fffc98cac29 was qcow2, converting to raw {{(pid=74743) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 18 17:03:50 user nova-compute[74743]: DEBUG nova.privsep.utils [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74743) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 18 17:03:50 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d533b2f6dacc26adc738fb527040eb2b7eb1698d.part /opt/stack/data/nova/instances/_base/d533b2f6dacc26adc738fb527040eb2b7eb1698d.converted {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:03:50 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d533b2f6dacc26adc738fb527040eb2b7eb1698d.part /opt/stack/data/nova/instances/_base/d533b2f6dacc26adc738fb527040eb2b7eb1698d.converted" returned: 0 in 0.249s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:03:50 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d533b2f6dacc26adc738fb527040eb2b7eb1698d.converted --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:03:50 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d533b2f6dacc26adc738fb527040eb2b7eb1698d.converted --force-share --output=json" returned: 0 in 0.239s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:03:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Lock "d533b2f6dacc26adc738fb527040eb2b7eb1698d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.397s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:03:50 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d533b2f6dacc26adc738fb527040eb2b7eb1698d --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:03:50 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d533b2f6dacc26adc738fb527040eb2b7eb1698d --force-share --output=json" returned: 0 in 0.247s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:03:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Acquiring lock "d533b2f6dacc26adc738fb527040eb2b7eb1698d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:03:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Lock "d533b2f6dacc26adc738fb527040eb2b7eb1698d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:03:50 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d533b2f6dacc26adc738fb527040eb2b7eb1698d --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:03:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d533b2f6dacc26adc738fb527040eb2b7eb1698d --force-share --output=json" returned: 0 in 0.207s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:03:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d533b2f6dacc26adc738fb527040eb2b7eb1698d,backing_fmt=raw /opt/stack/data/nova/instances/8e6111e9-59e9-4a30-870c-3d308a5d4936/disk 1073741824 {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:03:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d533b2f6dacc26adc738fb527040eb2b7eb1698d,backing_fmt=raw /opt/stack/data/nova/instances/8e6111e9-59e9-4a30-870c-3d308a5d4936/disk 1073741824" returned: 0 in 0.055s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:03:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Lock "d533b2f6dacc26adc738fb527040eb2b7eb1698d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:03:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d533b2f6dacc26adc738fb527040eb2b7eb1698d --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:03:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d533b2f6dacc26adc738fb527040eb2b7eb1698d --force-share --output=json" returned: 0 in 0.243s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:03:51 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8e6111e9-59e9-4a30-870c-3d308a5d4936/disk. size=1073741824 {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 17:03:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6111e9-59e9-4a30-870c-3d308a5d4936/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:03:51 user nova-compute[74743]: DEBUG nova.compute.manager [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:03:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Guest created on hypervisor {{(pid=74743) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 17:03:51 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:51 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Instance spawned successfully.
Nov 18 17:03:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 17:03:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Found default for hw_cdrom_bus of ide {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:03:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Found default for hw_disk_bus of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:03:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Found default for hw_input_bus of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:03:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Found default for hw_pointer_model of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:03:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Found default for hw_video_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:03:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Found default for hw_vif_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:03:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6111e9-59e9-4a30-870c-3d308a5d4936/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:03:51 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Cannot resize image /opt/stack/data/nova/instances/8e6111e9-59e9-4a30-870c-3d308a5d4936/disk to a smaller size. {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 17:03:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Created local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 17:03:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Ensure instance console log exists: /opt/stack/data/nova/instances/8e6111e9-59e9-4a30-870c-3d308a5d4936/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:03:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:03:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:03:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:03:51 user nova-compute[74743]: INFO nova.compute.manager [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Took 10.88 seconds to spawn the instance on the hypervisor.
Nov 18 17:03:51 user nova-compute[74743]: DEBUG nova.compute.manager [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:03:51 user nova-compute[74743]: INFO nova.compute.manager [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Took 11.99 seconds to build instance.
Nov 18 17:03:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3b3e37b4-ddaa-4108-93ab-fc82c00f5b28 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Lock "55192f7b-5aaf-42e6-926a-cf9f43e460ca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.222s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:03:51 user nova-compute[74743]: DEBUG nova.network.neutron [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Successfully created port: 3b8c6ca6-189a-44fc-b8d5-d8ae5c501188 {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:03:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Acquiring lock "567feb03-a356-4347-b146-d8930ad60c11" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:03:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Lock "567feb03-a356-4347-b146-d8930ad60c11" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:03:53 user nova-compute[74743]: DEBUG nova.network.neutron [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Successfully updated port: 3b8c6ca6-189a-44fc-b8d5-d8ae5c501188 {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:03:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Acquiring lock "refresh_cache-8e6111e9-59e9-4a30-870c-3d308a5d4936" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:03:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Acquired lock "refresh_cache-8e6111e9-59e9-4a30-870c-3d308a5d4936" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:03:53 user nova-compute[74743]: DEBUG nova.network.neutron [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:03:53 user nova-compute[74743]: DEBUG nova.compute.manager [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Starting instance... {{(pid=74743) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 17:03:53 user nova-compute[74743]: DEBUG nova.compute.manager [req-20e57d5c-a000-40e9-b711-24011288651b req-424eb1ae-12e0-4b8c-99ca-f2af46675740 service nova] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Received event network-changed-3b8c6ca6-189a-44fc-b8d5-d8ae5c501188 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:03:53 user nova-compute[74743]: DEBUG nova.compute.manager [req-20e57d5c-a000-40e9-b711-24011288651b req-424eb1ae-12e0-4b8c-99ca-f2af46675740 service nova] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Refreshing instance network info cache due to event network-changed-3b8c6ca6-189a-44fc-b8d5-d8ae5c501188. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:03:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-20e57d5c-a000-40e9-b711-24011288651b req-424eb1ae-12e0-4b8c-99ca-f2af46675740 service nova] Acquiring lock "refresh_cache-8e6111e9-59e9-4a30-870c-3d308a5d4936" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:03:53 user nova-compute[74743]: DEBUG nova.network.neutron [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:03:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:03:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:03:53 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74743) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 17:03:53 user nova-compute[74743]: INFO nova.compute.claims [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Claim successful on node user
Nov 18 17:03:53 user nova-compute[74743]: DEBUG nova.network.neutron [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Updating instance_info_cache with network_info: [{"id": "3b8c6ca6-189a-44fc-b8d5-d8ae5c501188", "address": "fa:16:3e:8c:b5:bb", "network": {"id": "cf1ba269-6100-4ad9-88bb-9693137fd478", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1280411595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16de5043b38d4b3f8b1eccc4fed18acb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b8c6ca6-18", "ovs_interfaceid": "3b8c6ca6-189a-44fc-b8d5-d8ae5c501188", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Releasing lock "refresh_cache-8e6111e9-59e9-4a30-870c-3d308a5d4936" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG nova.compute.manager [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Instance network_info: |[{"id": "3b8c6ca6-189a-44fc-b8d5-d8ae5c501188", "address": "fa:16:3e:8c:b5:bb", "network": {"id": "cf1ba269-6100-4ad9-88bb-9693137fd478", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1280411595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16de5043b38d4b3f8b1eccc4fed18acb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b8c6ca6-18", "ovs_interfaceid": "3b8c6ca6-189a-44fc-b8d5-d8ae5c501188", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-20e57d5c-a000-40e9-b711-24011288651b req-424eb1ae-12e0-4b8c-99ca-f2af46675740 service nova] Acquired lock "refresh_cache-8e6111e9-59e9-4a30-870c-3d308a5d4936" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG nova.network.neutron [req-20e57d5c-a000-40e9-b711-24011288651b req-424eb1ae-12e0-4b8c-99ca-f2af46675740 service nova] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Refreshing network info cache for port 3b8c6ca6-189a-44fc-b8d5-d8ae5c501188 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Start _get_guest_xml network_info=[{"id": "3b8c6ca6-189a-44fc-b8d5-d8ae5c501188", "address": "fa:16:3e:8c:b5:bb", "network": {"id": "cf1ba269-6100-4ad9-88bb-9693137fd478", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1280411595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16de5043b38d4b3f8b1eccc4fed18acb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b8c6ca6-18", "ovs_interfaceid": "3b8c6ca6-189a-44fc-b8d5-d8ae5c501188", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T17:03:38Z,direct_url=<?>,disk_format='qcow2',id=322d9677-06f7-4b08-be88-9fffc98cac29,min_disk=0,min_ram=0,name='',owner='22f8a6bdafb442f3bfcca4ca72d1295d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T17:03:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'device_type': 'disk', 'device_name': '/dev/sda', 'guest_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'scsi', 'image_id': '322d9677-06f7-4b08-be88-9fffc98cac29'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:03:54 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:03:54 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:03:54 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T17:03:38Z,direct_url=<?>,disk_format='qcow2',id=322d9677-06f7-4b08-be88-9fffc98cac29,min_disk=0,min_ram=0,name='',owner='22f8a6bdafb442f3bfcca4ca72d1295d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T17:03:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T17:03:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-466821373',display_name='tempest-AttachSCSIVolumeTestJSON-server-466821373',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-466821373',id=6,image_ref='322d9677-06f7-4b08-be88-9fffc98cac29',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVayI6NJDJ6ndIrTQnGbHVl/zmbaufeiiLi9nS36Dia8lGCf9LIzHdhMloHXaFlyYWzcXaa4WOyMzaECwK2FjDqYqUSVgzKin34Zm0v05Yd4TyxIk3HYanaBkRLff3V0w==',key_name='tempest-keypair-1043222923',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16de5043b38d4b3f8b1eccc4fed18acb',ramdisk_id='',reservation_id='r-lr0uviy2',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='322d9677-06f7-4b08-be88-9fffc98cac29',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-74434130',owner_user_name='tempest-AttachSCSIVolumeTestJSON-74434130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:03:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2edb384cc4d249a2b07528a6e2d90ead',uuid=8e6111e9-59e9-4a30-870c-3d308a5d4936,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b8c6ca6-189a-44fc-b8d5-d8ae5c501188", "address": "fa:16:3e:8c:b5:bb", "network": {"id": "cf1ba269-6100-4ad9-88bb-9693137fd478", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1280411595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16de5043b38d4b3f8b1eccc4fed18acb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b8c6ca6-18", "ovs_interfaceid": "3b8c6ca6-189a-44fc-b8d5-d8ae5c501188", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Converting VIF {"id": "3b8c6ca6-189a-44fc-b8d5-d8ae5c501188", "address": "fa:16:3e:8c:b5:bb", "network": {"id": "cf1ba269-6100-4ad9-88bb-9693137fd478", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1280411595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16de5043b38d4b3f8b1eccc4fed18acb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b8c6ca6-18", "ovs_interfaceid": "3b8c6ca6-189a-44fc-b8d5-d8ae5c501188", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:b5:bb,bridge_name='br-int',has_traffic_filtering=True,id=3b8c6ca6-189a-44fc-b8d5-d8ae5c501188,network=Network(cf1ba269-6100-4ad9-88bb-9693137fd478),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b8c6ca6-18') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG nova.objects.instance [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e6111e9-59e9-4a30-870c-3d308a5d4936 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:03:54 user nova-compute[74743]:   <uuid>8e6111e9-59e9-4a30-870c-3d308a5d4936</uuid>
Nov 18 17:03:54 user nova-compute[74743]:   <name>instance-00000006</name>
Nov 18 17:03:54 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:03:54 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:03:54 user nova-compute[74743]:   <metadata>
Nov 18 17:03:54 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:03:54 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:03:54 user nova-compute[74743]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-466821373</nova:name>
Nov 18 17:03:54 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:03:54</nova:creationTime>
Nov 18 17:03:54 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:03:54 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:03:54 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:03:54 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:03:54 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:03:54 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:03:54 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:03:54 user nova-compute[74743]:       <nova:owner>
Nov 18 17:03:54 user nova-compute[74743]:         <nova:user uuid="2edb384cc4d249a2b07528a6e2d90ead">tempest-AttachSCSIVolumeTestJSON-74434130-project-member</nova:user>
Nov 18 17:03:54 user nova-compute[74743]:         <nova:project uuid="16de5043b38d4b3f8b1eccc4fed18acb">tempest-AttachSCSIVolumeTestJSON-74434130</nova:project>
Nov 18 17:03:54 user nova-compute[74743]:       </nova:owner>
Nov 18 17:03:54 user nova-compute[74743]:       <nova:root type="image" uuid="322d9677-06f7-4b08-be88-9fffc98cac29"/>
Nov 18 17:03:54 user nova-compute[74743]:       <nova:ports>
Nov 18 17:03:54 user nova-compute[74743]:         <nova:port uuid="3b8c6ca6-189a-44fc-b8d5-d8ae5c501188">
Nov 18 17:03:54 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 18 17:03:54 user nova-compute[74743]:         </nova:port>
Nov 18 17:03:54 user nova-compute[74743]:       </nova:ports>
Nov 18 17:03:54 user nova-compute[74743]:     </nova:instance>
Nov 18 17:03:54 user nova-compute[74743]:   </metadata>
Nov 18 17:03:54 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:03:54 user nova-compute[74743]:     <system>
Nov 18 17:03:54 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:03:54 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:03:54 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:03:54 user nova-compute[74743]:       <entry name="serial">8e6111e9-59e9-4a30-870c-3d308a5d4936</entry>
Nov 18 17:03:54 user nova-compute[74743]:       <entry name="uuid">8e6111e9-59e9-4a30-870c-3d308a5d4936</entry>
Nov 18 17:03:54 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:03:54 user nova-compute[74743]:     </system>
Nov 18 17:03:54 user nova-compute[74743]:   </sysinfo>
Nov 18 17:03:54 user nova-compute[74743]:   <os>
Nov 18 17:03:54 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:03:54 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:03:54 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:03:54 user nova-compute[74743]:   </os>
Nov 18 17:03:54 user nova-compute[74743]:   <features>
Nov 18 17:03:54 user nova-compute[74743]:     <acpi/>
Nov 18 17:03:54 user nova-compute[74743]:     <apic/>
Nov 18 17:03:54 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:03:54 user nova-compute[74743]:   </features>
Nov 18 17:03:54 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:03:54 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:03:54 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:03:54 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:03:54 user nova-compute[74743]:   </clock>
Nov 18 17:03:54 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:03:54 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:03:54 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:03:54 user nova-compute[74743]:   </cpu>
Nov 18 17:03:54 user nova-compute[74743]:   <devices>
Nov 18 17:03:54 user nova-compute[74743]:     <disk type="file" device="disk">
Nov 18 17:03:54 user nova-compute[74743]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 17:03:54 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/8e6111e9-59e9-4a30-870c-3d308a5d4936/disk"/>
Nov 18 17:03:54 user nova-compute[74743]:       <target dev="sda" bus="scsi"/>
Nov 18 17:03:54 user nova-compute[74743]:       <address type="drive" controller="0" unit="0"/>
Nov 18 17:03:54 user nova-compute[74743]:     </disk>
Nov 18 17:03:54 user nova-compute[74743]:     <disk type="file" device="cdrom">
Nov 18 17:03:54 user nova-compute[74743]:       <driver name="qemu" type="raw" cache="none"/>
Nov 18 17:03:54 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/8e6111e9-59e9-4a30-870c-3d308a5d4936/disk.config"/>
Nov 18 17:03:54 user nova-compute[74743]:       <target dev="sdb" bus="scsi"/>
Nov 18 17:03:54 user nova-compute[74743]:       <address type="drive" controller="0" unit="1"/>
Nov 18 17:03:54 user nova-compute[74743]:     </disk>
Nov 18 17:03:54 user nova-compute[74743]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 18 17:03:54 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:03:54 user nova-compute[74743]:       <mac address="fa:16:3e:8c:b5:bb"/>
Nov 18 17:03:54 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:03:54 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:03:54 user nova-compute[74743]:       <target dev="tap3b8c6ca6-18"/>
Nov 18 17:03:54 user nova-compute[74743]:     </interface>
Nov 18 17:03:54 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:03:54 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/8e6111e9-59e9-4a30-870c-3d308a5d4936/console.log" append="off"/>
Nov 18 17:03:54 user nova-compute[74743]:     </serial>
Nov 18 17:03:54 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:03:54 user nova-compute[74743]:     <video>
Nov 18 17:03:54 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:03:54 user nova-compute[74743]:     </video>
Nov 18 17:03:54 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:03:54 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:03:54 user nova-compute[74743]:     </rng>
Nov 18 17:03:54 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:03:54 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:03:54 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:03:54 user nova-compute[74743]:     </memballoon>
Nov 18 17:03:54 user nova-compute[74743]:   </devices>
Nov 18 17:03:54 user nova-compute[74743]: </domain>
Nov 18 17:03:54 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T17:03:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-466821373',display_name='tempest-AttachSCSIVolumeTestJSON-server-466821373',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-466821373',id=6,image_ref='322d9677-06f7-4b08-be88-9fffc98cac29',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVayI6NJDJ6ndIrTQnGbHVl/zmbaufeiiLi9nS36Dia8lGCf9LIzHdhMloHXaFlyYWzcXaa4WOyMzaECwK2FjDqYqUSVgzKin34Zm0v05Yd4TyxIk3HYanaBkRLff3V0w==',key_name='tempest-keypair-1043222923',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16de5043b38d4b3f8b1eccc4fed18acb',ramdisk_id='',reservation_id='r-lr0uviy2',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='322d9677-06f7-4b08-be88-9fffc98cac29',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-74434130',owner_user_name='tempest-AttachSCSIVolumeTestJSON-74434130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:03:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2edb384cc4d249a2b07528a6e2d90ead',uuid=8e6111e9-59e9-4a30-870c-3d308a5d4936,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b8c6ca6-189a-44fc-b8d5-d8ae5c501188", "address": "fa:16:3e:8c:b5:bb", "network": {"id": "cf1ba269-6100-4ad9-88bb-9693137fd478", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1280411595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16de5043b38d4b3f8b1eccc4fed18acb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b8c6ca6-18", "ovs_interfaceid": "3b8c6ca6-189a-44fc-b8d5-d8ae5c501188", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Converting VIF {"id": "3b8c6ca6-189a-44fc-b8d5-d8ae5c501188", "address": "fa:16:3e:8c:b5:bb", "network": {"id": "cf1ba269-6100-4ad9-88bb-9693137fd478", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1280411595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16de5043b38d4b3f8b1eccc4fed18acb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b8c6ca6-18", "ovs_interfaceid": "3b8c6ca6-189a-44fc-b8d5-d8ae5c501188", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:b5:bb,bridge_name='br-int',has_traffic_filtering=True,id=3b8c6ca6-189a-44fc-b8d5-d8ae5c501188,network=Network(cf1ba269-6100-4ad9-88bb-9693137fd478),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b8c6ca6-18') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG os_vif [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:b5:bb,bridge_name='br-int',has_traffic_filtering=True,id=3b8c6ca6-189a-44fc-b8d5-d8ae5c501188,network=Network(cf1ba269-6100-4ad9-88bb-9693137fd478),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b8c6ca6-18') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '09e589a8-db60-5069-816b-36198291945f', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b8c6ca6-18, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3b8c6ca6-18, col_values=(('qos', UUID('733140b5-f083-4365-89db-71e5e07eb700')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3b8c6ca6-18, col_values=(('external_ids', {'iface-id': '3b8c6ca6-189a-44fc-b8d5-d8ae5c501188', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:b5:bb', 'vm-uuid': '8e6111e9-59e9-4a30-870c-3d308a5d4936'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:54 user nova-compute[74743]: INFO os_vif [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:b5:bb,bridge_name='br-int',has_traffic_filtering=True,id=3b8c6ca6-189a-44fc-b8d5-d8ae5c501188,network=Network(cf1ba269-6100-4ad9-88bb-9693137fd478),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b8c6ca6-18')
Nov 18 17:03:54 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] No BDM found with device name sda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] No VIF found with MAC fa:16:3e:8c:b5:bb, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:03:54 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Using config drive
Nov 18 17:03:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.566s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG nova.compute.manager [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Start building networks asynchronously for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG nova.compute.manager [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Allocating IP information in the background. {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG nova.network.neutron [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] [instance: 567feb03-a356-4347-b146-d8930ad60c11] allocate_for_instance() {{(pid=74743) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 17:03:54 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Creating config drive at /opt/stack/data/nova/instances/8e6111e9-59e9-4a30-870c-3d308a5d4936/disk.config
Nov 18 17:03:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8e6111e9-59e9-4a30-870c-3d308a5d4936/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpf17t12kv {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG nova.policy [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2898fbfb804d4710a2cab8cd943f0c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944d66befe2a46dc85d3c3aded3495f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74743) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 17:03:54 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 17:03:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8e6111e9-59e9-4a30-870c-3d308a5d4936/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpf17t12kv" returned: 0 in 0.083s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG nova.compute.manager [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Start building block device mappings for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG nova.compute.manager [req-884b8ce3-531c-48e0-96f4-1b6660f8e0b5 req-739975a3-656f-43fe-a8f4-1976c00e63a7 service nova] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Received event network-vif-plugged-de102d31-a76d-4945-a89a-bdc58bf0f3a6 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-884b8ce3-531c-48e0-96f4-1b6660f8e0b5 req-739975a3-656f-43fe-a8f4-1976c00e63a7 service nova] Acquiring lock "d30a49de-abf1-4985-8dc5-6f7f24d51d2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-884b8ce3-531c-48e0-96f4-1b6660f8e0b5 req-739975a3-656f-43fe-a8f4-1976c00e63a7 service nova] Lock "d30a49de-abf1-4985-8dc5-6f7f24d51d2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-884b8ce3-531c-48e0-96f4-1b6660f8e0b5 req-739975a3-656f-43fe-a8f4-1976c00e63a7 service nova] Lock "d30a49de-abf1-4985-8dc5-6f7f24d51d2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG nova.compute.manager [req-884b8ce3-531c-48e0-96f4-1b6660f8e0b5 req-739975a3-656f-43fe-a8f4-1976c00e63a7 service nova] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] No waiting events found dispatching network-vif-plugged-de102d31-a76d-4945-a89a-bdc58bf0f3a6 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:03:54 user nova-compute[74743]: WARNING nova.compute.manager [req-884b8ce3-531c-48e0-96f4-1b6660f8e0b5 req-739975a3-656f-43fe-a8f4-1976c00e63a7 service nova] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Received unexpected event network-vif-plugged-de102d31-a76d-4945-a89a-bdc58bf0f3a6 for instance with vm_state active and task_state None.
Nov 18 17:03:54 user nova-compute[74743]: DEBUG nova.network.neutron [req-20e57d5c-a000-40e9-b711-24011288651b req-424eb1ae-12e0-4b8c-99ca-f2af46675740 service nova] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Updated VIF entry in instance network info cache for port 3b8c6ca6-189a-44fc-b8d5-d8ae5c501188. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG nova.network.neutron [req-20e57d5c-a000-40e9-b711-24011288651b req-424eb1ae-12e0-4b8c-99ca-f2af46675740 service nova] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Updating instance_info_cache with network_info: [{"id": "3b8c6ca6-189a-44fc-b8d5-d8ae5c501188", "address": "fa:16:3e:8c:b5:bb", "network": {"id": "cf1ba269-6100-4ad9-88bb-9693137fd478", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1280411595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16de5043b38d4b3f8b1eccc4fed18acb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b8c6ca6-18", "ovs_interfaceid": "3b8c6ca6-189a-44fc-b8d5-d8ae5c501188", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-20e57d5c-a000-40e9-b711-24011288651b req-424eb1ae-12e0-4b8c-99ca-f2af46675740 service nova] Releasing lock "refresh_cache-8e6111e9-59e9-4a30-870c-3d308a5d4936" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG nova.compute.manager [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Start spawning the instance on the hypervisor. {{(pid=74743) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Creating instance directory {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 17:03:54 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Creating image(s)
Nov 18 17:03:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Acquiring lock "/opt/stack/data/nova/instances/567feb03-a356-4347-b146-d8930ad60c11/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Lock "/opt/stack/data/nova/instances/567feb03-a356-4347-b146-d8930ad60c11/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Lock "/opt/stack/data/nova/instances/567feb03-a356-4347-b146-d8930ad60c11/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:03:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:03:55 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.244s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:03:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Acquiring lock "c188b3a997bfafa42fa341f9dcc326545681eed9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:03:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:03:55 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:03:55 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.260s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:03:55 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/567feb03-a356-4347-b146-d8930ad60c11/disk 1073741824 {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:03:55 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/567feb03-a356-4347-b146-d8930ad60c11/disk 1073741824" returned: 0 in 0.057s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:03:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.324s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:03:55 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:03:55 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.212s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:03:55 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Checking if we can resize image /opt/stack/data/nova/instances/567feb03-a356-4347-b146-d8930ad60c11/disk. size=1073741824 {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 17:03:55 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/567feb03-a356-4347-b146-d8930ad60c11/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:03:55 user nova-compute[74743]: DEBUG nova.network.neutron [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Successfully created port: 8b4ff8a1-a6e9-45bc-bea0-ea343801011d {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:03:55 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/567feb03-a356-4347-b146-d8930ad60c11/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:03:55 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Cannot resize image /opt/stack/data/nova/instances/567feb03-a356-4347-b146-d8930ad60c11/disk to a smaller size. {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 17:03:55 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Created local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 17:03:55 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Ensure instance console log exists: /opt/stack/data/nova/instances/567feb03-a356-4347-b146-d8930ad60c11/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:03:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:03:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:03:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:03:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:56 user nova-compute[74743]: DEBUG nova.compute.manager [req-e990a30d-3a30-4a57-b3fc-f7abaddba356 req-d69a34e4-2e39-4c78-a07b-8ce305213c8e service nova] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Received event network-vif-plugged-de102d31-a76d-4945-a89a-bdc58bf0f3a6 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:03:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e990a30d-3a30-4a57-b3fc-f7abaddba356 req-d69a34e4-2e39-4c78-a07b-8ce305213c8e service nova] Acquiring lock "d30a49de-abf1-4985-8dc5-6f7f24d51d2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:03:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e990a30d-3a30-4a57-b3fc-f7abaddba356 req-d69a34e4-2e39-4c78-a07b-8ce305213c8e service nova] Lock "d30a49de-abf1-4985-8dc5-6f7f24d51d2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:03:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e990a30d-3a30-4a57-b3fc-f7abaddba356 req-d69a34e4-2e39-4c78-a07b-8ce305213c8e service nova] Lock "d30a49de-abf1-4985-8dc5-6f7f24d51d2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:03:56 user nova-compute[74743]: DEBUG nova.compute.manager [req-e990a30d-3a30-4a57-b3fc-f7abaddba356 req-d69a34e4-2e39-4c78-a07b-8ce305213c8e service nova] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] No waiting events found dispatching network-vif-plugged-de102d31-a76d-4945-a89a-bdc58bf0f3a6 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:03:56 user nova-compute[74743]: WARNING nova.compute.manager [req-e990a30d-3a30-4a57-b3fc-f7abaddba356 req-d69a34e4-2e39-4c78-a07b-8ce305213c8e service nova] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Received unexpected event network-vif-plugged-de102d31-a76d-4945-a89a-bdc58bf0f3a6 for instance with vm_state active and task_state None.
Nov 18 17:03:56 user nova-compute[74743]: DEBUG nova.network.neutron [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Successfully updated port: 8b4ff8a1-a6e9-45bc-bea0-ea343801011d {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:03:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Acquiring lock "refresh_cache-567feb03-a356-4347-b146-d8930ad60c11" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:03:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Acquired lock "refresh_cache-567feb03-a356-4347-b146-d8930ad60c11" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:03:56 user nova-compute[74743]: DEBUG nova.network.neutron [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:03:56 user nova-compute[74743]: DEBUG nova.network.neutron [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:03:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:57 user nova-compute[74743]: DEBUG nova.compute.manager [req-32c23950-f547-4ba2-b5a6-0cfd56caa696 req-7b7a9489-287a-41af-b85f-854ddb8ce714 service nova] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Received event network-changed-8b4ff8a1-a6e9-45bc-bea0-ea343801011d {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:03:57 user nova-compute[74743]: DEBUG nova.compute.manager [req-32c23950-f547-4ba2-b5a6-0cfd56caa696 req-7b7a9489-287a-41af-b85f-854ddb8ce714 service nova] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Refreshing instance network info cache due to event network-changed-8b4ff8a1-a6e9-45bc-bea0-ea343801011d. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:03:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-32c23950-f547-4ba2-b5a6-0cfd56caa696 req-7b7a9489-287a-41af-b85f-854ddb8ce714 service nova] Acquiring lock "refresh_cache-567feb03-a356-4347-b146-d8930ad60c11" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:03:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:57 user nova-compute[74743]: DEBUG nova.network.neutron [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Updating instance_info_cache with network_info: [{"id": "8b4ff8a1-a6e9-45bc-bea0-ea343801011d", "address": "fa:16:3e:b3:b4:6a", "network": {"id": "0db4e9a5-ebe1-4af2-a7a4-25ae3a070a1a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-868857269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "944d66befe2a46dc85d3c3aded3495f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4ff8a1-a6", "ovs_interfaceid": "8b4ff8a1-a6e9-45bc-bea0-ea343801011d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:03:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Releasing lock "refresh_cache-567feb03-a356-4347-b146-d8930ad60c11" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:03:57 user nova-compute[74743]: DEBUG nova.compute.manager [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Instance network_info: |[{"id": "8b4ff8a1-a6e9-45bc-bea0-ea343801011d", "address": "fa:16:3e:b3:b4:6a", "network": {"id": "0db4e9a5-ebe1-4af2-a7a4-25ae3a070a1a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-868857269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "944d66befe2a46dc85d3c3aded3495f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4ff8a1-a6", "ovs_interfaceid": "8b4ff8a1-a6e9-45bc-bea0-ea343801011d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 17:03:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-32c23950-f547-4ba2-b5a6-0cfd56caa696 req-7b7a9489-287a-41af-b85f-854ddb8ce714 service nova] Acquired lock "refresh_cache-567feb03-a356-4347-b146-d8930ad60c11" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:03:57 user nova-compute[74743]: DEBUG nova.network.neutron [req-32c23950-f547-4ba2-b5a6-0cfd56caa696 req-7b7a9489-287a-41af-b85f-854ddb8ce714 service nova] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Refreshing network info cache for port 8b4ff8a1-a6e9-45bc-bea0-ea343801011d {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:03:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Start _get_guest_xml network_info=[{"id": "8b4ff8a1-a6e9-45bc-bea0-ea343801011d", "address": "fa:16:3e:b3:b4:6a", "network": {"id": "0db4e9a5-ebe1-4af2-a7a4-25ae3a070a1a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-868857269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "944d66befe2a46dc85d3c3aded3495f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4ff8a1-a6", "ovs_interfaceid": "8b4ff8a1-a6e9-45bc-bea0-ea343801011d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '9536f6cf-95c4-40e2-864a-09a91525678a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:03:57 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:03:57 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:03:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:03:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:03:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:03:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:03:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:03:57 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:03:57 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:03:57 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:03:57 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:03:57 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:03:57 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:03:57 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:03:57 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:03:57 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:03:57 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:03:57 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:03:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:03:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1875844160',display_name='tempest-TestVolumeSwap-server-1875844160',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1875844160',id=7,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCg1YXN0TzaTnpbw2dwzzWU5+kovzT7JAIHs2x8cRM/vhH290LjElIv66tJ3Kom4/c/xOainrd1BBPd+eYRZMWQT02xLZGQejkg3iaRCe+Idi8tlr/r8D4zZ3LmKvfcEPA==',key_name='tempest-keypair-524493985',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='944d66befe2a46dc85d3c3aded3495f9',ramdisk_id='',reservation_id='r-2ex2nqqb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1246113169',owner_user_name='tempest-TestVolumeSwap-1246113169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:03:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2898fbfb804d4710a2cab8cd943f0c53',uuid=567feb03-a356-4347-b146-d8930ad60c11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b4ff8a1-a6e9-45bc-bea0-ea343801011d", "address": "fa:16:3e:b3:b4:6a", "network": {"id": "0db4e9a5-ebe1-4af2-a7a4-25ae3a070a1a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-868857269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "944d66befe2a46dc85d3c3aded3495f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4ff8a1-a6", "ovs_interfaceid": "8b4ff8a1-a6e9-45bc-bea0-ea343801011d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:03:57 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Converting VIF {"id": "8b4ff8a1-a6e9-45bc-bea0-ea343801011d", "address": "fa:16:3e:b3:b4:6a", "network": {"id": "0db4e9a5-ebe1-4af2-a7a4-25ae3a070a1a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-868857269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "944d66befe2a46dc85d3c3aded3495f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4ff8a1-a6", "ovs_interfaceid": "8b4ff8a1-a6e9-45bc-bea0-ea343801011d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:03:57 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:b4:6a,bridge_name='br-int',has_traffic_filtering=True,id=8b4ff8a1-a6e9-45bc-bea0-ea343801011d,network=Network(0db4e9a5-ebe1-4af2-a7a4-25ae3a070a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4ff8a1-a6') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:03:57 user nova-compute[74743]: DEBUG nova.objects.instance [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Lazy-loading 'pci_devices' on Instance uuid 567feb03-a356-4347-b146-d8930ad60c11 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:03:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] [instance: 567feb03-a356-4347-b146-d8930ad60c11] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:03:57 user nova-compute[74743]:   <uuid>567feb03-a356-4347-b146-d8930ad60c11</uuid>
Nov 18 17:03:57 user nova-compute[74743]:   <name>instance-00000007</name>
Nov 18 17:03:57 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:03:57 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:03:57 user nova-compute[74743]:   <metadata>
Nov 18 17:03:57 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:03:57 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:03:57 user nova-compute[74743]:       <nova:name>tempest-TestVolumeSwap-server-1875844160</nova:name>
Nov 18 17:03:57 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:03:57</nova:creationTime>
Nov 18 17:03:57 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:03:57 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:03:57 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:03:57 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:03:57 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:03:57 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:03:57 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:03:57 user nova-compute[74743]:       <nova:owner>
Nov 18 17:03:57 user nova-compute[74743]:         <nova:user uuid="2898fbfb804d4710a2cab8cd943f0c53">tempest-TestVolumeSwap-1246113169-project-member</nova:user>
Nov 18 17:03:57 user nova-compute[74743]:         <nova:project uuid="944d66befe2a46dc85d3c3aded3495f9">tempest-TestVolumeSwap-1246113169</nova:project>
Nov 18 17:03:57 user nova-compute[74743]:       </nova:owner>
Nov 18 17:03:57 user nova-compute[74743]:       <nova:root type="image" uuid="9536f6cf-95c4-40e2-864a-09a91525678a"/>
Nov 18 17:03:57 user nova-compute[74743]:       <nova:ports>
Nov 18 17:03:57 user nova-compute[74743]:         <nova:port uuid="8b4ff8a1-a6e9-45bc-bea0-ea343801011d">
Nov 18 17:03:57 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 18 17:03:57 user nova-compute[74743]:         </nova:port>
Nov 18 17:03:57 user nova-compute[74743]:       </nova:ports>
Nov 18 17:03:57 user nova-compute[74743]:     </nova:instance>
Nov 18 17:03:57 user nova-compute[74743]:   </metadata>
Nov 18 17:03:57 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:03:57 user nova-compute[74743]:     <system>
Nov 18 17:03:57 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:03:57 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:03:57 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:03:57 user nova-compute[74743]:       <entry name="serial">567feb03-a356-4347-b146-d8930ad60c11</entry>
Nov 18 17:03:57 user nova-compute[74743]:       <entry name="uuid">567feb03-a356-4347-b146-d8930ad60c11</entry>
Nov 18 17:03:57 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:03:57 user nova-compute[74743]:     </system>
Nov 18 17:03:57 user nova-compute[74743]:   </sysinfo>
Nov 18 17:03:57 user nova-compute[74743]:   <os>
Nov 18 17:03:57 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:03:57 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:03:57 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:03:57 user nova-compute[74743]:   </os>
Nov 18 17:03:57 user nova-compute[74743]:   <features>
Nov 18 17:03:57 user nova-compute[74743]:     <acpi/>
Nov 18 17:03:57 user nova-compute[74743]:     <apic/>
Nov 18 17:03:57 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:03:57 user nova-compute[74743]:   </features>
Nov 18 17:03:57 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:03:57 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:03:57 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:03:57 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:03:57 user nova-compute[74743]:   </clock>
Nov 18 17:03:57 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:03:57 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:03:57 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:03:57 user nova-compute[74743]:   </cpu>
Nov 18 17:03:57 user nova-compute[74743]:   <devices>
Nov 18 17:03:57 user nova-compute[74743]:     <disk type="file" device="disk">
Nov 18 17:03:57 user nova-compute[74743]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 17:03:57 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/567feb03-a356-4347-b146-d8930ad60c11/disk"/>
Nov 18 17:03:57 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:03:57 user nova-compute[74743]:     </disk>
Nov 18 17:03:57 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:03:57 user nova-compute[74743]:       <mac address="fa:16:3e:b3:b4:6a"/>
Nov 18 17:03:57 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:03:57 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:03:57 user nova-compute[74743]:       <target dev="tap8b4ff8a1-a6"/>
Nov 18 17:03:57 user nova-compute[74743]:     </interface>
Nov 18 17:03:57 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:03:57 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/567feb03-a356-4347-b146-d8930ad60c11/console.log" append="off"/>
Nov 18 17:03:57 user nova-compute[74743]:     </serial>
Nov 18 17:03:57 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:03:57 user nova-compute[74743]:     <video>
Nov 18 17:03:57 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:03:57 user nova-compute[74743]:     </video>
Nov 18 17:03:57 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:03:57 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:03:57 user nova-compute[74743]:     </rng>
Nov 18 17:03:57 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:03:57 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:03:57 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:03:57 user nova-compute[74743]:     </memballoon>
Nov 18 17:03:57 user nova-compute[74743]:   </devices>
Nov 18 17:03:57 user nova-compute[74743]: </domain>
Nov 18 17:03:57 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:03:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:03:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1875844160',display_name='tempest-TestVolumeSwap-server-1875844160',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1875844160',id=7,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCg1YXN0TzaTnpbw2dwzzWU5+kovzT7JAIHs2x8cRM/vhH290LjElIv66tJ3Kom4/c/xOainrd1BBPd+eYRZMWQT02xLZGQejkg3iaRCe+Idi8tlr/r8D4zZ3LmKvfcEPA==',key_name='tempest-keypair-524493985',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='944d66befe2a46dc85d3c3aded3495f9',ramdisk_id='',reservation_id='r-2ex2nqqb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1246113169',owner_user_name='tempest-TestVolumeSwap-1246113169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:03:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2898fbfb804d4710a2cab8cd943f0c53',uuid=567feb03-a356-4347-b146-d8930ad60c11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b4ff8a1-a6e9-45bc-bea0-ea343801011d", "address": "fa:16:3e:b3:b4:6a", "network": {"id": "0db4e9a5-ebe1-4af2-a7a4-25ae3a070a1a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-868857269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "944d66befe2a46dc85d3c3aded3495f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4ff8a1-a6", "ovs_interfaceid": "8b4ff8a1-a6e9-45bc-bea0-ea343801011d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:03:57 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Converting VIF {"id": "8b4ff8a1-a6e9-45bc-bea0-ea343801011d", "address": "fa:16:3e:b3:b4:6a", "network": {"id": "0db4e9a5-ebe1-4af2-a7a4-25ae3a070a1a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-868857269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "944d66befe2a46dc85d3c3aded3495f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4ff8a1-a6", "ovs_interfaceid": "8b4ff8a1-a6e9-45bc-bea0-ea343801011d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:03:57 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:b4:6a,bridge_name='br-int',has_traffic_filtering=True,id=8b4ff8a1-a6e9-45bc-bea0-ea343801011d,network=Network(0db4e9a5-ebe1-4af2-a7a4-25ae3a070a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4ff8a1-a6') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:03:57 user nova-compute[74743]: DEBUG os_vif [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:b4:6a,bridge_name='br-int',has_traffic_filtering=True,id=8b4ff8a1-a6e9-45bc-bea0-ea343801011d,network=Network(0db4e9a5-ebe1-4af2-a7a4-25ae3a070a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4ff8a1-a6') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:03:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:03:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:03:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'adaa0427-b625-5f75-88c5-edb9b500df11', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:03:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:03:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b4ff8a1-a6, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:03:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8b4ff8a1-a6, col_values=(('qos', UUID('8c931e45-b7dd-47fa-87a0-c97424998156')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:03:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8b4ff8a1-a6, col_values=(('external_ids', {'iface-id': '8b4ff8a1-a6e9-45bc-bea0-ea343801011d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:b4:6a', 'vm-uuid': '567feb03-a356-4347-b146-d8930ad60c11'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:03:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:03:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:57 user nova-compute[74743]: INFO os_vif [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:b4:6a,bridge_name='br-int',has_traffic_filtering=True,id=8b4ff8a1-a6e9-45bc-bea0-ea343801011d,network=Network(0db4e9a5-ebe1-4af2-a7a4-25ae3a070a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4ff8a1-a6')
Nov 18 17:03:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:03:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] No VIF found with MAC fa:16:3e:b3:b4:6a, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:03:57 user nova-compute[74743]: DEBUG nova.network.neutron [req-32c23950-f547-4ba2-b5a6-0cfd56caa696 req-7b7a9489-287a-41af-b85f-854ddb8ce714 service nova] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Updated VIF entry in instance network info cache for port 8b4ff8a1-a6e9-45bc-bea0-ea343801011d. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:03:57 user nova-compute[74743]: DEBUG nova.network.neutron [req-32c23950-f547-4ba2-b5a6-0cfd56caa696 req-7b7a9489-287a-41af-b85f-854ddb8ce714 service nova] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Updating instance_info_cache with network_info: [{"id": "8b4ff8a1-a6e9-45bc-bea0-ea343801011d", "address": "fa:16:3e:b3:b4:6a", "network": {"id": "0db4e9a5-ebe1-4af2-a7a4-25ae3a070a1a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-868857269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "944d66befe2a46dc85d3c3aded3495f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4ff8a1-a6", "ovs_interfaceid": "8b4ff8a1-a6e9-45bc-bea0-ea343801011d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:03:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-32c23950-f547-4ba2-b5a6-0cfd56caa696 req-7b7a9489-287a-41af-b85f-854ddb8ce714 service nova] Releasing lock "refresh_cache-567feb03-a356-4347-b146-d8930ad60c11" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:03:58 user nova-compute[74743]: DEBUG nova.compute.manager [req-ad33743b-dd32-4780-919d-00cae65b0117 req-18312cf4-5da9-4577-bc4c-018ef9b02b5a service nova] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Received event network-vif-plugged-3b8c6ca6-189a-44fc-b8d5-d8ae5c501188 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:03:58 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ad33743b-dd32-4780-919d-00cae65b0117 req-18312cf4-5da9-4577-bc4c-018ef9b02b5a service nova] Acquiring lock "8e6111e9-59e9-4a30-870c-3d308a5d4936-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:03:58 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ad33743b-dd32-4780-919d-00cae65b0117 req-18312cf4-5da9-4577-bc4c-018ef9b02b5a service nova] Lock "8e6111e9-59e9-4a30-870c-3d308a5d4936-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:03:58 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ad33743b-dd32-4780-919d-00cae65b0117 req-18312cf4-5da9-4577-bc4c-018ef9b02b5a service nova] Lock "8e6111e9-59e9-4a30-870c-3d308a5d4936-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:03:58 user nova-compute[74743]: DEBUG nova.compute.manager [req-ad33743b-dd32-4780-919d-00cae65b0117 req-18312cf4-5da9-4577-bc4c-018ef9b02b5a service nova] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] No waiting events found dispatching network-vif-plugged-3b8c6ca6-189a-44fc-b8d5-d8ae5c501188 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:03:58 user nova-compute[74743]: WARNING nova.compute.manager [req-ad33743b-dd32-4780-919d-00cae65b0117 req-18312cf4-5da9-4577-bc4c-018ef9b02b5a service nova] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Received unexpected event network-vif-plugged-3b8c6ca6-189a-44fc-b8d5-d8ae5c501188 for instance with vm_state building and task_state spawning.
Nov 18 17:03:58 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Acquiring lock "fc4cdeb6-51ff-4090-a29d-d4f6105e15f3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:03:58 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Lock "fc4cdeb6-51ff-4090-a29d-d4f6105e15f3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:03:58 user nova-compute[74743]: DEBUG nova.compute.manager [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Starting instance... {{(pid=74743) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 17:03:58 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:03:58 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:03:58 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74743) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 17:03:58 user nova-compute[74743]: INFO nova.compute.claims [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Claim successful on node user
Nov 18 17:03:58 user nova-compute[74743]: DEBUG nova.compute.manager [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:03:58 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Guest created on hypervisor {{(pid=74743) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 17:03:58 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Instance spawned successfully.
Nov 18 17:03:58 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 17:03:58 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Found default for hw_input_bus of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:03:58 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Found default for hw_pointer_model of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:03:58 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Found default for hw_video_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:03:58 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Found default for hw_vif_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:03:59 user nova-compute[74743]: INFO nova.compute.manager [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Took 9.80 seconds to spawn the instance on the hypervisor.
Nov 18 17:03:59 user nova-compute[74743]: DEBUG nova.compute.manager [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:03:59 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:59 user nova-compute[74743]: INFO nova.compute.manager [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Took 11.83 seconds to build instance.
Nov 18 17:03:59 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3821c19e-08f2-4530-8628-8ecee1ae3639 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Lock "8e6111e9-59e9-4a30-870c-3d308a5d4936" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.218s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:03:59 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:03:59 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:03:59 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:03:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.657s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:03:59 user nova-compute[74743]: DEBUG nova.compute.manager [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Start building networks asynchronously for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 17:03:59 user nova-compute[74743]: DEBUG nova.compute.manager [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Allocating IP information in the background. {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 17:03:59 user nova-compute[74743]: DEBUG nova.network.neutron [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] allocate_for_instance() {{(pid=74743) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 17:03:59 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 17:03:59 user nova-compute[74743]: DEBUG nova.compute.manager [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Start building block device mappings for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 17:03:59 user nova-compute[74743]: DEBUG nova.compute.manager [req-adaef232-d13c-4d2c-9af1-c2e1054afcde req-3ff8237c-43fb-4609-b904-29ff36801182 service nova] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Received event network-vif-plugged-8b4ff8a1-a6e9-45bc-bea0-ea343801011d {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:03:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-adaef232-d13c-4d2c-9af1-c2e1054afcde req-3ff8237c-43fb-4609-b904-29ff36801182 service nova] Acquiring lock "567feb03-a356-4347-b146-d8930ad60c11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:03:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-adaef232-d13c-4d2c-9af1-c2e1054afcde req-3ff8237c-43fb-4609-b904-29ff36801182 service nova] Lock "567feb03-a356-4347-b146-d8930ad60c11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:03:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-adaef232-d13c-4d2c-9af1-c2e1054afcde req-3ff8237c-43fb-4609-b904-29ff36801182 service nova] Lock "567feb03-a356-4347-b146-d8930ad60c11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:03:59 user nova-compute[74743]: DEBUG nova.compute.manager [req-adaef232-d13c-4d2c-9af1-c2e1054afcde req-3ff8237c-43fb-4609-b904-29ff36801182 service nova] [instance: 567feb03-a356-4347-b146-d8930ad60c11] No waiting events found dispatching network-vif-plugged-8b4ff8a1-a6e9-45bc-bea0-ea343801011d {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:03:59 user nova-compute[74743]: WARNING nova.compute.manager [req-adaef232-d13c-4d2c-9af1-c2e1054afcde req-3ff8237c-43fb-4609-b904-29ff36801182 service nova] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Received unexpected event network-vif-plugged-8b4ff8a1-a6e9-45bc-bea0-ea343801011d for instance with vm_state building and task_state spawning.
Nov 18 17:03:59 user nova-compute[74743]: INFO nova.virt.block_device [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Booting with volume 47861a8d-8eb0-4239-a9b5-962337012ed8 at /dev/vda
Nov 18 17:03:59 user nova-compute[74743]: DEBUG nova.policy [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c39539fc6bbd40628ff16ddd50054661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba340b1c9b03442ca58b2fef8ec6d60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74743) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 17:03:59 user nova-compute[74743]: DEBUG os_brick.utils [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:03:59 user nova-compute[74743]: INFO oslo.privsep.daemon [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp0ck77tf4/privsep.sock']
Nov 18 17:03:59 user sudo[85230]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp0ck77tf4/privsep.sock
Nov 18 17:03:59 user sudo[85230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 18 17:03:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Acquiring lock "e2a7ff40-310e-481f-8459-cde1034a0fbd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:03:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Lock "e2a7ff40-310e-481f-8459-cde1034a0fbd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:04:00 user nova-compute[74743]: DEBUG nova.compute.manager [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Starting instance... {{(pid=74743) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 17:04:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:00 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:04:00 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:04:00 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74743) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 17:04:00 user nova-compute[74743]: INFO nova.compute.claims [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Claim successful on node user
Nov 18 17:04:00 user nova-compute[74743]: DEBUG nova.compute.manager [req-bc0e979f-79cc-4cc9-a394-d05c16690c8f req-1b917c20-90b2-470d-bd74-94a6ca204c0e service nova] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Received event network-vif-plugged-3b8c6ca6-189a-44fc-b8d5-d8ae5c501188 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:04:00 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-bc0e979f-79cc-4cc9-a394-d05c16690c8f req-1b917c20-90b2-470d-bd74-94a6ca204c0e service nova] Acquiring lock "8e6111e9-59e9-4a30-870c-3d308a5d4936-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:04:00 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-bc0e979f-79cc-4cc9-a394-d05c16690c8f req-1b917c20-90b2-470d-bd74-94a6ca204c0e service nova] Lock "8e6111e9-59e9-4a30-870c-3d308a5d4936-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:04:00 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-bc0e979f-79cc-4cc9-a394-d05c16690c8f req-1b917c20-90b2-470d-bd74-94a6ca204c0e service nova] Lock "8e6111e9-59e9-4a30-870c-3d308a5d4936-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:04:00 user nova-compute[74743]: DEBUG nova.compute.manager [req-bc0e979f-79cc-4cc9-a394-d05c16690c8f req-1b917c20-90b2-470d-bd74-94a6ca204c0e service nova] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] No waiting events found dispatching network-vif-plugged-3b8c6ca6-189a-44fc-b8d5-d8ae5c501188 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:04:00 user nova-compute[74743]: WARNING nova.compute.manager [req-bc0e979f-79cc-4cc9-a394-d05c16690c8f req-1b917c20-90b2-470d-bd74-94a6ca204c0e service nova] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Received unexpected event network-vif-plugged-3b8c6ca6-189a-44fc-b8d5-d8ae5c501188 for instance with vm_state active and task_state None.
Nov 18 17:04:00 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:04:00 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:04:00 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.733s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:04:00 user nova-compute[74743]: DEBUG nova.compute.manager [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Start building networks asynchronously for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 17:04:00 user nova-compute[74743]: DEBUG nova.network.neutron [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Successfully created port: 9abd882a-72d9-46b9-9dc0-8bdd727125b2 {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:04:00 user nova-compute[74743]: DEBUG nova.compute.manager [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Allocating IP information in the background. {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 17:04:00 user nova-compute[74743]: DEBUG nova.network.neutron [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] allocate_for_instance() {{(pid=74743) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 17:04:01 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 17:04:01 user nova-compute[74743]: DEBUG nova.compute.manager [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Start building block device mappings for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 17:04:01 user nova-compute[74743]: DEBUG nova.policy [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5c3fd257809b44b9ba4e8c60e1d988a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7771c1adef144c06bc2635a551bf1c50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74743) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 17:04:01 user nova-compute[74743]: DEBUG nova.compute.manager [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Start spawning the instance on the hypervisor. {{(pid=74743) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 17:04:01 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Creating instance directory {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 17:04:01 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Creating image(s)
Nov 18 17:04:01 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Acquiring lock "/opt/stack/data/nova/instances/e2a7ff40-310e-481f-8459-cde1034a0fbd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:04:01 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Lock "/opt/stack/data/nova/instances/e2a7ff40-310e-481f-8459-cde1034a0fbd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:04:01 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Lock "/opt/stack/data/nova/instances/e2a7ff40-310e-481f-8459-cde1034a0fbd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:04:01 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:01 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.259s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:01 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Acquiring lock "c188b3a997bfafa42fa341f9dcc326545681eed9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:04:01 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:04:01 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:01 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:01 user nova-compute[74743]: DEBUG nova.network.neutron [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Successfully updated port: 9abd882a-72d9-46b9-9dc0-8bdd727125b2 {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:04:01 user sudo[85230]: pam_unix(sudo:session): session closed for user root
Nov 18 17:04:01 user nova-compute[74743]: DEBUG nova.compute.manager [req-a5b894bc-e9e3-419d-ac8e-07a5a5059740 req-04559145-8fc7-4ad7-a002-ffbbb9afa2c4 service nova] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Received event network-vif-plugged-8b4ff8a1-a6e9-45bc-bea0-ea343801011d {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:04:01 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a5b894bc-e9e3-419d-ac8e-07a5a5059740 req-04559145-8fc7-4ad7-a002-ffbbb9afa2c4 service nova] Acquiring lock "567feb03-a356-4347-b146-d8930ad60c11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:04:01 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a5b894bc-e9e3-419d-ac8e-07a5a5059740 req-04559145-8fc7-4ad7-a002-ffbbb9afa2c4 service nova] Lock "567feb03-a356-4347-b146-d8930ad60c11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:04:01 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a5b894bc-e9e3-419d-ac8e-07a5a5059740 req-04559145-8fc7-4ad7-a002-ffbbb9afa2c4 service nova] Lock "567feb03-a356-4347-b146-d8930ad60c11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:04:01 user nova-compute[74743]: DEBUG nova.compute.manager [req-a5b894bc-e9e3-419d-ac8e-07a5a5059740 req-04559145-8fc7-4ad7-a002-ffbbb9afa2c4 service nova] [instance: 567feb03-a356-4347-b146-d8930ad60c11] No waiting events found dispatching network-vif-plugged-8b4ff8a1-a6e9-45bc-bea0-ea343801011d {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:04:01 user nova-compute[74743]: WARNING nova.compute.manager [req-a5b894bc-e9e3-419d-ac8e-07a5a5059740 req-04559145-8fc7-4ad7-a002-ffbbb9afa2c4 service nova] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Received unexpected event network-vif-plugged-8b4ff8a1-a6e9-45bc-bea0-ea343801011d for instance with vm_state building and task_state spawning.
Nov 18 17:04:01 user nova-compute[74743]: INFO oslo.privsep.daemon [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Spawned new privsep daemon via rootwrap
Nov 18 17:04:01 user nova-compute[74743]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 18 17:04:01 user nova-compute[74743]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 18 17:04:01 user nova-compute[74743]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 18 17:04:01 user nova-compute[74743]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85244
Nov 18 17:04:01 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Acquiring lock "refresh_cache-fc4cdeb6-51ff-4090-a29d-d4f6105e15f3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:04:01 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Acquired lock "refresh_cache-fc4cdeb6-51ff-4090-a29d-d4f6105e15f3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:04:01 user nova-compute[74743]: DEBUG nova.network.neutron [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:04:01 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.304s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:01 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/e2a7ff40-310e-481f-8459-cde1034a0fbd/disk 1073741824 {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:01 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5645ac-b423-4382-bddd-9c3029cd3405]: (2,) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:01 user nova-compute[74743]: DEBUG nova.compute.manager [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:04:01 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Guest created on hypervisor {{(pid=74743) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 17:04:01 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/e2a7ff40-310e-481f-8459-cde1034a0fbd/disk 1073741824" returned: 0 in 0.074s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:01 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.389s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:04:01 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:01 user nova-compute[74743]: DEBUG nova.network.neutron [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:04:01 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Instance spawned successfully.
Nov 18 17:04:01 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 17:04:02 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Found default for hw_cdrom_bus of ide {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:04:02 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Found default for hw_disk_bus of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:04:02 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Found default for hw_input_bus of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:04:02 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Found default for hw_pointer_model of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:04:02 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Found default for hw_video_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:04:02 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Found default for hw_vif_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:04:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.227s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:02 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e2a7ff40-310e-481f-8459-cde1034a0fbd/disk. size=1073741824 {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 17:04:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2a7ff40-310e-481f-8459-cde1034a0fbd/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:02 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d8421f-bc04-43a6-9d9d-ffefb6c937d3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1116acd8874d\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:02 user nova-compute[74743]: INFO nova.compute.manager [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Took 7.32 seconds to spawn the instance on the hypervisor.
Nov 18 17:04:02 user nova-compute[74743]: DEBUG nova.compute.manager [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:04:02 user nova-compute[74743]: WARNING os_brick.initiator.connectors.nvmeof [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 18 17:04:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:02 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2de393-7c81-47b0-a568-03841121796c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:02 user nova-compute[74743]: DEBUG nova.network.neutron [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Successfully created port: 9c7850d5-314e-4854-bbc1-b4e08037abd1 {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:04:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:02 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc594f61-8dc1-416b-9e2e-43aaabcec618]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:02 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff6021c-8c1d-458c-aca2-5e3e476e3cfe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Running cmd (subprocess): nvme version {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] 'nvme version' failed. Not Retrying. {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:04:02 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] nvme not present on system {{(pid=74743) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 17:04:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:02 user nova-compute[74743]: DEBUG nova.network.neutron [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Updating instance_info_cache with network_info: [{"id": "9abd882a-72d9-46b9-9dc0-8bdd727125b2", "address": "fa:16:3e:b0:f7:a6", "network": {"id": "b9dd5bf0-7dcc-4428-8496-f77a6e0ddbef", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-386192241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba340b1c9b03442ca58b2fef8ec6d60d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9abd882a-72", "ovs_interfaceid": "9abd882a-72d9-46b9-9dc0-8bdd727125b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:04:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:04:02 user nova-compute[74743]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 17:04:02 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c201ddb-9cf0-47c3-8a91-543fe4feea8c]: (4, '') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:02 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74743) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 17:04:02 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 17:04:02 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] LIGHTOS: no hostnqn found. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 17:04:02 user nova-compute[74743]: DEBUG os_brick.utils [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] <== get_connector_properties: return (2403ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1116acd8874d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:04:02 user nova-compute[74743]: DEBUG nova.virt.block_device [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Updating existing volume attachment record: 44cffb09-312f-4a66-880c-bf11c23f33a0 {{(pid=74743) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 17:04:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Releasing lock "refresh_cache-fc4cdeb6-51ff-4090-a29d-d4f6105e15f3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:04:02 user nova-compute[74743]: DEBUG nova.compute.manager [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Instance network_info: |[{"id": "9abd882a-72d9-46b9-9dc0-8bdd727125b2", "address": "fa:16:3e:b0:f7:a6", "network": {"id": "b9dd5bf0-7dcc-4428-8496-f77a6e0ddbef", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-386192241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba340b1c9b03442ca58b2fef8ec6d60d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9abd882a-72", "ovs_interfaceid": "9abd882a-72d9-46b9-9dc0-8bdd727125b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 17:04:02 user nova-compute[74743]: INFO nova.compute.manager [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Took 8.60 seconds to build instance.
Nov 18 17:04:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2a7ff40-310e-481f-8459-cde1034a0fbd/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:02 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Cannot resize image /opt/stack/data/nova/instances/e2a7ff40-310e-481f-8459-cde1034a0fbd/disk to a smaller size. {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 17:04:02 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Created local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 17:04:02 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Ensure instance console log exists: /opt/stack/data/nova/instances/e2a7ff40-310e-481f-8459-cde1034a0fbd/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:04:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:04:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:04:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:04:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-266fc92d-e995-49b2-8ed4-a138dc4afeea tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Lock "567feb03-a356-4347-b146-d8930ad60c11" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.842s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:04:02 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:02 user nova-compute[74743]: DEBUG nova.network.neutron [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Successfully updated port: 9c7850d5-314e-4854-bbc1-b4e08037abd1 {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:04:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Acquiring lock "refresh_cache-e2a7ff40-310e-481f-8459-cde1034a0fbd" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:04:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Acquired lock "refresh_cache-e2a7ff40-310e-481f-8459-cde1034a0fbd" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:04:02 user nova-compute[74743]: DEBUG nova.network.neutron [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:04:02 user nova-compute[74743]: DEBUG nova.compute.manager [req-23282209-8470-4b5e-8f74-7635a1b2664b req-d85a7f43-0ad0-46d1-b414-c84a9b3d5121 service nova] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Received event network-changed-9c7850d5-314e-4854-bbc1-b4e08037abd1 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:04:02 user nova-compute[74743]: DEBUG nova.compute.manager [req-23282209-8470-4b5e-8f74-7635a1b2664b req-d85a7f43-0ad0-46d1-b414-c84a9b3d5121 service nova] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Refreshing instance network info cache due to event network-changed-9c7850d5-314e-4854-bbc1-b4e08037abd1. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:04:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-23282209-8470-4b5e-8f74-7635a1b2664b req-d85a7f43-0ad0-46d1-b414-c84a9b3d5121 service nova] Acquiring lock "refresh_cache-e2a7ff40-310e-481f-8459-cde1034a0fbd" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:04:03 user nova-compute[74743]: DEBUG nova.network.neutron [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:04:03 user nova-compute[74743]: DEBUG nova.network.neutron [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Updating instance_info_cache with network_info: [{"id": "9c7850d5-314e-4854-bbc1-b4e08037abd1", "address": "fa:16:3e:05:50:5c", "network": {"id": "55694218-7eff-4083-b98f-0604e4ac3c20", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-34716983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7771c1adef144c06bc2635a551bf1c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c7850d5-31", "ovs_interfaceid": "9c7850d5-314e-4854-bbc1-b4e08037abd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:04:03 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Releasing lock "refresh_cache-e2a7ff40-310e-481f-8459-cde1034a0fbd" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:04:03 user nova-compute[74743]: DEBUG nova.compute.manager [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Instance network_info: |[{"id": "9c7850d5-314e-4854-bbc1-b4e08037abd1", "address": "fa:16:3e:05:50:5c", "network": {"id": "55694218-7eff-4083-b98f-0604e4ac3c20", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-34716983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7771c1adef144c06bc2635a551bf1c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c7850d5-31", "ovs_interfaceid": "9c7850d5-314e-4854-bbc1-b4e08037abd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 17:04:03 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-23282209-8470-4b5e-8f74-7635a1b2664b req-d85a7f43-0ad0-46d1-b414-c84a9b3d5121 service nova] Acquired lock "refresh_cache-e2a7ff40-310e-481f-8459-cde1034a0fbd" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:04:03 user nova-compute[74743]: DEBUG nova.network.neutron [req-23282209-8470-4b5e-8f74-7635a1b2664b req-d85a7f43-0ad0-46d1-b414-c84a9b3d5121 service nova] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Refreshing network info cache for port 9c7850d5-314e-4854-bbc1-b4e08037abd1 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:04:03 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Start _get_guest_xml network_info=[{"id": "9c7850d5-314e-4854-bbc1-b4e08037abd1", "address": "fa:16:3e:05:50:5c", "network": {"id": "55694218-7eff-4083-b98f-0604e4ac3c20", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-34716983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7771c1adef144c06bc2635a551bf1c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c7850d5-31", "ovs_interfaceid": "9c7850d5-314e-4854-bbc1-b4e08037abd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '9536f6cf-95c4-40e2-864a-09a91525678a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:04:03 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:04:03 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:04:03 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:04:03 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:04:03 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:04:03 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:04:03 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:04:03 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:04:03 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:04:03 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:04:03 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:04:03 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:04:03 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:04:03 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:04:03 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:04:03 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:04:03 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:04:03 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:04:03 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:03:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-339350780',display_name='tempest-VolumesAssistedSnapshotsTest-server-339350780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-339350780',id=9,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPsKCzfUQWQXQ3/HK5Qqi9cFLmOjsEFKKg3Yt3iiY12xnfyRZ2/rFHMjTrP6mdiHsSuJltDbJQNayteqXWXOlImKAn5pi6TVuSSERYWV2Ta9KlxuVOYV5igWs/Mh+GxYkQ==',key_name='tempest-keypair-743524350',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7771c1adef144c06bc2635a551bf1c50',ramdisk_id='',reservation_id='r-ikw9ji6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-318796158',owner_user_name='tempest-VolumesAssistedSnapshotsTest-318796158-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:04:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c3fd257809b44b9ba4e8c60e1d988a9',uuid=e2a7ff40-310e-481f-8459-cde1034a0fbd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c7850d5-314e-4854-bbc1-b4e08037abd1", "address": "fa:16:3e:05:50:5c", "network": {"id": "55694218-7eff-4083-b98f-0604e4ac3c20", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-34716983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7771c1adef144c06bc2635a551bf1c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c7850d5-31", "ovs_interfaceid": "9c7850d5-314e-4854-bbc1-b4e08037abd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:04:03 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Converting VIF {"id": "9c7850d5-314e-4854-bbc1-b4e08037abd1", "address": "fa:16:3e:05:50:5c", "network": {"id": "55694218-7eff-4083-b98f-0604e4ac3c20", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-34716983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7771c1adef144c06bc2635a551bf1c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c7850d5-31", "ovs_interfaceid": "9c7850d5-314e-4854-bbc1-b4e08037abd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:04:03 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:50:5c,bridge_name='br-int',has_traffic_filtering=True,id=9c7850d5-314e-4854-bbc1-b4e08037abd1,network=Network(55694218-7eff-4083-b98f-0604e4ac3c20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c7850d5-31') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:04:03 user nova-compute[74743]: DEBUG nova.objects.instance [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Lazy-loading 'pci_devices' on Instance uuid e2a7ff40-310e-481f-8459-cde1034a0fbd {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:04:03 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:04:03 user nova-compute[74743]:   <uuid>e2a7ff40-310e-481f-8459-cde1034a0fbd</uuid>
Nov 18 17:04:03 user nova-compute[74743]:   <name>instance-00000009</name>
Nov 18 17:04:03 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:04:03 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:04:03 user nova-compute[74743]:   <metadata>
Nov 18 17:04:03 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:04:03 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:04:03 user nova-compute[74743]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-339350780</nova:name>
Nov 18 17:04:03 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:04:03</nova:creationTime>
Nov 18 17:04:03 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:04:03 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:04:03 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:04:03 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:04:03 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:04:03 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:04:03 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:04:03 user nova-compute[74743]:       <nova:owner>
Nov 18 17:04:03 user nova-compute[74743]:         <nova:user uuid="5c3fd257809b44b9ba4e8c60e1d988a9">tempest-VolumesAssistedSnapshotsTest-318796158-project-member</nova:user>
Nov 18 17:04:03 user nova-compute[74743]:         <nova:project uuid="7771c1adef144c06bc2635a551bf1c50">tempest-VolumesAssistedSnapshotsTest-318796158</nova:project>
Nov 18 17:04:03 user nova-compute[74743]:       </nova:owner>
Nov 18 17:04:03 user nova-compute[74743]:       <nova:root type="image" uuid="9536f6cf-95c4-40e2-864a-09a91525678a"/>
Nov 18 17:04:03 user nova-compute[74743]:       <nova:ports>
Nov 18 17:04:03 user nova-compute[74743]:         <nova:port uuid="9c7850d5-314e-4854-bbc1-b4e08037abd1">
Nov 18 17:04:03 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 18 17:04:03 user nova-compute[74743]:         </nova:port>
Nov 18 17:04:03 user nova-compute[74743]:       </nova:ports>
Nov 18 17:04:03 user nova-compute[74743]:     </nova:instance>
Nov 18 17:04:03 user nova-compute[74743]:   </metadata>
Nov 18 17:04:03 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:04:03 user nova-compute[74743]:     <system>
Nov 18 17:04:03 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:04:03 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:04:03 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:04:03 user nova-compute[74743]:       <entry name="serial">e2a7ff40-310e-481f-8459-cde1034a0fbd</entry>
Nov 18 17:04:03 user nova-compute[74743]:       <entry name="uuid">e2a7ff40-310e-481f-8459-cde1034a0fbd</entry>
Nov 18 17:04:03 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:04:03 user nova-compute[74743]:     </system>
Nov 18 17:04:03 user nova-compute[74743]:   </sysinfo>
Nov 18 17:04:03 user nova-compute[74743]:   <os>
Nov 18 17:04:03 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:04:03 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:04:03 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:04:03 user nova-compute[74743]:   </os>
Nov 18 17:04:03 user nova-compute[74743]:   <features>
Nov 18 17:04:03 user nova-compute[74743]:     <acpi/>
Nov 18 17:04:03 user nova-compute[74743]:     <apic/>
Nov 18 17:04:03 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:04:03 user nova-compute[74743]:   </features>
Nov 18 17:04:03 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:04:03 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:04:03 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:04:03 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:04:03 user nova-compute[74743]:   </clock>
Nov 18 17:04:03 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:04:03 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:04:03 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:04:03 user nova-compute[74743]:   </cpu>
Nov 18 17:04:03 user nova-compute[74743]:   <devices>
Nov 18 17:04:03 user nova-compute[74743]:     <disk type="file" device="disk">
Nov 18 17:04:03 user nova-compute[74743]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 17:04:03 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/e2a7ff40-310e-481f-8459-cde1034a0fbd/disk"/>
Nov 18 17:04:03 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:04:03 user nova-compute[74743]:     </disk>
Nov 18 17:04:03 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:04:03 user nova-compute[74743]:       <mac address="fa:16:3e:05:50:5c"/>
Nov 18 17:04:03 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:04:03 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:04:03 user nova-compute[74743]:       <target dev="tap9c7850d5-31"/>
Nov 18 17:04:03 user nova-compute[74743]:     </interface>
Nov 18 17:04:03 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:04:03 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/e2a7ff40-310e-481f-8459-cde1034a0fbd/console.log" append="off"/>
Nov 18 17:04:03 user nova-compute[74743]:     </serial>
Nov 18 17:04:03 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:04:03 user nova-compute[74743]:     <video>
Nov 18 17:04:03 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:04:03 user nova-compute[74743]:     </video>
Nov 18 17:04:03 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:04:03 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:04:03 user nova-compute[74743]:     </rng>
Nov 18 17:04:03 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:04:03 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:04:03 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:04:03 user nova-compute[74743]:     </memballoon>
Nov 18 17:04:03 user nova-compute[74743]:   </devices>
Nov 18 17:04:03 user nova-compute[74743]: </domain>
Nov 18 17:04:03 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:04:03 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:03:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-339350780',display_name='tempest-VolumesAssistedSnapshotsTest-server-339350780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-339350780',id=9,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPsKCzfUQWQXQ3/HK5Qqi9cFLmOjsEFKKg3Yt3iiY12xnfyRZ2/rFHMjTrP6mdiHsSuJltDbJQNayteqXWXOlImKAn5pi6TVuSSERYWV2Ta9KlxuVOYV5igWs/Mh+GxYkQ==',key_name='tempest-keypair-743524350',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7771c1adef144c06bc2635a551bf1c50',ramdisk_id='',reservation_id='r-ikw9ji6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-318796158',owner_user_name='tempest-VolumesAssistedSnapshotsTest-318796158-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:04:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c3fd257809b44b9ba4e8c60e1d988a9',uuid=e2a7ff40-310e-481f-8459-cde1034a0fbd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c7850d5-314e-4854-bbc1-b4e08037abd1", "address": "fa:16:3e:05:50:5c", "network": {"id": "55694218-7eff-4083-b98f-0604e4ac3c20", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-34716983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7771c1adef144c06bc2635a551bf1c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c7850d5-31", "ovs_interfaceid": "9c7850d5-314e-4854-bbc1-b4e08037abd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:04:03 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Converting VIF {"id": "9c7850d5-314e-4854-bbc1-b4e08037abd1", "address": "fa:16:3e:05:50:5c", "network": {"id": "55694218-7eff-4083-b98f-0604e4ac3c20", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-34716983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7771c1adef144c06bc2635a551bf1c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c7850d5-31", "ovs_interfaceid": "9c7850d5-314e-4854-bbc1-b4e08037abd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:04:03 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:50:5c,bridge_name='br-int',has_traffic_filtering=True,id=9c7850d5-314e-4854-bbc1-b4e08037abd1,network=Network(55694218-7eff-4083-b98f-0604e4ac3c20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c7850d5-31') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:04:03 user nova-compute[74743]: DEBUG os_vif [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:50:5c,bridge_name='br-int',has_traffic_filtering=True,id=9c7850d5-314e-4854-bbc1-b4e08037abd1,network=Network(55694218-7eff-4083-b98f-0604e4ac3c20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c7850d5-31') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:04:03 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:03 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:03 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:04:03 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:03 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f9e8f8a2-2f59-5c62-b5b2-b66583917670', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:03 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:03 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:04:03 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:03 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c7850d5-31, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:03 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9c7850d5-31, col_values=(('qos', UUID('2fa8b5fa-5538-44da-b966-9dded8180f3b')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:03 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9c7850d5-31, col_values=(('external_ids', {'iface-id': '9c7850d5-314e-4854-bbc1-b4e08037abd1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:50:5c', 'vm-uuid': 'e2a7ff40-310e-481f-8459-cde1034a0fbd'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:03 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:03 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:04:03 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:03 user nova-compute[74743]: INFO os_vif [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:50:5c,bridge_name='br-int',has_traffic_filtering=True,id=9c7850d5-314e-4854-bbc1-b4e08037abd1,network=Network(55694218-7eff-4083-b98f-0604e4ac3c20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c7850d5-31')
Nov 18 17:04:03 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:04:03 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] No VIF found with MAC fa:16:3e:05:50:5c, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:04:03 user nova-compute[74743]: DEBUG nova.compute.manager [req-7c5656a1-bc7a-445b-aa7f-b951438e291b req-d0566609-1ce8-4391-a60b-424894e0658c service nova] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Received event network-changed-9abd882a-72d9-46b9-9dc0-8bdd727125b2 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:04:03 user nova-compute[74743]: DEBUG nova.compute.manager [req-7c5656a1-bc7a-445b-aa7f-b951438e291b req-d0566609-1ce8-4391-a60b-424894e0658c service nova] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Refreshing instance network info cache due to event network-changed-9abd882a-72d9-46b9-9dc0-8bdd727125b2. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:04:03 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-7c5656a1-bc7a-445b-aa7f-b951438e291b req-d0566609-1ce8-4391-a60b-424894e0658c service nova] Acquiring lock "refresh_cache-fc4cdeb6-51ff-4090-a29d-d4f6105e15f3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:04:03 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-7c5656a1-bc7a-445b-aa7f-b951438e291b req-d0566609-1ce8-4391-a60b-424894e0658c service nova] Acquired lock "refresh_cache-fc4cdeb6-51ff-4090-a29d-d4f6105e15f3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:04:03 user nova-compute[74743]: DEBUG nova.network.neutron [req-7c5656a1-bc7a-445b-aa7f-b951438e291b req-d0566609-1ce8-4391-a60b-424894e0658c service nova] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Refreshing network info cache for port 9abd882a-72d9-46b9-9dc0-8bdd727125b2 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:04:03 user nova-compute[74743]: DEBUG nova.network.neutron [req-23282209-8470-4b5e-8f74-7635a1b2664b req-d85a7f43-0ad0-46d1-b414-c84a9b3d5121 service nova] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Updated VIF entry in instance network info cache for port 9c7850d5-314e-4854-bbc1-b4e08037abd1. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:04:03 user nova-compute[74743]: DEBUG nova.network.neutron [req-23282209-8470-4b5e-8f74-7635a1b2664b req-d85a7f43-0ad0-46d1-b414-c84a9b3d5121 service nova] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Updating instance_info_cache with network_info: [{"id": "9c7850d5-314e-4854-bbc1-b4e08037abd1", "address": "fa:16:3e:05:50:5c", "network": {"id": "55694218-7eff-4083-b98f-0604e4ac3c20", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-34716983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7771c1adef144c06bc2635a551bf1c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c7850d5-31", "ovs_interfaceid": "9c7850d5-314e-4854-bbc1-b4e08037abd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:04:03 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-23282209-8470-4b5e-8f74-7635a1b2664b req-d85a7f43-0ad0-46d1-b414-c84a9b3d5121 service nova] Releasing lock "refresh_cache-e2a7ff40-310e-481f-8459-cde1034a0fbd" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:04:04 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:04 user nova-compute[74743]: DEBUG nova.network.neutron [req-7c5656a1-bc7a-445b-aa7f-b951438e291b req-d0566609-1ce8-4391-a60b-424894e0658c service nova] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Updated VIF entry in instance network info cache for port 9abd882a-72d9-46b9-9dc0-8bdd727125b2. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:04:04 user nova-compute[74743]: DEBUG nova.network.neutron [req-7c5656a1-bc7a-445b-aa7f-b951438e291b req-d0566609-1ce8-4391-a60b-424894e0658c service nova] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Updating instance_info_cache with network_info: [{"id": "9abd882a-72d9-46b9-9dc0-8bdd727125b2", "address": "fa:16:3e:b0:f7:a6", "network": {"id": "b9dd5bf0-7dcc-4428-8496-f77a6e0ddbef", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-386192241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba340b1c9b03442ca58b2fef8ec6d60d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9abd882a-72", "ovs_interfaceid": "9abd882a-72d9-46b9-9dc0-8bdd727125b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:04:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-7c5656a1-bc7a-445b-aa7f-b951438e291b req-d0566609-1ce8-4391-a60b-424894e0658c service nova] Releasing lock "refresh_cache-fc4cdeb6-51ff-4090-a29d-d4f6105e15f3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:04:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:05 user nova-compute[74743]: DEBUG nova.compute.manager [req-58ab2351-c643-486f-9848-b687beb9525e req-e6dacf27-721c-49f3-8237-b9dc788cf7bb service nova] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Received event network-vif-plugged-9c7850d5-314e-4854-bbc1-b4e08037abd1 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:04:05 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-58ab2351-c643-486f-9848-b687beb9525e req-e6dacf27-721c-49f3-8237-b9dc788cf7bb service nova] Acquiring lock "e2a7ff40-310e-481f-8459-cde1034a0fbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:04:05 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-58ab2351-c643-486f-9848-b687beb9525e req-e6dacf27-721c-49f3-8237-b9dc788cf7bb service nova] Lock "e2a7ff40-310e-481f-8459-cde1034a0fbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:04:05 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-58ab2351-c643-486f-9848-b687beb9525e req-e6dacf27-721c-49f3-8237-b9dc788cf7bb service nova] Lock "e2a7ff40-310e-481f-8459-cde1034a0fbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:04:05 user nova-compute[74743]: DEBUG nova.compute.manager [req-58ab2351-c643-486f-9848-b687beb9525e req-e6dacf27-721c-49f3-8237-b9dc788cf7bb service nova] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] No waiting events found dispatching network-vif-plugged-9c7850d5-314e-4854-bbc1-b4e08037abd1 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:04:05 user nova-compute[74743]: WARNING nova.compute.manager [req-58ab2351-c643-486f-9848-b687beb9525e req-e6dacf27-721c-49f3-8237-b9dc788cf7bb service nova] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Received unexpected event network-vif-plugged-9c7850d5-314e-4854-bbc1-b4e08037abd1 for instance with vm_state building and task_state spawning.
Nov 18 17:04:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:07 user nova-compute[74743]: DEBUG nova.compute.manager [req-3b8be9c6-141e-4304-bc0b-d2fe71956a0e req-527af212-7bf4-43a0-ae3c-4a4dae8edb5e service nova] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Received event network-vif-plugged-9c7850d5-314e-4854-bbc1-b4e08037abd1 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:04:07 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3b8be9c6-141e-4304-bc0b-d2fe71956a0e req-527af212-7bf4-43a0-ae3c-4a4dae8edb5e service nova] Acquiring lock "e2a7ff40-310e-481f-8459-cde1034a0fbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:04:07 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3b8be9c6-141e-4304-bc0b-d2fe71956a0e req-527af212-7bf4-43a0-ae3c-4a4dae8edb5e service nova] Lock "e2a7ff40-310e-481f-8459-cde1034a0fbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:04:07 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3b8be9c6-141e-4304-bc0b-d2fe71956a0e req-527af212-7bf4-43a0-ae3c-4a4dae8edb5e service nova] Lock "e2a7ff40-310e-481f-8459-cde1034a0fbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:04:07 user nova-compute[74743]: DEBUG nova.compute.manager [req-3b8be9c6-141e-4304-bc0b-d2fe71956a0e req-527af212-7bf4-43a0-ae3c-4a4dae8edb5e service nova] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] No waiting events found dispatching network-vif-plugged-9c7850d5-314e-4854-bbc1-b4e08037abd1 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:04:07 user nova-compute[74743]: WARNING nova.compute.manager [req-3b8be9c6-141e-4304-bc0b-d2fe71956a0e req-527af212-7bf4-43a0-ae3c-4a4dae8edb5e service nova] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Received unexpected event network-vif-plugged-9c7850d5-314e-4854-bbc1-b4e08037abd1 for instance with vm_state building and task_state spawning.
Nov 18 17:04:07 user nova-compute[74743]: DEBUG nova.compute.manager [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:04:07 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Guest created on hypervisor {{(pid=74743) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 17:04:07 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Instance spawned successfully.
Nov 18 17:04:07 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 17:04:07 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Found default for hw_cdrom_bus of ide {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:04:07 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Found default for hw_disk_bus of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:04:07 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Found default for hw_input_bus of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:04:07 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Found default for hw_pointer_model of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:04:07 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Found default for hw_video_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:04:07 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Found default for hw_vif_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:04:08 user nova-compute[74743]: INFO nova.compute.manager [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Took 6.79 seconds to spawn the instance on the hypervisor.
Nov 18 17:04:08 user nova-compute[74743]: DEBUG nova.compute.manager [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:04:08 user nova-compute[74743]: INFO nova.compute.manager [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Took 8.02 seconds to build instance.
Nov 18 17:04:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-9c0fa4ed-dce5-4b43-8aca-0ad844800139 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Lock "e2a7ff40-310e-481f-8459-cde1034a0fbd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.216s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:04:08 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG nova.compute.manager [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Start spawning the instance on the hypervisor. {{(pid=74743) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Creating instance directory {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 17:04:09 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Creating image(s)
Nov 18 17:04:09 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Did not create local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Ensure instance console log exists: /opt/stack/data/nova/instances/fc4cdeb6-51ff-4090-a29d-d4f6105e15f3/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Start _get_guest_xml network_info=[{"id": "9abd882a-72d9-46b9-9dc0-8bdd727125b2", "address": "fa:16:3e:b0:f7:a6", "network": {"id": "b9dd5bf0-7dcc-4428-8496-f77a6e0ddbef", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-386192241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba340b1c9b03442ca58b2fef8ec6d60d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9abd882a-72", "ovs_interfaceid": "9abd882a-72d9-46b9-9dc0-8bdd727125b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '44cffb09-312f-4a66-880c-bf11c23f33a0', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KPiubrlw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fc4cdeb6-51ff-4090-a29d-d4f6105e15f3', 'attached_at': '', 'detached_at': '', 'volume_id': '47861a8d-8eb0-4239-a9b5-962337012ed8', 'serial': '47861a8d-8eb0-4239-a9b5-962337012ed8'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:04:09 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:04:09 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:04:09 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG os_brick.initiator.connector [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Factory for ISCSI on None {{(pid=74743) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Calling os-brick to attach iSCSI Volume {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KPiubrlw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:04:09 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:04:09 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:04:09 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:04:09 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:04:09 user nova-compute[74743]: INFO os_brick.initiator.connectors.iscsi [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 17:04:09 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 -p 172.16.0.220:3260 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c2a7ec-6e7e-450e-861b-4c25eb2f1149]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 17:04:09 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f69931a-189d-480f-9726-170580fc0e26]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8] added\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8] added
Nov 18 17:04:09 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.037s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f17523-7e42-4e0f-bb9f-f7063f5a7857]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c6cb88-12f3-4c15-b7c5-4ef000247f31]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KPiubrlw {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KPiubrlw" returned: 0 in 0.023s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb0d987-c2ec-423c-b6bf-512d8099e663]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KPiubrlw'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[067f8dbd-af38-4453-b75e-4704c9571235]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdcdb571-cd11-4268-8614-615fd7c5433f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 18 17:04:09 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:04:09 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 18 17:04:09 user nova-compute[74743]:  {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:04:09 user nova-compute[74743]: WARNING os_brick.initiator.connectors.iscsi [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 18 17:04:09 user nova-compute[74743]: 
Nov 18 17:04:09 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 -p 172.16.0.220:3260 --login {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:10 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3408263-528e-48a8-9be6-a7bfb6eca9dd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:10 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8, portal: 172.16.0.220,3260]
Nov 18 17:04:10 user nova-compute[74743]: Login to [iface: default, target: iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8, portal: 172.16.0.220,3260] successful.
Nov 18 17:04:10 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:04:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:10 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[343f6a57-79d0-4e0c-bda3-5f4972d384cc]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:10 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:04:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:10 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99f0ca4-7fc5-44db-b4fe-3c79d9c56a8d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:10 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:04:10 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:04:10 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:04:10 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:04:10 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:04:10 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Connected to 172.16.0.220:3260 {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 17:04:10 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74743) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 17:04:10 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74743) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 17:04:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:10 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6e6f68-f0f8-499c-b814-06431f8ba77c]: (4, ('- - 0', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:10 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:04:10 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KPiubrlw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 17:04:10 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:04:10 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Cleaning up deleted instances {{(pid=74743) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 18 17:04:10 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] There are 0 instances to clean {{(pid=74743) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 18 17:04:10 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:04:10 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Cleaning up deleted instances with incomplete migration  {{(pid=74743) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 18 17:04:10 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:04:11 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:04:11 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '26262396233373563', 'path': '/dev/sdb'} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:04:11 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262396233373563', 'path': '/dev/sdb'} {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 17:04:11 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:03:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-249778714',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-249778714',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM28SzHspmmwqm/7BfauIk9VldwafpsWIykch7gczsKSmKWidDt9xX54sYh31kKA3ijdAH08ekJdERVxFWwJ5PxDpqwRxmcm6s/pJQsbUZ4m6+AK3rHMz90lQEaJaoFkvQ==',key_name='tempest-keypair-2066506709',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba340b1c9b03442ca58b2fef8ec6d60d',ramdisk_id='',reservation_id='r-9w700wic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-507265829',owner_user_name='tempest-ServerActionsV293TestJSON-507265829-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:04:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c39539fc6bbd40628ff16ddd50054661',uuid=fc4cdeb6-51ff-4090-a29d-d4f6105e15f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9abd882a-72d9-46b9-9dc0-8bdd727125b2", "address": "fa:16:3e:b0:f7:a6", "network": {"id": "b9dd5bf0-7dcc-4428-8496-f77a6e0ddbef", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-386192241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba340b1c9b03442ca58b2fef8ec6d60d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9abd882a-72", "ovs_interfaceid": "9abd882a-72d9-46b9-9dc0-8bdd727125b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:04:11 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Converting VIF {"id": "9abd882a-72d9-46b9-9dc0-8bdd727125b2", "address": "fa:16:3e:b0:f7:a6", "network": {"id": "b9dd5bf0-7dcc-4428-8496-f77a6e0ddbef", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-386192241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba340b1c9b03442ca58b2fef8ec6d60d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9abd882a-72", "ovs_interfaceid": "9abd882a-72d9-46b9-9dc0-8bdd727125b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:04:11 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:f7:a6,bridge_name='br-int',has_traffic_filtering=True,id=9abd882a-72d9-46b9-9dc0-8bdd727125b2,network=Network(b9dd5bf0-7dcc-4428-8496-f77a6e0ddbef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9abd882a-72') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:04:11 user nova-compute[74743]: DEBUG nova.objects.instance [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Lazy-loading 'pci_devices' on Instance uuid fc4cdeb6-51ff-4090-a29d-d4f6105e15f3 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:04:11 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:04:11 user nova-compute[74743]:   <uuid>fc4cdeb6-51ff-4090-a29d-d4f6105e15f3</uuid>
Nov 18 17:04:11 user nova-compute[74743]:   <name>instance-00000008</name>
Nov 18 17:04:11 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:04:11 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:04:11 user nova-compute[74743]:   <metadata>
Nov 18 17:04:11 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:04:11 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:04:11 user nova-compute[74743]:       <nova:name>tempest-ServerActionsV293TestJSON-server-249778714</nova:name>
Nov 18 17:04:11 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:04:09</nova:creationTime>
Nov 18 17:04:11 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:04:11 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:04:11 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:04:11 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:04:11 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:04:11 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:04:11 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:04:11 user nova-compute[74743]:       <nova:owner>
Nov 18 17:04:11 user nova-compute[74743]:         <nova:user uuid="c39539fc6bbd40628ff16ddd50054661">tempest-ServerActionsV293TestJSON-507265829-project-member</nova:user>
Nov 18 17:04:11 user nova-compute[74743]:         <nova:project uuid="ba340b1c9b03442ca58b2fef8ec6d60d">tempest-ServerActionsV293TestJSON-507265829</nova:project>
Nov 18 17:04:11 user nova-compute[74743]:       </nova:owner>
Nov 18 17:04:11 user nova-compute[74743]:       <nova:ports>
Nov 18 17:04:11 user nova-compute[74743]:         <nova:port uuid="9abd882a-72d9-46b9-9dc0-8bdd727125b2">
Nov 18 17:04:11 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 18 17:04:11 user nova-compute[74743]:         </nova:port>
Nov 18 17:04:11 user nova-compute[74743]:       </nova:ports>
Nov 18 17:04:11 user nova-compute[74743]:     </nova:instance>
Nov 18 17:04:11 user nova-compute[74743]:   </metadata>
Nov 18 17:04:11 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:04:11 user nova-compute[74743]:     <system>
Nov 18 17:04:11 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:04:11 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:04:11 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:04:11 user nova-compute[74743]:       <entry name="serial">fc4cdeb6-51ff-4090-a29d-d4f6105e15f3</entry>
Nov 18 17:04:11 user nova-compute[74743]:       <entry name="uuid">fc4cdeb6-51ff-4090-a29d-d4f6105e15f3</entry>
Nov 18 17:04:11 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:04:11 user nova-compute[74743]:     </system>
Nov 18 17:04:11 user nova-compute[74743]:   </sysinfo>
Nov 18 17:04:11 user nova-compute[74743]:   <os>
Nov 18 17:04:11 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:04:11 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:04:11 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:04:11 user nova-compute[74743]:   </os>
Nov 18 17:04:11 user nova-compute[74743]:   <features>
Nov 18 17:04:11 user nova-compute[74743]:     <acpi/>
Nov 18 17:04:11 user nova-compute[74743]:     <apic/>
Nov 18 17:04:11 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:04:11 user nova-compute[74743]:   </features>
Nov 18 17:04:11 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:04:11 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:04:11 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:04:11 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:04:11 user nova-compute[74743]:   </clock>
Nov 18 17:04:11 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:04:11 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:04:11 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:04:11 user nova-compute[74743]:   </cpu>
Nov 18 17:04:11 user nova-compute[74743]:   <devices>
Nov 18 17:04:11 user nova-compute[74743]:     <disk type="block" device="disk">
Nov 18 17:04:11 user nova-compute[74743]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:04:11 user nova-compute[74743]:       <source dev="/dev/sdb"/>
Nov 18 17:04:11 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:04:11 user nova-compute[74743]:       <serial>47861a8d-8eb0-4239-a9b5-962337012ed8</serial>
Nov 18 17:04:11 user nova-compute[74743]:     </disk>
Nov 18 17:04:11 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:04:11 user nova-compute[74743]:       <mac address="fa:16:3e:b0:f7:a6"/>
Nov 18 17:04:11 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:04:11 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:04:11 user nova-compute[74743]:       <target dev="tap9abd882a-72"/>
Nov 18 17:04:11 user nova-compute[74743]:     </interface>
Nov 18 17:04:11 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:04:11 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/fc4cdeb6-51ff-4090-a29d-d4f6105e15f3/console.log" append="off"/>
Nov 18 17:04:11 user nova-compute[74743]:     </serial>
Nov 18 17:04:11 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:04:11 user nova-compute[74743]:     <video>
Nov 18 17:04:11 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:04:11 user nova-compute[74743]:     </video>
Nov 18 17:04:11 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:04:11 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:04:11 user nova-compute[74743]:     </rng>
Nov 18 17:04:11 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:04:11 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:04:11 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:04:11 user nova-compute[74743]:     </memballoon>
Nov 18 17:04:11 user nova-compute[74743]:   </devices>
Nov 18 17:04:11 user nova-compute[74743]: </domain>
Nov 18 17:04:11 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:04:11 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:03:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-249778714',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-249778714',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM28SzHspmmwqm/7BfauIk9VldwafpsWIykch7gczsKSmKWidDt9xX54sYh31kKA3ijdAH08ekJdERVxFWwJ5PxDpqwRxmcm6s/pJQsbUZ4m6+AK3rHMz90lQEaJaoFkvQ==',key_name='tempest-keypair-2066506709',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba340b1c9b03442ca58b2fef8ec6d60d',ramdisk_id='',reservation_id='r-9w700wic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-507265829',owner_user_name='tempest-ServerActionsV293TestJSON-507265829-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:04:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c39539fc6bbd40628ff16ddd50054661',uuid=fc4cdeb6-51ff-4090-a29d-d4f6105e15f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9abd882a-72d9-46b9-9dc0-8bdd727125b2", "address": "fa:16:3e:b0:f7:a6", "network": {"id": "b9dd5bf0-7dcc-4428-8496-f77a6e0ddbef", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-386192241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba340b1c9b03442ca58b2fef8ec6d60d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9abd882a-72", "ovs_interfaceid": "9abd882a-72d9-46b9-9dc0-8bdd727125b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:04:11 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Converting VIF {"id": "9abd882a-72d9-46b9-9dc0-8bdd727125b2", "address": "fa:16:3e:b0:f7:a6", "network": {"id": "b9dd5bf0-7dcc-4428-8496-f77a6e0ddbef", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-386192241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba340b1c9b03442ca58b2fef8ec6d60d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9abd882a-72", "ovs_interfaceid": "9abd882a-72d9-46b9-9dc0-8bdd727125b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:04:11 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:f7:a6,bridge_name='br-int',has_traffic_filtering=True,id=9abd882a-72d9-46b9-9dc0-8bdd727125b2,network=Network(b9dd5bf0-7dcc-4428-8496-f77a6e0ddbef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9abd882a-72') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:04:11 user nova-compute[74743]: DEBUG os_vif [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:f7:a6,bridge_name='br-int',has_traffic_filtering=True,id=9abd882a-72d9-46b9-9dc0-8bdd727125b2,network=Network(b9dd5bf0-7dcc-4428-8496-f77a6e0ddbef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9abd882a-72') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:04:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:04:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1e598279-caf4-597e-9380-918be1371f08', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:04:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9abd882a-72, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9abd882a-72, col_values=(('qos', UUID('479c80b0-aab4-4aaf-b86a-f2cd8320cd32')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9abd882a-72, col_values=(('external_ids', {'iface-id': '9abd882a-72d9-46b9-9dc0-8bdd727125b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:f7:a6', 'vm-uuid': 'fc4cdeb6-51ff-4090-a29d-d4f6105e15f3'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:04:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:11 user nova-compute[74743]: INFO os_vif [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:f7:a6,bridge_name='br-int',has_traffic_filtering=True,id=9abd882a-72d9-46b9-9dc0-8bdd727125b2,network=Network(b9dd5bf0-7dcc-4428-8496-f77a6e0ddbef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9abd882a-72')
Nov 18 17:04:11 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:04:11 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] No VIF found with MAC fa:16:3e:b0:f7:a6, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:04:12 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:12 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:12 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:13 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:13 user nova-compute[74743]: DEBUG nova.compute.manager [req-9d00565c-6a00-4913-b246-05468634f45d req-4e97b7bc-d0fd-4751-84af-3ce282ba0341 service nova] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Received event network-vif-plugged-999980cf-efd0-4b78-aa42-f4e80073b5a9 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:04:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-9d00565c-6a00-4913-b246-05468634f45d req-4e97b7bc-d0fd-4751-84af-3ce282ba0341 service nova] Acquiring lock "c006a4ad-a8e2-4108-9af1-dec4dd53fcda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:04:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-9d00565c-6a00-4913-b246-05468634f45d req-4e97b7bc-d0fd-4751-84af-3ce282ba0341 service nova] Lock "c006a4ad-a8e2-4108-9af1-dec4dd53fcda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:04:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-9d00565c-6a00-4913-b246-05468634f45d req-4e97b7bc-d0fd-4751-84af-3ce282ba0341 service nova] Lock "c006a4ad-a8e2-4108-9af1-dec4dd53fcda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:04:13 user nova-compute[74743]: DEBUG nova.compute.manager [req-9d00565c-6a00-4913-b246-05468634f45d req-4e97b7bc-d0fd-4751-84af-3ce282ba0341 service nova] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] No waiting events found dispatching network-vif-plugged-999980cf-efd0-4b78-aa42-f4e80073b5a9 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:04:13 user nova-compute[74743]: WARNING nova.compute.manager [req-9d00565c-6a00-4913-b246-05468634f45d req-4e97b7bc-d0fd-4751-84af-3ce282ba0341 service nova] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Received unexpected event network-vif-plugged-999980cf-efd0-4b78-aa42-f4e80073b5a9 for instance with vm_state active and task_state None.
Nov 18 17:04:13 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:04:13 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:04:13 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Starting heal instance info cache {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 17:04:13 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Rebuilding the list of instances to heal {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 17:04:13 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Skipping network cache update for instance because it is Building. {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 18 17:04:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "refresh_cache-4cce1628-2dcb-40c7-abd4-6a327a432de3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:04:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquired lock "refresh_cache-4cce1628-2dcb-40c7-abd4-6a327a432de3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:04:13 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Forcefully refreshing network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 17:04:13 user nova-compute[74743]: DEBUG nova.objects.instance [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lazy-loading 'info_cache' on Instance uuid 4cce1628-2dcb-40c7-abd4-6a327a432de3 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:04:13 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:13 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:13 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:14 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Updating instance_info_cache with network_info: [{"id": "28f81291-34bb-4a6f-890b-faea6ef8a385", "address": "fa:16:3e:47:f5:86", "network": {"id": "252343cc-f379-471d-a2c9-99b9a60ebcb4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25c06dc8e7be46229750b8e283622c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28f81291-34", "ovs_interfaceid": "28f81291-34bb-4a6f-890b-faea6ef8a385", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:04:14 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Releasing lock "refresh_cache-4cce1628-2dcb-40c7-abd4-6a327a432de3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:04:14 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Updated the network info_cache for instance {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 17:04:14 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:04:14 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:04:15 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:04:15 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:04:15 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:04:15 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74743) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 17:04:15 user nova-compute[74743]: DEBUG nova.compute.manager [req-a520254b-4380-4900-a0c0-c68ba7107953 req-cbcc57c9-12b0-4185-952c-66ed90df45d5 service nova] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Received event network-vif-plugged-999980cf-efd0-4b78-aa42-f4e80073b5a9 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:04:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a520254b-4380-4900-a0c0-c68ba7107953 req-cbcc57c9-12b0-4185-952c-66ed90df45d5 service nova] Acquiring lock "c006a4ad-a8e2-4108-9af1-dec4dd53fcda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:04:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a520254b-4380-4900-a0c0-c68ba7107953 req-cbcc57c9-12b0-4185-952c-66ed90df45d5 service nova] Lock "c006a4ad-a8e2-4108-9af1-dec4dd53fcda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:04:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a520254b-4380-4900-a0c0-c68ba7107953 req-cbcc57c9-12b0-4185-952c-66ed90df45d5 service nova] Lock "c006a4ad-a8e2-4108-9af1-dec4dd53fcda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:04:15 user nova-compute[74743]: DEBUG nova.compute.manager [req-a520254b-4380-4900-a0c0-c68ba7107953 req-cbcc57c9-12b0-4185-952c-66ed90df45d5 service nova] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] No waiting events found dispatching network-vif-plugged-999980cf-efd0-4b78-aa42-f4e80073b5a9 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:04:15 user nova-compute[74743]: WARNING nova.compute.manager [req-a520254b-4380-4900-a0c0-c68ba7107953 req-cbcc57c9-12b0-4185-952c-66ed90df45d5 service nova] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Received unexpected event network-vif-plugged-999980cf-efd0-4b78-aa42-f4e80073b5a9 for instance with vm_state active and task_state None.
Nov 18 17:04:15 user nova-compute[74743]: DEBUG nova.compute.manager [req-a520254b-4380-4900-a0c0-c68ba7107953 req-cbcc57c9-12b0-4185-952c-66ed90df45d5 service nova] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Received event network-vif-plugged-3fecf596-29c4-44af-bbe1-25589e8aa794 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:04:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a520254b-4380-4900-a0c0-c68ba7107953 req-cbcc57c9-12b0-4185-952c-66ed90df45d5 service nova] Acquiring lock "55192f7b-5aaf-42e6-926a-cf9f43e460ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:04:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a520254b-4380-4900-a0c0-c68ba7107953 req-cbcc57c9-12b0-4185-952c-66ed90df45d5 service nova] Lock "55192f7b-5aaf-42e6-926a-cf9f43e460ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:04:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a520254b-4380-4900-a0c0-c68ba7107953 req-cbcc57c9-12b0-4185-952c-66ed90df45d5 service nova] Lock "55192f7b-5aaf-42e6-926a-cf9f43e460ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:04:15 user nova-compute[74743]: DEBUG nova.compute.manager [req-a520254b-4380-4900-a0c0-c68ba7107953 req-cbcc57c9-12b0-4185-952c-66ed90df45d5 service nova] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] No waiting events found dispatching network-vif-plugged-3fecf596-29c4-44af-bbe1-25589e8aa794 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:04:15 user nova-compute[74743]: WARNING nova.compute.manager [req-a520254b-4380-4900-a0c0-c68ba7107953 req-cbcc57c9-12b0-4185-952c-66ed90df45d5 service nova] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Received unexpected event network-vif-plugged-3fecf596-29c4-44af-bbe1-25589e8aa794 for instance with vm_state active and task_state None.
Nov 18 17:04:15 user nova-compute[74743]: DEBUG nova.compute.manager [req-a520254b-4380-4900-a0c0-c68ba7107953 req-cbcc57c9-12b0-4185-952c-66ed90df45d5 service nova] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Received event network-vif-plugged-3fecf596-29c4-44af-bbe1-25589e8aa794 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:04:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a520254b-4380-4900-a0c0-c68ba7107953 req-cbcc57c9-12b0-4185-952c-66ed90df45d5 service nova] Acquiring lock "55192f7b-5aaf-42e6-926a-cf9f43e460ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:04:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a520254b-4380-4900-a0c0-c68ba7107953 req-cbcc57c9-12b0-4185-952c-66ed90df45d5 service nova] Lock "55192f7b-5aaf-42e6-926a-cf9f43e460ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:04:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a520254b-4380-4900-a0c0-c68ba7107953 req-cbcc57c9-12b0-4185-952c-66ed90df45d5 service nova] Lock "55192f7b-5aaf-42e6-926a-cf9f43e460ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:04:15 user nova-compute[74743]: DEBUG nova.compute.manager [req-a520254b-4380-4900-a0c0-c68ba7107953 req-cbcc57c9-12b0-4185-952c-66ed90df45d5 service nova] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] No waiting events found dispatching network-vif-plugged-3fecf596-29c4-44af-bbe1-25589e8aa794 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:04:15 user nova-compute[74743]: WARNING nova.compute.manager [req-a520254b-4380-4900-a0c0-c68ba7107953 req-cbcc57c9-12b0-4185-952c-66ed90df45d5 service nova] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Received unexpected event network-vif-plugged-3fecf596-29c4-44af-bbe1-25589e8aa794 for instance with vm_state active and task_state None.
Nov 18 17:04:15 user nova-compute[74743]: DEBUG nova.compute.manager [req-a520254b-4380-4900-a0c0-c68ba7107953 req-cbcc57c9-12b0-4185-952c-66ed90df45d5 service nova] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Received event network-vif-plugged-9abd882a-72d9-46b9-9dc0-8bdd727125b2 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:04:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a520254b-4380-4900-a0c0-c68ba7107953 req-cbcc57c9-12b0-4185-952c-66ed90df45d5 service nova] Acquiring lock "fc4cdeb6-51ff-4090-a29d-d4f6105e15f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:04:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a520254b-4380-4900-a0c0-c68ba7107953 req-cbcc57c9-12b0-4185-952c-66ed90df45d5 service nova] Lock "fc4cdeb6-51ff-4090-a29d-d4f6105e15f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:04:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a520254b-4380-4900-a0c0-c68ba7107953 req-cbcc57c9-12b0-4185-952c-66ed90df45d5 service nova] Lock "fc4cdeb6-51ff-4090-a29d-d4f6105e15f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:04:15 user nova-compute[74743]: DEBUG nova.compute.manager [req-a520254b-4380-4900-a0c0-c68ba7107953 req-cbcc57c9-12b0-4185-952c-66ed90df45d5 service nova] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] No waiting events found dispatching network-vif-plugged-9abd882a-72d9-46b9-9dc0-8bdd727125b2 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:04:15 user nova-compute[74743]: WARNING nova.compute.manager [req-a520254b-4380-4900-a0c0-c68ba7107953 req-cbcc57c9-12b0-4185-952c-66ed90df45d5 service nova] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Received unexpected event network-vif-plugged-9abd882a-72d9-46b9-9dc0-8bdd727125b2 for instance with vm_state building and task_state spawning.
Nov 18 17:04:15 user nova-compute[74743]: DEBUG nova.compute.manager [req-a520254b-4380-4900-a0c0-c68ba7107953 req-cbcc57c9-12b0-4185-952c-66ed90df45d5 service nova] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Received event network-vif-plugged-9abd882a-72d9-46b9-9dc0-8bdd727125b2 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:04:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a520254b-4380-4900-a0c0-c68ba7107953 req-cbcc57c9-12b0-4185-952c-66ed90df45d5 service nova] Acquiring lock "fc4cdeb6-51ff-4090-a29d-d4f6105e15f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:04:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a520254b-4380-4900-a0c0-c68ba7107953 req-cbcc57c9-12b0-4185-952c-66ed90df45d5 service nova] Lock "fc4cdeb6-51ff-4090-a29d-d4f6105e15f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:04:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a520254b-4380-4900-a0c0-c68ba7107953 req-cbcc57c9-12b0-4185-952c-66ed90df45d5 service nova] Lock "fc4cdeb6-51ff-4090-a29d-d4f6105e15f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:04:15 user nova-compute[74743]: DEBUG nova.compute.manager [req-a520254b-4380-4900-a0c0-c68ba7107953 req-cbcc57c9-12b0-4185-952c-66ed90df45d5 service nova] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] No waiting events found dispatching network-vif-plugged-9abd882a-72d9-46b9-9dc0-8bdd727125b2 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:04:15 user nova-compute[74743]: WARNING nova.compute.manager [req-a520254b-4380-4900-a0c0-c68ba7107953 req-cbcc57c9-12b0-4185-952c-66ed90df45d5 service nova] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Received unexpected event network-vif-plugged-9abd882a-72d9-46b9-9dc0-8bdd727125b2 for instance with vm_state building and task_state spawning.
Nov 18 17:04:15 user nova-compute[74743]: DEBUG nova.compute.manager [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:04:15 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Guest created on hypervisor {{(pid=74743) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 17:04:15 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Instance spawned successfully.
Nov 18 17:04:15 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 17:04:15 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Found default for hw_cdrom_bus of ide {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:04:15 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Found default for hw_disk_bus of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:04:15 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Found default for hw_input_bus of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:04:15 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Found default for hw_pointer_model of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:04:15 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Found default for hw_video_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:04:15 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Found default for hw_vif_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:04:15 user nova-compute[74743]: INFO nova.compute.manager [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Took 6.13 seconds to spawn the instance on the hypervisor.
Nov 18 17:04:15 user nova-compute[74743]: DEBUG nova.compute.manager [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:04:15 user nova-compute[74743]: INFO nova.compute.manager [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Took 17.07 seconds to build instance.
Nov 18 17:04:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-eb309b31-8a8f-4481-a8ec-c24db2ed9683 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Lock "fc4cdeb6-51ff-4090-a29d-d4f6105e15f3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.240s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:04:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:16 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:04:17 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:04:17 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:04:17 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:04:17 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:04:17 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Auditing locally available compute resources for user (node: user) {{(pid=74743) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 17:04:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:18 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:18 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/567feb03-a356-4347-b146-d8930ad60c11/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:18 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/567feb03-a356-4347-b146-d8930ad60c11/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:18 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/567feb03-a356-4347-b146-d8930ad60c11/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:18 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/567feb03-a356-4347-b146-d8930ad60c11/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:18 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2a7ff40-310e-481f-8459-cde1034a0fbd/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:18 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2a7ff40-310e-481f-8459-cde1034a0fbd/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:18 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2a7ff40-310e-481f-8459-cde1034a0fbd/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:18 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2a7ff40-310e-481f-8459-cde1034a0fbd/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:18 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d30a49de-abf1-4985-8dc5-6f7f24d51d2f/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d30a49de-abf1-4985-8dc5-6f7f24d51d2f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d30a49de-abf1-4985-8dc5-6f7f24d51d2f/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d30a49de-abf1-4985-8dc5-6f7f24d51d2f/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:04:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6111e9-59e9-4a30-870c-3d308a5d4936/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6111e9-59e9-4a30-870c-3d308a5d4936/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6111e9-59e9-4a30-870c-3d308a5d4936/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6111e9-59e9-4a30-870c-3d308a5d4936/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55192f7b-5aaf-42e6-926a-cf9f43e460ca/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55192f7b-5aaf-42e6-926a-cf9f43e460ca/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55192f7b-5aaf-42e6-926a-cf9f43e460ca/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55192f7b-5aaf-42e6-926a-cf9f43e460ca/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Acquiring lock "58edd8cc-a455-4922-8de8-c800a61e7b43" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:04:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:04:21 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:04:21 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:04:21 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Hypervisor/Node resource view: name=user free_ram=7334MB free_disk=25.728717803955078GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74743) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 17:04:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:04:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:04:21 user nova-compute[74743]: DEBUG nova.compute.manager [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Starting instance... {{(pid=74743) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 17:04:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Acquiring lock "8ed74254-d845-4810-965f-300a97ce3817" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:04:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Lock "8ed74254-d845-4810-965f-300a97ce3817" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:04:21 user nova-compute[74743]: DEBUG nova.compute.manager [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Starting instance... {{(pid=74743) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 17:04:22 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 8e6111e9-59e9-4a30-870c-3d308a5d4936 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:04:22 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 4cce1628-2dcb-40c7-abd4-6a327a432de3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:04:22 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance e9668e1c-1e8d-4dd7-8f58-d453db294557 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:04:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:04:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:04:22 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 58edd8cc-a455-4922-8de8-c800a61e7b43 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 18 17:04:22 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance d30a49de-abf1-4985-8dc5-6f7f24d51d2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:04:22 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance e2a7ff40-310e-481f-8459-cde1034a0fbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:04:22 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 567feb03-a356-4347-b146-d8930ad60c11 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:04:22 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 8ed74254-d845-4810-965f-300a97ce3817 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 18 17:04:22 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance fc4cdeb6-51ff-4090-a29d-d4f6105e15f3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:04:22 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 55192f7b-5aaf-42e6-926a-cf9f43e460ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:04:22 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance c006a4ad-a8e2-4108-9af1-dec4dd53fcda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:04:22 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 17:04:22 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 17:04:22 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Refreshing inventories for resource provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 18 17:04:22 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Updating ProviderTree inventory for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 18 17:04:22 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Updating inventory in ProviderTree for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 18 17:04:22 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Refreshing aggregate associations for resource provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8, aggregates: None {{(pid=74743) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 18 17:04:22 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Refreshing trait associations for resource provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=74743) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 18 17:04:22 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:04:22 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:04:22 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Compute_service record updated for user:user {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 17:04:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.088s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:04:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.777s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:04:22 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74743) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 17:04:22 user nova-compute[74743]: INFO nova.compute.claims [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Claim successful on node user
Nov 18 17:04:23 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:04:23 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:04:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.560s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:04:23 user nova-compute[74743]: DEBUG nova.compute.manager [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Start building networks asynchronously for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 17:04:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.342s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:04:23 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74743) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 17:04:23 user nova-compute[74743]: INFO nova.compute.claims [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Claim successful on node user
Nov 18 17:04:23 user nova-compute[74743]: DEBUG nova.compute.manager [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Allocating IP information in the background. {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 17:04:23 user nova-compute[74743]: DEBUG nova.network.neutron [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] allocate_for_instance() {{(pid=74743) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 17:04:23 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 17:04:23 user nova-compute[74743]: DEBUG nova.compute.manager [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Start building block device mappings for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 17:04:23 user nova-compute[74743]: INFO nova.virt.block_device [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Booting with volume 9f522558-51f6-48e8-baf6-d7e55732e9fe at /dev/vda
Nov 18 17:04:23 user nova-compute[74743]: DEBUG os_brick.utils [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:04:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:23 user nova-compute[74743]: DEBUG nova.policy [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cad6e6d43b3d474a888f6b02458b2ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499d0dc41fbb400ab2b83b5d5091d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74743) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 17:04:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:23 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f793477-e64d-465e-9103-13f9669e2fe4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1116acd8874d\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:23 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0511d4d0-6f84-46cc-a0e2-7f41e194cd71]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:23 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[412fa45c-7be4-436e-89bc-e08d61f8bcbb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:23 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0689364e-c61c-4e16-8c9b-f84dd4836610]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Running cmd (subprocess): nvme version {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] 'nvme version' failed. Not Retrying. {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:04:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] nvme not present on system {{(pid=74743) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 17:04:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:04:23 user nova-compute[74743]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 17:04:23 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c3dbfc-ea7c-4500-8126-23ed7b605148]: (4, '') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74743) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 17:04:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 17:04:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] LIGHTOS: no hostnqn found. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 17:04:23 user nova-compute[74743]: DEBUG os_brick.utils [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] <== get_connector_properties: return (173ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1116acd8874d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:04:23 user nova-compute[74743]: DEBUG nova.virt.block_device [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Updating existing volume attachment record: 52e1234b-06d4-4e0c-920d-1f9772a06861 {{(pid=74743) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 17:04:23 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:04:24 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:04:24 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.673s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:04:24 user nova-compute[74743]: DEBUG nova.compute.manager [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Start building networks asynchronously for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 17:04:24 user nova-compute[74743]: DEBUG nova.compute.manager [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Allocating IP information in the background. {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 17:04:24 user nova-compute[74743]: DEBUG nova.network.neutron [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] allocate_for_instance() {{(pid=74743) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 17:04:24 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 17:04:24 user nova-compute[74743]: DEBUG nova.compute.manager [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Start building block device mappings for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 17:04:24 user nova-compute[74743]: INFO nova.virt.block_device [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Booting with volume 7b0fcb91-3634-461b-acd1-c69cb0d51abc at /dev/vda
Nov 18 17:04:24 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:24 user nova-compute[74743]: DEBUG nova.policy [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '480793b3fb7848a89ae4add6c6cf2d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a9888c9a4349e896e6bdf2af37ef98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74743) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 17:04:24 user nova-compute[74743]: DEBUG os_brick.utils [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:04:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:24 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b66e756-9582-4723-b0fb-e10c940df00a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1116acd8874d\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:24 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[798abdfd-d2a5-4185-9a01-c41d2069753b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:24 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f471e9-7305-400e-a8b7-62f4cf91bc01]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:24 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde28f8b-5316-4c75-9af2-89db51b3c58c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Running cmd (subprocess): nvme version {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] 'nvme version' failed. Not Retrying. {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:04:24 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.nvmeof [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] nvme not present on system {{(pid=74743) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 17:04:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:24 user nova-compute[74743]: DEBUG nova.network.neutron [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Successfully created port: 34bfd284-1ef1-415a-9c96-f5ae24114a6a {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:04:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:04:24 user nova-compute[74743]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 17:04:24 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[55084a89-abed-44fe-87a9-9effdd4d0a18]: (4, '') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:24 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74743) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 17:04:24 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 17:04:24 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] LIGHTOS: no hostnqn found. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 17:04:24 user nova-compute[74743]: DEBUG os_brick.utils [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1116acd8874d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:04:24 user nova-compute[74743]: DEBUG nova.virt.block_device [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Updating existing volume attachment record: 1047c55e-ee89-4696-926d-4290b76bacb3 {{(pid=74743) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 17:04:25 user nova-compute[74743]: DEBUG nova.network.neutron [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Successfully created port: c646e401-7317-4e71-9ec5-5720fbc4b449 {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:04:25 user nova-compute[74743]: DEBUG nova.network.neutron [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Successfully created port: 64686449-f344-4a65-ac45-8e7ff3f8cd84 {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:04:25 user nova-compute[74743]: DEBUG nova.network.neutron [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Successfully created port: 8ba0c408-cb71-4fe5-88de-5ec1c8a81704 {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:04:26 user nova-compute[74743]: DEBUG nova.network.neutron [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Successfully created port: 9dd57873-8274-4099-b5a7-cefeabbbc308 {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:04:26 user nova-compute[74743]: DEBUG nova.network.neutron [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Successfully created port: 587569cd-f07c-4087-b7e7-66967dfcfcf7 {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:04:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:26 user nova-compute[74743]: DEBUG nova.network.neutron [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Successfully created port: c658955e-999b-40cf-bed4-b59459a8953a {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:04:27 user nova-compute[74743]: DEBUG nova.network.neutron [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Successfully created port: f4532d74-be0a-451a-ad58-d7b0d3aeb757 {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:04:27 user nova-compute[74743]: DEBUG nova.network.neutron [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Successfully created port: a44b1589-f08b-4d65-a6a0-bb0e95fcf2ab {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:04:27 user nova-compute[74743]: DEBUG nova.network.neutron [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Successfully created port: 2a12256b-0d24-4ffa-aac0-451c27187fc7 {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:04:28 user nova-compute[74743]: DEBUG nova.network.neutron [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Successfully updated port: 34bfd284-1ef1-415a-9c96-f5ae24114a6a {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:04:28 user nova-compute[74743]: DEBUG nova.compute.manager [req-b3fa7abb-3ef3-4b2c-83fe-cd9cef44d594 req-898108a8-62fd-450f-9f8e-e66a5c320734 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received event network-changed-34bfd284-1ef1-415a-9c96-f5ae24114a6a {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:04:28 user nova-compute[74743]: DEBUG nova.compute.manager [req-b3fa7abb-3ef3-4b2c-83fe-cd9cef44d594 req-898108a8-62fd-450f-9f8e-e66a5c320734 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Refreshing instance network info cache due to event network-changed-34bfd284-1ef1-415a-9c96-f5ae24114a6a. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:04:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b3fa7abb-3ef3-4b2c-83fe-cd9cef44d594 req-898108a8-62fd-450f-9f8e-e66a5c320734 service nova] Acquiring lock "refresh_cache-58edd8cc-a455-4922-8de8-c800a61e7b43" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:04:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b3fa7abb-3ef3-4b2c-83fe-cd9cef44d594 req-898108a8-62fd-450f-9f8e-e66a5c320734 service nova] Acquired lock "refresh_cache-58edd8cc-a455-4922-8de8-c800a61e7b43" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:04:28 user nova-compute[74743]: DEBUG nova.network.neutron [req-b3fa7abb-3ef3-4b2c-83fe-cd9cef44d594 req-898108a8-62fd-450f-9f8e-e66a5c320734 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Refreshing network info cache for port 34bfd284-1ef1-415a-9c96-f5ae24114a6a {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:04:28 user nova-compute[74743]: DEBUG nova.network.neutron [req-b3fa7abb-3ef3-4b2c-83fe-cd9cef44d594 req-898108a8-62fd-450f-9f8e-e66a5c320734 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:04:28 user nova-compute[74743]: DEBUG nova.network.neutron [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Successfully updated port: c646e401-7317-4e71-9ec5-5720fbc4b449 {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:04:28 user nova-compute[74743]: DEBUG nova.compute.manager [req-c24f9def-3006-496b-87b5-66d17d74a54e req-858de901-d775-46e5-a688-649dab638dba service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received event network-changed-c646e401-7317-4e71-9ec5-5720fbc4b449 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:04:28 user nova-compute[74743]: DEBUG nova.compute.manager [req-c24f9def-3006-496b-87b5-66d17d74a54e req-858de901-d775-46e5-a688-649dab638dba service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Refreshing instance network info cache due to event network-changed-c646e401-7317-4e71-9ec5-5720fbc4b449. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:04:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-c24f9def-3006-496b-87b5-66d17d74a54e req-858de901-d775-46e5-a688-649dab638dba service nova] Acquiring lock "refresh_cache-8ed74254-d845-4810-965f-300a97ce3817" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:04:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-c24f9def-3006-496b-87b5-66d17d74a54e req-858de901-d775-46e5-a688-649dab638dba service nova] Acquired lock "refresh_cache-8ed74254-d845-4810-965f-300a97ce3817" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:04:28 user nova-compute[74743]: DEBUG nova.network.neutron [req-c24f9def-3006-496b-87b5-66d17d74a54e req-858de901-d775-46e5-a688-649dab638dba service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Refreshing network info cache for port c646e401-7317-4e71-9ec5-5720fbc4b449 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:04:28 user nova-compute[74743]: DEBUG nova.network.neutron [req-c24f9def-3006-496b-87b5-66d17d74a54e req-858de901-d775-46e5-a688-649dab638dba service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:04:28 user nova-compute[74743]: DEBUG nova.network.neutron [req-b3fa7abb-3ef3-4b2c-83fe-cd9cef44d594 req-898108a8-62fd-450f-9f8e-e66a5c320734 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:04:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b3fa7abb-3ef3-4b2c-83fe-cd9cef44d594 req-898108a8-62fd-450f-9f8e-e66a5c320734 service nova] Releasing lock "refresh_cache-58edd8cc-a455-4922-8de8-c800a61e7b43" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:04:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:29 user nova-compute[74743]: DEBUG nova.network.neutron [req-c24f9def-3006-496b-87b5-66d17d74a54e req-858de901-d775-46e5-a688-649dab638dba service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:04:29 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-c24f9def-3006-496b-87b5-66d17d74a54e req-858de901-d775-46e5-a688-649dab638dba service nova] Releasing lock "refresh_cache-8ed74254-d845-4810-965f-300a97ce3817" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:04:29 user nova-compute[74743]: DEBUG nova.network.neutron [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Successfully updated port: 36ac949f-e4af-432f-b042-62e8614b5b84 {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:04:29 user nova-compute[74743]: DEBUG nova.network.neutron [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Successfully updated port: f7d1b2be-29b6-45a1-9917-d16b576a84b2 {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:04:30 user nova-compute[74743]: DEBUG nova.network.neutron [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Successfully updated port: 2937523f-15c9-4fe4-9f7c-174b941035e8 {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:04:30 user nova-compute[74743]: DEBUG nova.network.neutron [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Successfully updated port: 2629b394-59bc-4ddd-9d05-3fa4fbb15b55 {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:04:30 user nova-compute[74743]: DEBUG nova.compute.manager [req-95809605-eb60-4aa9-ab2e-80510ce33943 req-51a38bc9-cbca-4917-8068-cb78f0981ddf service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received event network-changed-f7d1b2be-29b6-45a1-9917-d16b576a84b2 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:04:30 user nova-compute[74743]: DEBUG nova.compute.manager [req-95809605-eb60-4aa9-ab2e-80510ce33943 req-51a38bc9-cbca-4917-8068-cb78f0981ddf service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Refreshing instance network info cache due to event network-changed-f7d1b2be-29b6-45a1-9917-d16b576a84b2. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:04:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-95809605-eb60-4aa9-ab2e-80510ce33943 req-51a38bc9-cbca-4917-8068-cb78f0981ddf service nova] Acquiring lock "refresh_cache-58edd8cc-a455-4922-8de8-c800a61e7b43" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:04:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-95809605-eb60-4aa9-ab2e-80510ce33943 req-51a38bc9-cbca-4917-8068-cb78f0981ddf service nova] Acquired lock "refresh_cache-58edd8cc-a455-4922-8de8-c800a61e7b43" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:04:30 user nova-compute[74743]: DEBUG nova.network.neutron [req-95809605-eb60-4aa9-ab2e-80510ce33943 req-51a38bc9-cbca-4917-8068-cb78f0981ddf service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Refreshing network info cache for port f7d1b2be-29b6-45a1-9917-d16b576a84b2 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:04:30 user nova-compute[74743]: INFO nova.virt.block_device [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Booting with volume 09d9fafc-921d-4018-91a8-ea22e51fcb9f at /dev/vdb
Nov 18 17:04:30 user nova-compute[74743]: DEBUG nova.compute.manager [req-049e6867-c6aa-42cf-b29b-966bc233db0a req-181aaea5-69cd-4af0-a299-cfd2d3693f92 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received event network-changed-36ac949f-e4af-432f-b042-62e8614b5b84 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:04:30 user nova-compute[74743]: DEBUG nova.compute.manager [req-049e6867-c6aa-42cf-b29b-966bc233db0a req-181aaea5-69cd-4af0-a299-cfd2d3693f92 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Refreshing instance network info cache due to event network-changed-36ac949f-e4af-432f-b042-62e8614b5b84. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:04:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-049e6867-c6aa-42cf-b29b-966bc233db0a req-181aaea5-69cd-4af0-a299-cfd2d3693f92 service nova] Acquiring lock "refresh_cache-8ed74254-d845-4810-965f-300a97ce3817" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:04:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-049e6867-c6aa-42cf-b29b-966bc233db0a req-181aaea5-69cd-4af0-a299-cfd2d3693f92 service nova] Acquired lock "refresh_cache-8ed74254-d845-4810-965f-300a97ce3817" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:04:30 user nova-compute[74743]: DEBUG nova.network.neutron [req-049e6867-c6aa-42cf-b29b-966bc233db0a req-181aaea5-69cd-4af0-a299-cfd2d3693f92 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Refreshing network info cache for port 36ac949f-e4af-432f-b042-62e8614b5b84 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:04:30 user nova-compute[74743]: DEBUG nova.network.neutron [req-95809605-eb60-4aa9-ab2e-80510ce33943 req-51a38bc9-cbca-4917-8068-cb78f0981ddf service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:04:30 user nova-compute[74743]: DEBUG os_brick.utils [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:04:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:30 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec8724f-339b-4ca5-b7b2-bd3cd404eedb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1116acd8874d\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:30 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[84cc5fbe-9570-499d-8473-4d6ca5291749]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:30 user nova-compute[74743]: DEBUG nova.network.neutron [req-049e6867-c6aa-42cf-b29b-966bc233db0a req-181aaea5-69cd-4af0-a299-cfd2d3693f92 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:04:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:30 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[109a516a-6936-4453-86c6-3d64a8af5917]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:30 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[48943b6b-bf57-48a3-bd94-292f168a5531]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Running cmd (subprocess): nvme version {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] 'nvme version' failed. Not Retrying. {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:04:30 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] nvme not present on system {{(pid=74743) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 17:04:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:30 user nova-compute[74743]: DEBUG nova.network.neutron [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Successfully updated port: 8ba0c408-cb71-4fe5-88de-5ec1c8a81704 {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:04:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:04:30 user nova-compute[74743]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 17:04:30 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a4ceca-6f93-4d8e-9020-755c823d9063]: (4, '') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:30 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74743) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 17:04:30 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 17:04:30 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] LIGHTOS: no hostnqn found. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 17:04:30 user nova-compute[74743]: DEBUG os_brick.utils [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1116acd8874d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:04:30 user nova-compute[74743]: DEBUG nova.virt.block_device [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Updating existing volume attachment record: 3ea5637b-772f-450a-adb9-5360c2b11ce0 {{(pid=74743) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 17:04:31 user nova-compute[74743]: DEBUG nova.network.neutron [req-049e6867-c6aa-42cf-b29b-966bc233db0a req-181aaea5-69cd-4af0-a299-cfd2d3693f92 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:04:31 user nova-compute[74743]: DEBUG nova.network.neutron [req-95809605-eb60-4aa9-ab2e-80510ce33943 req-51a38bc9-cbca-4917-8068-cb78f0981ddf service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:04:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-95809605-eb60-4aa9-ab2e-80510ce33943 req-51a38bc9-cbca-4917-8068-cb78f0981ddf service nova] Releasing lock "refresh_cache-58edd8cc-a455-4922-8de8-c800a61e7b43" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:04:31 user nova-compute[74743]: DEBUG nova.compute.manager [req-95809605-eb60-4aa9-ab2e-80510ce33943 req-51a38bc9-cbca-4917-8068-cb78f0981ddf service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received event network-changed-2629b394-59bc-4ddd-9d05-3fa4fbb15b55 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:04:31 user nova-compute[74743]: DEBUG nova.compute.manager [req-95809605-eb60-4aa9-ab2e-80510ce33943 req-51a38bc9-cbca-4917-8068-cb78f0981ddf service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Refreshing instance network info cache due to event network-changed-2629b394-59bc-4ddd-9d05-3fa4fbb15b55. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:04:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-95809605-eb60-4aa9-ab2e-80510ce33943 req-51a38bc9-cbca-4917-8068-cb78f0981ddf service nova] Acquiring lock "refresh_cache-58edd8cc-a455-4922-8de8-c800a61e7b43" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:04:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-95809605-eb60-4aa9-ab2e-80510ce33943 req-51a38bc9-cbca-4917-8068-cb78f0981ddf service nova] Acquired lock "refresh_cache-58edd8cc-a455-4922-8de8-c800a61e7b43" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:04:31 user nova-compute[74743]: DEBUG nova.network.neutron [req-95809605-eb60-4aa9-ab2e-80510ce33943 req-51a38bc9-cbca-4917-8068-cb78f0981ddf service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Refreshing network info cache for port 2629b394-59bc-4ddd-9d05-3fa4fbb15b55 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:04:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-049e6867-c6aa-42cf-b29b-966bc233db0a req-181aaea5-69cd-4af0-a299-cfd2d3693f92 service nova] Releasing lock "refresh_cache-8ed74254-d845-4810-965f-300a97ce3817" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:04:31 user nova-compute[74743]: DEBUG nova.compute.manager [req-049e6867-c6aa-42cf-b29b-966bc233db0a req-181aaea5-69cd-4af0-a299-cfd2d3693f92 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received event network-changed-2937523f-15c9-4fe4-9f7c-174b941035e8 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:04:31 user nova-compute[74743]: DEBUG nova.compute.manager [req-049e6867-c6aa-42cf-b29b-966bc233db0a req-181aaea5-69cd-4af0-a299-cfd2d3693f92 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Refreshing instance network info cache due to event network-changed-2937523f-15c9-4fe4-9f7c-174b941035e8. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:04:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-049e6867-c6aa-42cf-b29b-966bc233db0a req-181aaea5-69cd-4af0-a299-cfd2d3693f92 service nova] Acquiring lock "refresh_cache-8ed74254-d845-4810-965f-300a97ce3817" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:04:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-049e6867-c6aa-42cf-b29b-966bc233db0a req-181aaea5-69cd-4af0-a299-cfd2d3693f92 service nova] Acquired lock "refresh_cache-8ed74254-d845-4810-965f-300a97ce3817" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:04:31 user nova-compute[74743]: DEBUG nova.network.neutron [req-049e6867-c6aa-42cf-b29b-966bc233db0a req-181aaea5-69cd-4af0-a299-cfd2d3693f92 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Refreshing network info cache for port 2937523f-15c9-4fe4-9f7c-174b941035e8 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:04:31 user nova-compute[74743]: DEBUG nova.network.neutron [req-95809605-eb60-4aa9-ab2e-80510ce33943 req-51a38bc9-cbca-4917-8068-cb78f0981ddf service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:04:31 user nova-compute[74743]: DEBUG nova.network.neutron [req-049e6867-c6aa-42cf-b29b-966bc233db0a req-181aaea5-69cd-4af0-a299-cfd2d3693f92 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:04:31 user nova-compute[74743]: DEBUG nova.network.neutron [req-049e6867-c6aa-42cf-b29b-966bc233db0a req-181aaea5-69cd-4af0-a299-cfd2d3693f92 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:04:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-049e6867-c6aa-42cf-b29b-966bc233db0a req-181aaea5-69cd-4af0-a299-cfd2d3693f92 service nova] Releasing lock "refresh_cache-8ed74254-d845-4810-965f-300a97ce3817" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:04:31 user nova-compute[74743]: DEBUG nova.network.neutron [req-95809605-eb60-4aa9-ab2e-80510ce33943 req-51a38bc9-cbca-4917-8068-cb78f0981ddf service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:04:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-95809605-eb60-4aa9-ab2e-80510ce33943 req-51a38bc9-cbca-4917-8068-cb78f0981ddf service nova] Releasing lock "refresh_cache-58edd8cc-a455-4922-8de8-c800a61e7b43" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:04:31 user nova-compute[74743]: DEBUG nova.network.neutron [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Successfully updated port: 64686449-f344-4a65-ac45-8e7ff3f8cd84 {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:04:31 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:31 user nova-compute[74743]: DEBUG nova.network.neutron [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Successfully updated port: 587569cd-f07c-4087-b7e7-66967dfcfcf7 {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:04:31 user nova-compute[74743]: INFO nova.virt.block_device [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Booting with volume 8acd2ae2-7bae-49e7-99e2-e5dd725746fd at /dev/vdb
Nov 18 17:04:32 user nova-compute[74743]: DEBUG os_brick.utils [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:04:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:32 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6dbd2b-3bfe-4336-922b-fd7e4099ed71]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1116acd8874d\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:32 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c7d739-f500-4868-8ff9-db05df781ea6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:32 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[358853d9-bb98-481f-8a9d-0b7b944aa20f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:32 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0350cffd-98cc-4e52-bfd7-29a2616776c4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Running cmd (subprocess): nvme version {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] 'nvme version' failed. Not Retrying. {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:04:32 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.nvmeof [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] nvme not present on system {{(pid=74743) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 17:04:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:04:32 user nova-compute[74743]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 17:04:32 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[736d896d-8e1a-4e77-a24a-b5cda81f23f2]: (4, '') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:32 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74743) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 17:04:32 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 17:04:32 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] LIGHTOS: no hostnqn found. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 17:04:32 user nova-compute[74743]: DEBUG os_brick.utils [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1116acd8874d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:04:32 user nova-compute[74743]: DEBUG nova.virt.block_device [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Updating existing volume attachment record: 30af33c7-5af5-47fa-81ff-3521c1fbda3b {{(pid=74743) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 17:04:32 user nova-compute[74743]: DEBUG nova.network.neutron [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Successfully updated port: 9dd57873-8274-4099-b5a7-cefeabbbc308 {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:04:32 user nova-compute[74743]: DEBUG nova.network.neutron [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Successfully updated port: f4532d74-be0a-451a-ad58-d7b0d3aeb757 {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:04:32 user nova-compute[74743]: DEBUG nova.compute.manager [req-a2d629a0-1baa-4818-bdaa-fb0ddc506ae3 req-9762a64b-d0b8-4319-a1f9-6c285b8b70f2 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received event network-changed-64686449-f344-4a65-ac45-8e7ff3f8cd84 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:04:32 user nova-compute[74743]: DEBUG nova.compute.manager [req-a2d629a0-1baa-4818-bdaa-fb0ddc506ae3 req-9762a64b-d0b8-4319-a1f9-6c285b8b70f2 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Refreshing instance network info cache due to event network-changed-64686449-f344-4a65-ac45-8e7ff3f8cd84. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:04:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a2d629a0-1baa-4818-bdaa-fb0ddc506ae3 req-9762a64b-d0b8-4319-a1f9-6c285b8b70f2 service nova] Acquiring lock "refresh_cache-58edd8cc-a455-4922-8de8-c800a61e7b43" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:04:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a2d629a0-1baa-4818-bdaa-fb0ddc506ae3 req-9762a64b-d0b8-4319-a1f9-6c285b8b70f2 service nova] Acquired lock "refresh_cache-58edd8cc-a455-4922-8de8-c800a61e7b43" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:04:32 user nova-compute[74743]: DEBUG nova.network.neutron [req-a2d629a0-1baa-4818-bdaa-fb0ddc506ae3 req-9762a64b-d0b8-4319-a1f9-6c285b8b70f2 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Refreshing network info cache for port 64686449-f344-4a65-ac45-8e7ff3f8cd84 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:04:32 user nova-compute[74743]: DEBUG nova.compute.manager [req-225e50e1-c4d4-4551-971c-43815e094cc2 req-842d5a6f-4ce3-4cf2-81de-e06214082be4 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received event network-changed-8ba0c408-cb71-4fe5-88de-5ec1c8a81704 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:04:32 user nova-compute[74743]: DEBUG nova.compute.manager [req-225e50e1-c4d4-4551-971c-43815e094cc2 req-842d5a6f-4ce3-4cf2-81de-e06214082be4 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Refreshing instance network info cache due to event network-changed-8ba0c408-cb71-4fe5-88de-5ec1c8a81704. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:04:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-225e50e1-c4d4-4551-971c-43815e094cc2 req-842d5a6f-4ce3-4cf2-81de-e06214082be4 service nova] Acquiring lock "refresh_cache-8ed74254-d845-4810-965f-300a97ce3817" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:04:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-225e50e1-c4d4-4551-971c-43815e094cc2 req-842d5a6f-4ce3-4cf2-81de-e06214082be4 service nova] Acquired lock "refresh_cache-8ed74254-d845-4810-965f-300a97ce3817" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:04:32 user nova-compute[74743]: DEBUG nova.network.neutron [req-225e50e1-c4d4-4551-971c-43815e094cc2 req-842d5a6f-4ce3-4cf2-81de-e06214082be4 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Refreshing network info cache for port 8ba0c408-cb71-4fe5-88de-5ec1c8a81704 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:04:32 user nova-compute[74743]: DEBUG nova.network.neutron [req-a2d629a0-1baa-4818-bdaa-fb0ddc506ae3 req-9762a64b-d0b8-4319-a1f9-6c285b8b70f2 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:04:32 user nova-compute[74743]: DEBUG nova.network.neutron [req-225e50e1-c4d4-4551-971c-43815e094cc2 req-842d5a6f-4ce3-4cf2-81de-e06214082be4 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:04:33 user nova-compute[74743]: DEBUG nova.network.neutron [req-225e50e1-c4d4-4551-971c-43815e094cc2 req-842d5a6f-4ce3-4cf2-81de-e06214082be4 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:04:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-225e50e1-c4d4-4551-971c-43815e094cc2 req-842d5a6f-4ce3-4cf2-81de-e06214082be4 service nova] Releasing lock "refresh_cache-8ed74254-d845-4810-965f-300a97ce3817" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:04:33 user nova-compute[74743]: DEBUG nova.compute.manager [req-225e50e1-c4d4-4551-971c-43815e094cc2 req-842d5a6f-4ce3-4cf2-81de-e06214082be4 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received event network-changed-587569cd-f07c-4087-b7e7-66967dfcfcf7 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:04:33 user nova-compute[74743]: DEBUG nova.compute.manager [req-225e50e1-c4d4-4551-971c-43815e094cc2 req-842d5a6f-4ce3-4cf2-81de-e06214082be4 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Refreshing instance network info cache due to event network-changed-587569cd-f07c-4087-b7e7-66967dfcfcf7. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:04:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-225e50e1-c4d4-4551-971c-43815e094cc2 req-842d5a6f-4ce3-4cf2-81de-e06214082be4 service nova] Acquiring lock "refresh_cache-8ed74254-d845-4810-965f-300a97ce3817" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:04:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-225e50e1-c4d4-4551-971c-43815e094cc2 req-842d5a6f-4ce3-4cf2-81de-e06214082be4 service nova] Acquired lock "refresh_cache-8ed74254-d845-4810-965f-300a97ce3817" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:04:33 user nova-compute[74743]: DEBUG nova.network.neutron [req-225e50e1-c4d4-4551-971c-43815e094cc2 req-842d5a6f-4ce3-4cf2-81de-e06214082be4 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Refreshing network info cache for port 587569cd-f07c-4087-b7e7-66967dfcfcf7 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:04:33 user nova-compute[74743]: DEBUG nova.network.neutron [req-225e50e1-c4d4-4551-971c-43815e094cc2 req-842d5a6f-4ce3-4cf2-81de-e06214082be4 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:04:33 user nova-compute[74743]: DEBUG nova.network.neutron [req-a2d629a0-1baa-4818-bdaa-fb0ddc506ae3 req-9762a64b-d0b8-4319-a1f9-6c285b8b70f2 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:04:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a2d629a0-1baa-4818-bdaa-fb0ddc506ae3 req-9762a64b-d0b8-4319-a1f9-6c285b8b70f2 service nova] Releasing lock "refresh_cache-58edd8cc-a455-4922-8de8-c800a61e7b43" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:04:33 user nova-compute[74743]: DEBUG nova.compute.manager [req-a2d629a0-1baa-4818-bdaa-fb0ddc506ae3 req-9762a64b-d0b8-4319-a1f9-6c285b8b70f2 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received event network-changed-9dd57873-8274-4099-b5a7-cefeabbbc308 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:04:33 user nova-compute[74743]: DEBUG nova.compute.manager [req-a2d629a0-1baa-4818-bdaa-fb0ddc506ae3 req-9762a64b-d0b8-4319-a1f9-6c285b8b70f2 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Refreshing instance network info cache due to event network-changed-9dd57873-8274-4099-b5a7-cefeabbbc308. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:04:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a2d629a0-1baa-4818-bdaa-fb0ddc506ae3 req-9762a64b-d0b8-4319-a1f9-6c285b8b70f2 service nova] Acquiring lock "refresh_cache-58edd8cc-a455-4922-8de8-c800a61e7b43" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:04:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a2d629a0-1baa-4818-bdaa-fb0ddc506ae3 req-9762a64b-d0b8-4319-a1f9-6c285b8b70f2 service nova] Acquired lock "refresh_cache-58edd8cc-a455-4922-8de8-c800a61e7b43" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:04:33 user nova-compute[74743]: DEBUG nova.network.neutron [req-a2d629a0-1baa-4818-bdaa-fb0ddc506ae3 req-9762a64b-d0b8-4319-a1f9-6c285b8b70f2 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Refreshing network info cache for port 9dd57873-8274-4099-b5a7-cefeabbbc308 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:04:33 user nova-compute[74743]: DEBUG nova.network.neutron [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Successfully updated port: c658955e-999b-40cf-bed4-b59459a8953a {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:04:33 user nova-compute[74743]: DEBUG nova.network.neutron [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Successfully updated port: 2a12256b-0d24-4ffa-aac0-451c27187fc7 {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:04:33 user nova-compute[74743]: DEBUG nova.network.neutron [req-a2d629a0-1baa-4818-bdaa-fb0ddc506ae3 req-9762a64b-d0b8-4319-a1f9-6c285b8b70f2 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:04:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Acquiring lock "refresh_cache-8ed74254-d845-4810-965f-300a97ce3817" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:04:33 user nova-compute[74743]: DEBUG nova.network.neutron [req-225e50e1-c4d4-4551-971c-43815e094cc2 req-842d5a6f-4ce3-4cf2-81de-e06214082be4 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:04:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-225e50e1-c4d4-4551-971c-43815e094cc2 req-842d5a6f-4ce3-4cf2-81de-e06214082be4 service nova] Releasing lock "refresh_cache-8ed74254-d845-4810-965f-300a97ce3817" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:04:33 user nova-compute[74743]: DEBUG nova.compute.manager [req-225e50e1-c4d4-4551-971c-43815e094cc2 req-842d5a6f-4ce3-4cf2-81de-e06214082be4 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received event network-changed-f4532d74-be0a-451a-ad58-d7b0d3aeb757 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:04:33 user nova-compute[74743]: DEBUG nova.compute.manager [req-225e50e1-c4d4-4551-971c-43815e094cc2 req-842d5a6f-4ce3-4cf2-81de-e06214082be4 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Refreshing instance network info cache due to event network-changed-f4532d74-be0a-451a-ad58-d7b0d3aeb757. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:04:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-225e50e1-c4d4-4551-971c-43815e094cc2 req-842d5a6f-4ce3-4cf2-81de-e06214082be4 service nova] Acquiring lock "refresh_cache-8ed74254-d845-4810-965f-300a97ce3817" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:04:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-225e50e1-c4d4-4551-971c-43815e094cc2 req-842d5a6f-4ce3-4cf2-81de-e06214082be4 service nova] Acquired lock "refresh_cache-8ed74254-d845-4810-965f-300a97ce3817" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:04:33 user nova-compute[74743]: DEBUG nova.network.neutron [req-225e50e1-c4d4-4551-971c-43815e094cc2 req-842d5a6f-4ce3-4cf2-81de-e06214082be4 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Refreshing network info cache for port f4532d74-be0a-451a-ad58-d7b0d3aeb757 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:04:33 user nova-compute[74743]: DEBUG nova.network.neutron [req-a2d629a0-1baa-4818-bdaa-fb0ddc506ae3 req-9762a64b-d0b8-4319-a1f9-6c285b8b70f2 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:04:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a2d629a0-1baa-4818-bdaa-fb0ddc506ae3 req-9762a64b-d0b8-4319-a1f9-6c285b8b70f2 service nova] Releasing lock "refresh_cache-58edd8cc-a455-4922-8de8-c800a61e7b43" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:04:33 user nova-compute[74743]: DEBUG nova.network.neutron [req-225e50e1-c4d4-4551-971c-43815e094cc2 req-842d5a6f-4ce3-4cf2-81de-e06214082be4 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:04:33 user nova-compute[74743]: DEBUG nova.network.neutron [req-225e50e1-c4d4-4551-971c-43815e094cc2 req-842d5a6f-4ce3-4cf2-81de-e06214082be4 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:04:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-225e50e1-c4d4-4551-971c-43815e094cc2 req-842d5a6f-4ce3-4cf2-81de-e06214082be4 service nova] Releasing lock "refresh_cache-8ed74254-d845-4810-965f-300a97ce3817" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:04:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Acquired lock "refresh_cache-8ed74254-d845-4810-965f-300a97ce3817" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:04:33 user nova-compute[74743]: DEBUG nova.network.neutron [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:04:33 user nova-compute[74743]: DEBUG nova.network.neutron [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:04:34 user nova-compute[74743]: DEBUG nova.network.neutron [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Successfully updated port: a44b1589-f08b-4d65-a6a0-bb0e95fcf2ab {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:04:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Acquiring lock "refresh_cache-58edd8cc-a455-4922-8de8-c800a61e7b43" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:04:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Acquired lock "refresh_cache-58edd8cc-a455-4922-8de8-c800a61e7b43" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:04:34 user nova-compute[74743]: DEBUG nova.network.neutron [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:04:34 user nova-compute[74743]: DEBUG nova.network.neutron [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:04:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:34 user nova-compute[74743]: DEBUG nova.compute.manager [req-654f26d5-7e11-41db-a598-54116d690605 req-6f321cd9-d48e-4eb5-8903-433c3c4d1885 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received event network-changed-c658955e-999b-40cf-bed4-b59459a8953a {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:04:34 user nova-compute[74743]: DEBUG nova.compute.manager [req-654f26d5-7e11-41db-a598-54116d690605 req-6f321cd9-d48e-4eb5-8903-433c3c4d1885 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Refreshing instance network info cache due to event network-changed-c658955e-999b-40cf-bed4-b59459a8953a. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:04:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-654f26d5-7e11-41db-a598-54116d690605 req-6f321cd9-d48e-4eb5-8903-433c3c4d1885 service nova] Acquiring lock "refresh_cache-58edd8cc-a455-4922-8de8-c800a61e7b43" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:04:34 user nova-compute[74743]: DEBUG nova.compute.manager [req-1357e86d-6d1e-4c7f-8921-ae081a3a0ec7 req-f9055e77-14ef-4c19-9fde-6c375d4a12d3 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received event network-changed-2a12256b-0d24-4ffa-aac0-451c27187fc7 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:04:34 user nova-compute[74743]: DEBUG nova.compute.manager [req-1357e86d-6d1e-4c7f-8921-ae081a3a0ec7 req-f9055e77-14ef-4c19-9fde-6c375d4a12d3 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Refreshing instance network info cache due to event network-changed-2a12256b-0d24-4ffa-aac0-451c27187fc7. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:04:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-1357e86d-6d1e-4c7f-8921-ae081a3a0ec7 req-f9055e77-14ef-4c19-9fde-6c375d4a12d3 service nova] Acquiring lock "refresh_cache-8ed74254-d845-4810-965f-300a97ce3817" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:04:35 user nova-compute[74743]: DEBUG nova.network.neutron [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Updating instance_info_cache with network_info: [{"id": "c646e401-7317-4e71-9ec5-5720fbc4b449", "address": "fa:16:3e:af:d8:d7", "network": {"id": "b0e24bcb-e9d6-4a04-bbb1-b3a0744f245a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1528865723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc646e401-73", "ovs_interfaceid": "c646e401-7317-4e71-9ec5-5720fbc4b449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "36ac949f-e4af-432f-b042-62e8614b5b84", "address": "fa:16:3e:d8:e1:eb", "network": {"id": "c4ed0e46-c74d-44bb-94ee-d1b2dc871d15", "bridge": "br-int", "label": "tempest-device-tagging-net1-2003876734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36ac949f-e4", "ovs_interfaceid": "36ac949f-e4af-432f-b042-62e8614b5b84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2937523f-15c9-4fe4-9f7c-174b941035e8", "address": "fa:16:3e:3e:90:e2", "network": {"id": "c4ed0e46-c74d-44bb-94ee-d1b2dc871d15", "bridge": "br-int", "label": "tempest-device-tagging-net1-2003876734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2937523f-15", "ovs_interfaceid": "2937523f-15c9-4fe4-9f7c-174b941035e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8ba0c408-cb71-4fe5-88de-5ec1c8a81704", "address": "fa:16:3e:aa:1e:86", "network": {"id": "c4ed0e46-c74d-44bb-94ee-d1b2dc871d15", "bridge": "br-int", "label": "tempest-device-tagging-net1-2003876734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba0c408-cb", "ovs_interfaceid": "8ba0c408-cb71-4fe5-88de-5ec1c8a81704", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "587569cd-f07c-4087-b7e7-66967dfcfcf7", "address": "fa:16:3e:c3:d6:8a", "network": {"id": "c4ed0e46-c74d-44bb-94ee-d1b2dc871d15", "bridge": "br-int", "label": "tempest-device-tagging-net1-2003876734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap587569cd-f0", "ovs_interfaceid": "587569cd-f07c-4087-b7e7-66967dfcfcf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f4532d74-be0a-451a-ad58-d7b0d3aeb757", "address": "fa:16:3e:51:3a:05", "network": {"id": "29131171-10e1-4628-9763-a74023087bca", "bridge": "br-int", "label": "tempest-device-tagging-net2-1600450954", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4532d74-be", "ovs_interfaceid": "f4532d74-be0a-451a-ad58-d7b0d3aeb757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2a12256b-0d24-4ffa-aac0-451c27187fc7", "address": "fa:16:3e:d4:68:ae", "network": {"id": "29131171-10e1-4628-9763-a74023087bca", "bridge": "br-int", "label": "tempest-device-tagging-net2-1600450954", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a12256b-0d", "ovs_interfaceid": "2a12256b-0d24-4ffa-aac0-451c27187fc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:04:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Releasing lock "refresh_cache-8ed74254-d845-4810-965f-300a97ce3817" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:04:35 user nova-compute[74743]: DEBUG nova.compute.manager [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Instance network_info: |[{"id": "c646e401-7317-4e71-9ec5-5720fbc4b449", "address": "fa:16:3e:af:d8:d7", "network": {"id": "b0e24bcb-e9d6-4a04-bbb1-b3a0744f245a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1528865723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc646e401-73", "ovs_interfaceid": "c646e401-7317-4e71-9ec5-5720fbc4b449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "36ac949f-e4af-432f-b042-62e8614b5b84", "address": "fa:16:3e:d8:e1:eb", "network": {"id": "c4ed0e46-c74d-44bb-94ee-d1b2dc871d15", "bridge": "br-int", "label": "tempest-device-tagging-net1-2003876734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36ac949f-e4", "ovs_interfaceid": "36ac949f-e4af-432f-b042-62e8614b5b84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2937523f-15c9-4fe4-9f7c-174b941035e8", "address": "fa:16:3e:3e:90:e2", "network": {"id": "c4ed0e46-c74d-44bb-94ee-d1b2dc871d15", "bridge": "br-int", "label": "tempest-device-tagging-net1-2003876734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2937523f-15", "ovs_interfaceid": "2937523f-15c9-4fe4-9f7c-174b941035e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8ba0c408-cb71-4fe5-88de-5ec1c8a81704", "address": "fa:16:3e:aa:1e:86", "network": {"id": "c4ed0e46-c74d-44bb-94ee-d1b2dc871d15", "bridge": "br-int", "label": "tempest-device-tagging-net1-2003876734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba0c408-cb", "ovs_interfaceid": "8ba0c408-cb71-4fe5-88de-5ec1c8a81704", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "587569cd-f07c-4087-b7e7-66967dfcfcf7", "address": "fa:16:3e:c3:d6:8a", "network": {"id": "c4ed0e46-c74d-44bb-94ee-d1b2dc871d15", "bridge": "br-int", "label": "tempest-device-tagging-net1-2003876734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap587569cd-f0", "ovs_interfaceid": "587569cd-f07c-4087-b7e7-66967dfcfcf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f4532d74-be0a-451a-ad58-d7b0d3aeb757", "address": "fa:16:3e:51:3a:05", "network": {"id": "29131171-10e1-4628-9763-a74023087bca", "bridge": "br-int", "label": "tempest-device-tagging-net2-1600450954", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4532d74-be", "ovs_interfaceid": "f4532d74-be0a-451a-ad58-d7b0d3aeb757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2a12256b-0d24-4ffa-aac0-451c27187fc7", "address": "fa:16:3e:d4:68:ae", "network": {"id": "29131171-10e1-4628-9763-a74023087bca", "bridge": "br-int", "label": "tempest-device-tagging-net2-1600450954", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a12256b-0d", "ovs_interfaceid": "2a12256b-0d24-4ffa-aac0-451c27187fc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 17:04:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-1357e86d-6d1e-4c7f-8921-ae081a3a0ec7 req-f9055e77-14ef-4c19-9fde-6c375d4a12d3 service nova] Acquired lock "refresh_cache-8ed74254-d845-4810-965f-300a97ce3817" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:04:35 user nova-compute[74743]: DEBUG nova.network.neutron [req-1357e86d-6d1e-4c7f-8921-ae081a3a0ec7 req-f9055e77-14ef-4c19-9fde-6c375d4a12d3 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Refreshing network info cache for port 2a12256b-0d24-4ffa-aac0-451c27187fc7 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:04:36 user nova-compute[74743]: DEBUG nova.network.neutron [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Updating instance_info_cache with network_info: [{"id": "34bfd284-1ef1-415a-9c96-f5ae24114a6a", "address": "fa:16:3e:3f:ad:b1", "network": {"id": "1638ba59-8de1-4e32-ab20-8cd8c688de5f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1073649476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34bfd284-1e", "ovs_interfaceid": "34bfd284-1ef1-415a-9c96-f5ae24114a6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f7d1b2be-29b6-45a1-9917-d16b576a84b2", "address": "fa:16:3e:c2:43:ab", "network": {"id": "4501b03b-0b17-40b9-8545-c3385627d276", "bridge": "br-int", "label": "tempest-device-tagging-net1-1630322313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7d1b2be-29", "ovs_interfaceid": "f7d1b2be-29b6-45a1-9917-d16b576a84b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2629b394-59bc-4ddd-9d05-3fa4fbb15b55", "address": "fa:16:3e:6c:2d:b7", "network": {"id": "4501b03b-0b17-40b9-8545-c3385627d276", "bridge": "br-int", "label": "tempest-device-tagging-net1-1630322313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2629b394-59", "ovs_interfaceid": "2629b394-59bc-4ddd-9d05-3fa4fbb15b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "64686449-f344-4a65-ac45-8e7ff3f8cd84", "address": "fa:16:3e:8b:69:97", "network": {"id": "4501b03b-0b17-40b9-8545-c3385627d276", "bridge": "br-int", "label": "tempest-device-tagging-net1-1630322313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64686449-f3", "ovs_interfaceid": "64686449-f344-4a65-ac45-8e7ff3f8cd84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9dd57873-8274-4099-b5a7-cefeabbbc308", "address": "fa:16:3e:3d:0f:1e", "network": {"id": "4501b03b-0b17-40b9-8545-c3385627d276", "bridge": "br-int", "label": "tempest-device-tagging-net1-1630322313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dd57873-82", "ovs_interfaceid": "9dd57873-8274-4099-b5a7-cefeabbbc308", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c658955e-999b-40cf-bed4-b59459a8953a", "address": "fa:16:3e:20:e9:d3", "network": {"id": "a14a0aa7-2798-4429-9394-a35ee3367c86", "bridge": "br-int", "label": "tempest-device-tagging-net2-808383388", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc658955e-99", "ovs_interfaceid": "c658955e-999b-40cf-bed4-b59459a8953a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a44b1589-f08b-4d65-a6a0-bb0e95fcf2ab", "address": "fa:16:3e:aa:65:f0", "network": {"id": "a14a0aa7-2798-4429-9394-a35ee3367c86", "bridge": "br-int", "label": "tempest-device-tagging-net2-808383388", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa44b1589-f0", "ovs_interfaceid": "a44b1589-f08b-4d65-a6a0-bb0e95fcf2ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:04:36 user nova-compute[74743]: DEBUG nova.network.neutron [req-1357e86d-6d1e-4c7f-8921-ae081a3a0ec7 req-f9055e77-14ef-4c19-9fde-6c375d4a12d3 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Updated VIF entry in instance network info cache for port 2a12256b-0d24-4ffa-aac0-451c27187fc7. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:04:36 user nova-compute[74743]: DEBUG nova.network.neutron [req-1357e86d-6d1e-4c7f-8921-ae081a3a0ec7 req-f9055e77-14ef-4c19-9fde-6c375d4a12d3 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Updating instance_info_cache with network_info: [{"id": "c646e401-7317-4e71-9ec5-5720fbc4b449", "address": "fa:16:3e:af:d8:d7", "network": {"id": "b0e24bcb-e9d6-4a04-bbb1-b3a0744f245a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1528865723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc646e401-73", "ovs_interfaceid": "c646e401-7317-4e71-9ec5-5720fbc4b449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "36ac949f-e4af-432f-b042-62e8614b5b84", "address": "fa:16:3e:d8:e1:eb", "network": {"id": "c4ed0e46-c74d-44bb-94ee-d1b2dc871d15", "bridge": "br-int", "label": "tempest-device-tagging-net1-2003876734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36ac949f-e4", "ovs_interfaceid": "36ac949f-e4af-432f-b042-62e8614b5b84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2937523f-15c9-4fe4-9f7c-174b941035e8", "address": "fa:16:3e:3e:90:e2", "network": {"id": "c4ed0e46-c74d-44bb-94ee-d1b2dc871d15", "bridge": "br-int", "label": "tempest-device-tagging-net1-2003876734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2937523f-15", "ovs_interfaceid": "2937523f-15c9-4fe4-9f7c-174b941035e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8ba0c408-cb71-4fe5-88de-5ec1c8a81704", "address": "fa:16:3e:aa:1e:86", "network": {"id": "c4ed0e46-c74d-44bb-94ee-d1b2dc871d15", "bridge": "br-int", "label": "tempest-device-tagging-net1-2003876734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba0c408-cb", "ovs_interfaceid": "8ba0c408-cb71-4fe5-88de-5ec1c8a81704", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "587569cd-f07c-4087-b7e7-66967dfcfcf7", "address": "fa:16:3e:c3:d6:8a", "network": {"id": "c4ed0e46-c74d-44bb-94ee-d1b2dc871d15", "bridge": "br-int", "label": "tempest-device-tagging-net1-2003876734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap587569cd-f0", "ovs_interfaceid": "587569cd-f07c-4087-b7e7-66967dfcfcf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f4532d74-be0a-451a-ad58-d7b0d3aeb757", "address": "fa:16:3e:51:3a:05", "network": {"id": "29131171-10e1-4628-9763-a74023087bca", "bridge": "br-int", "label": "tempest-device-tagging-net2-1600450954", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4532d74-be", "ovs_interfaceid": "f4532d74-be0a-451a-ad58-d7b0d3aeb757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2a12256b-0d24-4ffa-aac0-451c27187fc7", "address": "fa:16:3e:d4:68:ae", "network": {"id": "29131171-10e1-4628-9763-a74023087bca", "bridge": "br-int", "label": "tempest-device-tagging-net2-1600450954", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a12256b-0d", "ovs_interfaceid": "2a12256b-0d24-4ffa-aac0-451c27187fc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:04:36 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Releasing lock "refresh_cache-58edd8cc-a455-4922-8de8-c800a61e7b43" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:04:36 user nova-compute[74743]: DEBUG nova.compute.manager [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Instance network_info: |[{"id": "34bfd284-1ef1-415a-9c96-f5ae24114a6a", "address": "fa:16:3e:3f:ad:b1", "network": {"id": "1638ba59-8de1-4e32-ab20-8cd8c688de5f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1073649476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34bfd284-1e", "ovs_interfaceid": "34bfd284-1ef1-415a-9c96-f5ae24114a6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f7d1b2be-29b6-45a1-9917-d16b576a84b2", "address": "fa:16:3e:c2:43:ab", "network": {"id": "4501b03b-0b17-40b9-8545-c3385627d276", "bridge": "br-int", "label": "tempest-device-tagging-net1-1630322313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7d1b2be-29", "ovs_interfaceid": "f7d1b2be-29b6-45a1-9917-d16b576a84b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2629b394-59bc-4ddd-9d05-3fa4fbb15b55", "address": "fa:16:3e:6c:2d:b7", "network": {"id": "4501b03b-0b17-40b9-8545-c3385627d276", "bridge": "br-int", "label": "tempest-device-tagging-net1-1630322313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2629b394-59", "ovs_interfaceid": "2629b394-59bc-4ddd-9d05-3fa4fbb15b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "64686449-f344-4a65-ac45-8e7ff3f8cd84", "address": "fa:16:3e:8b:69:97", "network": {"id": "4501b03b-0b17-40b9-8545-c3385627d276", "bridge": "br-int", "label": "tempest-device-tagging-net1-1630322313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64686449-f3", "ovs_interfaceid": "64686449-f344-4a65-ac45-8e7ff3f8cd84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9dd57873-8274-4099-b5a7-cefeabbbc308", "address": "fa:16:3e:3d:0f:1e", "network": {"id": "4501b03b-0b17-40b9-8545-c3385627d276", "bridge": "br-int", "label": "tempest-device-tagging-net1-1630322313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dd57873-82", "ovs_interfaceid": "9dd57873-8274-4099-b5a7-cefeabbbc308", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c658955e-999b-40cf-bed4-b59459a8953a", "address": "fa:16:3e:20:e9:d3", "network": {"id": "a14a0aa7-2798-4429-9394-a35ee3367c86", "bridge": "br-int", "label": "tempest-device-tagging-net2-808383388", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc658955e-99", "ovs_interfaceid": "c658955e-999b-40cf-bed4-b59459a8953a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a44b1589-f08b-4d65-a6a0-bb0e95fcf2ab", "address": "fa:16:3e:aa:65:f0", "network": {"id": "a14a0aa7-2798-4429-9394-a35ee3367c86", "bridge": "br-int", "label": "tempest-device-tagging-net2-808383388", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa44b1589-f0", "ovs_interfaceid": "a44b1589-f08b-4d65-a6a0-bb0e95fcf2ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 17:04:36 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-1357e86d-6d1e-4c7f-8921-ae081a3a0ec7 req-f9055e77-14ef-4c19-9fde-6c375d4a12d3 service nova] Releasing lock "refresh_cache-8ed74254-d845-4810-965f-300a97ce3817" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:04:36 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-654f26d5-7e11-41db-a598-54116d690605 req-6f321cd9-d48e-4eb5-8903-433c3c4d1885 service nova] Acquired lock "refresh_cache-58edd8cc-a455-4922-8de8-c800a61e7b43" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:04:36 user nova-compute[74743]: DEBUG nova.network.neutron [req-654f26d5-7e11-41db-a598-54116d690605 req-6f321cd9-d48e-4eb5-8903-433c3c4d1885 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Refreshing network info cache for port c658955e-999b-40cf-bed4-b59459a8953a {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:04:36 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:36 user nova-compute[74743]: DEBUG nova.network.neutron [req-654f26d5-7e11-41db-a598-54116d690605 req-6f321cd9-d48e-4eb5-8903-433c3c4d1885 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Updated VIF entry in instance network info cache for port c658955e-999b-40cf-bed4-b59459a8953a. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:04:36 user nova-compute[74743]: DEBUG nova.network.neutron [req-654f26d5-7e11-41db-a598-54116d690605 req-6f321cd9-d48e-4eb5-8903-433c3c4d1885 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Updating instance_info_cache with network_info: [{"id": "34bfd284-1ef1-415a-9c96-f5ae24114a6a", "address": "fa:16:3e:3f:ad:b1", "network": {"id": "1638ba59-8de1-4e32-ab20-8cd8c688de5f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1073649476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34bfd284-1e", "ovs_interfaceid": "34bfd284-1ef1-415a-9c96-f5ae24114a6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f7d1b2be-29b6-45a1-9917-d16b576a84b2", "address": "fa:16:3e:c2:43:ab", "network": {"id": "4501b03b-0b17-40b9-8545-c3385627d276", "bridge": "br-int", "label": "tempest-device-tagging-net1-1630322313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7d1b2be-29", "ovs_interfaceid": "f7d1b2be-29b6-45a1-9917-d16b576a84b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2629b394-59bc-4ddd-9d05-3fa4fbb15b55", "address": "fa:16:3e:6c:2d:b7", "network": {"id": "4501b03b-0b17-40b9-8545-c3385627d276", "bridge": "br-int", "label": "tempest-device-tagging-net1-1630322313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2629b394-59", "ovs_interfaceid": "2629b394-59bc-4ddd-9d05-3fa4fbb15b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "64686449-f344-4a65-ac45-8e7ff3f8cd84", "address": "fa:16:3e:8b:69:97", "network": {"id": "4501b03b-0b17-40b9-8545-c3385627d276", "bridge": "br-int", "label": "tempest-device-tagging-net1-1630322313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64686449-f3", "ovs_interfaceid": "64686449-f344-4a65-ac45-8e7ff3f8cd84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9dd57873-8274-4099-b5a7-cefeabbbc308", "address": "fa:16:3e:3d:0f:1e", "network": {"id": "4501b03b-0b17-40b9-8545-c3385627d276", "bridge": "br-int", "label": "tempest-device-tagging-net1-1630322313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dd57873-82", "ovs_interfaceid": "9dd57873-8274-4099-b5a7-cefeabbbc308", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c658955e-999b-40cf-bed4-b59459a8953a", "address": "fa:16:3e:20:e9:d3", "network": {"id": "a14a0aa7-2798-4429-9394-a35ee3367c86", "bridge": "br-int", "label": "tempest-device-tagging-net2-808383388", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc658955e-99", "ovs_interfaceid": "c658955e-999b-40cf-bed4-b59459a8953a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a44b1589-f08b-4d65-a6a0-bb0e95fcf2ab", "address": "fa:16:3e:aa:65:f0", "network": {"id": "a14a0aa7-2798-4429-9394-a35ee3367c86", "bridge": "br-int", "label": "tempest-device-tagging-net2-808383388", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa44b1589-f0", "ovs_interfaceid": "a44b1589-f08b-4d65-a6a0-bb0e95fcf2ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:04:36 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-654f26d5-7e11-41db-a598-54116d690605 req-6f321cd9-d48e-4eb5-8903-433c3c4d1885 service nova] Releasing lock "refresh_cache-58edd8cc-a455-4922-8de8-c800a61e7b43" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:04:36 user nova-compute[74743]: DEBUG nova.compute.manager [req-654f26d5-7e11-41db-a598-54116d690605 req-6f321cd9-d48e-4eb5-8903-433c3c4d1885 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received event network-changed-a44b1589-f08b-4d65-a6a0-bb0e95fcf2ab {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:04:36 user nova-compute[74743]: DEBUG nova.compute.manager [req-654f26d5-7e11-41db-a598-54116d690605 req-6f321cd9-d48e-4eb5-8903-433c3c4d1885 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Refreshing instance network info cache due to event network-changed-a44b1589-f08b-4d65-a6a0-bb0e95fcf2ab. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:04:36 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-654f26d5-7e11-41db-a598-54116d690605 req-6f321cd9-d48e-4eb5-8903-433c3c4d1885 service nova] Acquiring lock "refresh_cache-58edd8cc-a455-4922-8de8-c800a61e7b43" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:04:36 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-654f26d5-7e11-41db-a598-54116d690605 req-6f321cd9-d48e-4eb5-8903-433c3c4d1885 service nova] Acquired lock "refresh_cache-58edd8cc-a455-4922-8de8-c800a61e7b43" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:04:36 user nova-compute[74743]: DEBUG nova.network.neutron [req-654f26d5-7e11-41db-a598-54116d690605 req-6f321cd9-d48e-4eb5-8903-433c3c4d1885 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Refreshing network info cache for port a44b1589-f08b-4d65-a6a0-bb0e95fcf2ab {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:04:37 user nova-compute[74743]: INFO nova.virt.block_device [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Booting with volume 3a394185-bc59-47fb-8214-07aa026083a3 at /dev/vdc
Nov 18 17:04:37 user nova-compute[74743]: DEBUG os_brick.utils [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:04:37 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:37 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:37 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d321b49c-a69c-46f3-8371-4efbadae21c4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1116acd8874d\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:37 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:37 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:37 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cdaf3b1-dd22-4bb3-bfd5-021283179a1a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:37 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:37 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:37 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[482ebb12-db53-479c-b6cd-03ada060320b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:37 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd289081-8346-4a18-a876-a94247ce696c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:37 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Running cmd (subprocess): nvme version {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:37 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] 'nvme version' failed. Not Retrying. {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:04:37 user nova-compute[74743]: DEBUG nova.network.neutron [req-654f26d5-7e11-41db-a598-54116d690605 req-6f321cd9-d48e-4eb5-8903-433c3c4d1885 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Updated VIF entry in instance network info cache for port a44b1589-f08b-4d65-a6a0-bb0e95fcf2ab. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:04:37 user nova-compute[74743]: DEBUG nova.network.neutron [req-654f26d5-7e11-41db-a598-54116d690605 req-6f321cd9-d48e-4eb5-8903-433c3c4d1885 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Updating instance_info_cache with network_info: [{"id": "34bfd284-1ef1-415a-9c96-f5ae24114a6a", "address": "fa:16:3e:3f:ad:b1", "network": {"id": "1638ba59-8de1-4e32-ab20-8cd8c688de5f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1073649476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34bfd284-1e", "ovs_interfaceid": "34bfd284-1ef1-415a-9c96-f5ae24114a6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f7d1b2be-29b6-45a1-9917-d16b576a84b2", "address": "fa:16:3e:c2:43:ab", "network": {"id": "4501b03b-0b17-40b9-8545-c3385627d276", "bridge": "br-int", "label": "tempest-device-tagging-net1-1630322313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7d1b2be-29", "ovs_interfaceid": "f7d1b2be-29b6-45a1-9917-d16b576a84b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2629b394-59bc-4ddd-9d05-3fa4fbb15b55", "address": "fa:16:3e:6c:2d:b7", "network": {"id": "4501b03b-0b17-40b9-8545-c3385627d276", "bridge": "br-int", "label": "tempest-device-tagging-net1-1630322313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2629b394-59", "ovs_interfaceid": "2629b394-59bc-4ddd-9d05-3fa4fbb15b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "64686449-f344-4a65-ac45-8e7ff3f8cd84", "address": "fa:16:3e:8b:69:97", "network": {"id": "4501b03b-0b17-40b9-8545-c3385627d276", "bridge": "br-int", "label": "tempest-device-tagging-net1-1630322313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64686449-f3", "ovs_interfaceid": "64686449-f344-4a65-ac45-8e7ff3f8cd84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9dd57873-8274-4099-b5a7-cefeabbbc308", "address": "fa:16:3e:3d:0f:1e", "network": {"id": "4501b03b-0b17-40b9-8545-c3385627d276", "bridge": "br-int", "label": "tempest-device-tagging-net1-1630322313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dd57873-82", "ovs_interfaceid": "9dd57873-8274-4099-b5a7-cefeabbbc308", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c658955e-999b-40cf-bed4-b59459a8953a", "address": "fa:16:3e:20:e9:d3", "network": {"id": "a14a0aa7-2798-4429-9394-a35ee3367c86", "bridge": "br-int", "label": "tempest-device-tagging-net2-808383388", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc658955e-99", "ovs_interfaceid": "c658955e-999b-40cf-bed4-b59459a8953a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a44b1589-f08b-4d65-a6a0-bb0e95fcf2ab", "address": "fa:16:3e:aa:65:f0", "network": {"id": "a14a0aa7-2798-4429-9394-a35ee3367c86", "bridge": "br-int", "label": "tempest-device-tagging-net2-808383388", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa44b1589-f0", "ovs_interfaceid": "a44b1589-f08b-4d65-a6a0-bb0e95fcf2ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:04:37 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] nvme not present on system {{(pid=74743) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 17:04:37 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-654f26d5-7e11-41db-a598-54116d690605 req-6f321cd9-d48e-4eb5-8903-433c3c4d1885 service nova] Releasing lock "refresh_cache-58edd8cc-a455-4922-8de8-c800a61e7b43" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:04:37 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:04:37 user nova-compute[74743]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 17:04:37 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[c290b111-a3e4-49d7-a6f7-20e17561c1f3]: (4, '') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:37 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74743) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 17:04:37 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 17:04:37 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] LIGHTOS: no hostnqn found. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 17:04:37 user nova-compute[74743]: DEBUG os_brick.utils [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1116acd8874d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:04:37 user nova-compute[74743]: DEBUG nova.virt.block_device [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Updating existing volume attachment record: 460b4e78-a1ba-4217-9d89-8d6457ab1410 {{(pid=74743) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 17:04:38 user nova-compute[74743]: INFO nova.virt.block_device [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Booting with volume c320c2fa-d0f0-461e-ac7a-2bec3693bbaa at /dev/vdc
Nov 18 17:04:38 user nova-compute[74743]: DEBUG os_brick.utils [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:04:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:38 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1c0f56-aa29-4f89-9000-678bd0dd9dd5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1116acd8874d\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:39 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ca9173-78cd-4653-92e5-c3d38414dd4d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:39 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[639c2380-413d-4d22-90bd-d1e65aea3353]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:39 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da5b4d5-21dc-42a3-bed0-3e7bb38bb059]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Running cmd (subprocess): nvme version {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] 'nvme version' failed. Not Retrying. {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:04:39 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.nvmeof [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] nvme not present on system {{(pid=74743) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 17:04:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:04:39 user nova-compute[74743]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 17:04:39 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[9856840e-2146-4e4a-8ed2-f410f83d5d19]: (4, '') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:39 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74743) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 17:04:39 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 17:04:39 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] LIGHTOS: no hostnqn found. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 17:04:39 user nova-compute[74743]: DEBUG os_brick.utils [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1116acd8874d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:04:39 user nova-compute[74743]: DEBUG nova.virt.block_device [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Updating existing volume attachment record: 5b8b7a73-09da-4637-9fb0-52a50b24cab7 {{(pid=74743) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 17:04:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:41 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:43 user nova-compute[74743]: DEBUG nova.compute.manager [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Start spawning the instance on the hypervisor. {{(pid=74743) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 17:04:43 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Creating instance directory {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 17:04:43 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Creating image(s)
Nov 18 17:04:43 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Did not create local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 18 17:04:43 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Ensure instance console log exists: /opt/stack/data/nova/instances/58edd8cc-a455-4922-8de8-c800a61e7b43/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:04:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:04:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:04:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:04:43 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Start _get_guest_xml network_info=[{"id": "34bfd284-1ef1-415a-9c96-f5ae24114a6a", "address": "fa:16:3e:3f:ad:b1", "network": {"id": "1638ba59-8de1-4e32-ab20-8cd8c688de5f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1073649476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34bfd284-1e", "ovs_interfaceid": "34bfd284-1ef1-415a-9c96-f5ae24114a6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f7d1b2be-29b6-45a1-9917-d16b576a84b2", "address": "fa:16:3e:c2:43:ab", "network": {"id": "4501b03b-0b17-40b9-8545-c3385627d276", "bridge": "br-int", "label": "tempest-device-tagging-net1-1630322313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7d1b2be-29", "ovs_interfaceid": "f7d1b2be-29b6-45a1-9917-d16b576a84b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2629b394-59bc-4ddd-9d05-3fa4fbb15b55", "address": "fa:16:3e:6c:2d:b7", "network": {"id": "4501b03b-0b17-40b9-8545-c3385627d276", "bridge": "br-int", "label": "tempest-device-tagging-net1-1630322313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2629b394-59", "ovs_interfaceid": "2629b394-59bc-4ddd-9d05-3fa4fbb15b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "64686449-f344-4a65-ac45-8e7ff3f8cd84", "address": "fa:16:3e:8b:69:97", "network": {"id": "4501b03b-0b17-40b9-8545-c3385627d276", "bridge": "br-int", "label": "tempest-device-tagging-net1-1630322313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64686449-f3", "ovs_interfaceid": "64686449-f344-4a65-ac45-8e7ff3f8cd84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9dd57873-8274-4099-b5a7-cefeabbbc308", "address": "fa:16:3e:3d:0f:1e", "network": {"id": "4501b03b-0b17-40b9-8545-c3385627d276", "bridge": "br-int", "label": "tempest-device-tagging-net1-1630322313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dd57873-82", "ovs_interfaceid": "9dd57873-8274-4099-b5a7-cefeabbbc308", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c658955e-999b-40cf-bed4-b59459a8953a", "address": "fa:16:3e:20:e9:d3", "network": {"id": "a14a0aa7-2798-4429-9394-a35ee3367c86", "bridge": "br-int", "label": "tempest-device-tagging-net2-808383388", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc658955e-99", "ovs_interfaceid": "c658955e-999b-40cf-bed4-b59459a8953a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a44b1589-f08b-4d65-a6a0-bb0e95fcf2ab", "address": "fa:16:3e:aa:65:f0", "network": {"id": "a14a0aa7-2798-4429-9394-a35ee3367c86", "bridge": "br-int", "label": "tempest-device-tagging-net2-808383388", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa44b1589-f0", "ovs_interfaceid": "a44b1589-f08b-4d65-a6a0-bb0e95fcf2ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '52e1234b-06d4-4e0c-920d-1f9772a06861', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aAwgKMiD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '58edd8cc-a455-4922-8de8-c800a61e7b43', 'attached_at': '', 'detached_at': '', 'volume_id': '9f522558-51f6-48e8-baf6-d7e55732e9fe', 'serial': '9f522558-51f6-48e8-baf6-d7e55732e9fe'}, 'disk_bus': 'virtio', 'volume_type': None}, {'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 1, 'mount_device': '/dev/vdb', 'attachment_id': '3ea5637b-772f-450a-adb9-5360c2b11ce0', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NscaIDYg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '58edd8cc-a455-4922-8de8-c800a61e7b43', 'attached_at': '', 'detached_at': '', 'volume_id': '09d9fafc-921d-4018-91a8-ea22e51fcb9f', 'serial': '09d9fafc-921d-4018-91a8-ea22e51fcb9f'}, 'disk_bus': 'virtio', 'volume_type': None}, {'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 2, 'mount_device': '/dev/vdc', 'attachment_id': '460b4e78-a1ba-4217-9d89-8d6457ab1410', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cVueLGFk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '58edd8cc-a455-4922-8de8-c800a61e7b43', 'attached_at': '', 'detached_at': '', 'volume_id': '3a394185-bc59-47fb-8214-07aa026083a3', 'serial': '3a394185-bc59-47fb-8214-07aa026083a3'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:04:43 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:04:43 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:04:43 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:04:43 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:04:43 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:04:43 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:04:43 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:04:43 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:04:43 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:04:43 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:04:43 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:04:43 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:04:43 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:04:43 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:04:43 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:04:43 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:04:43 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:04:43 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:04:44 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Calling os-brick to attach iSCSI Volume {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 17:04:44 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aAwgKMiD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:04:44 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:04:44 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:04:44 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:04:44 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:04:44 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:04:44 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:04:44 user nova-compute[74743]: INFO os_brick.initiator.connectors.iscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 17:04:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe -p 172.16.0.220:3260 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:44 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[f986f430-1984-43ad-ac26-fe889de40f6a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:44 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 17:04:44 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:04:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe -p 172.16.0.220:3260 --interface default --op new {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:44 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63ee9fb-7f39-4f90-95b2-c9f78a89f826]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe] added\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:44 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe] added
Nov 18 17:04:44 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:04:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:44 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0a33d7-f34f-464e-af75-b7997c6eebf7]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:44 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:04:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:44 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[9667f4b1-a558-4f27-a4c3-4cb66745c02f]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:44 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:04:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aAwgKMiD {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aAwgKMiD" returned: 0 in 0.028s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:44 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65dbec9-279b-4e7e-98cf-50cade0eff7b]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:44 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aAwgKMiD'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:04:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:44 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[822bfd81-b49e-4d70-8d4d-414728e84e7e]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:44 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:04:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:44 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c606fa3-94a4-413e-bfbd-66dd7e8062ec]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:44 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:04:44 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:04:44 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:04:44 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:04:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe -p 172.16.0.220:3260 --login {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:44 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71c51c5-c265-4f79-9c18-2ea0086b0f21]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:44 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe, portal: 172.16.0.220,3260]
Nov 18 17:04:44 user nova-compute[74743]: Login to [iface: default, target: iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe, portal: 172.16.0.220,3260] successful.
Nov 18 17:04:44 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:04:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:44 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a1804a-64fa-464f-b4e7-0b81a912f7f6]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:44 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:04:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:44 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1aec851-6486-48c3-8ee8-8ab7f37b0233]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:44 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:04:44 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:04:44 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:04:44 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:04:44 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:04:44 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:04:44 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:04:44 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Connected to 172.16.0.220:3260 {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 17:04:44 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74743) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 17:04:44 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74743) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 17:04:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.030s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:44 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b35973b-5f82-4650-9e60-8fda595a08f3]: (4, ('- - 0', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:44 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:44 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:04:44 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aAwgKMiD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.403s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] <== connect_volume: return (1406ms) {'type': 'block', 'scsi_wwn': '23139613934333937', 'path': '/dev/sdc'} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139613934333937', 'path': '/dev/sdc'} {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Calling os-brick to attach iSCSI Volume {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NscaIDYg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:04:45 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:04:45 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:04:45 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:04:45 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:04:45 user nova-compute[74743]: INFO os_brick.initiator.connectors.iscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 17:04:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f -p 172.16.0.220:3260 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[012b39eb-df3a-4d72-a06b-b10db0920c8b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 17:04:45 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f -p 172.16.0.220:3260 --interface default --op new {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[468dc3b3-8b31-4f36-ae86-c7f4b11ee038]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f] added\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f] added
Nov 18 17:04:45 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[394c0992-dbd3-4724-b279-802e5c915e46]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ccfdd3d-288b-4ded-8257-fcd422b45712]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NscaIDYg {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NscaIDYg" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f11b37f-24b0-4917-a915-085200d8e039]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NscaIDYg'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b4c4d2-6555-471d-90de-01ccc44ea3f8]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[422b07a2-4f7e-4ac7-8133-38c7172e6f43]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:04:45 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:04:45 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:04:45 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:04:45 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f -p 172.16.0.220:3260 --login {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[41268fab-0bf0-450b-83cc-dc33ddc2c0da]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f, portal: 172.16.0.220,3260]
Nov 18 17:04:45 user nova-compute[74743]: Login to [iface: default, target: iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f, portal: 172.16.0.220,3260] successful.
Nov 18 17:04:45 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG nova.compute.manager [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Start spawning the instance on the hypervisor. {{(pid=74743) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Creating instance directory {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 17:04:45 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Creating image(s)
Nov 18 17:04:45 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Did not create local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Ensure instance console log exists: /opt/stack/data/nova/instances/8ed74254-d845-4810-965f-300a97ce3817/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Start _get_guest_xml network_info=[{"id": "c646e401-7317-4e71-9ec5-5720fbc4b449", "address": "fa:16:3e:af:d8:d7", "network": {"id": "b0e24bcb-e9d6-4a04-bbb1-b3a0744f245a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1528865723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc646e401-73", "ovs_interfaceid": "c646e401-7317-4e71-9ec5-5720fbc4b449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "36ac949f-e4af-432f-b042-62e8614b5b84", "address": "fa:16:3e:d8:e1:eb", "network": {"id": "c4ed0e46-c74d-44bb-94ee-d1b2dc871d15", "bridge": "br-int", "label": "tempest-device-tagging-net1-2003876734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36ac949f-e4", "ovs_interfaceid": "36ac949f-e4af-432f-b042-62e8614b5b84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2937523f-15c9-4fe4-9f7c-174b941035e8", "address": "fa:16:3e:3e:90:e2", "network": {"id": "c4ed0e46-c74d-44bb-94ee-d1b2dc871d15", "bridge": "br-int", "label": "tempest-device-tagging-net1-2003876734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2937523f-15", "ovs_interfaceid": "2937523f-15c9-4fe4-9f7c-174b941035e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8ba0c408-cb71-4fe5-88de-5ec1c8a81704", "address": "fa:16:3e:aa:1e:86", "network": {"id": "c4ed0e46-c74d-44bb-94ee-d1b2dc871d15", "bridge": "br-int", "label": "tempest-device-tagging-net1-2003876734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba0c408-cb", "ovs_interfaceid": "8ba0c408-cb71-4fe5-88de-5ec1c8a81704", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "587569cd-f07c-4087-b7e7-66967dfcfcf7", "address": "fa:16:3e:c3:d6:8a", "network": {"id": "c4ed0e46-c74d-44bb-94ee-d1b2dc871d15", "bridge": "br-int", "label": "tempest-device-tagging-net1-2003876734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap587569cd-f0", "ovs_interfaceid": "587569cd-f07c-4087-b7e7-66967dfcfcf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f4532d74-be0a-451a-ad58-d7b0d3aeb757", "address": "fa:16:3e:51:3a:05", "network": {"id": "29131171-10e1-4628-9763-a74023087bca", "bridge": "br-int", "label": "tempest-device-tagging-net2-1600450954", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4532d74-be", "ovs_interfaceid": "f4532d74-be0a-451a-ad58-d7b0d3aeb757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2a12256b-0d24-4ffa-aac0-451c27187fc7", "address": "fa:16:3e:d4:68:ae", "network": {"id": "29131171-10e1-4628-9763-a74023087bca", "bridge": "br-int", "label": "tempest-device-tagging-net2-1600450954", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a12256b-0d", "ovs_interfaceid": "2a12256b-0d24-4ffa-aac0-451c27187fc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '1047c55e-ee89-4696-926d-4290b76bacb3', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qfFdOuJE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8ed74254-d845-4810-965f-300a97ce3817', 'attached_at': '', 'detached_at': '', 'volume_id': '7b0fcb91-3634-461b-acd1-c69cb0d51abc', 'serial': '7b0fcb91-3634-461b-acd1-c69cb0d51abc'}, 'disk_bus': 'virtio', 'volume_type': None}, {'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 1, 'mount_device': '/dev/vdb', 'attachment_id': '30af33c7-5af5-47fa-81ff-3521c1fbda3b', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'idvQfnOr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8ed74254-d845-4810-965f-300a97ce3817', 'attached_at': '', 'detached_at': '', 'volume_id': '8acd2ae2-7bae-49e7-99e2-e5dd725746fd', 'serial': '8acd2ae2-7bae-49e7-99e2-e5dd725746fd'}, 'disk_bus': 'virtio', 'volume_type': None}, {'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 2, 'mount_device': '/dev/vdc', 'attachment_id': '5b8b7a73-09da-4637-9fb0-52a50b24cab7', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PSecUtMD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8ed74254-d845-4810-965f-300a97ce3817', 'attached_at': '', 'detached_at': '', 'volume_id': 'c320c2fa-d0f0-461e-ac7a-2bec3693bbaa', 'serial': 'c320c2fa-d0f0-461e-ac7a-2bec3693bbaa'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[189cbc22-8b64-4019-aaa8-d59b360ebffe]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:45 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:04:45 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:04:45 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Calling os-brick to attach iSCSI Volume {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qfFdOuJE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:04:45 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:04:45 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f946e1a-3308-4fc2-b872-8094ce6104ab]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:04:45 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:04:45 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:04:45 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:04:45 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:04:45 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:04:45 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Connected to 172.16.0.220:3260 {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=74743) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74743) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f2b011-b363-4701-bea0-82fd2e355edc]: (4, ('- - 0', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:04:45 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NscaIDYg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 17:04:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:46 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:04:46 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] <== connect_volume: return (1395ms) {'type': 'block', 'scsi_wwn': '23839363038336233', 'path': '/dev/sdd'} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:04:46 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23839363038336233', 'path': '/dev/sdd'} {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 17:04:46 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.048s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:04:46 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:04:46 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:04:46 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:04:46 user nova-compute[74743]: INFO os_brick.initiator.connectors.iscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 17:04:46 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc -p 172.16.0.220:3260 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:46 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:46 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d939ed6b-b125-4494-9d5b-9f45a0025f61]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:46 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 17:04:46 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:04:46 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Calling os-brick to attach iSCSI Volume {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 17:04:46 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cVueLGFk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:04:46 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:04:46 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:04:46 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc -p 172.16.0.220:3260 --interface default --op new {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:46 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:46 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0ad9ae-aaf5-42d2-8f72-54ee250f9646]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc] added\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:46 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc] added
Nov 18 17:04:46 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:04:46 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:46 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:46 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[152ce689-4211-4c35-b63a-829cab2a7408]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:46 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:04:46 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:46 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:46 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba9f38e-28ab-44d0-80cf-56907ce28d10]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:46 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:04:46 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qfFdOuJE {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:46 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qfFdOuJE" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:46 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[e543ec93-7290-4bdc-8086-49654c63301f]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:46 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qfFdOuJE'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:04:46 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:46 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:46 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae5a99f-886f-4b5e-adc9-85b42ba7ea2f]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:46 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:04:46 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:47 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:47 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c01669-c9a9-43b4-83cd-df6bea3fb5c4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:47 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:04:47 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:04:47 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:04:47 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:04:47 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:04:47 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:04:47 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:04:47 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:04:47 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc -p 172.16.0.220:3260 --login {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:47 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:47 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[cead0257-fd0e-48af-bdce-bb17ad481ce2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:47 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc, portal: 172.16.0.220,3260]
Nov 18 17:04:47 user nova-compute[74743]: Login to [iface: default, target: iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc, portal: 172.16.0.220,3260] successful.
Nov 18 17:04:47 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:04:47 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:47 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:47 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[19972f46-6785-4e91-8bb1-1afbfb4a0ab0]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:47 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:04:47 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:47 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:47 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ddbae4-64cb-4151-a91a-89a72908b215]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:47 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:04:47 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:04:47 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:04:47 user nova-compute[74743]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)
Nov 18 17:04:47 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:04:47 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:04:47 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:04:47 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:04:47 user nova-compute[74743]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)
Nov 18 17:04:47 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:04:47 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:04:47 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Connected to 172.16.0.220:3260 {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 17:04:47 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=74743) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 17:04:47 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74743) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 17:04:47 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:47 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:47 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[2861d5cf-6c1f-44e6-b1ef-747f4eee6c24]: (4, ('- - 0', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:47 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:04:47 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qfFdOuJE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 17:04:48 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:04:48 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] <== connect_volume: return (2371ms) {'type': 'block', 'scsi_wwn': '26564373338616231', 'path': '/dev/sde'} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:04:48 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564373338616231', 'path': '/dev/sde'} {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 17:04:48 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.296s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:04:48 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:04:48 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:04:48 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:04:48 user nova-compute[74743]: INFO os_brick.initiator.connectors.iscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 17:04:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 -p 172.16.0.220:3260 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:48 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b43761a-2ad9-460c-a2d0-0634e01eac7a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:48 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 17:04:48 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:04:48 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Calling os-brick to attach iSCSI Volume {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 17:04:48 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'idvQfnOr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:04:48 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:04:48 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:04:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:48 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44cd89a-92d8-46cb-837c-441b979b72a1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3] added\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:48 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3] added
Nov 18 17:04:48 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:04:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:48 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea9be92-6a95-476d-87f3-8f53cab5fbcf]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:48 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:04:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:48 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f67ddf8-037f-4417-a4a7-0869e06b74fa]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:48 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:04:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cVueLGFk {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cVueLGFk" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:48 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[26eba425-7c75-410c-905e-f20bd5b384b7]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:48 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cVueLGFk'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:04:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:48 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfcaf4a8-77f1-4926-af2a-6ad942260e19]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:48 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:04:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:48 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[22888047-5125-401b-8df6-fb7585d93f2e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:48 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:04:48 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:04:48 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:04:48 user nova-compute[74743]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)
Nov 18 17:04:48 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:04:48 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:04:48 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:04:48 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:04:48 user nova-compute[74743]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)
Nov 18 17:04:48 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:04:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 -p 172.16.0.220:3260 --login {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:48 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e16f2a-7179-4744-947c-60e8a04ab27d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:48 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3, portal: 172.16.0.220,3260]
Nov 18 17:04:48 user nova-compute[74743]: Login to [iface: default, target: iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3, portal: 172.16.0.220,3260] successful.
Nov 18 17:04:48 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:04:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:48 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a321648-ada6-440e-a9f9-2d97b967c78f]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:48 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:04:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:48 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bfcaffc-d326-48e4-89ec-e64e0b02e18d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:48 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:04:48 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:04:48 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:04:48 user nova-compute[74743]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)
Nov 18 17:04:48 user nova-compute[74743]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)
Nov 18 17:04:48 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:04:48 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:04:48 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:04:48 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:04:48 user nova-compute[74743]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)
Nov 18 17:04:48 user nova-compute[74743]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)
Nov 18 17:04:48 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:04:48 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:04:48 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Connected to 172.16.0.220:3260 {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 17:04:48 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=74743) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 17:04:48 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74743) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 17:04:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:48 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[28969d06-e17c-483b-8425-30388093e9d3]: (4, ('- - 0', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:48 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: None {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cVueLGFk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] <== connect_volume: return (2632ms) {'type': 'block', 'scsi_wwn': '26334633064653637', 'path': '/dev/sdf'} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334633064653637', 'path': '/dev/sdf'} {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.308s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:04:49 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:04:49 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:04:49 user nova-compute[74743]: INFO os_brick.initiator.connectors.iscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 17:04:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd -p 172.16.0.220:3260 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T17:04:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1317300551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1317300551',id=10,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5BDO9C8x4KBW8CgUPnSx7E01ZR+pcKEml0/t6Gj2w4MmQpDst8vuwOeiuCSmZUUzT19BBkzO9wQBMDEcUuTHO37Nx1as9VWeLZ/OjxIDUYzc9Z6H/jeRdfuIP00EqKSg==',key_name='tempest-keypair-1501335207',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='499d0dc41fbb400ab2b83b5d5091d880',ramdisk_id='',reservation_id='r-x8o6nc9i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1747303038',owner_user_name='tempest-TaggedBootDevicesTest_v242-1747303038-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cad6e6d43b3d474a888f6b02458b2ac8',uuid=58edd8cc-a455-4922-8de8-c800a61e7b43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34bfd284-1ef1-415a-9c96-f5ae24114a6a", "address": "fa:16:3e:3f:ad:b1", "network": {"id": "1638ba59-8de1-4e32-ab20-8cd8c688de5f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1073649476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34bfd284-1e", "ovs_interfaceid": "34bfd284-1ef1-415a-9c96-f5ae24114a6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Converting VIF {"id": "34bfd284-1ef1-415a-9c96-f5ae24114a6a", "address": "fa:16:3e:3f:ad:b1", "network": {"id": "1638ba59-8de1-4e32-ab20-8cd8c688de5f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1073649476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34bfd284-1e", "ovs_interfaceid": "34bfd284-1ef1-415a-9c96-f5ae24114a6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:ad:b1,bridge_name='br-int',has_traffic_filtering=True,id=34bfd284-1ef1-415a-9c96-f5ae24114a6a,network=Network(1638ba59-8de1-4e32-ab20-8cd8c688de5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34bfd284-1e') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T17:04:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1317300551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1317300551',id=10,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5BDO9C8x4KBW8CgUPnSx7E01ZR+pcKEml0/t6Gj2w4MmQpDst8vuwOeiuCSmZUUzT19BBkzO9wQBMDEcUuTHO37Nx1as9VWeLZ/OjxIDUYzc9Z6H/jeRdfuIP00EqKSg==',key_name='tempest-keypair-1501335207',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='499d0dc41fbb400ab2b83b5d5091d880',ramdisk_id='',reservation_id='r-x8o6nc9i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1747303038',owner_user_name='tempest-TaggedBootDevicesTest_v242-1747303038-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cad6e6d43b3d474a888f6b02458b2ac8',uuid=58edd8cc-a455-4922-8de8-c800a61e7b43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7d1b2be-29b6-45a1-9917-d16b576a84b2", "address": "fa:16:3e:c2:43:ab", "network": {"id": "4501b03b-0b17-40b9-8545-c3385627d276", "bridge": "br-int", "label": "tempest-device-tagging-net1-1630322313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7d1b2be-29", "ovs_interfaceid": "f7d1b2be-29b6-45a1-9917-d16b576a84b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Converting VIF {"id": "f7d1b2be-29b6-45a1-9917-d16b576a84b2", "address": "fa:16:3e:c2:43:ab", "network": {"id": "4501b03b-0b17-40b9-8545-c3385627d276", "bridge": "br-int", "label": "tempest-device-tagging-net1-1630322313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7d1b2be-29", "ovs_interfaceid": "f7d1b2be-29b6-45a1-9917-d16b576a84b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:43:ab,bridge_name='br-int',has_traffic_filtering=True,id=f7d1b2be-29b6-45a1-9917-d16b576a84b2,network=Network(4501b03b-0b17-40b9-8545-c3385627d276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf7d1b2be-29') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T17:04:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1317300551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1317300551',id=10,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5BDO9C8x4KBW8CgUPnSx7E01ZR+pcKEml0/t6Gj2w4MmQpDst8vuwOeiuCSmZUUzT19BBkzO9wQBMDEcUuTHO37Nx1as9VWeLZ/OjxIDUYzc9Z6H/jeRdfuIP00EqKSg==',key_name='tempest-keypair-1501335207',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='499d0dc41fbb400ab2b83b5d5091d880',ramdisk_id='',reservation_id='r-x8o6nc9i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1747303038',owner_user_name='tempest-TaggedBootDevicesTest_v242-1747303038-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cad6e6d43b3d474a888f6b02458b2ac8',uuid=58edd8cc-a455-4922-8de8-c800a61e7b43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2629b394-59bc-4ddd-9d05-3fa4fbb15b55", "address": "fa:16:3e:6c:2d:b7", "network": {"id": "4501b03b-0b17-40b9-8545-c3385627d276", "bridge": "br-int", "label": "tempest-device-tagging-net1-1630322313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2629b394-59", "ovs_interfaceid": "2629b394-59bc-4ddd-9d05-3fa4fbb15b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Converting VIF {"id": "2629b394-59bc-4ddd-9d05-3fa4fbb15b55", "address": "fa:16:3e:6c:2d:b7", "network": {"id": "4501b03b-0b17-40b9-8545-c3385627d276", "bridge": "br-int", "label": "tempest-device-tagging-net1-1630322313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2629b394-59", "ovs_interfaceid": "2629b394-59bc-4ddd-9d05-3fa4fbb15b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:2d:b7,bridge_name='br-int',has_traffic_filtering=True,id=2629b394-59bc-4ddd-9d05-3fa4fbb15b55,network=Network(4501b03b-0b17-40b9-8545-c3385627d276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2629b394-59') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T17:04:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1317300551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1317300551',id=10,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5BDO9C8x4KBW8CgUPnSx7E01ZR+pcKEml0/t6Gj2w4MmQpDst8vuwOeiuCSmZUUzT19BBkzO9wQBMDEcUuTHO37Nx1as9VWeLZ/OjxIDUYzc9Z6H/jeRdfuIP00EqKSg==',key_name='tempest-keypair-1501335207',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='499d0dc41fbb400ab2b83b5d5091d880',ramdisk_id='',reservation_id='r-x8o6nc9i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1747303038',owner_user_name='tempest-TaggedBootDevicesTest_v242-1747303038-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cad6e6d43b3d474a888f6b02458b2ac8',uuid=58edd8cc-a455-4922-8de8-c800a61e7b43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64686449-f344-4a65-ac45-8e7ff3f8cd84", "address": "fa:16:3e:8b:69:97", "network": {"id": "4501b03b-0b17-40b9-8545-c3385627d276", "bridge": "br-int", "label": "tempest-device-tagging-net1-1630322313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64686449-f3", "ovs_interfaceid": "64686449-f344-4a65-ac45-8e7ff3f8cd84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Converting VIF {"id": "64686449-f344-4a65-ac45-8e7ff3f8cd84", "address": "fa:16:3e:8b:69:97", "network": {"id": "4501b03b-0b17-40b9-8545-c3385627d276", "bridge": "br-int", "label": "tempest-device-tagging-net1-1630322313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64686449-f3", "ovs_interfaceid": "64686449-f344-4a65-ac45-8e7ff3f8cd84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:69:97,bridge_name='br-int',has_traffic_filtering=True,id=64686449-f344-4a65-ac45-8e7ff3f8cd84,network=Network(4501b03b-0b17-40b9-8545-c3385627d276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64686449-f3') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T17:04:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1317300551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1317300551',id=10,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5BDO9C8x4KBW8CgUPnSx7E01ZR+pcKEml0/t6Gj2w4MmQpDst8vuwOeiuCSmZUUzT19BBkzO9wQBMDEcUuTHO37Nx1as9VWeLZ/OjxIDUYzc9Z6H/jeRdfuIP00EqKSg==',key_name='tempest-keypair-1501335207',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='499d0dc41fbb400ab2b83b5d5091d880',ramdisk_id='',reservation_id='r-x8o6nc9i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1747303038',owner_user_name='tempest-TaggedBootDevicesTest_v242-1747303038-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cad6e6d43b3d474a888f6b02458b2ac8',uuid=58edd8cc-a455-4922-8de8-c800a61e7b43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9dd57873-8274-4099-b5a7-cefeabbbc308", "address": "fa:16:3e:3d:0f:1e", "network": {"id": "4501b03b-0b17-40b9-8545-c3385627d276", "bridge": "br-int", "label": "tempest-device-tagging-net1-1630322313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dd57873-82", "ovs_interfaceid": "9dd57873-8274-4099-b5a7-cefeabbbc308", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Converting VIF {"id": "9dd57873-8274-4099-b5a7-cefeabbbc308", "address": "fa:16:3e:3d:0f:1e", "network": {"id": "4501b03b-0b17-40b9-8545-c3385627d276", "bridge": "br-int", "label": "tempest-device-tagging-net1-1630322313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dd57873-82", "ovs_interfaceid": "9dd57873-8274-4099-b5a7-cefeabbbc308", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:0f:1e,bridge_name='br-int',has_traffic_filtering=True,id=9dd57873-8274-4099-b5a7-cefeabbbc308,network=Network(4501b03b-0b17-40b9-8545-c3385627d276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dd57873-82') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T17:04:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1317300551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1317300551',id=10,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5BDO9C8x4KBW8CgUPnSx7E01ZR+pcKEml0/t6Gj2w4MmQpDst8vuwOeiuCSmZUUzT19BBkzO9wQBMDEcUuTHO37Nx1as9VWeLZ/OjxIDUYzc9Z6H/jeRdfuIP00EqKSg==',key_name='tempest-keypair-1501335207',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='499d0dc41fbb400ab2b83b5d5091d880',ramdisk_id='',reservation_id='r-x8o6nc9i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1747303038',owner_user_name='tempest-TaggedBootDevicesTest_v242-1747303038-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cad6e6d43b3d474a888f6b02458b2ac8',uuid=58edd8cc-a455-4922-8de8-c800a61e7b43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c658955e-999b-40cf-bed4-b59459a8953a", "address": "fa:16:3e:20:e9:d3", "network": {"id": "a14a0aa7-2798-4429-9394-a35ee3367c86", "bridge": "br-int", "label": "tempest-device-tagging-net2-808383388", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc658955e-99", "ovs_interfaceid": "c658955e-999b-40cf-bed4-b59459a8953a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Converting VIF {"id": "c658955e-999b-40cf-bed4-b59459a8953a", "address": "fa:16:3e:20:e9:d3", "network": {"id": "a14a0aa7-2798-4429-9394-a35ee3367c86", "bridge": "br-int", "label": "tempest-device-tagging-net2-808383388", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc658955e-99", "ovs_interfaceid": "c658955e-999b-40cf-bed4-b59459a8953a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:e9:d3,bridge_name='br-int',has_traffic_filtering=True,id=c658955e-999b-40cf-bed4-b59459a8953a,network=Network(a14a0aa7-2798-4429-9394-a35ee3367c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc658955e-99') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T17:04:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1317300551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1317300551',id=10,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5BDO9C8x4KBW8CgUPnSx7E01ZR+pcKEml0/t6Gj2w4MmQpDst8vuwOeiuCSmZUUzT19BBkzO9wQBMDEcUuTHO37Nx1as9VWeLZ/OjxIDUYzc9Z6H/jeRdfuIP00EqKSg==',key_name='tempest-keypair-1501335207',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='499d0dc41fbb400ab2b83b5d5091d880',ramdisk_id='',reservation_id='r-x8o6nc9i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1747303038',owner_user_name='tempest-TaggedBootDevicesTest_v242-1747303038-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cad6e6d43b3d474a888f6b02458b2ac8',uuid=58edd8cc-a455-4922-8de8-c800a61e7b43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a44b1589-f08b-4d65-a6a0-bb0e95fcf2ab", "address": "fa:16:3e:aa:65:f0", "network": {"id": "a14a0aa7-2798-4429-9394-a35ee3367c86", "bridge": "br-int", "label": "tempest-device-tagging-net2-808383388", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa44b1589-f0", "ovs_interfaceid": "a44b1589-f08b-4d65-a6a0-bb0e95fcf2ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Converting VIF {"id": "a44b1589-f08b-4d65-a6a0-bb0e95fcf2ab", "address": "fa:16:3e:aa:65:f0", "network": {"id": "a14a0aa7-2798-4429-9394-a35ee3367c86", "bridge": "br-int", "label": "tempest-device-tagging-net2-808383388", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa44b1589-f0", "ovs_interfaceid": "a44b1589-f08b-4d65-a6a0-bb0e95fcf2ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:65:f0,bridge_name='br-int',has_traffic_filtering=True,id=a44b1589-f08b-4d65-a6a0-bb0e95fcf2ab,network=Network(a14a0aa7-2798-4429-9394-a35ee3367c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa44b1589-f0') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG nova.objects.instance [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Lazy-loading 'pci_devices' on Instance uuid 58edd8cc-a455-4922-8de8-c800a61e7b43 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e396a5f-67ac-4b6d-b132-0a7e24d719ed]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 17:04:49 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd -p 172.16.0.220:3260 --interface default --op new {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:04:49 user nova-compute[74743]:   <uuid>58edd8cc-a455-4922-8de8-c800a61e7b43</uuid>
Nov 18 17:04:49 user nova-compute[74743]:   <name>instance-0000000a</name>
Nov 18 17:04:49 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:04:49 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:04:49 user nova-compute[74743]:   <metadata>
Nov 18 17:04:49 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:04:49 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:04:49 user nova-compute[74743]:       <nova:name>tempest-device-tagging-server-1317300551</nova:name>
Nov 18 17:04:49 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:04:43</nova:creationTime>
Nov 18 17:04:49 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:04:49 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:04:49 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:04:49 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:04:49 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:04:49 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:04:49 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:04:49 user nova-compute[74743]:       <nova:owner>
Nov 18 17:04:49 user nova-compute[74743]:         <nova:user uuid="cad6e6d43b3d474a888f6b02458b2ac8">tempest-TaggedBootDevicesTest_v242-1747303038-project-member</nova:user>
Nov 18 17:04:49 user nova-compute[74743]:         <nova:project uuid="499d0dc41fbb400ab2b83b5d5091d880">tempest-TaggedBootDevicesTest_v242-1747303038</nova:project>
Nov 18 17:04:49 user nova-compute[74743]:       </nova:owner>
Nov 18 17:04:49 user nova-compute[74743]:       <nova:root type="image" uuid="9536f6cf-95c4-40e2-864a-09a91525678a"/>
Nov 18 17:04:49 user nova-compute[74743]:       <nova:ports>
Nov 18 17:04:49 user nova-compute[74743]:         <nova:port uuid="34bfd284-1ef1-415a-9c96-f5ae24114a6a">
Nov 18 17:04:49 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 18 17:04:49 user nova-compute[74743]:         </nova:port>
Nov 18 17:04:49 user nova-compute[74743]:         <nova:port uuid="f7d1b2be-29b6-45a1-9917-d16b576a84b2">
Nov 18 17:04:49 user nova-compute[74743]:           <nova:ip type="fixed" address="10.1.1.33" ipVersion="4"/>
Nov 18 17:04:49 user nova-compute[74743]:         </nova:port>
Nov 18 17:04:49 user nova-compute[74743]:         <nova:port uuid="2629b394-59bc-4ddd-9d05-3fa4fbb15b55">
Nov 18 17:04:49 user nova-compute[74743]:           <nova:ip type="fixed" address="10.1.1.143" ipVersion="4"/>
Nov 18 17:04:49 user nova-compute[74743]:         </nova:port>
Nov 18 17:04:49 user nova-compute[74743]:         <nova:port uuid="64686449-f344-4a65-ac45-8e7ff3f8cd84">
Nov 18 17:04:49 user nova-compute[74743]:           <nova:ip type="fixed" address="10.1.1.165" ipVersion="4"/>
Nov 18 17:04:49 user nova-compute[74743]:         </nova:port>
Nov 18 17:04:49 user nova-compute[74743]:         <nova:port uuid="9dd57873-8274-4099-b5a7-cefeabbbc308">
Nov 18 17:04:49 user nova-compute[74743]:           <nova:ip type="fixed" address="10.1.1.244" ipVersion="4"/>
Nov 18 17:04:49 user nova-compute[74743]:         </nova:port>
Nov 18 17:04:49 user nova-compute[74743]:         <nova:port uuid="c658955e-999b-40cf-bed4-b59459a8953a">
Nov 18 17:04:49 user nova-compute[74743]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 18 17:04:49 user nova-compute[74743]:         </nova:port>
Nov 18 17:04:49 user nova-compute[74743]:         <nova:port uuid="a44b1589-f08b-4d65-a6a0-bb0e95fcf2ab">
Nov 18 17:04:49 user nova-compute[74743]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 18 17:04:49 user nova-compute[74743]:         </nova:port>
Nov 18 17:04:49 user nova-compute[74743]:       </nova:ports>
Nov 18 17:04:49 user nova-compute[74743]:     </nova:instance>
Nov 18 17:04:49 user nova-compute[74743]:   </metadata>
Nov 18 17:04:49 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:04:49 user nova-compute[74743]:     <system>
Nov 18 17:04:49 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:04:49 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:04:49 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:04:49 user nova-compute[74743]:       <entry name="serial">58edd8cc-a455-4922-8de8-c800a61e7b43</entry>
Nov 18 17:04:49 user nova-compute[74743]:       <entry name="uuid">58edd8cc-a455-4922-8de8-c800a61e7b43</entry>
Nov 18 17:04:49 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:04:49 user nova-compute[74743]:     </system>
Nov 18 17:04:49 user nova-compute[74743]:   </sysinfo>
Nov 18 17:04:49 user nova-compute[74743]:   <os>
Nov 18 17:04:49 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:04:49 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:04:49 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:04:49 user nova-compute[74743]:   </os>
Nov 18 17:04:49 user nova-compute[74743]:   <features>
Nov 18 17:04:49 user nova-compute[74743]:     <acpi/>
Nov 18 17:04:49 user nova-compute[74743]:     <apic/>
Nov 18 17:04:49 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:04:49 user nova-compute[74743]:   </features>
Nov 18 17:04:49 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:04:49 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:04:49 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:04:49 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:04:49 user nova-compute[74743]:   </clock>
Nov 18 17:04:49 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:04:49 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:04:49 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:04:49 user nova-compute[74743]:   </cpu>
Nov 18 17:04:49 user nova-compute[74743]:   <devices>
Nov 18 17:04:49 user nova-compute[74743]:     <disk type="file" device="cdrom">
Nov 18 17:04:49 user nova-compute[74743]:       <driver name="qemu" type="raw" cache="none"/>
Nov 18 17:04:49 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/58edd8cc-a455-4922-8de8-c800a61e7b43/disk.config"/>
Nov 18 17:04:49 user nova-compute[74743]:       <target dev="hda" bus="ide"/>
Nov 18 17:04:49 user nova-compute[74743]:     </disk>
Nov 18 17:04:49 user nova-compute[74743]:     <disk type="block" device="disk">
Nov 18 17:04:49 user nova-compute[74743]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:04:49 user nova-compute[74743]:       <source dev="/dev/sdc"/>
Nov 18 17:04:49 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:04:49 user nova-compute[74743]:       <serial>9f522558-51f6-48e8-baf6-d7e55732e9fe</serial>
Nov 18 17:04:49 user nova-compute[74743]:     </disk>
Nov 18 17:04:49 user nova-compute[74743]:     <disk type="block" device="disk">
Nov 18 17:04:49 user nova-compute[74743]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:04:49 user nova-compute[74743]:       <source dev="/dev/sdd"/>
Nov 18 17:04:49 user nova-compute[74743]:       <target dev="vdb" bus="virtio"/>
Nov 18 17:04:49 user nova-compute[74743]:       <serial>09d9fafc-921d-4018-91a8-ea22e51fcb9f</serial>
Nov 18 17:04:49 user nova-compute[74743]:     </disk>
Nov 18 17:04:49 user nova-compute[74743]:     <disk type="block" device="disk">
Nov 18 17:04:49 user nova-compute[74743]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:04:49 user nova-compute[74743]:       <source dev="/dev/sdf"/>
Nov 18 17:04:49 user nova-compute[74743]:       <target dev="vdc" bus="virtio"/>
Nov 18 17:04:49 user nova-compute[74743]:       <serial>3a394185-bc59-47fb-8214-07aa026083a3</serial>
Nov 18 17:04:49 user nova-compute[74743]:     </disk>
Nov 18 17:04:49 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:04:49 user nova-compute[74743]:       <mac address="fa:16:3e:3f:ad:b1"/>
Nov 18 17:04:49 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:04:49 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:04:49 user nova-compute[74743]:       <target dev="tap34bfd284-1e"/>
Nov 18 17:04:49 user nova-compute[74743]:     </interface>
Nov 18 17:04:49 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:04:49 user nova-compute[74743]:       <mac address="fa:16:3e:c2:43:ab"/>
Nov 18 17:04:49 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:04:49 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:04:49 user nova-compute[74743]:       <target dev="tapf7d1b2be-29"/>
Nov 18 17:04:49 user nova-compute[74743]:     </interface>
Nov 18 17:04:49 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:04:49 user nova-compute[74743]:       <mac address="fa:16:3e:6c:2d:b7"/>
Nov 18 17:04:49 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:04:49 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:04:49 user nova-compute[74743]:       <target dev="tap2629b394-59"/>
Nov 18 17:04:49 user nova-compute[74743]:     </interface>
Nov 18 17:04:49 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:04:49 user nova-compute[74743]:       <mac address="fa:16:3e:8b:69:97"/>
Nov 18 17:04:49 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:04:49 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:04:49 user nova-compute[74743]:       <target dev="tap64686449-f3"/>
Nov 18 17:04:49 user nova-compute[74743]:     </interface>
Nov 18 17:04:49 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:04:49 user nova-compute[74743]:       <mac address="fa:16:3e:3d:0f:1e"/>
Nov 18 17:04:49 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:04:49 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:04:49 user nova-compute[74743]:       <target dev="tap9dd57873-82"/>
Nov 18 17:04:49 user nova-compute[74743]:     </interface>
Nov 18 17:04:49 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:04:49 user nova-compute[74743]:       <mac address="fa:16:3e:20:e9:d3"/>
Nov 18 17:04:49 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:04:49 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:04:49 user nova-compute[74743]:       <target dev="tapc658955e-99"/>
Nov 18 17:04:49 user nova-compute[74743]:     </interface>
Nov 18 17:04:49 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:04:49 user nova-compute[74743]:       <mac address="fa:16:3e:aa:65:f0"/>
Nov 18 17:04:49 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:04:49 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:04:49 user nova-compute[74743]:       <target dev="tapa44b1589-f0"/>
Nov 18 17:04:49 user nova-compute[74743]:     </interface>
Nov 18 17:04:49 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:04:49 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/58edd8cc-a455-4922-8de8-c800a61e7b43/console.log" append="off"/>
Nov 18 17:04:49 user nova-compute[74743]:     </serial>
Nov 18 17:04:49 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:04:49 user nova-compute[74743]:     <video>
Nov 18 17:04:49 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:04:49 user nova-compute[74743]:     </video>
Nov 18 17:04:49 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:04:49 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:04:49 user nova-compute[74743]:     </rng>
Nov 18 17:04:49 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:04:49 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:04:49 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:04:49 user nova-compute[74743]:     </memballoon>
Nov 18 17:04:49 user nova-compute[74743]:   </devices>
Nov 18 17:04:49 user nova-compute[74743]: </domain>
Nov 18 17:04:49 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T17:04:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1317300551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1317300551',id=10,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5BDO9C8x4KBW8CgUPnSx7E01ZR+pcKEml0/t6Gj2w4MmQpDst8vuwOeiuCSmZUUzT19BBkzO9wQBMDEcUuTHO37Nx1as9VWeLZ/OjxIDUYzc9Z6H/jeRdfuIP00EqKSg==',key_name='tempest-keypair-1501335207',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='499d0dc41fbb400ab2b83b5d5091d880',ramdisk_id='',reservation_id='r-x8o6nc9i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1747303038',owner_user_name='tempest-TaggedBootDevicesTest_v242-1747303038-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cad6e6d43b3d474a888f6b02458b2ac8',uuid=58edd8cc-a455-4922-8de8-c800a61e7b43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34bfd284-1ef1-415a-9c96-f5ae24114a6a", "address": "fa:16:3e:3f:ad:b1", "network": {"id": "1638ba59-8de1-4e32-ab20-8cd8c688de5f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1073649476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34bfd284-1e", "ovs_interfaceid": "34bfd284-1ef1-415a-9c96-f5ae24114a6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Converting VIF {"id": "34bfd284-1ef1-415a-9c96-f5ae24114a6a", "address": "fa:16:3e:3f:ad:b1", "network": {"id": "1638ba59-8de1-4e32-ab20-8cd8c688de5f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1073649476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34bfd284-1e", "ovs_interfaceid": "34bfd284-1ef1-415a-9c96-f5ae24114a6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:ad:b1,bridge_name='br-int',has_traffic_filtering=True,id=34bfd284-1ef1-415a-9c96-f5ae24114a6a,network=Network(1638ba59-8de1-4e32-ab20-8cd8c688de5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34bfd284-1e') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG os_vif [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:ad:b1,bridge_name='br-int',has_traffic_filtering=True,id=34bfd284-1ef1-415a-9c96-f5ae24114a6a,network=Network(1638ba59-8de1-4e32-ab20-8cd8c688de5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34bfd284-1e') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[683ddc50-2ea5-48a1-9e9d-1f92eb02d8c4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd] added\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9891cd50-beef-59e6-8f36-022a57b232b5', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd] added
Nov 18 17:04:49 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap34bfd284-1e, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap34bfd284-1e, col_values=(('qos', UUID('1a2795b3-d74a-4893-bda4-897b69021f9c')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap34bfd284-1e, col_values=(('external_ids', {'iface-id': '34bfd284-1ef1-415a-9c96-f5ae24114a6a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:ad:b1', 'vm-uuid': '58edd8cc-a455-4922-8de8-c800a61e7b43'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01191e8-2ced-459d-b3e4-ab06c507279a]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:49 user nova-compute[74743]: INFO os_vif [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:ad:b1,bridge_name='br-int',has_traffic_filtering=True,id=34bfd284-1ef1-415a-9c96-f5ae24114a6a,network=Network(1638ba59-8de1-4e32-ab20-8cd8c688de5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34bfd284-1e')
Nov 18 17:04:49 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T17:04:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1317300551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1317300551',id=10,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5BDO9C8x4KBW8CgUPnSx7E01ZR+pcKEml0/t6Gj2w4MmQpDst8vuwOeiuCSmZUUzT19BBkzO9wQBMDEcUuTHO37Nx1as9VWeLZ/OjxIDUYzc9Z6H/jeRdfuIP00EqKSg==',key_name='tempest-keypair-1501335207',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='499d0dc41fbb400ab2b83b5d5091d880',ramdisk_id='',reservation_id='r-x8o6nc9i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1747303038',owner_user_name='tempest-TaggedBootDevicesTest_v242-1747303038-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cad6e6d43b3d474a888f6b02458b2ac8',uuid=58edd8cc-a455-4922-8de8-c800a61e7b43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7d1b2be-29b6-45a1-9917-d16b576a84b2", "address": "fa:16:3e:c2:43:ab", "network": {"id": "4501b03b-0b17-40b9-8545-c3385627d276", "bridge": "br-int", "label": "tempest-device-tagging-net1-1630322313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7d1b2be-29", "ovs_interfaceid": "f7d1b2be-29b6-45a1-9917-d16b576a84b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Converting VIF {"id": "f7d1b2be-29b6-45a1-9917-d16b576a84b2", "address": "fa:16:3e:c2:43:ab", "network": {"id": "4501b03b-0b17-40b9-8545-c3385627d276", "bridge": "br-int", "label": "tempest-device-tagging-net1-1630322313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7d1b2be-29", "ovs_interfaceid": "f7d1b2be-29b6-45a1-9917-d16b576a84b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:43:ab,bridge_name='br-int',has_traffic_filtering=True,id=f7d1b2be-29b6-45a1-9917-d16b576a84b2,network=Network(4501b03b-0b17-40b9-8545-c3385627d276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf7d1b2be-29') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG os_vif [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:43:ab,bridge_name='br-int',has_traffic_filtering=True,id=f7d1b2be-29b6-45a1-9917-d16b576a84b2,network=Network(4501b03b-0b17-40b9-8545-c3385627d276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf7d1b2be-29') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c73af367-207a-55a7-9562-a986e08adc8c', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68f6fbb-e993-4c6e-a7b4-4930f5561bac]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v idvQfnOr {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf7d1b2be-29, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf7d1b2be-29, col_values=(('qos', UUID('d92bdfba-49d0-4ede-8298-bb10f2cc78ff')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf7d1b2be-29, col_values=(('external_ids', {'iface-id': 'f7d1b2be-29b6-45a1-9917-d16b576a84b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:43:ab', 'vm-uuid': '58edd8cc-a455-4922-8de8-c800a61e7b43'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v idvQfnOr" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a5c57b-a559-4b16-84dd-90d1fa93eac2]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'idvQfnOr'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:49 user nova-compute[74743]: INFO os_vif [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:43:ab,bridge_name='br-int',has_traffic_filtering=True,id=f7d1b2be-29b6-45a1-9917-d16b576a84b2,network=Network(4501b03b-0b17-40b9-8545-c3385627d276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf7d1b2be-29')
Nov 18 17:04:49 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T17:04:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1317300551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1317300551',id=10,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5BDO9C8x4KBW8CgUPnSx7E01ZR+pcKEml0/t6Gj2w4MmQpDst8vuwOeiuCSmZUUzT19BBkzO9wQBMDEcUuTHO37Nx1as9VWeLZ/OjxIDUYzc9Z6H/jeRdfuIP00EqKSg==',key_name='tempest-keypair-1501335207',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='499d0dc41fbb400ab2b83b5d5091d880',ramdisk_id='',reservation_id='r-x8o6nc9i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1747303038',owner_user_name='tempest-TaggedBootDevicesTest_v242-1747303038-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cad6e6d43b3d474a888f6b02458b2ac8',uuid=58edd8cc-a455-4922-8de8-c800a61e7b43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2629b394-59bc-4ddd-9d05-3fa4fbb15b55", "address": "fa:16:3e:6c:2d:b7", "network": {"id": "4501b03b-0b17-40b9-8545-c3385627d276", "bridge": "br-int", "label": "tempest-device-tagging-net1-1630322313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2629b394-59", "ovs_interfaceid": "2629b394-59bc-4ddd-9d05-3fa4fbb15b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Converting VIF {"id": "2629b394-59bc-4ddd-9d05-3fa4fbb15b55", "address": "fa:16:3e:6c:2d:b7", "network": {"id": "4501b03b-0b17-40b9-8545-c3385627d276", "bridge": "br-int", "label": "tempest-device-tagging-net1-1630322313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2629b394-59", "ovs_interfaceid": "2629b394-59bc-4ddd-9d05-3fa4fbb15b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:2d:b7,bridge_name='br-int',has_traffic_filtering=True,id=2629b394-59bc-4ddd-9d05-3fa4fbb15b55,network=Network(4501b03b-0b17-40b9-8545-c3385627d276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2629b394-59') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG os_vif [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:2d:b7,bridge_name='br-int',has_traffic_filtering=True,id=2629b394-59bc-4ddd-9d05-3fa4fbb15b55,network=Network(4501b03b-0b17-40b9-8545-c3385627d276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2629b394-59') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c04ce9ec-3a51-52c8-addb-22e9378b7d50', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2e9e8e-3b41-49b6-bf66-fc7fa77fbb69]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2629b394-59, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2629b394-59, col_values=(('qos', UUID('a5f231e6-0241-4c72-8dc7-d124257b60be')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2629b394-59, col_values=(('external_ids', {'iface-id': '2629b394-59bc-4ddd-9d05-3fa4fbb15b55', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:2d:b7', 'vm-uuid': '58edd8cc-a455-4922-8de8-c800a61e7b43'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce4db84-1617-4f6c-8386-c463333cf3e2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:04:49 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:04:49 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:04:49 user nova-compute[74743]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)
Nov 18 17:04:49 user nova-compute[74743]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)
Nov 18 17:04:49 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:04:49 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:04:49 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:04:49 user nova-compute[74743]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)
Nov 18 17:04:49 user nova-compute[74743]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)
Nov 18 17:04:49 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd -p 172.16.0.220:3260 --login {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:49 user nova-compute[74743]: INFO os_vif [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:2d:b7,bridge_name='br-int',has_traffic_filtering=True,id=2629b394-59bc-4ddd-9d05-3fa4fbb15b55,network=Network(4501b03b-0b17-40b9-8545-c3385627d276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2629b394-59')
Nov 18 17:04:49 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T17:04:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1317300551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1317300551',id=10,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5BDO9C8x4KBW8CgUPnSx7E01ZR+pcKEml0/t6Gj2w4MmQpDst8vuwOeiuCSmZUUzT19BBkzO9wQBMDEcUuTHO37Nx1as9VWeLZ/OjxIDUYzc9Z6H/jeRdfuIP00EqKSg==',key_name='tempest-keypair-1501335207',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='499d0dc41fbb400ab2b83b5d5091d880',ramdisk_id='',reservation_id='r-x8o6nc9i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1747303038',owner_user_name='tempest-TaggedBootDevicesTest_v242-1747303038-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cad6e6d43b3d474a888f6b02458b2ac8',uuid=58edd8cc-a455-4922-8de8-c800a61e7b43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64686449-f344-4a65-ac45-8e7ff3f8cd84", "address": "fa:16:3e:8b:69:97", "network": {"id": "4501b03b-0b17-40b9-8545-c3385627d276", "bridge": "br-int", "label": "tempest-device-tagging-net1-1630322313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64686449-f3", "ovs_interfaceid": "64686449-f344-4a65-ac45-8e7ff3f8cd84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Converting VIF {"id": "64686449-f344-4a65-ac45-8e7ff3f8cd84", "address": "fa:16:3e:8b:69:97", "network": {"id": "4501b03b-0b17-40b9-8545-c3385627d276", "bridge": "br-int", "label": "tempest-device-tagging-net1-1630322313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64686449-f3", "ovs_interfaceid": "64686449-f344-4a65-ac45-8e7ff3f8cd84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:69:97,bridge_name='br-int',has_traffic_filtering=True,id=64686449-f344-4a65-ac45-8e7ff3f8cd84,network=Network(4501b03b-0b17-40b9-8545-c3385627d276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64686449-f3') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG os_vif [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:69:97,bridge_name='br-int',has_traffic_filtering=True,id=64686449-f344-4a65-ac45-8e7ff3f8cd84,network=Network(4501b03b-0b17-40b9-8545-c3385627d276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64686449-f3') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd238eded-b8c6-58ec-8c7a-79b53b87d0e0', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap64686449-f3, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap64686449-f3, col_values=(('qos', UUID('bd55e3a6-fab5-42ff-a983-ce94c812a066')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap64686449-f3, col_values=(('external_ids', {'iface-id': '64686449-f344-4a65-ac45-8e7ff3f8cd84', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:69:97', 'vm-uuid': '58edd8cc-a455-4922-8de8-c800a61e7b43'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1ebe99-1f19-4b63-8f39-8caee877e81a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd, portal: 172.16.0.220,3260]
Nov 18 17:04:49 user nova-compute[74743]: Login to [iface: default, target: iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd, portal: 172.16.0.220,3260] successful.
Nov 18 17:04:49 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[95225cf3-5bb9-4cb0-adfa-d011e1106ff5]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:49 user nova-compute[74743]: INFO os_vif [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:69:97,bridge_name='br-int',has_traffic_filtering=True,id=64686449-f344-4a65-ac45-8e7ff3f8cd84,network=Network(4501b03b-0b17-40b9-8545-c3385627d276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64686449-f3')
Nov 18 17:04:49 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T17:04:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1317300551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1317300551',id=10,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5BDO9C8x4KBW8CgUPnSx7E01ZR+pcKEml0/t6Gj2w4MmQpDst8vuwOeiuCSmZUUzT19BBkzO9wQBMDEcUuTHO37Nx1as9VWeLZ/OjxIDUYzc9Z6H/jeRdfuIP00EqKSg==',key_name='tempest-keypair-1501335207',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='499d0dc41fbb400ab2b83b5d5091d880',ramdisk_id='',reservation_id='r-x8o6nc9i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1747303038',owner_user_name='tempest-TaggedBootDevicesTest_v242-1747303038-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cad6e6d43b3d474a888f6b02458b2ac8',uuid=58edd8cc-a455-4922-8de8-c800a61e7b43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9dd57873-8274-4099-b5a7-cefeabbbc308", "address": "fa:16:3e:3d:0f:1e", "network": {"id": "4501b03b-0b17-40b9-8545-c3385627d276", "bridge": "br-int", "label": "tempest-device-tagging-net1-1630322313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dd57873-82", "ovs_interfaceid": "9dd57873-8274-4099-b5a7-cefeabbbc308", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Converting VIF {"id": "9dd57873-8274-4099-b5a7-cefeabbbc308", "address": "fa:16:3e:3d:0f:1e", "network": {"id": "4501b03b-0b17-40b9-8545-c3385627d276", "bridge": "br-int", "label": "tempest-device-tagging-net1-1630322313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dd57873-82", "ovs_interfaceid": "9dd57873-8274-4099-b5a7-cefeabbbc308", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:0f:1e,bridge_name='br-int',has_traffic_filtering=True,id=9dd57873-8274-4099-b5a7-cefeabbbc308,network=Network(4501b03b-0b17-40b9-8545-c3385627d276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dd57873-82') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG os_vif [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:0f:1e,bridge_name='br-int',has_traffic_filtering=True,id=9dd57873-8274-4099-b5a7-cefeabbbc308,network=Network(4501b03b-0b17-40b9-8545-c3385627d276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dd57873-82') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '68661aa8-7d0f-534e-b0ca-5975b32a8c8c', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5782e1b-d33b-4623-ad3d-eb94a32b4112]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:04:49 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:04:49 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:04:49 user nova-compute[74743]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)
Nov 18 17:04:49 user nova-compute[74743]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)
Nov 18 17:04:49 user nova-compute[74743]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)
Nov 18 17:04:49 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:04:49 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:04:49 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:04:49 user nova-compute[74743]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)
Nov 18 17:04:49 user nova-compute[74743]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)
Nov 18 17:04:49 user nova-compute[74743]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)
Nov 18 17:04:49 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.357s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Connected to 172.16.0.220:3260 {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=74743) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74743) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff91e161-9a5a-4893-a6af-40337d2d8453]: (4, ('- - 0', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'idvQfnOr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9dd57873-82, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9dd57873-82, col_values=(('qos', UUID('7971e975-7062-408d-96ba-285154906744')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9dd57873-82, col_values=(('external_ids', {'iface-id': '9dd57873-8274-4099-b5a7-cefeabbbc308', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:0f:1e', 'vm-uuid': '58edd8cc-a455-4922-8de8-c800a61e7b43'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:49 user nova-compute[74743]: INFO os_vif [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:0f:1e,bridge_name='br-int',has_traffic_filtering=True,id=9dd57873-8274-4099-b5a7-cefeabbbc308,network=Network(4501b03b-0b17-40b9-8545-c3385627d276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dd57873-82')
Nov 18 17:04:49 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T17:04:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1317300551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1317300551',id=10,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5BDO9C8x4KBW8CgUPnSx7E01ZR+pcKEml0/t6Gj2w4MmQpDst8vuwOeiuCSmZUUzT19BBkzO9wQBMDEcUuTHO37Nx1as9VWeLZ/OjxIDUYzc9Z6H/jeRdfuIP00EqKSg==',key_name='tempest-keypair-1501335207',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='499d0dc41fbb400ab2b83b5d5091d880',ramdisk_id='',reservation_id='r-x8o6nc9i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1747303038',owner_user_name='tempest-TaggedBootDevicesTest_v242-1747303038-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cad6e6d43b3d474a888f6b02458b2ac8',uuid=58edd8cc-a455-4922-8de8-c800a61e7b43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c658955e-999b-40cf-bed4-b59459a8953a", "address": "fa:16:3e:20:e9:d3", "network": {"id": "a14a0aa7-2798-4429-9394-a35ee3367c86", "bridge": "br-int", "label": "tempest-device-tagging-net2-808383388", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc658955e-99", "ovs_interfaceid": "c658955e-999b-40cf-bed4-b59459a8953a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Converting VIF {"id": "c658955e-999b-40cf-bed4-b59459a8953a", "address": "fa:16:3e:20:e9:d3", "network": {"id": "a14a0aa7-2798-4429-9394-a35ee3367c86", "bridge": "br-int", "label": "tempest-device-tagging-net2-808383388", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc658955e-99", "ovs_interfaceid": "c658955e-999b-40cf-bed4-b59459a8953a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:e9:d3,bridge_name='br-int',has_traffic_filtering=True,id=c658955e-999b-40cf-bed4-b59459a8953a,network=Network(a14a0aa7-2798-4429-9394-a35ee3367c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc658955e-99') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG os_vif [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:e9:d3,bridge_name='br-int',has_traffic_filtering=True,id=c658955e-999b-40cf-bed4-b59459a8953a,network=Network(a14a0aa7-2798-4429-9394-a35ee3367c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc658955e-99') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c23171aa-1739-5cd1-b74f-d2a2346eb0e7', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:04:50 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:50 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:50 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc658955e-99, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:50 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc658955e-99, col_values=(('qos', UUID('1cfe3f79-6720-42a1-a277-e0da257c87d8')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:50 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc658955e-99, col_values=(('external_ids', {'iface-id': 'c658955e-999b-40cf-bed4-b59459a8953a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:e9:d3', 'vm-uuid': '58edd8cc-a455-4922-8de8-c800a61e7b43'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:50 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:50 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:04:50 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:50 user nova-compute[74743]: INFO os_vif [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:e9:d3,bridge_name='br-int',has_traffic_filtering=True,id=c658955e-999b-40cf-bed4-b59459a8953a,network=Network(a14a0aa7-2798-4429-9394-a35ee3367c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc658955e-99')
Nov 18 17:04:50 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T17:04:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1317300551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1317300551',id=10,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5BDO9C8x4KBW8CgUPnSx7E01ZR+pcKEml0/t6Gj2w4MmQpDst8vuwOeiuCSmZUUzT19BBkzO9wQBMDEcUuTHO37Nx1as9VWeLZ/OjxIDUYzc9Z6H/jeRdfuIP00EqKSg==',key_name='tempest-keypair-1501335207',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='499d0dc41fbb400ab2b83b5d5091d880',ramdisk_id='',reservation_id='r-x8o6nc9i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1747303038',owner_user_name='tempest-TaggedBootDevicesTest_v242-1747303038-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cad6e6d43b3d474a888f6b02458b2ac8',uuid=58edd8cc-a455-4922-8de8-c800a61e7b43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a44b1589-f08b-4d65-a6a0-bb0e95fcf2ab", "address": "fa:16:3e:aa:65:f0", "network": {"id": "a14a0aa7-2798-4429-9394-a35ee3367c86", "bridge": "br-int", "label": "tempest-device-tagging-net2-808383388", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa44b1589-f0", "ovs_interfaceid": "a44b1589-f08b-4d65-a6a0-bb0e95fcf2ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:04:50 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Converting VIF {"id": "a44b1589-f08b-4d65-a6a0-bb0e95fcf2ab", "address": "fa:16:3e:aa:65:f0", "network": {"id": "a14a0aa7-2798-4429-9394-a35ee3367c86", "bridge": "br-int", "label": "tempest-device-tagging-net2-808383388", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa44b1589-f0", "ovs_interfaceid": "a44b1589-f08b-4d65-a6a0-bb0e95fcf2ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:04:50 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:65:f0,bridge_name='br-int',has_traffic_filtering=True,id=a44b1589-f08b-4d65-a6a0-bb0e95fcf2ab,network=Network(a14a0aa7-2798-4429-9394-a35ee3367c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa44b1589-f0') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:04:50 user nova-compute[74743]: DEBUG os_vif [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:65:f0,bridge_name='br-int',has_traffic_filtering=True,id=a44b1589-f08b-4d65-a6a0-bb0e95fcf2ab,network=Network(a14a0aa7-2798-4429-9394-a35ee3367c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa44b1589-f0') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:04:50 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:50 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:50 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:04:50 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:50 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a812baad-0df9-55a9-8c6b-1dc02bdef7c0', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:50 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:50 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:04:50 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:50 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:50 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa44b1589-f0, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:50 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa44b1589-f0, col_values=(('qos', UUID('72505b6d-9ff6-4bb4-8605-a70523dbcc1b')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:50 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa44b1589-f0, col_values=(('external_ids', {'iface-id': 'a44b1589-f08b-4d65-a6a0-bb0e95fcf2ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:65:f0', 'vm-uuid': '58edd8cc-a455-4922-8de8-c800a61e7b43'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:50 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:50 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:04:50 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:50 user nova-compute[74743]: INFO os_vif [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:65:f0,bridge_name='br-int',has_traffic_filtering=True,id=a44b1589-f08b-4d65-a6a0-bb0e95fcf2ab,network=Network(a14a0aa7-2798-4429-9394-a35ee3367c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa44b1589-f0')
Nov 18 17:04:50 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] No BDM found with device name hda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:04:50 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:04:50 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] No VIF found with MAC fa:16:3e:3f:ad:b1, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:04:50 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] No VIF found with MAC fa:16:3e:3d:0f:1e, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:04:50 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Using config drive
Nov 18 17:04:50 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Creating config drive at /opt/stack/data/nova/instances/58edd8cc-a455-4922-8de8-c800a61e7b43/disk.config
Nov 18 17:04:50 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/58edd8cc-a455-4922-8de8-c800a61e7b43/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpiqi7nhfz {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:50 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/58edd8cc-a455-4922-8de8-c800a61e7b43/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpiqi7nhfz" returned: 0 in 0.059s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:50 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:04:50 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] <== connect_volume: return (2709ms) {'type': 'block', 'scsi_wwn': '26635353134303663', 'path': '/dev/sdg'} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:04:50 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635353134303663', 'path': '/dev/sdg'} {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 17:04:50 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Calling os-brick to attach iSCSI Volume {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 17:04:50 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PSecUtMD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:04:50 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:04:50 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:04:50 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:04:50 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:04:50 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:04:50 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:04:50 user nova-compute[74743]: INFO os_brick.initiator.connectors.iscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 17:04:50 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa -p 172.16.0.220:3260 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:50 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:50 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[42729da1-6b41-48dd-8fa5-c539099dd950]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:50 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 17:04:50 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:04:50 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa -p 172.16.0.220:3260 --interface default --op new {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:51 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[529f0ece-71d5-4982-9f24-a07b2075bfd0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa] added\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa] added
Nov 18 17:04:51 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:04:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:51 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed53253b-35e5-4f82-b29d-6a1645c175bc]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:04:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:51 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef169f5-d19e-4224-9706-a393f50b03d8]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:04:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PSecUtMD {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PSecUtMD" returned: 0 in 0.026s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:51 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[49019fd6-29f9-40f8-8d53-7e78ab881834]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PSecUtMD'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:04:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:51 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[994dd643-5d67-416d-9512-326fd3d791ee]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:04:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:51 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[77eb0544-7209-48c9-bff8-99b33669f332]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:04:51 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:04:51 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:04:51 user nova-compute[74743]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)
Nov 18 17:04:51 user nova-compute[74743]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)
Nov 18 17:04:51 user nova-compute[74743]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)
Nov 18 17:04:51 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:04:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:04:51 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:04:51 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:04:51 user nova-compute[74743]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)
Nov 18 17:04:51 user nova-compute[74743]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)
Nov 18 17:04:51 user nova-compute[74743]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)
Nov 18 17:04:51 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:04:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa -p 172.16.0.220:3260 --login {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:51 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5bc6c24-0321-4a1d-b5a7-665f234e907e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa, portal: 172.16.0.220,3260]
Nov 18 17:04:51 user nova-compute[74743]: Login to [iface: default, target: iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa, portal: 172.16.0.220,3260] successful.
Nov 18 17:04:51 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:04:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:51 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[124adb97-3d7c-4d7a-95e3-30197eeef6aa]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:04:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:51 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3edaf4e-ac1b-4cb0-8274-28c53d68b741]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:04:51 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:04:51 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:04:51 user nova-compute[74743]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)
Nov 18 17:04:51 user nova-compute[74743]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)
Nov 18 17:04:51 user nova-compute[74743]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)
Nov 18 17:04:51 user nova-compute[74743]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)
Nov 18 17:04:51 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:04:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:04:51 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:04:51 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:04:51 user nova-compute[74743]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)
Nov 18 17:04:51 user nova-compute[74743]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)
Nov 18 17:04:51 user nova-compute[74743]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)
Nov 18 17:04:51 user nova-compute[74743]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)
Nov 18 17:04:51 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:04:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:04:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Connected to 172.16.0.220:3260 {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 17:04:51 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=74743) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 17:04:51 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74743) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 17:04:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:51 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0f21d9-3093-42a2-84f2-a01d16234635]: (4, ('- - 0', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:04:51 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:04:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PSecUtMD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 17:04:51 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:51 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG nova.compute.manager [req-98079866-d0d6-45fc-8899-a164c576f2a2 req-2c466b8a-9254-4f68-91a3-a3dcca6d2265 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received event network-vif-plugged-34bfd284-1ef1-415a-9c96-f5ae24114a6a {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-98079866-d0d6-45fc-8899-a164c576f2a2 req-2c466b8a-9254-4f68-91a3-a3dcca6d2265 service nova] Acquiring lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-98079866-d0d6-45fc-8899-a164c576f2a2 req-2c466b8a-9254-4f68-91a3-a3dcca6d2265 service nova] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-98079866-d0d6-45fc-8899-a164c576f2a2 req-2c466b8a-9254-4f68-91a3-a3dcca6d2265 service nova] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG nova.compute.manager [req-98079866-d0d6-45fc-8899-a164c576f2a2 req-2c466b8a-9254-4f68-91a3-a3dcca6d2265 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] No waiting events found dispatching network-vif-plugged-34bfd284-1ef1-415a-9c96-f5ae24114a6a {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:04:52 user nova-compute[74743]: WARNING nova.compute.manager [req-98079866-d0d6-45fc-8899-a164c576f2a2 req-2c466b8a-9254-4f68-91a3-a3dcca6d2265 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received unexpected event network-vif-plugged-34bfd284-1ef1-415a-9c96-f5ae24114a6a for instance with vm_state building and task_state spawning.
Nov 18 17:04:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '23837383832636264', 'path': '/dev/sdh'} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23837383832636264', 'path': '/dev/sdh'} {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T17:04:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1943040326',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1943040326',id=11,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjnTCPkQxuEtLzy+XmBSDH56QrRsiiTpaDkmMTDnxMmMj6n9lDqW72cXc9PIo+K+Uncg1A8ETn0FYi2Bgr/OTSN79EbcvpXNaaew5fh55Enmun/lTqwO1/r1tUwCcUz8Q==',key_name='tempest-keypair-2114506226',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94a9888c9a4349e896e6bdf2af37ef98',ramdisk_id='',reservation_id='r-fa2gzleq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-951253911',owner_user_name='tempest-TaggedBootDevicesTest-951253911-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='480793b3fb7848a89ae4add6c6cf2d90',uuid=8ed74254-d845-4810-965f-300a97ce3817,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c646e401-7317-4e71-9ec5-5720fbc4b449", "address": "fa:16:3e:af:d8:d7", "network": {"id": "b0e24bcb-e9d6-4a04-bbb1-b3a0744f245a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1528865723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc646e401-73", "ovs_interfaceid": "c646e401-7317-4e71-9ec5-5720fbc4b449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Converting VIF {"id": "c646e401-7317-4e71-9ec5-5720fbc4b449", "address": "fa:16:3e:af:d8:d7", "network": {"id": "b0e24bcb-e9d6-4a04-bbb1-b3a0744f245a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1528865723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc646e401-73", "ovs_interfaceid": "c646e401-7317-4e71-9ec5-5720fbc4b449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:d8:d7,bridge_name='br-int',has_traffic_filtering=True,id=c646e401-7317-4e71-9ec5-5720fbc4b449,network=Network(b0e24bcb-e9d6-4a04-bbb1-b3a0744f245a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc646e401-73') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T17:04:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1943040326',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1943040326',id=11,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjnTCPkQxuEtLzy+XmBSDH56QrRsiiTpaDkmMTDnxMmMj6n9lDqW72cXc9PIo+K+Uncg1A8ETn0FYi2Bgr/OTSN79EbcvpXNaaew5fh55Enmun/lTqwO1/r1tUwCcUz8Q==',key_name='tempest-keypair-2114506226',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94a9888c9a4349e896e6bdf2af37ef98',ramdisk_id='',reservation_id='r-fa2gzleq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-951253911',owner_user_name='tempest-TaggedBootDevicesTest-951253911-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='480793b3fb7848a89ae4add6c6cf2d90',uuid=8ed74254-d845-4810-965f-300a97ce3817,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36ac949f-e4af-432f-b042-62e8614b5b84", "address": "fa:16:3e:d8:e1:eb", "network": {"id": "c4ed0e46-c74d-44bb-94ee-d1b2dc871d15", "bridge": "br-int", "label": "tempest-device-tagging-net1-2003876734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36ac949f-e4", "ovs_interfaceid": "36ac949f-e4af-432f-b042-62e8614b5b84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Converting VIF {"id": "36ac949f-e4af-432f-b042-62e8614b5b84", "address": "fa:16:3e:d8:e1:eb", "network": {"id": "c4ed0e46-c74d-44bb-94ee-d1b2dc871d15", "bridge": "br-int", "label": "tempest-device-tagging-net1-2003876734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36ac949f-e4", "ovs_interfaceid": "36ac949f-e4af-432f-b042-62e8614b5b84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:e1:eb,bridge_name='br-int',has_traffic_filtering=True,id=36ac949f-e4af-432f-b042-62e8614b5b84,network=Network(c4ed0e46-c74d-44bb-94ee-d1b2dc871d15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap36ac949f-e4') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T17:04:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1943040326',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1943040326',id=11,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjnTCPkQxuEtLzy+XmBSDH56QrRsiiTpaDkmMTDnxMmMj6n9lDqW72cXc9PIo+K+Uncg1A8ETn0FYi2Bgr/OTSN79EbcvpXNaaew5fh55Enmun/lTqwO1/r1tUwCcUz8Q==',key_name='tempest-keypair-2114506226',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94a9888c9a4349e896e6bdf2af37ef98',ramdisk_id='',reservation_id='r-fa2gzleq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-951253911',owner_user_name='tempest-TaggedBootDevicesTest-951253911-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='480793b3fb7848a89ae4add6c6cf2d90',uuid=8ed74254-d845-4810-965f-300a97ce3817,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2937523f-15c9-4fe4-9f7c-174b941035e8", "address": "fa:16:3e:3e:90:e2", "network": {"id": "c4ed0e46-c74d-44bb-94ee-d1b2dc871d15", "bridge": "br-int", "label": "tempest-device-tagging-net1-2003876734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2937523f-15", "ovs_interfaceid": "2937523f-15c9-4fe4-9f7c-174b941035e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Converting VIF {"id": "2937523f-15c9-4fe4-9f7c-174b941035e8", "address": "fa:16:3e:3e:90:e2", "network": {"id": "c4ed0e46-c74d-44bb-94ee-d1b2dc871d15", "bridge": "br-int", "label": "tempest-device-tagging-net1-2003876734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2937523f-15", "ovs_interfaceid": "2937523f-15c9-4fe4-9f7c-174b941035e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:90:e2,bridge_name='br-int',has_traffic_filtering=True,id=2937523f-15c9-4fe4-9f7c-174b941035e8,network=Network(c4ed0e46-c74d-44bb-94ee-d1b2dc871d15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2937523f-15') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T17:04:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1943040326',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1943040326',id=11,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjnTCPkQxuEtLzy+XmBSDH56QrRsiiTpaDkmMTDnxMmMj6n9lDqW72cXc9PIo+K+Uncg1A8ETn0FYi2Bgr/OTSN79EbcvpXNaaew5fh55Enmun/lTqwO1/r1tUwCcUz8Q==',key_name='tempest-keypair-2114506226',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94a9888c9a4349e896e6bdf2af37ef98',ramdisk_id='',reservation_id='r-fa2gzleq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-951253911',owner_user_name='tempest-TaggedBootDevicesTest-951253911-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='480793b3fb7848a89ae4add6c6cf2d90',uuid=8ed74254-d845-4810-965f-300a97ce3817,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ba0c408-cb71-4fe5-88de-5ec1c8a81704", "address": "fa:16:3e:aa:1e:86", "network": {"id": "c4ed0e46-c74d-44bb-94ee-d1b2dc871d15", "bridge": "br-int", "label": "tempest-device-tagging-net1-2003876734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba0c408-cb", "ovs_interfaceid": "8ba0c408-cb71-4fe5-88de-5ec1c8a81704", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Converting VIF {"id": "8ba0c408-cb71-4fe5-88de-5ec1c8a81704", "address": "fa:16:3e:aa:1e:86", "network": {"id": "c4ed0e46-c74d-44bb-94ee-d1b2dc871d15", "bridge": "br-int", "label": "tempest-device-tagging-net1-2003876734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba0c408-cb", "ovs_interfaceid": "8ba0c408-cb71-4fe5-88de-5ec1c8a81704", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:1e:86,bridge_name='br-int',has_traffic_filtering=True,id=8ba0c408-cb71-4fe5-88de-5ec1c8a81704,network=Network(c4ed0e46-c74d-44bb-94ee-d1b2dc871d15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ba0c408-cb') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T17:04:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1943040326',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1943040326',id=11,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjnTCPkQxuEtLzy+XmBSDH56QrRsiiTpaDkmMTDnxMmMj6n9lDqW72cXc9PIo+K+Uncg1A8ETn0FYi2Bgr/OTSN79EbcvpXNaaew5fh55Enmun/lTqwO1/r1tUwCcUz8Q==',key_name='tempest-keypair-2114506226',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94a9888c9a4349e896e6bdf2af37ef98',ramdisk_id='',reservation_id='r-fa2gzleq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-951253911',owner_user_name='tempest-TaggedBootDevicesTest-951253911-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='480793b3fb7848a89ae4add6c6cf2d90',uuid=8ed74254-d845-4810-965f-300a97ce3817,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "587569cd-f07c-4087-b7e7-66967dfcfcf7", "address": "fa:16:3e:c3:d6:8a", "network": {"id": "c4ed0e46-c74d-44bb-94ee-d1b2dc871d15", "bridge": "br-int", "label": "tempest-device-tagging-net1-2003876734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap587569cd-f0", "ovs_interfaceid": "587569cd-f07c-4087-b7e7-66967dfcfcf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Converting VIF {"id": "587569cd-f07c-4087-b7e7-66967dfcfcf7", "address": "fa:16:3e:c3:d6:8a", "network": {"id": "c4ed0e46-c74d-44bb-94ee-d1b2dc871d15", "bridge": "br-int", "label": "tempest-device-tagging-net1-2003876734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap587569cd-f0", "ovs_interfaceid": "587569cd-f07c-4087-b7e7-66967dfcfcf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:d6:8a,bridge_name='br-int',has_traffic_filtering=True,id=587569cd-f07c-4087-b7e7-66967dfcfcf7,network=Network(c4ed0e46-c74d-44bb-94ee-d1b2dc871d15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap587569cd-f0') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T17:04:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1943040326',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1943040326',id=11,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjnTCPkQxuEtLzy+XmBSDH56QrRsiiTpaDkmMTDnxMmMj6n9lDqW72cXc9PIo+K+Uncg1A8ETn0FYi2Bgr/OTSN79EbcvpXNaaew5fh55Enmun/lTqwO1/r1tUwCcUz8Q==',key_name='tempest-keypair-2114506226',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94a9888c9a4349e896e6bdf2af37ef98',ramdisk_id='',reservation_id='r-fa2gzleq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-951253911',owner_user_name='tempest-TaggedBootDevicesTest-951253911-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='480793b3fb7848a89ae4add6c6cf2d90',uuid=8ed74254-d845-4810-965f-300a97ce3817,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4532d74-be0a-451a-ad58-d7b0d3aeb757", "address": "fa:16:3e:51:3a:05", "network": {"id": "29131171-10e1-4628-9763-a74023087bca", "bridge": "br-int", "label": "tempest-device-tagging-net2-1600450954", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4532d74-be", "ovs_interfaceid": "f4532d74-be0a-451a-ad58-d7b0d3aeb757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Converting VIF {"id": "f4532d74-be0a-451a-ad58-d7b0d3aeb757", "address": "fa:16:3e:51:3a:05", "network": {"id": "29131171-10e1-4628-9763-a74023087bca", "bridge": "br-int", "label": "tempest-device-tagging-net2-1600450954", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4532d74-be", "ovs_interfaceid": "f4532d74-be0a-451a-ad58-d7b0d3aeb757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:3a:05,bridge_name='br-int',has_traffic_filtering=True,id=f4532d74-be0a-451a-ad58-d7b0d3aeb757,network=Network(29131171-10e1-4628-9763-a74023087bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4532d74-be') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T17:04:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1943040326',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1943040326',id=11,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjnTCPkQxuEtLzy+XmBSDH56QrRsiiTpaDkmMTDnxMmMj6n9lDqW72cXc9PIo+K+Uncg1A8ETn0FYi2Bgr/OTSN79EbcvpXNaaew5fh55Enmun/lTqwO1/r1tUwCcUz8Q==',key_name='tempest-keypair-2114506226',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94a9888c9a4349e896e6bdf2af37ef98',ramdisk_id='',reservation_id='r-fa2gzleq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-951253911',owner_user_name='tempest-TaggedBootDevicesTest-951253911-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='480793b3fb7848a89ae4add6c6cf2d90',uuid=8ed74254-d845-4810-965f-300a97ce3817,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a12256b-0d24-4ffa-aac0-451c27187fc7", "address": "fa:16:3e:d4:68:ae", "network": {"id": "29131171-10e1-4628-9763-a74023087bca", "bridge": "br-int", "label": "tempest-device-tagging-net2-1600450954", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a12256b-0d", "ovs_interfaceid": "2a12256b-0d24-4ffa-aac0-451c27187fc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Converting VIF {"id": "2a12256b-0d24-4ffa-aac0-451c27187fc7", "address": "fa:16:3e:d4:68:ae", "network": {"id": "29131171-10e1-4628-9763-a74023087bca", "bridge": "br-int", "label": "tempest-device-tagging-net2-1600450954", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a12256b-0d", "ovs_interfaceid": "2a12256b-0d24-4ffa-aac0-451c27187fc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:68:ae,bridge_name='br-int',has_traffic_filtering=True,id=2a12256b-0d24-4ffa-aac0-451c27187fc7,network=Network(29131171-10e1-4628-9763-a74023087bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a12256b-0d') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG nova.objects.instance [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ed74254-d845-4810-965f-300a97ce3817 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:04:52 user nova-compute[74743]:   <uuid>8ed74254-d845-4810-965f-300a97ce3817</uuid>
Nov 18 17:04:52 user nova-compute[74743]:   <name>instance-0000000b</name>
Nov 18 17:04:52 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:04:52 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:04:52 user nova-compute[74743]:   <metadata>
Nov 18 17:04:52 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:04:52 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:04:52 user nova-compute[74743]:       <nova:name>tempest-device-tagging-server-1943040326</nova:name>
Nov 18 17:04:52 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:04:45</nova:creationTime>
Nov 18 17:04:52 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:04:52 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:04:52 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:04:52 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:04:52 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:04:52 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:04:52 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:04:52 user nova-compute[74743]:       <nova:owner>
Nov 18 17:04:52 user nova-compute[74743]:         <nova:user uuid="480793b3fb7848a89ae4add6c6cf2d90">tempest-TaggedBootDevicesTest-951253911-project-member</nova:user>
Nov 18 17:04:52 user nova-compute[74743]:         <nova:project uuid="94a9888c9a4349e896e6bdf2af37ef98">tempest-TaggedBootDevicesTest-951253911</nova:project>
Nov 18 17:04:52 user nova-compute[74743]:       </nova:owner>
Nov 18 17:04:52 user nova-compute[74743]:       <nova:root type="image" uuid="9536f6cf-95c4-40e2-864a-09a91525678a"/>
Nov 18 17:04:52 user nova-compute[74743]:       <nova:ports>
Nov 18 17:04:52 user nova-compute[74743]:         <nova:port uuid="c646e401-7317-4e71-9ec5-5720fbc4b449">
Nov 18 17:04:52 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 18 17:04:52 user nova-compute[74743]:         </nova:port>
Nov 18 17:04:52 user nova-compute[74743]:         <nova:port uuid="36ac949f-e4af-432f-b042-62e8614b5b84">
Nov 18 17:04:52 user nova-compute[74743]:           <nova:ip type="fixed" address="10.1.1.67" ipVersion="4"/>
Nov 18 17:04:52 user nova-compute[74743]:         </nova:port>
Nov 18 17:04:52 user nova-compute[74743]:         <nova:port uuid="2937523f-15c9-4fe4-9f7c-174b941035e8">
Nov 18 17:04:52 user nova-compute[74743]:           <nova:ip type="fixed" address="10.1.1.109" ipVersion="4"/>
Nov 18 17:04:52 user nova-compute[74743]:         </nova:port>
Nov 18 17:04:52 user nova-compute[74743]:         <nova:port uuid="8ba0c408-cb71-4fe5-88de-5ec1c8a81704">
Nov 18 17:04:52 user nova-compute[74743]:           <nova:ip type="fixed" address="10.1.1.82" ipVersion="4"/>
Nov 18 17:04:52 user nova-compute[74743]:         </nova:port>
Nov 18 17:04:52 user nova-compute[74743]:         <nova:port uuid="587569cd-f07c-4087-b7e7-66967dfcfcf7">
Nov 18 17:04:52 user nova-compute[74743]:           <nova:ip type="fixed" address="10.1.1.88" ipVersion="4"/>
Nov 18 17:04:52 user nova-compute[74743]:         </nova:port>
Nov 18 17:04:52 user nova-compute[74743]:         <nova:port uuid="f4532d74-be0a-451a-ad58-d7b0d3aeb757">
Nov 18 17:04:52 user nova-compute[74743]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 18 17:04:52 user nova-compute[74743]:         </nova:port>
Nov 18 17:04:52 user nova-compute[74743]:         <nova:port uuid="2a12256b-0d24-4ffa-aac0-451c27187fc7">
Nov 18 17:04:52 user nova-compute[74743]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 18 17:04:52 user nova-compute[74743]:         </nova:port>
Nov 18 17:04:52 user nova-compute[74743]:       </nova:ports>
Nov 18 17:04:52 user nova-compute[74743]:     </nova:instance>
Nov 18 17:04:52 user nova-compute[74743]:   </metadata>
Nov 18 17:04:52 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:04:52 user nova-compute[74743]:     <system>
Nov 18 17:04:52 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:04:52 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:04:52 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:04:52 user nova-compute[74743]:       <entry name="serial">8ed74254-d845-4810-965f-300a97ce3817</entry>
Nov 18 17:04:52 user nova-compute[74743]:       <entry name="uuid">8ed74254-d845-4810-965f-300a97ce3817</entry>
Nov 18 17:04:52 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:04:52 user nova-compute[74743]:     </system>
Nov 18 17:04:52 user nova-compute[74743]:   </sysinfo>
Nov 18 17:04:52 user nova-compute[74743]:   <os>
Nov 18 17:04:52 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:04:52 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:04:52 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:04:52 user nova-compute[74743]:   </os>
Nov 18 17:04:52 user nova-compute[74743]:   <features>
Nov 18 17:04:52 user nova-compute[74743]:     <acpi/>
Nov 18 17:04:52 user nova-compute[74743]:     <apic/>
Nov 18 17:04:52 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:04:52 user nova-compute[74743]:   </features>
Nov 18 17:04:52 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:04:52 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:04:52 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:04:52 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:04:52 user nova-compute[74743]:   </clock>
Nov 18 17:04:52 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:04:52 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:04:52 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:04:52 user nova-compute[74743]:   </cpu>
Nov 18 17:04:52 user nova-compute[74743]:   <devices>
Nov 18 17:04:52 user nova-compute[74743]:     <disk type="file" device="cdrom">
Nov 18 17:04:52 user nova-compute[74743]:       <driver name="qemu" type="raw" cache="none"/>
Nov 18 17:04:52 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/8ed74254-d845-4810-965f-300a97ce3817/disk.config"/>
Nov 18 17:04:52 user nova-compute[74743]:       <target dev="hda" bus="ide"/>
Nov 18 17:04:52 user nova-compute[74743]:     </disk>
Nov 18 17:04:52 user nova-compute[74743]:     <disk type="block" device="disk">
Nov 18 17:04:52 user nova-compute[74743]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:04:52 user nova-compute[74743]:       <source dev="/dev/sde"/>
Nov 18 17:04:52 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:04:52 user nova-compute[74743]:       <serial>7b0fcb91-3634-461b-acd1-c69cb0d51abc</serial>
Nov 18 17:04:52 user nova-compute[74743]:     </disk>
Nov 18 17:04:52 user nova-compute[74743]:     <disk type="block" device="disk">
Nov 18 17:04:52 user nova-compute[74743]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:04:52 user nova-compute[74743]:       <source dev="/dev/sdg"/>
Nov 18 17:04:52 user nova-compute[74743]:       <target dev="vdb" bus="virtio"/>
Nov 18 17:04:52 user nova-compute[74743]:       <serial>8acd2ae2-7bae-49e7-99e2-e5dd725746fd</serial>
Nov 18 17:04:52 user nova-compute[74743]:     </disk>
Nov 18 17:04:52 user nova-compute[74743]:     <disk type="block" device="disk">
Nov 18 17:04:52 user nova-compute[74743]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:04:52 user nova-compute[74743]:       <source dev="/dev/sdh"/>
Nov 18 17:04:52 user nova-compute[74743]:       <target dev="vdc" bus="virtio"/>
Nov 18 17:04:52 user nova-compute[74743]:       <serial>c320c2fa-d0f0-461e-ac7a-2bec3693bbaa</serial>
Nov 18 17:04:52 user nova-compute[74743]:     </disk>
Nov 18 17:04:52 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:04:52 user nova-compute[74743]:       <mac address="fa:16:3e:af:d8:d7"/>
Nov 18 17:04:52 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:04:52 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:04:52 user nova-compute[74743]:       <target dev="tapc646e401-73"/>
Nov 18 17:04:52 user nova-compute[74743]:     </interface>
Nov 18 17:04:52 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:04:52 user nova-compute[74743]:       <mac address="fa:16:3e:d8:e1:eb"/>
Nov 18 17:04:52 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:04:52 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:04:52 user nova-compute[74743]:       <target dev="tap36ac949f-e4"/>
Nov 18 17:04:52 user nova-compute[74743]:     </interface>
Nov 18 17:04:52 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:04:52 user nova-compute[74743]:       <mac address="fa:16:3e:3e:90:e2"/>
Nov 18 17:04:52 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:04:52 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:04:52 user nova-compute[74743]:       <target dev="tap2937523f-15"/>
Nov 18 17:04:52 user nova-compute[74743]:     </interface>
Nov 18 17:04:52 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:04:52 user nova-compute[74743]:       <mac address="fa:16:3e:aa:1e:86"/>
Nov 18 17:04:52 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:04:52 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:04:52 user nova-compute[74743]:       <target dev="tap8ba0c408-cb"/>
Nov 18 17:04:52 user nova-compute[74743]:     </interface>
Nov 18 17:04:52 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:04:52 user nova-compute[74743]:       <mac address="fa:16:3e:c3:d6:8a"/>
Nov 18 17:04:52 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:04:52 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:04:52 user nova-compute[74743]:       <target dev="tap587569cd-f0"/>
Nov 18 17:04:52 user nova-compute[74743]:     </interface>
Nov 18 17:04:52 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:04:52 user nova-compute[74743]:       <mac address="fa:16:3e:51:3a:05"/>
Nov 18 17:04:52 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:04:52 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:04:52 user nova-compute[74743]:       <target dev="tapf4532d74-be"/>
Nov 18 17:04:52 user nova-compute[74743]:     </interface>
Nov 18 17:04:52 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:04:52 user nova-compute[74743]:       <mac address="fa:16:3e:d4:68:ae"/>
Nov 18 17:04:52 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:04:52 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:04:52 user nova-compute[74743]:       <target dev="tap2a12256b-0d"/>
Nov 18 17:04:52 user nova-compute[74743]:     </interface>
Nov 18 17:04:52 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:04:52 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/8ed74254-d845-4810-965f-300a97ce3817/console.log" append="off"/>
Nov 18 17:04:52 user nova-compute[74743]:     </serial>
Nov 18 17:04:52 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:04:52 user nova-compute[74743]:     <video>
Nov 18 17:04:52 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:04:52 user nova-compute[74743]:     </video>
Nov 18 17:04:52 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:04:52 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:04:52 user nova-compute[74743]:     </rng>
Nov 18 17:04:52 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:04:52 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:04:52 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:04:52 user nova-compute[74743]:     </memballoon>
Nov 18 17:04:52 user nova-compute[74743]:   </devices>
Nov 18 17:04:52 user nova-compute[74743]: </domain>
Nov 18 17:04:52 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T17:04:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1943040326',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1943040326',id=11,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjnTCPkQxuEtLzy+XmBSDH56QrRsiiTpaDkmMTDnxMmMj6n9lDqW72cXc9PIo+K+Uncg1A8ETn0FYi2Bgr/OTSN79EbcvpXNaaew5fh55Enmun/lTqwO1/r1tUwCcUz8Q==',key_name='tempest-keypair-2114506226',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94a9888c9a4349e896e6bdf2af37ef98',ramdisk_id='',reservation_id='r-fa2gzleq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-951253911',owner_user_name='tempest-TaggedBootDevicesTest-951253911-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='480793b3fb7848a89ae4add6c6cf2d90',uuid=8ed74254-d845-4810-965f-300a97ce3817,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c646e401-7317-4e71-9ec5-5720fbc4b449", "address": "fa:16:3e:af:d8:d7", "network": {"id": "b0e24bcb-e9d6-4a04-bbb1-b3a0744f245a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1528865723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc646e401-73", "ovs_interfaceid": "c646e401-7317-4e71-9ec5-5720fbc4b449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Converting VIF {"id": "c646e401-7317-4e71-9ec5-5720fbc4b449", "address": "fa:16:3e:af:d8:d7", "network": {"id": "b0e24bcb-e9d6-4a04-bbb1-b3a0744f245a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1528865723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc646e401-73", "ovs_interfaceid": "c646e401-7317-4e71-9ec5-5720fbc4b449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:d8:d7,bridge_name='br-int',has_traffic_filtering=True,id=c646e401-7317-4e71-9ec5-5720fbc4b449,network=Network(b0e24bcb-e9d6-4a04-bbb1-b3a0744f245a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc646e401-73') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG os_vif [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:d8:d7,bridge_name='br-int',has_traffic_filtering=True,id=c646e401-7317-4e71-9ec5-5720fbc4b449,network=Network(b0e24bcb-e9d6-4a04-bbb1-b3a0744f245a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc646e401-73') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cbaa8636-24f4-5a3e-9661-1675d172c2d9', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc646e401-73, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc646e401-73, col_values=(('qos', UUID('c7d96fbf-fbdf-427b-b962-2405a33b1461')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc646e401-73, col_values=(('external_ids', {'iface-id': 'c646e401-7317-4e71-9ec5-5720fbc4b449', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:d8:d7', 'vm-uuid': '8ed74254-d845-4810-965f-300a97ce3817'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:52 user nova-compute[74743]: INFO os_vif [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:d8:d7,bridge_name='br-int',has_traffic_filtering=True,id=c646e401-7317-4e71-9ec5-5720fbc4b449,network=Network(b0e24bcb-e9d6-4a04-bbb1-b3a0744f245a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc646e401-73')
Nov 18 17:04:52 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T17:04:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1943040326',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1943040326',id=11,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjnTCPkQxuEtLzy+XmBSDH56QrRsiiTpaDkmMTDnxMmMj6n9lDqW72cXc9PIo+K+Uncg1A8ETn0FYi2Bgr/OTSN79EbcvpXNaaew5fh55Enmun/lTqwO1/r1tUwCcUz8Q==',key_name='tempest-keypair-2114506226',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94a9888c9a4349e896e6bdf2af37ef98',ramdisk_id='',reservation_id='r-fa2gzleq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-951253911',owner_user_name='tempest-TaggedBootDevicesTest-951253911-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='480793b3fb7848a89ae4add6c6cf2d90',uuid=8ed74254-d845-4810-965f-300a97ce3817,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36ac949f-e4af-432f-b042-62e8614b5b84", "address": "fa:16:3e:d8:e1:eb", "network": {"id": "c4ed0e46-c74d-44bb-94ee-d1b2dc871d15", "bridge": "br-int", "label": "tempest-device-tagging-net1-2003876734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36ac949f-e4", "ovs_interfaceid": "36ac949f-e4af-432f-b042-62e8614b5b84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Converting VIF {"id": "36ac949f-e4af-432f-b042-62e8614b5b84", "address": "fa:16:3e:d8:e1:eb", "network": {"id": "c4ed0e46-c74d-44bb-94ee-d1b2dc871d15", "bridge": "br-int", "label": "tempest-device-tagging-net1-2003876734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36ac949f-e4", "ovs_interfaceid": "36ac949f-e4af-432f-b042-62e8614b5b84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:e1:eb,bridge_name='br-int',has_traffic_filtering=True,id=36ac949f-e4af-432f-b042-62e8614b5b84,network=Network(c4ed0e46-c74d-44bb-94ee-d1b2dc871d15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap36ac949f-e4') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG os_vif [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:e1:eb,bridge_name='br-int',has_traffic_filtering=True,id=36ac949f-e4af-432f-b042-62e8614b5b84,network=Network(c4ed0e46-c74d-44bb-94ee-d1b2dc871d15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap36ac949f-e4') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c9bb06fb-2149-53d6-bdce-3cd1e1b3135b', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap36ac949f-e4, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap36ac949f-e4, col_values=(('qos', UUID('659185d7-c10f-406d-aa7d-4b175807ec87')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap36ac949f-e4, col_values=(('external_ids', {'iface-id': '36ac949f-e4af-432f-b042-62e8614b5b84', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:e1:eb', 'vm-uuid': '8ed74254-d845-4810-965f-300a97ce3817'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG nova.compute.manager [req-c4e7db02-f01e-4313-924d-369cb5cdf762 req-e2e39658-b48d-4161-bc51-bfbdd5e4ec42 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received event network-vif-plugged-f7d1b2be-29b6-45a1-9917-d16b576a84b2 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-c4e7db02-f01e-4313-924d-369cb5cdf762 req-e2e39658-b48d-4161-bc51-bfbdd5e4ec42 service nova] Acquiring lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-c4e7db02-f01e-4313-924d-369cb5cdf762 req-e2e39658-b48d-4161-bc51-bfbdd5e4ec42 service nova] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-c4e7db02-f01e-4313-924d-369cb5cdf762 req-e2e39658-b48d-4161-bc51-bfbdd5e4ec42 service nova] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG nova.compute.manager [req-c4e7db02-f01e-4313-924d-369cb5cdf762 req-e2e39658-b48d-4161-bc51-bfbdd5e4ec42 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] No waiting events found dispatching network-vif-plugged-f7d1b2be-29b6-45a1-9917-d16b576a84b2 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:04:52 user nova-compute[74743]: WARNING nova.compute.manager [req-c4e7db02-f01e-4313-924d-369cb5cdf762 req-e2e39658-b48d-4161-bc51-bfbdd5e4ec42 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received unexpected event network-vif-plugged-f7d1b2be-29b6-45a1-9917-d16b576a84b2 for instance with vm_state building and task_state spawning.
Nov 18 17:04:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:52 user nova-compute[74743]: INFO os_vif [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:e1:eb,bridge_name='br-int',has_traffic_filtering=True,id=36ac949f-e4af-432f-b042-62e8614b5b84,network=Network(c4ed0e46-c74d-44bb-94ee-d1b2dc871d15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap36ac949f-e4')
Nov 18 17:04:52 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T17:04:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1943040326',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1943040326',id=11,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjnTCPkQxuEtLzy+XmBSDH56QrRsiiTpaDkmMTDnxMmMj6n9lDqW72cXc9PIo+K+Uncg1A8ETn0FYi2Bgr/OTSN79EbcvpXNaaew5fh55Enmun/lTqwO1/r1tUwCcUz8Q==',key_name='tempest-keypair-2114506226',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94a9888c9a4349e896e6bdf2af37ef98',ramdisk_id='',reservation_id='r-fa2gzleq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-951253911',owner_user_name='tempest-TaggedBootDevicesTest-951253911-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='480793b3fb7848a89ae4add6c6cf2d90',uuid=8ed74254-d845-4810-965f-300a97ce3817,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2937523f-15c9-4fe4-9f7c-174b941035e8", "address": "fa:16:3e:3e:90:e2", "network": {"id": "c4ed0e46-c74d-44bb-94ee-d1b2dc871d15", "bridge": "br-int", "label": "tempest-device-tagging-net1-2003876734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2937523f-15", "ovs_interfaceid": "2937523f-15c9-4fe4-9f7c-174b941035e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Converting VIF {"id": "2937523f-15c9-4fe4-9f7c-174b941035e8", "address": "fa:16:3e:3e:90:e2", "network": {"id": "c4ed0e46-c74d-44bb-94ee-d1b2dc871d15", "bridge": "br-int", "label": "tempest-device-tagging-net1-2003876734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2937523f-15", "ovs_interfaceid": "2937523f-15c9-4fe4-9f7c-174b941035e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:90:e2,bridge_name='br-int',has_traffic_filtering=True,id=2937523f-15c9-4fe4-9f7c-174b941035e8,network=Network(c4ed0e46-c74d-44bb-94ee-d1b2dc871d15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2937523f-15') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG os_vif [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:90:e2,bridge_name='br-int',has_traffic_filtering=True,id=2937523f-15c9-4fe4-9f7c-174b941035e8,network=Network(c4ed0e46-c74d-44bb-94ee-d1b2dc871d15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2937523f-15') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bbcea8de-08fc-5fc5-8597-c46dbeabb220', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:04:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2937523f-15, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2937523f-15, col_values=(('qos', UUID('030474ff-bdb4-4cbe-b492-33fdfc28a493')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2937523f-15, col_values=(('external_ids', {'iface-id': '2937523f-15c9-4fe4-9f7c-174b941035e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:90:e2', 'vm-uuid': '8ed74254-d845-4810-965f-300a97ce3817'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:53 user nova-compute[74743]: INFO os_vif [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:90:e2,bridge_name='br-int',has_traffic_filtering=True,id=2937523f-15c9-4fe4-9f7c-174b941035e8,network=Network(c4ed0e46-c74d-44bb-94ee-d1b2dc871d15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2937523f-15')
Nov 18 17:04:53 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T17:04:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1943040326',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1943040326',id=11,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjnTCPkQxuEtLzy+XmBSDH56QrRsiiTpaDkmMTDnxMmMj6n9lDqW72cXc9PIo+K+Uncg1A8ETn0FYi2Bgr/OTSN79EbcvpXNaaew5fh55Enmun/lTqwO1/r1tUwCcUz8Q==',key_name='tempest-keypair-2114506226',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94a9888c9a4349e896e6bdf2af37ef98',ramdisk_id='',reservation_id='r-fa2gzleq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-951253911',owner_user_name='tempest-TaggedBootDevicesTest-951253911-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='480793b3fb7848a89ae4add6c6cf2d90',uuid=8ed74254-d845-4810-965f-300a97ce3817,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ba0c408-cb71-4fe5-88de-5ec1c8a81704", "address": "fa:16:3e:aa:1e:86", "network": {"id": "c4ed0e46-c74d-44bb-94ee-d1b2dc871d15", "bridge": "br-int", "label": "tempest-device-tagging-net1-2003876734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba0c408-cb", "ovs_interfaceid": "8ba0c408-cb71-4fe5-88de-5ec1c8a81704", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Converting VIF {"id": "8ba0c408-cb71-4fe5-88de-5ec1c8a81704", "address": "fa:16:3e:aa:1e:86", "network": {"id": "c4ed0e46-c74d-44bb-94ee-d1b2dc871d15", "bridge": "br-int", "label": "tempest-device-tagging-net1-2003876734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba0c408-cb", "ovs_interfaceid": "8ba0c408-cb71-4fe5-88de-5ec1c8a81704", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:1e:86,bridge_name='br-int',has_traffic_filtering=True,id=8ba0c408-cb71-4fe5-88de-5ec1c8a81704,network=Network(c4ed0e46-c74d-44bb-94ee-d1b2dc871d15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ba0c408-cb') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG os_vif [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:1e:86,bridge_name='br-int',has_traffic_filtering=True,id=8ba0c408-cb71-4fe5-88de-5ec1c8a81704,network=Network(c4ed0e46-c74d-44bb-94ee-d1b2dc871d15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ba0c408-cb') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a0de73dc-1626-5c68-a538-20da7d7ee3be', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ba0c408-cb, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8ba0c408-cb, col_values=(('qos', UUID('1830832a-1c1b-43e5-995d-854e3d6bb57a')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8ba0c408-cb, col_values=(('external_ids', {'iface-id': '8ba0c408-cb71-4fe5-88de-5ec1c8a81704', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:1e:86', 'vm-uuid': '8ed74254-d845-4810-965f-300a97ce3817'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG nova.compute.manager [req-edfb5e5a-a12e-4329-a598-8af586272eed req-e73b2284-d81a-44f7-8171-a03ea609c7b3 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received event network-vif-plugged-64686449-f344-4a65-ac45-8e7ff3f8cd84 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-edfb5e5a-a12e-4329-a598-8af586272eed req-e73b2284-d81a-44f7-8171-a03ea609c7b3 service nova] Acquiring lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-edfb5e5a-a12e-4329-a598-8af586272eed req-e73b2284-d81a-44f7-8171-a03ea609c7b3 service nova] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-edfb5e5a-a12e-4329-a598-8af586272eed req-e73b2284-d81a-44f7-8171-a03ea609c7b3 service nova] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG nova.compute.manager [req-edfb5e5a-a12e-4329-a598-8af586272eed req-e73b2284-d81a-44f7-8171-a03ea609c7b3 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] No waiting events found dispatching network-vif-plugged-64686449-f344-4a65-ac45-8e7ff3f8cd84 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:04:53 user nova-compute[74743]: WARNING nova.compute.manager [req-edfb5e5a-a12e-4329-a598-8af586272eed req-e73b2284-d81a-44f7-8171-a03ea609c7b3 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received unexpected event network-vif-plugged-64686449-f344-4a65-ac45-8e7ff3f8cd84 for instance with vm_state building and task_state spawning.
Nov 18 17:04:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:53 user nova-compute[74743]: INFO os_vif [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:1e:86,bridge_name='br-int',has_traffic_filtering=True,id=8ba0c408-cb71-4fe5-88de-5ec1c8a81704,network=Network(c4ed0e46-c74d-44bb-94ee-d1b2dc871d15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ba0c408-cb')
Nov 18 17:04:53 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T17:04:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1943040326',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1943040326',id=11,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjnTCPkQxuEtLzy+XmBSDH56QrRsiiTpaDkmMTDnxMmMj6n9lDqW72cXc9PIo+K+Uncg1A8ETn0FYi2Bgr/OTSN79EbcvpXNaaew5fh55Enmun/lTqwO1/r1tUwCcUz8Q==',key_name='tempest-keypair-2114506226',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94a9888c9a4349e896e6bdf2af37ef98',ramdisk_id='',reservation_id='r-fa2gzleq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-951253911',owner_user_name='tempest-TaggedBootDevicesTest-951253911-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='480793b3fb7848a89ae4add6c6cf2d90',uuid=8ed74254-d845-4810-965f-300a97ce3817,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "587569cd-f07c-4087-b7e7-66967dfcfcf7", "address": "fa:16:3e:c3:d6:8a", "network": {"id": "c4ed0e46-c74d-44bb-94ee-d1b2dc871d15", "bridge": "br-int", "label": "tempest-device-tagging-net1-2003876734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap587569cd-f0", "ovs_interfaceid": "587569cd-f07c-4087-b7e7-66967dfcfcf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Converting VIF {"id": "587569cd-f07c-4087-b7e7-66967dfcfcf7", "address": "fa:16:3e:c3:d6:8a", "network": {"id": "c4ed0e46-c74d-44bb-94ee-d1b2dc871d15", "bridge": "br-int", "label": "tempest-device-tagging-net1-2003876734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap587569cd-f0", "ovs_interfaceid": "587569cd-f07c-4087-b7e7-66967dfcfcf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:d6:8a,bridge_name='br-int',has_traffic_filtering=True,id=587569cd-f07c-4087-b7e7-66967dfcfcf7,network=Network(c4ed0e46-c74d-44bb-94ee-d1b2dc871d15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap587569cd-f0') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG os_vif [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:d6:8a,bridge_name='br-int',has_traffic_filtering=True,id=587569cd-f07c-4087-b7e7-66967dfcfcf7,network=Network(c4ed0e46-c74d-44bb-94ee-d1b2dc871d15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap587569cd-f0') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ab35993c-77cf-5bc5-b9f9-7158eb4962de', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap587569cd-f0, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap587569cd-f0, col_values=(('qos', UUID('b0baabab-ae62-4506-9282-ea081b9e6151')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap587569cd-f0, col_values=(('external_ids', {'iface-id': '587569cd-f07c-4087-b7e7-66967dfcfcf7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:d6:8a', 'vm-uuid': '8ed74254-d845-4810-965f-300a97ce3817'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:53 user nova-compute[74743]: INFO os_vif [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:d6:8a,bridge_name='br-int',has_traffic_filtering=True,id=587569cd-f07c-4087-b7e7-66967dfcfcf7,network=Network(c4ed0e46-c74d-44bb-94ee-d1b2dc871d15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap587569cd-f0')
Nov 18 17:04:53 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T17:04:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1943040326',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1943040326',id=11,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjnTCPkQxuEtLzy+XmBSDH56QrRsiiTpaDkmMTDnxMmMj6n9lDqW72cXc9PIo+K+Uncg1A8ETn0FYi2Bgr/OTSN79EbcvpXNaaew5fh55Enmun/lTqwO1/r1tUwCcUz8Q==',key_name='tempest-keypair-2114506226',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94a9888c9a4349e896e6bdf2af37ef98',ramdisk_id='',reservation_id='r-fa2gzleq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-951253911',owner_user_name='tempest-TaggedBootDevicesTest-951253911-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='480793b3fb7848a89ae4add6c6cf2d90',uuid=8ed74254-d845-4810-965f-300a97ce3817,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4532d74-be0a-451a-ad58-d7b0d3aeb757", "address": "fa:16:3e:51:3a:05", "network": {"id": "29131171-10e1-4628-9763-a74023087bca", "bridge": "br-int", "label": "tempest-device-tagging-net2-1600450954", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4532d74-be", "ovs_interfaceid": "f4532d74-be0a-451a-ad58-d7b0d3aeb757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Converting VIF {"id": "f4532d74-be0a-451a-ad58-d7b0d3aeb757", "address": "fa:16:3e:51:3a:05", "network": {"id": "29131171-10e1-4628-9763-a74023087bca", "bridge": "br-int", "label": "tempest-device-tagging-net2-1600450954", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4532d74-be", "ovs_interfaceid": "f4532d74-be0a-451a-ad58-d7b0d3aeb757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:3a:05,bridge_name='br-int',has_traffic_filtering=True,id=f4532d74-be0a-451a-ad58-d7b0d3aeb757,network=Network(29131171-10e1-4628-9763-a74023087bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4532d74-be') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG os_vif [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:3a:05,bridge_name='br-int',has_traffic_filtering=True,id=f4532d74-be0a-451a-ad58-d7b0d3aeb757,network=Network(29131171-10e1-4628-9763-a74023087bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4532d74-be') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd3aa7160-7363-55a0-acf7-573c9034d7f7', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4532d74-be, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf4532d74-be, col_values=(('qos', UUID('7226981a-fad7-4822-9b2e-75b06e164919')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf4532d74-be, col_values=(('external_ids', {'iface-id': 'f4532d74-be0a-451a-ad58-d7b0d3aeb757', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:3a:05', 'vm-uuid': '8ed74254-d845-4810-965f-300a97ce3817'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:54 user nova-compute[74743]: INFO os_vif [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:3a:05,bridge_name='br-int',has_traffic_filtering=True,id=f4532d74-be0a-451a-ad58-d7b0d3aeb757,network=Network(29131171-10e1-4628-9763-a74023087bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4532d74-be')
Nov 18 17:04:54 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T17:04:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1943040326',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1943040326',id=11,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjnTCPkQxuEtLzy+XmBSDH56QrRsiiTpaDkmMTDnxMmMj6n9lDqW72cXc9PIo+K+Uncg1A8ETn0FYi2Bgr/OTSN79EbcvpXNaaew5fh55Enmun/lTqwO1/r1tUwCcUz8Q==',key_name='tempest-keypair-2114506226',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94a9888c9a4349e896e6bdf2af37ef98',ramdisk_id='',reservation_id='r-fa2gzleq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-951253911',owner_user_name='tempest-TaggedBootDevicesTest-951253911-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='480793b3fb7848a89ae4add6c6cf2d90',uuid=8ed74254-d845-4810-965f-300a97ce3817,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a12256b-0d24-4ffa-aac0-451c27187fc7", "address": "fa:16:3e:d4:68:ae", "network": {"id": "29131171-10e1-4628-9763-a74023087bca", "bridge": "br-int", "label": "tempest-device-tagging-net2-1600450954", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a12256b-0d", "ovs_interfaceid": "2a12256b-0d24-4ffa-aac0-451c27187fc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Converting VIF {"id": "2a12256b-0d24-4ffa-aac0-451c27187fc7", "address": "fa:16:3e:d4:68:ae", "network": {"id": "29131171-10e1-4628-9763-a74023087bca", "bridge": "br-int", "label": "tempest-device-tagging-net2-1600450954", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a12256b-0d", "ovs_interfaceid": "2a12256b-0d24-4ffa-aac0-451c27187fc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:68:ae,bridge_name='br-int',has_traffic_filtering=True,id=2a12256b-0d24-4ffa-aac0-451c27187fc7,network=Network(29131171-10e1-4628-9763-a74023087bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a12256b-0d') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG os_vif [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:68:ae,bridge_name='br-int',has_traffic_filtering=True,id=2a12256b-0d24-4ffa-aac0-451c27187fc7,network=Network(29131171-10e1-4628-9763-a74023087bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a12256b-0d') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e295647d-d28a-510a-9b0d-48ea5ac57646', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG nova.compute.manager [req-4b7a78c8-eaa5-454b-8cc1-0e450e07742f req-b5e8fc12-8937-4902-bfb0-9fe3e10f5d07 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received event network-vif-plugged-34bfd284-1ef1-415a-9c96-f5ae24114a6a {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4b7a78c8-eaa5-454b-8cc1-0e450e07742f req-b5e8fc12-8937-4902-bfb0-9fe3e10f5d07 service nova] Acquiring lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4b7a78c8-eaa5-454b-8cc1-0e450e07742f req-b5e8fc12-8937-4902-bfb0-9fe3e10f5d07 service nova] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4b7a78c8-eaa5-454b-8cc1-0e450e07742f req-b5e8fc12-8937-4902-bfb0-9fe3e10f5d07 service nova] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG nova.compute.manager [req-4b7a78c8-eaa5-454b-8cc1-0e450e07742f req-b5e8fc12-8937-4902-bfb0-9fe3e10f5d07 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] No waiting events found dispatching network-vif-plugged-34bfd284-1ef1-415a-9c96-f5ae24114a6a {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:04:54 user nova-compute[74743]: WARNING nova.compute.manager [req-4b7a78c8-eaa5-454b-8cc1-0e450e07742f req-b5e8fc12-8937-4902-bfb0-9fe3e10f5d07 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received unexpected event network-vif-plugged-34bfd284-1ef1-415a-9c96-f5ae24114a6a for instance with vm_state building and task_state spawning.
Nov 18 17:04:54 user nova-compute[74743]: DEBUG nova.compute.manager [req-4b7a78c8-eaa5-454b-8cc1-0e450e07742f req-b5e8fc12-8937-4902-bfb0-9fe3e10f5d07 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received event network-vif-plugged-2629b394-59bc-4ddd-9d05-3fa4fbb15b55 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4b7a78c8-eaa5-454b-8cc1-0e450e07742f req-b5e8fc12-8937-4902-bfb0-9fe3e10f5d07 service nova] Acquiring lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4b7a78c8-eaa5-454b-8cc1-0e450e07742f req-b5e8fc12-8937-4902-bfb0-9fe3e10f5d07 service nova] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4b7a78c8-eaa5-454b-8cc1-0e450e07742f req-b5e8fc12-8937-4902-bfb0-9fe3e10f5d07 service nova] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG nova.compute.manager [req-4b7a78c8-eaa5-454b-8cc1-0e450e07742f req-b5e8fc12-8937-4902-bfb0-9fe3e10f5d07 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] No waiting events found dispatching network-vif-plugged-2629b394-59bc-4ddd-9d05-3fa4fbb15b55 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:04:54 user nova-compute[74743]: WARNING nova.compute.manager [req-4b7a78c8-eaa5-454b-8cc1-0e450e07742f req-b5e8fc12-8937-4902-bfb0-9fe3e10f5d07 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received unexpected event network-vif-plugged-2629b394-59bc-4ddd-9d05-3fa4fbb15b55 for instance with vm_state building and task_state spawning.
Nov 18 17:04:54 user nova-compute[74743]: DEBUG nova.compute.manager [req-4b7a78c8-eaa5-454b-8cc1-0e450e07742f req-b5e8fc12-8937-4902-bfb0-9fe3e10f5d07 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received event network-vif-plugged-2629b394-59bc-4ddd-9d05-3fa4fbb15b55 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4b7a78c8-eaa5-454b-8cc1-0e450e07742f req-b5e8fc12-8937-4902-bfb0-9fe3e10f5d07 service nova] Acquiring lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4b7a78c8-eaa5-454b-8cc1-0e450e07742f req-b5e8fc12-8937-4902-bfb0-9fe3e10f5d07 service nova] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4b7a78c8-eaa5-454b-8cc1-0e450e07742f req-b5e8fc12-8937-4902-bfb0-9fe3e10f5d07 service nova] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG nova.compute.manager [req-4b7a78c8-eaa5-454b-8cc1-0e450e07742f req-b5e8fc12-8937-4902-bfb0-9fe3e10f5d07 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] No waiting events found dispatching network-vif-plugged-2629b394-59bc-4ddd-9d05-3fa4fbb15b55 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:04:54 user nova-compute[74743]: WARNING nova.compute.manager [req-4b7a78c8-eaa5-454b-8cc1-0e450e07742f req-b5e8fc12-8937-4902-bfb0-9fe3e10f5d07 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received unexpected event network-vif-plugged-2629b394-59bc-4ddd-9d05-3fa4fbb15b55 for instance with vm_state building and task_state spawning.
Nov 18 17:04:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a12256b-0d, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2a12256b-0d, col_values=(('qos', UUID('265776d9-4f9d-4e89-a891-cb0b38d9ca44')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2a12256b-0d, col_values=(('external_ids', {'iface-id': '2a12256b-0d24-4ffa-aac0-451c27187fc7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:68:ae', 'vm-uuid': '8ed74254-d845-4810-965f-300a97ce3817'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:54 user nova-compute[74743]: INFO os_vif [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:68:ae,bridge_name='br-int',has_traffic_filtering=True,id=2a12256b-0d24-4ffa-aac0-451c27187fc7,network=Network(29131171-10e1-4628-9763-a74023087bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a12256b-0d')
Nov 18 17:04:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] No BDM found with device name hda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] No VIF found with MAC fa:16:3e:af:d8:d7, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] No VIF found with MAC fa:16:3e:c3:d6:8a, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:04:54 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Using config drive
Nov 18 17:04:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:54 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Creating config drive at /opt/stack/data/nova/instances/8ed74254-d845-4810-965f-300a97ce3817/disk.config
Nov 18 17:04:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8ed74254-d845-4810-965f-300a97ce3817/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpe6de9mwy {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8ed74254-d845-4810-965f-300a97ce3817/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpe6de9mwy" returned: 0 in 0.058s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG nova.compute.manager [req-4b52cb4a-1f2d-4dfb-bd55-d4db3ac674a8 req-79264059-736a-47f6-a842-ec0ac602ef7b service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received event network-vif-plugged-f7d1b2be-29b6-45a1-9917-d16b576a84b2 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4b52cb4a-1f2d-4dfb-bd55-d4db3ac674a8 req-79264059-736a-47f6-a842-ec0ac602ef7b service nova] Acquiring lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4b52cb4a-1f2d-4dfb-bd55-d4db3ac674a8 req-79264059-736a-47f6-a842-ec0ac602ef7b service nova] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4b52cb4a-1f2d-4dfb-bd55-d4db3ac674a8 req-79264059-736a-47f6-a842-ec0ac602ef7b service nova] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG nova.compute.manager [req-4b52cb4a-1f2d-4dfb-bd55-d4db3ac674a8 req-79264059-736a-47f6-a842-ec0ac602ef7b service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] No waiting events found dispatching network-vif-plugged-f7d1b2be-29b6-45a1-9917-d16b576a84b2 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:04:54 user nova-compute[74743]: WARNING nova.compute.manager [req-4b52cb4a-1f2d-4dfb-bd55-d4db3ac674a8 req-79264059-736a-47f6-a842-ec0ac602ef7b service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received unexpected event network-vif-plugged-f7d1b2be-29b6-45a1-9917-d16b576a84b2 for instance with vm_state building and task_state spawning.
Nov 18 17:04:54 user nova-compute[74743]: DEBUG nova.compute.manager [req-4b52cb4a-1f2d-4dfb-bd55-d4db3ac674a8 req-79264059-736a-47f6-a842-ec0ac602ef7b service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received event network-vif-plugged-9dd57873-8274-4099-b5a7-cefeabbbc308 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4b52cb4a-1f2d-4dfb-bd55-d4db3ac674a8 req-79264059-736a-47f6-a842-ec0ac602ef7b service nova] Acquiring lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4b52cb4a-1f2d-4dfb-bd55-d4db3ac674a8 req-79264059-736a-47f6-a842-ec0ac602ef7b service nova] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4b52cb4a-1f2d-4dfb-bd55-d4db3ac674a8 req-79264059-736a-47f6-a842-ec0ac602ef7b service nova] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG nova.compute.manager [req-4b52cb4a-1f2d-4dfb-bd55-d4db3ac674a8 req-79264059-736a-47f6-a842-ec0ac602ef7b service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] No waiting events found dispatching network-vif-plugged-9dd57873-8274-4099-b5a7-cefeabbbc308 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:04:54 user nova-compute[74743]: WARNING nova.compute.manager [req-4b52cb4a-1f2d-4dfb-bd55-d4db3ac674a8 req-79264059-736a-47f6-a842-ec0ac602ef7b service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received unexpected event network-vif-plugged-9dd57873-8274-4099-b5a7-cefeabbbc308 for instance with vm_state building and task_state spawning.
Nov 18 17:04:54 user nova-compute[74743]: DEBUG nova.compute.manager [req-4b52cb4a-1f2d-4dfb-bd55-d4db3ac674a8 req-79264059-736a-47f6-a842-ec0ac602ef7b service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received event network-vif-plugged-9dd57873-8274-4099-b5a7-cefeabbbc308 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4b52cb4a-1f2d-4dfb-bd55-d4db3ac674a8 req-79264059-736a-47f6-a842-ec0ac602ef7b service nova] Acquiring lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4b52cb4a-1f2d-4dfb-bd55-d4db3ac674a8 req-79264059-736a-47f6-a842-ec0ac602ef7b service nova] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4b52cb4a-1f2d-4dfb-bd55-d4db3ac674a8 req-79264059-736a-47f6-a842-ec0ac602ef7b service nova] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG nova.compute.manager [req-4b52cb4a-1f2d-4dfb-bd55-d4db3ac674a8 req-79264059-736a-47f6-a842-ec0ac602ef7b service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] No waiting events found dispatching network-vif-plugged-9dd57873-8274-4099-b5a7-cefeabbbc308 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:04:54 user nova-compute[74743]: WARNING nova.compute.manager [req-4b52cb4a-1f2d-4dfb-bd55-d4db3ac674a8 req-79264059-736a-47f6-a842-ec0ac602ef7b service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received unexpected event network-vif-plugged-9dd57873-8274-4099-b5a7-cefeabbbc308 for instance with vm_state building and task_state spawning.
Nov 18 17:04:54 user nova-compute[74743]: DEBUG nova.compute.manager [req-4b52cb4a-1f2d-4dfb-bd55-d4db3ac674a8 req-79264059-736a-47f6-a842-ec0ac602ef7b service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received event network-vif-plugged-a44b1589-f08b-4d65-a6a0-bb0e95fcf2ab {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4b52cb4a-1f2d-4dfb-bd55-d4db3ac674a8 req-79264059-736a-47f6-a842-ec0ac602ef7b service nova] Acquiring lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4b52cb4a-1f2d-4dfb-bd55-d4db3ac674a8 req-79264059-736a-47f6-a842-ec0ac602ef7b service nova] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4b52cb4a-1f2d-4dfb-bd55-d4db3ac674a8 req-79264059-736a-47f6-a842-ec0ac602ef7b service nova] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG nova.compute.manager [req-4b52cb4a-1f2d-4dfb-bd55-d4db3ac674a8 req-79264059-736a-47f6-a842-ec0ac602ef7b service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] No waiting events found dispatching network-vif-plugged-a44b1589-f08b-4d65-a6a0-bb0e95fcf2ab {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:04:54 user nova-compute[74743]: WARNING nova.compute.manager [req-4b52cb4a-1f2d-4dfb-bd55-d4db3ac674a8 req-79264059-736a-47f6-a842-ec0ac602ef7b service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received unexpected event network-vif-plugged-a44b1589-f08b-4d65-a6a0-bb0e95fcf2ab for instance with vm_state building and task_state spawning.
Nov 18 17:04:54 user nova-compute[74743]: DEBUG nova.compute.manager [req-4b52cb4a-1f2d-4dfb-bd55-d4db3ac674a8 req-79264059-736a-47f6-a842-ec0ac602ef7b service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received event network-vif-plugged-a44b1589-f08b-4d65-a6a0-bb0e95fcf2ab {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4b52cb4a-1f2d-4dfb-bd55-d4db3ac674a8 req-79264059-736a-47f6-a842-ec0ac602ef7b service nova] Acquiring lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4b52cb4a-1f2d-4dfb-bd55-d4db3ac674a8 req-79264059-736a-47f6-a842-ec0ac602ef7b service nova] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4b52cb4a-1f2d-4dfb-bd55-d4db3ac674a8 req-79264059-736a-47f6-a842-ec0ac602ef7b service nova] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:04:54 user nova-compute[74743]: DEBUG nova.compute.manager [req-4b52cb4a-1f2d-4dfb-bd55-d4db3ac674a8 req-79264059-736a-47f6-a842-ec0ac602ef7b service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] No waiting events found dispatching network-vif-plugged-a44b1589-f08b-4d65-a6a0-bb0e95fcf2ab {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:04:54 user nova-compute[74743]: WARNING nova.compute.manager [req-4b52cb4a-1f2d-4dfb-bd55-d4db3ac674a8 req-79264059-736a-47f6-a842-ec0ac602ef7b service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received unexpected event network-vif-plugged-a44b1589-f08b-4d65-a6a0-bb0e95fcf2ab for instance with vm_state building and task_state spawning.
Nov 18 17:04:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:55 user nova-compute[74743]: DEBUG nova.compute.manager [req-b684a605-1558-482d-86be-ed678e7b40be req-5f91cb4e-c199-40c4-9a4a-f1e5960c1e10 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received event network-vif-plugged-64686449-f344-4a65-ac45-8e7ff3f8cd84 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:04:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b684a605-1558-482d-86be-ed678e7b40be req-5f91cb4e-c199-40c4-9a4a-f1e5960c1e10 service nova] Acquiring lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:04:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b684a605-1558-482d-86be-ed678e7b40be req-5f91cb4e-c199-40c4-9a4a-f1e5960c1e10 service nova] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:04:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b684a605-1558-482d-86be-ed678e7b40be req-5f91cb4e-c199-40c4-9a4a-f1e5960c1e10 service nova] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:04:55 user nova-compute[74743]: DEBUG nova.compute.manager [req-b684a605-1558-482d-86be-ed678e7b40be req-5f91cb4e-c199-40c4-9a4a-f1e5960c1e10 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] No waiting events found dispatching network-vif-plugged-64686449-f344-4a65-ac45-8e7ff3f8cd84 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:04:55 user nova-compute[74743]: WARNING nova.compute.manager [req-b684a605-1558-482d-86be-ed678e7b40be req-5f91cb4e-c199-40c4-9a4a-f1e5960c1e10 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received unexpected event network-vif-plugged-64686449-f344-4a65-ac45-8e7ff3f8cd84 for instance with vm_state building and task_state spawning.
Nov 18 17:04:55 user nova-compute[74743]: DEBUG nova.compute.manager [req-b684a605-1558-482d-86be-ed678e7b40be req-5f91cb4e-c199-40c4-9a4a-f1e5960c1e10 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received event network-vif-plugged-c658955e-999b-40cf-bed4-b59459a8953a {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:04:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b684a605-1558-482d-86be-ed678e7b40be req-5f91cb4e-c199-40c4-9a4a-f1e5960c1e10 service nova] Acquiring lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:04:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b684a605-1558-482d-86be-ed678e7b40be req-5f91cb4e-c199-40c4-9a4a-f1e5960c1e10 service nova] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:04:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b684a605-1558-482d-86be-ed678e7b40be req-5f91cb4e-c199-40c4-9a4a-f1e5960c1e10 service nova] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:04:55 user nova-compute[74743]: DEBUG nova.compute.manager [req-b684a605-1558-482d-86be-ed678e7b40be req-5f91cb4e-c199-40c4-9a4a-f1e5960c1e10 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] No waiting events found dispatching network-vif-plugged-c658955e-999b-40cf-bed4-b59459a8953a {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:04:55 user nova-compute[74743]: WARNING nova.compute.manager [req-b684a605-1558-482d-86be-ed678e7b40be req-5f91cb4e-c199-40c4-9a4a-f1e5960c1e10 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received unexpected event network-vif-plugged-c658955e-999b-40cf-bed4-b59459a8953a for instance with vm_state building and task_state spawning.
Nov 18 17:04:55 user nova-compute[74743]: DEBUG nova.compute.manager [req-b684a605-1558-482d-86be-ed678e7b40be req-5f91cb4e-c199-40c4-9a4a-f1e5960c1e10 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received event network-vif-plugged-c658955e-999b-40cf-bed4-b59459a8953a {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:04:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b684a605-1558-482d-86be-ed678e7b40be req-5f91cb4e-c199-40c4-9a4a-f1e5960c1e10 service nova] Acquiring lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:04:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b684a605-1558-482d-86be-ed678e7b40be req-5f91cb4e-c199-40c4-9a4a-f1e5960c1e10 service nova] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:04:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b684a605-1558-482d-86be-ed678e7b40be req-5f91cb4e-c199-40c4-9a4a-f1e5960c1e10 service nova] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:04:55 user nova-compute[74743]: DEBUG nova.compute.manager [req-b684a605-1558-482d-86be-ed678e7b40be req-5f91cb4e-c199-40c4-9a4a-f1e5960c1e10 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] No waiting events found dispatching network-vif-plugged-c658955e-999b-40cf-bed4-b59459a8953a {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:04:55 user nova-compute[74743]: WARNING nova.compute.manager [req-b684a605-1558-482d-86be-ed678e7b40be req-5f91cb4e-c199-40c4-9a4a-f1e5960c1e10 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received unexpected event network-vif-plugged-c658955e-999b-40cf-bed4-b59459a8953a for instance with vm_state building and task_state spawning.
Nov 18 17:04:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:56 user nova-compute[74743]: DEBUG nova.compute.manager [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:04:56 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Guest created on hypervisor {{(pid=74743) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 17:04:56 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Instance spawned successfully.
Nov 18 17:04:56 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 17:04:56 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Found default for hw_cdrom_bus of ide {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:04:56 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Found default for hw_disk_bus of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:04:56 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Found default for hw_input_bus of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:04:56 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Found default for hw_pointer_model of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:04:56 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Found default for hw_video_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:04:56 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Found default for hw_vif_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:04:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:56 user nova-compute[74743]: INFO nova.compute.manager [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Took 12.66 seconds to spawn the instance on the hypervisor.
Nov 18 17:04:56 user nova-compute[74743]: DEBUG nova.compute.manager [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:04:56 user nova-compute[74743]: INFO nova.compute.manager [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Took 34.92 seconds to build instance.
Nov 18 17:04:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ba939261-a676-4c9d-b06a-e7e836a01453 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 35.043s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:04:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:56 user nova-compute[74743]: DEBUG nova.compute.manager [req-0db54ea5-e2ef-484c-840a-2f450c0a8ae8 req-2e79009b-f95d-4a08-a2ca-38b84ccd3bf8 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received event network-vif-plugged-36ac949f-e4af-432f-b042-62e8614b5b84 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:04:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-0db54ea5-e2ef-484c-840a-2f450c0a8ae8 req-2e79009b-f95d-4a08-a2ca-38b84ccd3bf8 service nova] Acquiring lock "8ed74254-d845-4810-965f-300a97ce3817-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:04:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-0db54ea5-e2ef-484c-840a-2f450c0a8ae8 req-2e79009b-f95d-4a08-a2ca-38b84ccd3bf8 service nova] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:04:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-0db54ea5-e2ef-484c-840a-2f450c0a8ae8 req-2e79009b-f95d-4a08-a2ca-38b84ccd3bf8 service nova] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:04:56 user nova-compute[74743]: DEBUG nova.compute.manager [req-0db54ea5-e2ef-484c-840a-2f450c0a8ae8 req-2e79009b-f95d-4a08-a2ca-38b84ccd3bf8 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] No waiting events found dispatching network-vif-plugged-36ac949f-e4af-432f-b042-62e8614b5b84 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:04:56 user nova-compute[74743]: WARNING nova.compute.manager [req-0db54ea5-e2ef-484c-840a-2f450c0a8ae8 req-2e79009b-f95d-4a08-a2ca-38b84ccd3bf8 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received unexpected event network-vif-plugged-36ac949f-e4af-432f-b042-62e8614b5b84 for instance with vm_state building and task_state spawning.
Nov 18 17:04:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:57 user nova-compute[74743]: DEBUG nova.compute.manager [req-f81d6a88-b984-42c3-a0d1-49305e072b32 req-ba2b6a49-9ba2-4dc1-913b-bc681c5ab7ee service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received event network-vif-plugged-2937523f-15c9-4fe4-9f7c-174b941035e8 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:04:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f81d6a88-b984-42c3-a0d1-49305e072b32 req-ba2b6a49-9ba2-4dc1-913b-bc681c5ab7ee service nova] Acquiring lock "8ed74254-d845-4810-965f-300a97ce3817-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:04:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f81d6a88-b984-42c3-a0d1-49305e072b32 req-ba2b6a49-9ba2-4dc1-913b-bc681c5ab7ee service nova] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:04:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f81d6a88-b984-42c3-a0d1-49305e072b32 req-ba2b6a49-9ba2-4dc1-913b-bc681c5ab7ee service nova] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:04:57 user nova-compute[74743]: DEBUG nova.compute.manager [req-f81d6a88-b984-42c3-a0d1-49305e072b32 req-ba2b6a49-9ba2-4dc1-913b-bc681c5ab7ee service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] No waiting events found dispatching network-vif-plugged-2937523f-15c9-4fe4-9f7c-174b941035e8 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:04:57 user nova-compute[74743]: WARNING nova.compute.manager [req-f81d6a88-b984-42c3-a0d1-49305e072b32 req-ba2b6a49-9ba2-4dc1-913b-bc681c5ab7ee service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received unexpected event network-vif-plugged-2937523f-15c9-4fe4-9f7c-174b941035e8 for instance with vm_state building and task_state spawning.
Nov 18 17:04:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:57 user nova-compute[74743]: DEBUG nova.compute.manager [req-a1022e1a-bc6f-4d21-8381-ae0612fab6ae req-446cab17-5bad-4918-9823-f09ba2483459 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received event network-vif-plugged-c646e401-7317-4e71-9ec5-5720fbc4b449 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:04:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a1022e1a-bc6f-4d21-8381-ae0612fab6ae req-446cab17-5bad-4918-9823-f09ba2483459 service nova] Acquiring lock "8ed74254-d845-4810-965f-300a97ce3817-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:04:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a1022e1a-bc6f-4d21-8381-ae0612fab6ae req-446cab17-5bad-4918-9823-f09ba2483459 service nova] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:04:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a1022e1a-bc6f-4d21-8381-ae0612fab6ae req-446cab17-5bad-4918-9823-f09ba2483459 service nova] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:04:57 user nova-compute[74743]: DEBUG nova.compute.manager [req-a1022e1a-bc6f-4d21-8381-ae0612fab6ae req-446cab17-5bad-4918-9823-f09ba2483459 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] No waiting events found dispatching network-vif-plugged-c646e401-7317-4e71-9ec5-5720fbc4b449 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:04:57 user nova-compute[74743]: WARNING nova.compute.manager [req-a1022e1a-bc6f-4d21-8381-ae0612fab6ae req-446cab17-5bad-4918-9823-f09ba2483459 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received unexpected event network-vif-plugged-c646e401-7317-4e71-9ec5-5720fbc4b449 for instance with vm_state building and task_state spawning.
Nov 18 17:04:57 user nova-compute[74743]: DEBUG nova.compute.manager [req-a1022e1a-bc6f-4d21-8381-ae0612fab6ae req-446cab17-5bad-4918-9823-f09ba2483459 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received event network-vif-plugged-c646e401-7317-4e71-9ec5-5720fbc4b449 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:04:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a1022e1a-bc6f-4d21-8381-ae0612fab6ae req-446cab17-5bad-4918-9823-f09ba2483459 service nova] Acquiring lock "8ed74254-d845-4810-965f-300a97ce3817-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:04:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a1022e1a-bc6f-4d21-8381-ae0612fab6ae req-446cab17-5bad-4918-9823-f09ba2483459 service nova] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:04:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a1022e1a-bc6f-4d21-8381-ae0612fab6ae req-446cab17-5bad-4918-9823-f09ba2483459 service nova] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:04:57 user nova-compute[74743]: DEBUG nova.compute.manager [req-a1022e1a-bc6f-4d21-8381-ae0612fab6ae req-446cab17-5bad-4918-9823-f09ba2483459 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] No waiting events found dispatching network-vif-plugged-c646e401-7317-4e71-9ec5-5720fbc4b449 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:04:57 user nova-compute[74743]: WARNING nova.compute.manager [req-a1022e1a-bc6f-4d21-8381-ae0612fab6ae req-446cab17-5bad-4918-9823-f09ba2483459 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received unexpected event network-vif-plugged-c646e401-7317-4e71-9ec5-5720fbc4b449 for instance with vm_state building and task_state spawning.
Nov 18 17:04:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:59 user nova-compute[74743]: DEBUG nova.compute.manager [req-d42a5f94-f28b-4dd0-b22d-623b5942f08f req-6e7211a1-9b0e-4230-b525-36af5084939b service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received event network-vif-plugged-36ac949f-e4af-432f-b042-62e8614b5b84 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:04:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d42a5f94-f28b-4dd0-b22d-623b5942f08f req-6e7211a1-9b0e-4230-b525-36af5084939b service nova] Acquiring lock "8ed74254-d845-4810-965f-300a97ce3817-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:04:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d42a5f94-f28b-4dd0-b22d-623b5942f08f req-6e7211a1-9b0e-4230-b525-36af5084939b service nova] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:04:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d42a5f94-f28b-4dd0-b22d-623b5942f08f req-6e7211a1-9b0e-4230-b525-36af5084939b service nova] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:04:59 user nova-compute[74743]: DEBUG nova.compute.manager [req-d42a5f94-f28b-4dd0-b22d-623b5942f08f req-6e7211a1-9b0e-4230-b525-36af5084939b service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] No waiting events found dispatching network-vif-plugged-36ac949f-e4af-432f-b042-62e8614b5b84 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:04:59 user nova-compute[74743]: WARNING nova.compute.manager [req-d42a5f94-f28b-4dd0-b22d-623b5942f08f req-6e7211a1-9b0e-4230-b525-36af5084939b service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received unexpected event network-vif-plugged-36ac949f-e4af-432f-b042-62e8614b5b84 for instance with vm_state building and task_state spawning.
Nov 18 17:04:59 user nova-compute[74743]: DEBUG nova.compute.manager [req-d42a5f94-f28b-4dd0-b22d-623b5942f08f req-6e7211a1-9b0e-4230-b525-36af5084939b service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received event network-vif-plugged-587569cd-f07c-4087-b7e7-66967dfcfcf7 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:04:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d42a5f94-f28b-4dd0-b22d-623b5942f08f req-6e7211a1-9b0e-4230-b525-36af5084939b service nova] Acquiring lock "8ed74254-d845-4810-965f-300a97ce3817-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:04:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d42a5f94-f28b-4dd0-b22d-623b5942f08f req-6e7211a1-9b0e-4230-b525-36af5084939b service nova] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:04:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d42a5f94-f28b-4dd0-b22d-623b5942f08f req-6e7211a1-9b0e-4230-b525-36af5084939b service nova] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:04:59 user nova-compute[74743]: DEBUG nova.compute.manager [req-d42a5f94-f28b-4dd0-b22d-623b5942f08f req-6e7211a1-9b0e-4230-b525-36af5084939b service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] No waiting events found dispatching network-vif-plugged-587569cd-f07c-4087-b7e7-66967dfcfcf7 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:04:59 user nova-compute[74743]: WARNING nova.compute.manager [req-d42a5f94-f28b-4dd0-b22d-623b5942f08f req-6e7211a1-9b0e-4230-b525-36af5084939b service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received unexpected event network-vif-plugged-587569cd-f07c-4087-b7e7-66967dfcfcf7 for instance with vm_state building and task_state spawning.
Nov 18 17:04:59 user nova-compute[74743]: DEBUG nova.compute.manager [req-d42a5f94-f28b-4dd0-b22d-623b5942f08f req-6e7211a1-9b0e-4230-b525-36af5084939b service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received event network-vif-plugged-587569cd-f07c-4087-b7e7-66967dfcfcf7 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:04:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d42a5f94-f28b-4dd0-b22d-623b5942f08f req-6e7211a1-9b0e-4230-b525-36af5084939b service nova] Acquiring lock "8ed74254-d845-4810-965f-300a97ce3817-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:04:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d42a5f94-f28b-4dd0-b22d-623b5942f08f req-6e7211a1-9b0e-4230-b525-36af5084939b service nova] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:04:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d42a5f94-f28b-4dd0-b22d-623b5942f08f req-6e7211a1-9b0e-4230-b525-36af5084939b service nova] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:04:59 user nova-compute[74743]: DEBUG nova.compute.manager [req-d42a5f94-f28b-4dd0-b22d-623b5942f08f req-6e7211a1-9b0e-4230-b525-36af5084939b service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] No waiting events found dispatching network-vif-plugged-587569cd-f07c-4087-b7e7-66967dfcfcf7 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:04:59 user nova-compute[74743]: WARNING nova.compute.manager [req-d42a5f94-f28b-4dd0-b22d-623b5942f08f req-6e7211a1-9b0e-4230-b525-36af5084939b service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received unexpected event network-vif-plugged-587569cd-f07c-4087-b7e7-66967dfcfcf7 for instance with vm_state building and task_state spawning.
Nov 18 17:04:59 user nova-compute[74743]: DEBUG nova.compute.manager [req-d42a5f94-f28b-4dd0-b22d-623b5942f08f req-6e7211a1-9b0e-4230-b525-36af5084939b service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received event network-vif-plugged-2a12256b-0d24-4ffa-aac0-451c27187fc7 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:04:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d42a5f94-f28b-4dd0-b22d-623b5942f08f req-6e7211a1-9b0e-4230-b525-36af5084939b service nova] Acquiring lock "8ed74254-d845-4810-965f-300a97ce3817-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:04:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d42a5f94-f28b-4dd0-b22d-623b5942f08f req-6e7211a1-9b0e-4230-b525-36af5084939b service nova] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:04:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d42a5f94-f28b-4dd0-b22d-623b5942f08f req-6e7211a1-9b0e-4230-b525-36af5084939b service nova] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:04:59 user nova-compute[74743]: DEBUG nova.compute.manager [req-d42a5f94-f28b-4dd0-b22d-623b5942f08f req-6e7211a1-9b0e-4230-b525-36af5084939b service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] No waiting events found dispatching network-vif-plugged-2a12256b-0d24-4ffa-aac0-451c27187fc7 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:04:59 user nova-compute[74743]: WARNING nova.compute.manager [req-d42a5f94-f28b-4dd0-b22d-623b5942f08f req-6e7211a1-9b0e-4230-b525-36af5084939b service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received unexpected event network-vif-plugged-2a12256b-0d24-4ffa-aac0-451c27187fc7 for instance with vm_state building and task_state spawning.
Nov 18 17:04:59 user nova-compute[74743]: DEBUG nova.compute.manager [req-d42a5f94-f28b-4dd0-b22d-623b5942f08f req-6e7211a1-9b0e-4230-b525-36af5084939b service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received event network-vif-plugged-2a12256b-0d24-4ffa-aac0-451c27187fc7 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:04:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d42a5f94-f28b-4dd0-b22d-623b5942f08f req-6e7211a1-9b0e-4230-b525-36af5084939b service nova] Acquiring lock "8ed74254-d845-4810-965f-300a97ce3817-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:04:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d42a5f94-f28b-4dd0-b22d-623b5942f08f req-6e7211a1-9b0e-4230-b525-36af5084939b service nova] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:04:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d42a5f94-f28b-4dd0-b22d-623b5942f08f req-6e7211a1-9b0e-4230-b525-36af5084939b service nova] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:04:59 user nova-compute[74743]: DEBUG nova.compute.manager [req-d42a5f94-f28b-4dd0-b22d-623b5942f08f req-6e7211a1-9b0e-4230-b525-36af5084939b service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] No waiting events found dispatching network-vif-plugged-2a12256b-0d24-4ffa-aac0-451c27187fc7 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:04:59 user nova-compute[74743]: WARNING nova.compute.manager [req-d42a5f94-f28b-4dd0-b22d-623b5942f08f req-6e7211a1-9b0e-4230-b525-36af5084939b service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received unexpected event network-vif-plugged-2a12256b-0d24-4ffa-aac0-451c27187fc7 for instance with vm_state building and task_state spawning.
Nov 18 17:04:59 user nova-compute[74743]: DEBUG nova.compute.manager [req-ac0e0ff8-f0ec-4251-8dce-12f3040f0b68 req-2ae841ef-031e-4cea-b33a-f3ac7c52058b service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received event network-vif-plugged-2937523f-15c9-4fe4-9f7c-174b941035e8 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:04:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ac0e0ff8-f0ec-4251-8dce-12f3040f0b68 req-2ae841ef-031e-4cea-b33a-f3ac7c52058b service nova] Acquiring lock "8ed74254-d845-4810-965f-300a97ce3817-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:04:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ac0e0ff8-f0ec-4251-8dce-12f3040f0b68 req-2ae841ef-031e-4cea-b33a-f3ac7c52058b service nova] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:04:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ac0e0ff8-f0ec-4251-8dce-12f3040f0b68 req-2ae841ef-031e-4cea-b33a-f3ac7c52058b service nova] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:04:59 user nova-compute[74743]: DEBUG nova.compute.manager [req-ac0e0ff8-f0ec-4251-8dce-12f3040f0b68 req-2ae841ef-031e-4cea-b33a-f3ac7c52058b service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] No waiting events found dispatching network-vif-plugged-2937523f-15c9-4fe4-9f7c-174b941035e8 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:04:59 user nova-compute[74743]: WARNING nova.compute.manager [req-ac0e0ff8-f0ec-4251-8dce-12f3040f0b68 req-2ae841ef-031e-4cea-b33a-f3ac7c52058b service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received unexpected event network-vif-plugged-2937523f-15c9-4fe4-9f7c-174b941035e8 for instance with vm_state building and task_state spawning.
Nov 18 17:04:59 user nova-compute[74743]: DEBUG nova.compute.manager [req-ac0e0ff8-f0ec-4251-8dce-12f3040f0b68 req-2ae841ef-031e-4cea-b33a-f3ac7c52058b service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received event network-vif-plugged-8ba0c408-cb71-4fe5-88de-5ec1c8a81704 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:04:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ac0e0ff8-f0ec-4251-8dce-12f3040f0b68 req-2ae841ef-031e-4cea-b33a-f3ac7c52058b service nova] Acquiring lock "8ed74254-d845-4810-965f-300a97ce3817-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:04:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ac0e0ff8-f0ec-4251-8dce-12f3040f0b68 req-2ae841ef-031e-4cea-b33a-f3ac7c52058b service nova] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:04:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ac0e0ff8-f0ec-4251-8dce-12f3040f0b68 req-2ae841ef-031e-4cea-b33a-f3ac7c52058b service nova] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:04:59 user nova-compute[74743]: DEBUG nova.compute.manager [req-ac0e0ff8-f0ec-4251-8dce-12f3040f0b68 req-2ae841ef-031e-4cea-b33a-f3ac7c52058b service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] No waiting events found dispatching network-vif-plugged-8ba0c408-cb71-4fe5-88de-5ec1c8a81704 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:04:59 user nova-compute[74743]: WARNING nova.compute.manager [req-ac0e0ff8-f0ec-4251-8dce-12f3040f0b68 req-2ae841ef-031e-4cea-b33a-f3ac7c52058b service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received unexpected event network-vif-plugged-8ba0c408-cb71-4fe5-88de-5ec1c8a81704 for instance with vm_state building and task_state spawning.
Nov 18 17:04:59 user nova-compute[74743]: DEBUG nova.compute.manager [req-ac0e0ff8-f0ec-4251-8dce-12f3040f0b68 req-2ae841ef-031e-4cea-b33a-f3ac7c52058b service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received event network-vif-plugged-8ba0c408-cb71-4fe5-88de-5ec1c8a81704 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:04:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ac0e0ff8-f0ec-4251-8dce-12f3040f0b68 req-2ae841ef-031e-4cea-b33a-f3ac7c52058b service nova] Acquiring lock "8ed74254-d845-4810-965f-300a97ce3817-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:04:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ac0e0ff8-f0ec-4251-8dce-12f3040f0b68 req-2ae841ef-031e-4cea-b33a-f3ac7c52058b service nova] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:04:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ac0e0ff8-f0ec-4251-8dce-12f3040f0b68 req-2ae841ef-031e-4cea-b33a-f3ac7c52058b service nova] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:04:59 user nova-compute[74743]: DEBUG nova.compute.manager [req-ac0e0ff8-f0ec-4251-8dce-12f3040f0b68 req-2ae841ef-031e-4cea-b33a-f3ac7c52058b service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] No waiting events found dispatching network-vif-plugged-8ba0c408-cb71-4fe5-88de-5ec1c8a81704 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:04:59 user nova-compute[74743]: WARNING nova.compute.manager [req-ac0e0ff8-f0ec-4251-8dce-12f3040f0b68 req-2ae841ef-031e-4cea-b33a-f3ac7c52058b service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received unexpected event network-vif-plugged-8ba0c408-cb71-4fe5-88de-5ec1c8a81704 for instance with vm_state building and task_state spawning.
Nov 18 17:04:59 user nova-compute[74743]: DEBUG nova.compute.manager [req-ac0e0ff8-f0ec-4251-8dce-12f3040f0b68 req-2ae841ef-031e-4cea-b33a-f3ac7c52058b service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received event network-vif-plugged-f4532d74-be0a-451a-ad58-d7b0d3aeb757 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:04:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ac0e0ff8-f0ec-4251-8dce-12f3040f0b68 req-2ae841ef-031e-4cea-b33a-f3ac7c52058b service nova] Acquiring lock "8ed74254-d845-4810-965f-300a97ce3817-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:04:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ac0e0ff8-f0ec-4251-8dce-12f3040f0b68 req-2ae841ef-031e-4cea-b33a-f3ac7c52058b service nova] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:04:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ac0e0ff8-f0ec-4251-8dce-12f3040f0b68 req-2ae841ef-031e-4cea-b33a-f3ac7c52058b service nova] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:04:59 user nova-compute[74743]: DEBUG nova.compute.manager [req-ac0e0ff8-f0ec-4251-8dce-12f3040f0b68 req-2ae841ef-031e-4cea-b33a-f3ac7c52058b service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] No waiting events found dispatching network-vif-plugged-f4532d74-be0a-451a-ad58-d7b0d3aeb757 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:04:59 user nova-compute[74743]: WARNING nova.compute.manager [req-ac0e0ff8-f0ec-4251-8dce-12f3040f0b68 req-2ae841ef-031e-4cea-b33a-f3ac7c52058b service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received unexpected event network-vif-plugged-f4532d74-be0a-451a-ad58-d7b0d3aeb757 for instance with vm_state building and task_state spawning.
Nov 18 17:04:59 user nova-compute[74743]: DEBUG nova.compute.manager [req-ac0e0ff8-f0ec-4251-8dce-12f3040f0b68 req-2ae841ef-031e-4cea-b33a-f3ac7c52058b service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received event network-vif-plugged-f4532d74-be0a-451a-ad58-d7b0d3aeb757 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:04:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ac0e0ff8-f0ec-4251-8dce-12f3040f0b68 req-2ae841ef-031e-4cea-b33a-f3ac7c52058b service nova] Acquiring lock "8ed74254-d845-4810-965f-300a97ce3817-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:04:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ac0e0ff8-f0ec-4251-8dce-12f3040f0b68 req-2ae841ef-031e-4cea-b33a-f3ac7c52058b service nova] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:04:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ac0e0ff8-f0ec-4251-8dce-12f3040f0b68 req-2ae841ef-031e-4cea-b33a-f3ac7c52058b service nova] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:04:59 user nova-compute[74743]: DEBUG nova.compute.manager [req-ac0e0ff8-f0ec-4251-8dce-12f3040f0b68 req-2ae841ef-031e-4cea-b33a-f3ac7c52058b service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] No waiting events found dispatching network-vif-plugged-f4532d74-be0a-451a-ad58-d7b0d3aeb757 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:04:59 user nova-compute[74743]: WARNING nova.compute.manager [req-ac0e0ff8-f0ec-4251-8dce-12f3040f0b68 req-2ae841ef-031e-4cea-b33a-f3ac7c52058b service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received unexpected event network-vif-plugged-f4532d74-be0a-451a-ad58-d7b0d3aeb757 for instance with vm_state building and task_state spawning.
Nov 18 17:04:59 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:59 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:59 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:59 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:59 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:59 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:04:59 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:00 user nova-compute[74743]: DEBUG nova.compute.manager [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:05:00 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Guest created on hypervisor {{(pid=74743) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 17:05:00 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Instance spawned successfully.
Nov 18 17:05:00 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 17:05:00 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Found default for hw_cdrom_bus of ide {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:05:00 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Found default for hw_disk_bus of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:05:00 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Found default for hw_input_bus of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:05:00 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Found default for hw_pointer_model of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:05:00 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Found default for hw_video_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:05:00 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Found default for hw_vif_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:05:00 user nova-compute[74743]: INFO nova.compute.manager [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Took 15.13 seconds to spawn the instance on the hypervisor.
Nov 18 17:05:00 user nova-compute[74743]: DEBUG nova.compute.manager [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:05:00 user nova-compute[74743]: INFO nova.compute.manager [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Took 38.95 seconds to build instance.
Nov 18 17:05:01 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-36ee0971-9333-4d80-99f5-68272e00b105 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Lock "8ed74254-d845-4810-965f-300a97ce3817" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 39.065s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:05:01 user nova-compute[74743]: INFO nova.compute.manager [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Rescuing
Nov 18 17:05:01 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Acquiring lock "refresh_cache-e9668e1c-1e8d-4dd7-8f58-d453db294557" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:05:01 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Acquired lock "refresh_cache-e9668e1c-1e8d-4dd7-8f58-d453db294557" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:05:01 user nova-compute[74743]: DEBUG nova.network.neutron [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:05:01 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:02 user nova-compute[74743]: DEBUG nova.network.neutron [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Updating instance_info_cache with network_info: [{"id": "fcc120f5-04f4-4675-817c-5161cc09a972", "address": "fa:16:3e:12:4a:34", "network": {"id": "252343cc-f379-471d-a2c9-99b9a60ebcb4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25c06dc8e7be46229750b8e283622c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc120f5-04", "ovs_interfaceid": "fcc120f5-04f4-4675-817c-5161cc09a972", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:05:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Releasing lock "refresh_cache-e9668e1c-1e8d-4dd7-8f58-d453db294557" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:05:02 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:02 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:02 user nova-compute[74743]: DEBUG nova.compute.manager [req-960a6310-fdbd-4dad-9137-807da956dedb req-dcd3f354-c270-482e-8755-79f89e7dc68d service nova] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Received event network-vif-unplugged-fcc120f5-04f4-4675-817c-5161cc09a972 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:05:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-960a6310-fdbd-4dad-9137-807da956dedb req-dcd3f354-c270-482e-8755-79f89e7dc68d service nova] Acquiring lock "e9668e1c-1e8d-4dd7-8f58-d453db294557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:05:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-960a6310-fdbd-4dad-9137-807da956dedb req-dcd3f354-c270-482e-8755-79f89e7dc68d service nova] Lock "e9668e1c-1e8d-4dd7-8f58-d453db294557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:05:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-960a6310-fdbd-4dad-9137-807da956dedb req-dcd3f354-c270-482e-8755-79f89e7dc68d service nova] Lock "e9668e1c-1e8d-4dd7-8f58-d453db294557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:05:02 user nova-compute[74743]: DEBUG nova.compute.manager [req-960a6310-fdbd-4dad-9137-807da956dedb req-dcd3f354-c270-482e-8755-79f89e7dc68d service nova] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] No waiting events found dispatching network-vif-unplugged-fcc120f5-04f4-4675-817c-5161cc09a972 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:05:02 user nova-compute[74743]: WARNING nova.compute.manager [req-960a6310-fdbd-4dad-9137-807da956dedb req-dcd3f354-c270-482e-8755-79f89e7dc68d service nova] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Received unexpected event network-vif-unplugged-fcc120f5-04f4-4675-817c-5161cc09a972 for instance with vm_state active and task_state rescuing.
Nov 18 17:05:02 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:02 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:03 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Instance destroyed successfully.
Nov 18 17:05:03 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Attempting rescue
Nov 18 17:05:03 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74743) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 18 17:05:03 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Instance directory exists: not creating {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 18 17:05:03 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Creating image(s)
Nov 18 17:05:03 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Acquiring lock "/opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:05:03 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "/opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:05:03 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "/opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:05:03 user nova-compute[74743]: DEBUG nova.objects.instance [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lazy-loading 'trusted_certs' on Instance uuid e9668e1c-1e8d-4dd7-8f58-d453db294557 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:05:03 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Acquiring lock "c188b3a997bfafa42fa341f9dcc326545681eed9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:05:03 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:05:03 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:03 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.290s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:03 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:03 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue" returned: 0 in 0.062s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:03 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.361s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:05:03 user nova-compute[74743]: DEBUG nova.objects.instance [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lazy-loading 'migration_context' on Instance uuid e9668e1c-1e8d-4dd7-8f58-d453db294557 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:05:03 user nova-compute[74743]: DEBUG nova.objects.base [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Object Instance<e9668e1c-1e8d-4dd7-8f58-d453db294557> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:05:03 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Created local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 17:05:03 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Start _get_guest_xml network_info=[{"id": "fcc120f5-04f4-4675-817c-5161cc09a972", "address": "fa:16:3e:12:4a:34", "network": {"id": "252343cc-f379-471d-a2c9-99b9a60ebcb4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "vif_mac": "fa:16:3e:12:4a:34"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25c06dc8e7be46229750b8e283622c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc120f5-04", "ovs_interfaceid": "fcc120f5-04f4-4675-817c-5161cc09a972", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '9536f6cf-95c4-40e2-864a-09a91525678a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:05:03 user nova-compute[74743]: DEBUG nova.objects.instance [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lazy-loading 'resources' on Instance uuid e9668e1c-1e8d-4dd7-8f58-d453db294557 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:05:03 user nova-compute[74743]: DEBUG nova.objects.base [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Object Instance<e9668e1c-1e8d-4dd7-8f58-d453db294557> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:05:03 user nova-compute[74743]: DEBUG nova.objects.instance [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lazy-loading 'numa_topology' on Instance uuid e9668e1c-1e8d-4dd7-8f58-d453db294557 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:05:03 user nova-compute[74743]: DEBUG nova.objects.base [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Object Instance<e9668e1c-1e8d-4dd7-8f58-d453db294557> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:05:03 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:05:03 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:05:03 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:05:03 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:05:03 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:05:03 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:05:03 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:05:03 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:05:03 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:05:03 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:05:03 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:05:03 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:05:03 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:05:03 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:05:03 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:05:03 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:05:03 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:05:03 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:05:03 user nova-compute[74743]: DEBUG nova.objects.instance [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lazy-loading 'vcpu_model' on Instance uuid e9668e1c-1e8d-4dd7-8f58-d453db294557 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:05:03 user nova-compute[74743]: DEBUG nova.objects.base [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Object Instance<e9668e1c-1e8d-4dd7-8f58-d453db294557> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:05:03 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:03:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1341409759',display_name='tempest-ServerRescueNegativeTestJSON-server-1341409759',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1341409759',id=2,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:03:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='25c06dc8e7be46229750b8e283622c9b',ramdisk_id='',reservation_id='r-pxylybnj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-732707405',owner_user_name='tempest-ServerRescueNegativeTestJSON-732707405-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:03:25Z,user_data=None,user_id='1470478a455242f9ad92eaf95dc6a2f4',uuid=e9668e1c-1e8d-4dd7-8f58-d453db294557,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fcc120f5-04f4-4675-817c-5161cc09a972", "address": "fa:16:3e:12:4a:34", "network": {"id": "252343cc-f379-471d-a2c9-99b9a60ebcb4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "vif_mac": "fa:16:3e:12:4a:34"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25c06dc8e7be46229750b8e283622c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc120f5-04", "ovs_interfaceid": "fcc120f5-04f4-4675-817c-5161cc09a972", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:05:03 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Converting VIF {"id": "fcc120f5-04f4-4675-817c-5161cc09a972", "address": "fa:16:3e:12:4a:34", "network": {"id": "252343cc-f379-471d-a2c9-99b9a60ebcb4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "vif_mac": "fa:16:3e:12:4a:34"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25c06dc8e7be46229750b8e283622c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc120f5-04", "ovs_interfaceid": "fcc120f5-04f4-4675-817c-5161cc09a972", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:05:03 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:4a:34,bridge_name='br-int',has_traffic_filtering=True,id=fcc120f5-04f4-4675-817c-5161cc09a972,network=Network(252343cc-f379-471d-a2c9-99b9a60ebcb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcc120f5-04') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:05:03 user nova-compute[74743]: DEBUG nova.objects.instance [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lazy-loading 'pci_devices' on Instance uuid e9668e1c-1e8d-4dd7-8f58-d453db294557 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:05:03 user nova-compute[74743]: DEBUG nova.objects.base [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Object Instance<e9668e1c-1e8d-4dd7-8f58-d453db294557> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:05:03 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:05:03 user nova-compute[74743]:   <uuid>e9668e1c-1e8d-4dd7-8f58-d453db294557</uuid>
Nov 18 17:05:03 user nova-compute[74743]:   <name>instance-00000002</name>
Nov 18 17:05:03 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:05:03 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:05:03 user nova-compute[74743]:   <metadata>
Nov 18 17:05:03 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:05:03 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:05:03 user nova-compute[74743]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1341409759</nova:name>
Nov 18 17:05:03 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:05:03</nova:creationTime>
Nov 18 17:05:03 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:05:03 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:05:03 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:05:03 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:05:03 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:05:03 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:05:03 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:05:03 user nova-compute[74743]:       <nova:owner>
Nov 18 17:05:03 user nova-compute[74743]:         <nova:user uuid="1470478a455242f9ad92eaf95dc6a2f4">tempest-ServerRescueNegativeTestJSON-732707405-project-member</nova:user>
Nov 18 17:05:03 user nova-compute[74743]:         <nova:project uuid="25c06dc8e7be46229750b8e283622c9b">tempest-ServerRescueNegativeTestJSON-732707405</nova:project>
Nov 18 17:05:03 user nova-compute[74743]:       </nova:owner>
Nov 18 17:05:03 user nova-compute[74743]:       <nova:root type="image" uuid="9536f6cf-95c4-40e2-864a-09a91525678a"/>
Nov 18 17:05:03 user nova-compute[74743]:       <nova:ports>
Nov 18 17:05:03 user nova-compute[74743]:         <nova:port uuid="fcc120f5-04f4-4675-817c-5161cc09a972">
Nov 18 17:05:03 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 18 17:05:03 user nova-compute[74743]:         </nova:port>
Nov 18 17:05:03 user nova-compute[74743]:       </nova:ports>
Nov 18 17:05:03 user nova-compute[74743]:     </nova:instance>
Nov 18 17:05:03 user nova-compute[74743]:   </metadata>
Nov 18 17:05:03 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:05:03 user nova-compute[74743]:     <system>
Nov 18 17:05:03 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:05:03 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:05:03 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:05:03 user nova-compute[74743]:       <entry name="serial">e9668e1c-1e8d-4dd7-8f58-d453db294557</entry>
Nov 18 17:05:03 user nova-compute[74743]:       <entry name="uuid">e9668e1c-1e8d-4dd7-8f58-d453db294557</entry>
Nov 18 17:05:03 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:05:03 user nova-compute[74743]:     </system>
Nov 18 17:05:03 user nova-compute[74743]:   </sysinfo>
Nov 18 17:05:03 user nova-compute[74743]:   <os>
Nov 18 17:05:03 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:05:03 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:05:03 user nova-compute[74743]:   </os>
Nov 18 17:05:03 user nova-compute[74743]:   <features>
Nov 18 17:05:03 user nova-compute[74743]:     <acpi/>
Nov 18 17:05:03 user nova-compute[74743]:     <apic/>
Nov 18 17:05:03 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:05:03 user nova-compute[74743]:   </features>
Nov 18 17:05:03 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:05:03 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:05:03 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:05:03 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:05:03 user nova-compute[74743]:   </clock>
Nov 18 17:05:03 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:05:03 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:05:03 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:05:03 user nova-compute[74743]:   </cpu>
Nov 18 17:05:03 user nova-compute[74743]:   <devices>
Nov 18 17:05:03 user nova-compute[74743]:     <disk type="file" device="disk">
Nov 18 17:05:03 user nova-compute[74743]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 17:05:03 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue"/>
Nov 18 17:05:03 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:05:03 user nova-compute[74743]:     </disk>
Nov 18 17:05:03 user nova-compute[74743]:     <disk type="file" device="disk">
Nov 18 17:05:03 user nova-compute[74743]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 17:05:03 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk"/>
Nov 18 17:05:03 user nova-compute[74743]:       <target dev="vdb" bus="virtio"/>
Nov 18 17:05:03 user nova-compute[74743]:     </disk>
Nov 18 17:05:03 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:05:03 user nova-compute[74743]:       <mac address="fa:16:3e:12:4a:34"/>
Nov 18 17:05:03 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:05:03 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:05:03 user nova-compute[74743]:       <target dev="tapfcc120f5-04"/>
Nov 18 17:05:03 user nova-compute[74743]:     </interface>
Nov 18 17:05:03 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:05:03 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/console.log" append="off"/>
Nov 18 17:05:03 user nova-compute[74743]:     </serial>
Nov 18 17:05:03 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:05:03 user nova-compute[74743]:     <video>
Nov 18 17:05:03 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:05:03 user nova-compute[74743]:     </video>
Nov 18 17:05:03 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:05:03 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:05:03 user nova-compute[74743]:     </rng>
Nov 18 17:05:03 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:05:03 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:05:03 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:05:03 user nova-compute[74743]:     </memballoon>
Nov 18 17:05:03 user nova-compute[74743]:   </devices>
Nov 18 17:05:03 user nova-compute[74743]: </domain>
Nov 18 17:05:03 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:05:03 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Instance destroyed successfully.
Nov 18 17:05:03 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:05:03 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:05:03 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] No VIF found with MAC fa:16:3e:12:4a:34, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:05:04 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:04 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:04 user nova-compute[74743]: DEBUG nova.compute.manager [req-29ac1c9f-5738-49d2-a626-353c0095ca46 req-a877a1ed-a564-4285-a60c-40a3061958b1 service nova] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Received event network-vif-plugged-fcc120f5-04f4-4675-817c-5161cc09a972 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:05:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-29ac1c9f-5738-49d2-a626-353c0095ca46 req-a877a1ed-a564-4285-a60c-40a3061958b1 service nova] Acquiring lock "e9668e1c-1e8d-4dd7-8f58-d453db294557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:05:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-29ac1c9f-5738-49d2-a626-353c0095ca46 req-a877a1ed-a564-4285-a60c-40a3061958b1 service nova] Lock "e9668e1c-1e8d-4dd7-8f58-d453db294557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:05:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-29ac1c9f-5738-49d2-a626-353c0095ca46 req-a877a1ed-a564-4285-a60c-40a3061958b1 service nova] Lock "e9668e1c-1e8d-4dd7-8f58-d453db294557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:05:04 user nova-compute[74743]: DEBUG nova.compute.manager [req-29ac1c9f-5738-49d2-a626-353c0095ca46 req-a877a1ed-a564-4285-a60c-40a3061958b1 service nova] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] No waiting events found dispatching network-vif-plugged-fcc120f5-04f4-4675-817c-5161cc09a972 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:05:04 user nova-compute[74743]: WARNING nova.compute.manager [req-29ac1c9f-5738-49d2-a626-353c0095ca46 req-a877a1ed-a564-4285-a60c-40a3061958b1 service nova] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Received unexpected event network-vif-plugged-fcc120f5-04f4-4675-817c-5161cc09a972 for instance with vm_state active and task_state rescuing.
Nov 18 17:05:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:06 user nova-compute[74743]: DEBUG nova.compute.manager [req-1971b5d1-e837-45e8-b89a-c6fb61d9f140 req-9195b2e6-fa27-46a5-9856-30b639af2add service nova] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Received event network-vif-plugged-fcc120f5-04f4-4675-817c-5161cc09a972 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:05:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-1971b5d1-e837-45e8-b89a-c6fb61d9f140 req-9195b2e6-fa27-46a5-9856-30b639af2add service nova] Acquiring lock "e9668e1c-1e8d-4dd7-8f58-d453db294557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:05:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-1971b5d1-e837-45e8-b89a-c6fb61d9f140 req-9195b2e6-fa27-46a5-9856-30b639af2add service nova] Lock "e9668e1c-1e8d-4dd7-8f58-d453db294557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:05:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-1971b5d1-e837-45e8-b89a-c6fb61d9f140 req-9195b2e6-fa27-46a5-9856-30b639af2add service nova] Lock "e9668e1c-1e8d-4dd7-8f58-d453db294557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:05:06 user nova-compute[74743]: DEBUG nova.compute.manager [req-1971b5d1-e837-45e8-b89a-c6fb61d9f140 req-9195b2e6-fa27-46a5-9856-30b639af2add service nova] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] No waiting events found dispatching network-vif-plugged-fcc120f5-04f4-4675-817c-5161cc09a972 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:05:06 user nova-compute[74743]: WARNING nova.compute.manager [req-1971b5d1-e837-45e8-b89a-c6fb61d9f140 req-9195b2e6-fa27-46a5-9856-30b639af2add service nova] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Received unexpected event network-vif-plugged-fcc120f5-04f4-4675-817c-5161cc09a972 for instance with vm_state active and task_state rescuing.
Nov 18 17:05:06 user nova-compute[74743]: DEBUG nova.compute.manager [req-1971b5d1-e837-45e8-b89a-c6fb61d9f140 req-9195b2e6-fa27-46a5-9856-30b639af2add service nova] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Received event network-vif-plugged-fcc120f5-04f4-4675-817c-5161cc09a972 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:05:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-1971b5d1-e837-45e8-b89a-c6fb61d9f140 req-9195b2e6-fa27-46a5-9856-30b639af2add service nova] Acquiring lock "e9668e1c-1e8d-4dd7-8f58-d453db294557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:05:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-1971b5d1-e837-45e8-b89a-c6fb61d9f140 req-9195b2e6-fa27-46a5-9856-30b639af2add service nova] Lock "e9668e1c-1e8d-4dd7-8f58-d453db294557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:05:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-1971b5d1-e837-45e8-b89a-c6fb61d9f140 req-9195b2e6-fa27-46a5-9856-30b639af2add service nova] Lock "e9668e1c-1e8d-4dd7-8f58-d453db294557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:05:06 user nova-compute[74743]: DEBUG nova.compute.manager [req-1971b5d1-e837-45e8-b89a-c6fb61d9f140 req-9195b2e6-fa27-46a5-9856-30b639af2add service nova] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] No waiting events found dispatching network-vif-plugged-fcc120f5-04f4-4675-817c-5161cc09a972 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:05:06 user nova-compute[74743]: WARNING nova.compute.manager [req-1971b5d1-e837-45e8-b89a-c6fb61d9f140 req-9195b2e6-fa27-46a5-9856-30b639af2add service nova] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Received unexpected event network-vif-plugged-fcc120f5-04f4-4675-817c-5161cc09a972 for instance with vm_state active and task_state rescuing.
Nov 18 17:05:07 user nova-compute[74743]: DEBUG nova.compute.manager [None req-e33a62b0-1559-4e2d-9f50-db85b7316497 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:05:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:09 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:09 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:09 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-dd663679-1e52-48e8-b331-fa1c19226f62 tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Acquiring lock "d30a49de-abf1-4985-8dc5-6f7f24d51d2f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:05:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-dd663679-1e52-48e8-b331-fa1c19226f62 tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Lock "d30a49de-abf1-4985-8dc5-6f7f24d51d2f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:05:15 user nova-compute[74743]: DEBUG nova.objects.instance [None req-dd663679-1e52-48e8-b331-fa1c19226f62 tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Lazy-loading 'flavor' on Instance uuid d30a49de-abf1-4985-8dc5-6f7f24d51d2f {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:05:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-dd663679-1e52-48e8-b331-fa1c19226f62 tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Lock "d30a49de-abf1-4985-8dc5-6f7f24d51d2f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:05:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-dd663679-1e52-48e8-b331-fa1c19226f62 tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Acquiring lock "d30a49de-abf1-4985-8dc5-6f7f24d51d2f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:05:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-dd663679-1e52-48e8-b331-fa1c19226f62 tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Lock "d30a49de-abf1-4985-8dc5-6f7f24d51d2f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:05:15 user nova-compute[74743]: INFO nova.compute.manager [None req-dd663679-1e52-48e8-b331-fa1c19226f62 tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Attaching volume ad14a9dc-3caf-47ea-8ef6-ef0c490d35be to /dev/vdb
Nov 18 17:05:15 user nova-compute[74743]: DEBUG os_brick.utils [None req-dd663679-1e52-48e8-b331-fa1c19226f62 tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:05:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:15 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6cf9e8e-ee0e-4509-9b71-9e7dcb0f0139]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1116acd8874d\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:15 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd545c7d-0d5f-4093-b8dd-656c084210bf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:15 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd11af90-5b43-4600-9183-25b61eeffd34]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:15 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[be539256-d723-4db1-9ca4-5a3ec72dec8c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-dd663679-1e52-48e8-b331-fa1c19226f62 tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Running cmd (subprocess): nvme version {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-dd663679-1e52-48e8-b331-fa1c19226f62 tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] 'nvme version' failed. Not Retrying. {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:05:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dd663679-1e52-48e8-b331-fa1c19226f62 tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] nvme not present on system {{(pid=74743) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 17:05:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:05:15 user nova-compute[74743]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 17:05:15 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ca4934-ca8d-4306-a87c-9f37b60c715e]: (4, '') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-dd663679-1e52-48e8-b331-fa1c19226f62 tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74743) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 17:05:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-dd663679-1e52-48e8-b331-fa1c19226f62 tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 17:05:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-dd663679-1e52-48e8-b331-fa1c19226f62 tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] LIGHTOS: no hostnqn found. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 17:05:15 user nova-compute[74743]: DEBUG os_brick.utils [None req-dd663679-1e52-48e8-b331-fa1c19226f62 tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] <== get_connector_properties: return (169ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1116acd8874d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:05:15 user nova-compute[74743]: DEBUG nova.virt.block_device [None req-dd663679-1e52-48e8-b331-fa1c19226f62 tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Updating existing volume attachment record: 2c4d4f16-7ee2-4fbb-8a90-7e970fd852b5 {{(pid=74743) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 17:05:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Acquiring lock "39e15045-0a84-4b48-a962-c006b6c747b3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:05:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Lock "39e15045-0a84-4b48-a962-c006b6c747b3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:05:19 user nova-compute[74743]: DEBUG nova.compute.manager [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Starting instance... {{(pid=74743) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 17:05:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:05:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:05:19 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74743) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 17:05:19 user nova-compute[74743]: INFO nova.compute.claims [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Claim successful on node user
Nov 18 17:05:19 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:05:19 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:05:19 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:05:19 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Starting heal instance info cache {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 17:05:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "refresh_cache-e9668e1c-1e8d-4dd7-8f58-d453db294557" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:05:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquired lock "refresh_cache-e9668e1c-1e8d-4dd7-8f58-d453db294557" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:05:19 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Forcefully refreshing network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 17:05:20 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:05:20 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:05:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.605s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:05:20 user nova-compute[74743]: DEBUG nova.compute.manager [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Start building networks asynchronously for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 17:05:20 user nova-compute[74743]: DEBUG nova.compute.manager [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Allocating IP information in the background. {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 17:05:20 user nova-compute[74743]: DEBUG nova.network.neutron [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] allocate_for_instance() {{(pid=74743) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 17:05:20 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 17:05:20 user nova-compute[74743]: DEBUG nova.compute.manager [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Start building block device mappings for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 17:05:20 user nova-compute[74743]: DEBUG nova.policy [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c20e517153644747a9284535f032c3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b814ffb2501544a6a5c669df102db2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74743) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 17:05:20 user nova-compute[74743]: DEBUG nova.compute.manager [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Start spawning the instance on the hypervisor. {{(pid=74743) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 17:05:20 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Creating instance directory {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 17:05:20 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Creating image(s)
Nov 18 17:05:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Acquiring lock "/opt/stack/data/nova/instances/39e15045-0a84-4b48-a962-c006b6c747b3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:05:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Lock "/opt/stack/data/nova/instances/39e15045-0a84-4b48-a962-c006b6c747b3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:05:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Lock "/opt/stack/data/nova/instances/39e15045-0a84-4b48-a962-c006b6c747b3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:05:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.181s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Acquiring lock "c188b3a997bfafa42fa341f9dcc326545681eed9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:05:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:05:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:20 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Updating instance_info_cache with network_info: [{"id": "fcc120f5-04f4-4675-817c-5161cc09a972", "address": "fa:16:3e:12:4a:34", "network": {"id": "252343cc-f379-471d-a2c9-99b9a60ebcb4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25c06dc8e7be46229750b8e283622c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc120f5-04", "ovs_interfaceid": "fcc120f5-04f4-4675-817c-5161cc09a972", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:05:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Releasing lock "refresh_cache-e9668e1c-1e8d-4dd7-8f58-d453db294557" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:05:20 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Updated the network info_cache for instance {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 17:05:20 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:05:20 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:05:20 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:05:20 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:05:20 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:05:20 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:05:20 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74743) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 17:05:20 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:05:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:05:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:05:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:05:20 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Auditing locally available compute resources for user (node: user) {{(pid=74743) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 17:05:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.188s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/39e15045-0a84-4b48-a962-c006b6c747b3/disk 1073741824 {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/39e15045-0a84-4b48-a962-c006b6c747b3/disk 1073741824" returned: 0 in 0.050s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:05:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.253s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:21 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Checking if we can resize image /opt/stack/data/nova/instances/39e15045-0a84-4b48-a962-c006b6c747b3/disk. size=1073741824 {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 17:05:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39e15045-0a84-4b48-a962-c006b6c747b3/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:21 user nova-compute[74743]: DEBUG nova.network.neutron [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Successfully created port: eec59f5d-4379-4f07-b4cb-f56b388fca0a {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:05:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39e15045-0a84-4b48-a962-c006b6c747b3/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:21 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Cannot resize image /opt/stack/data/nova/instances/39e15045-0a84-4b48-a962-c006b6c747b3/disk to a smaller size. {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 17:05:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Created local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 17:05:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Ensure instance console log exists: /opt/stack/data/nova/instances/39e15045-0a84-4b48-a962-c006b6c747b3/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:05:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:05:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:05:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:05:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:21 user nova-compute[74743]: DEBUG nova.network.neutron [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Successfully updated port: eec59f5d-4379-4f07-b4cb-f56b388fca0a {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:05:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Acquiring lock "refresh_cache-39e15045-0a84-4b48-a962-c006b6c747b3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:05:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Acquired lock "refresh_cache-39e15045-0a84-4b48-a962-c006b6c747b3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:05:21 user nova-compute[74743]: DEBUG nova.network.neutron [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG nova.compute.manager [req-0cfd78c9-3f2a-4af4-9f00-754adc51e948 req-5070c662-0afc-43f9-b8af-9c4774d9c9a4 service nova] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Received event network-changed-eec59f5d-4379-4f07-b4cb-f56b388fca0a {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG nova.compute.manager [req-0cfd78c9-3f2a-4af4-9f00-754adc51e948 req-5070c662-0afc-43f9-b8af-9c4774d9c9a4 service nova] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Refreshing instance network info cache due to event network-changed-eec59f5d-4379-4f07-b4cb-f56b388fca0a. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-0cfd78c9-3f2a-4af4-9f00-754adc51e948 req-5070c662-0afc-43f9-b8af-9c4774d9c9a4 service nova] Acquiring lock "refresh_cache-39e15045-0a84-4b48-a962-c006b6c747b3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/567feb03-a356-4347-b146-d8930ad60c11/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG nova.network.neutron [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/567feb03-a356-4347-b146-d8930ad60c11/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/567feb03-a356-4347-b146-d8930ad60c11/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG nova.network.neutron [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Updating instance_info_cache with network_info: [{"id": "eec59f5d-4379-4f07-b4cb-f56b388fca0a", "address": "fa:16:3e:1e:8b:be", "network": {"id": "0aaa14d8-7754-499d-8438-fd1229fddc6a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-589739381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b814ffb2501544a6a5c669df102db2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeec59f5d-43", "ovs_interfaceid": "eec59f5d-4379-4f07-b4cb-f56b388fca0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/567feb03-a356-4347-b146-d8930ad60c11/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2a7ff40-310e-481f-8459-cde1034a0fbd/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Releasing lock "refresh_cache-39e15045-0a84-4b48-a962-c006b6c747b3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG nova.compute.manager [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Instance network_info: |[{"id": "eec59f5d-4379-4f07-b4cb-f56b388fca0a", "address": "fa:16:3e:1e:8b:be", "network": {"id": "0aaa14d8-7754-499d-8438-fd1229fddc6a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-589739381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b814ffb2501544a6a5c669df102db2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeec59f5d-43", "ovs_interfaceid": "eec59f5d-4379-4f07-b4cb-f56b388fca0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-0cfd78c9-3f2a-4af4-9f00-754adc51e948 req-5070c662-0afc-43f9-b8af-9c4774d9c9a4 service nova] Acquired lock "refresh_cache-39e15045-0a84-4b48-a962-c006b6c747b3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG nova.network.neutron [req-0cfd78c9-3f2a-4af4-9f00-754adc51e948 req-5070c662-0afc-43f9-b8af-9c4774d9c9a4 service nova] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Refreshing network info cache for port eec59f5d-4379-4f07-b4cb-f56b388fca0a {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Start _get_guest_xml network_info=[{"id": "eec59f5d-4379-4f07-b4cb-f56b388fca0a", "address": "fa:16:3e:1e:8b:be", "network": {"id": "0aaa14d8-7754-499d-8438-fd1229fddc6a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-589739381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b814ffb2501544a6a5c669df102db2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeec59f5d-43", "ovs_interfaceid": "eec59f5d-4379-4f07-b4cb-f56b388fca0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '9536f6cf-95c4-40e2-864a-09a91525678a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:05:22 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:05:22 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:05:22 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:05:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-136508521',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-136508521',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1365085',id=12,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCY9v376v12iHPTn5Jtyl4n1foaPCisWGmqHQBpFJ6SNiXM2qGq2yc0TuZ+fOvMFYq8onwGKyqOghMBII2zwzVUbwRaBy+CSo/wQfbKk4gGo14xOqlcPyO+UpVFA9zibTA==',key_name='tempest-keypair-1893785406',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b814ffb2501544a6a5c669df102db2d4',ramdisk_id='',reservation_id='r-n0bec0hg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-204264382',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:05:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c20e517153644747a9284535f032c3cb',uuid=39e15045-0a84-4b48-a962-c006b6c747b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eec59f5d-4379-4f07-b4cb-f56b388fca0a", "address": "fa:16:3e:1e:8b:be", "network": {"id": "0aaa14d8-7754-499d-8438-fd1229fddc6a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-589739381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b814ffb2501544a6a5c669df102db2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeec59f5d-43", "ovs_interfaceid": "eec59f5d-4379-4f07-b4cb-f56b388fca0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Converting VIF {"id": "eec59f5d-4379-4f07-b4cb-f56b388fca0a", "address": "fa:16:3e:1e:8b:be", "network": {"id": "0aaa14d8-7754-499d-8438-fd1229fddc6a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-589739381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b814ffb2501544a6a5c669df102db2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeec59f5d-43", "ovs_interfaceid": "eec59f5d-4379-4f07-b4cb-f56b388fca0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:8b:be,bridge_name='br-int',has_traffic_filtering=True,id=eec59f5d-4379-4f07-b4cb-f56b388fca0a,network=Network(0aaa14d8-7754-499d-8438-fd1229fddc6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeec59f5d-43') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG nova.objects.instance [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Lazy-loading 'pci_devices' on Instance uuid 39e15045-0a84-4b48-a962-c006b6c747b3 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:05:22 user nova-compute[74743]:   <uuid>39e15045-0a84-4b48-a962-c006b6c747b3</uuid>
Nov 18 17:05:22 user nova-compute[74743]:   <name>instance-0000000c</name>
Nov 18 17:05:22 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:05:22 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:05:22 user nova-compute[74743]:   <metadata>
Nov 18 17:05:22 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:05:22 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:05:22 user nova-compute[74743]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-136508521</nova:name>
Nov 18 17:05:22 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:05:22</nova:creationTime>
Nov 18 17:05:22 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:05:22 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:05:22 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:05:22 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:05:22 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:05:22 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:05:22 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:05:22 user nova-compute[74743]:       <nova:owner>
Nov 18 17:05:22 user nova-compute[74743]:         <nova:user uuid="c20e517153644747a9284535f032c3cb">tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member</nova:user>
Nov 18 17:05:22 user nova-compute[74743]:         <nova:project uuid="b814ffb2501544a6a5c669df102db2d4">tempest-TestServerVolumeAttachScenarioOldVersion-204264382</nova:project>
Nov 18 17:05:22 user nova-compute[74743]:       </nova:owner>
Nov 18 17:05:22 user nova-compute[74743]:       <nova:root type="image" uuid="9536f6cf-95c4-40e2-864a-09a91525678a"/>
Nov 18 17:05:22 user nova-compute[74743]:       <nova:ports>
Nov 18 17:05:22 user nova-compute[74743]:         <nova:port uuid="eec59f5d-4379-4f07-b4cb-f56b388fca0a">
Nov 18 17:05:22 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 18 17:05:22 user nova-compute[74743]:         </nova:port>
Nov 18 17:05:22 user nova-compute[74743]:       </nova:ports>
Nov 18 17:05:22 user nova-compute[74743]:     </nova:instance>
Nov 18 17:05:22 user nova-compute[74743]:   </metadata>
Nov 18 17:05:22 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:05:22 user nova-compute[74743]:     <system>
Nov 18 17:05:22 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:05:22 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:05:22 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:05:22 user nova-compute[74743]:       <entry name="serial">39e15045-0a84-4b48-a962-c006b6c747b3</entry>
Nov 18 17:05:22 user nova-compute[74743]:       <entry name="uuid">39e15045-0a84-4b48-a962-c006b6c747b3</entry>
Nov 18 17:05:22 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:05:22 user nova-compute[74743]:     </system>
Nov 18 17:05:22 user nova-compute[74743]:   </sysinfo>
Nov 18 17:05:22 user nova-compute[74743]:   <os>
Nov 18 17:05:22 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:05:22 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:05:22 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:05:22 user nova-compute[74743]:   </os>
Nov 18 17:05:22 user nova-compute[74743]:   <features>
Nov 18 17:05:22 user nova-compute[74743]:     <acpi/>
Nov 18 17:05:22 user nova-compute[74743]:     <apic/>
Nov 18 17:05:22 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:05:22 user nova-compute[74743]:   </features>
Nov 18 17:05:22 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:05:22 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:05:22 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:05:22 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:05:22 user nova-compute[74743]:   </clock>
Nov 18 17:05:22 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:05:22 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:05:22 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:05:22 user nova-compute[74743]:   </cpu>
Nov 18 17:05:22 user nova-compute[74743]:   <devices>
Nov 18 17:05:22 user nova-compute[74743]:     <disk type="file" device="disk">
Nov 18 17:05:22 user nova-compute[74743]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 17:05:22 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/39e15045-0a84-4b48-a962-c006b6c747b3/disk"/>
Nov 18 17:05:22 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:05:22 user nova-compute[74743]:     </disk>
Nov 18 17:05:22 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:05:22 user nova-compute[74743]:       <mac address="fa:16:3e:1e:8b:be"/>
Nov 18 17:05:22 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:05:22 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:05:22 user nova-compute[74743]:       <target dev="tapeec59f5d-43"/>
Nov 18 17:05:22 user nova-compute[74743]:     </interface>
Nov 18 17:05:22 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:05:22 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/39e15045-0a84-4b48-a962-c006b6c747b3/console.log" append="off"/>
Nov 18 17:05:22 user nova-compute[74743]:     </serial>
Nov 18 17:05:22 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:05:22 user nova-compute[74743]:     <video>
Nov 18 17:05:22 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:05:22 user nova-compute[74743]:     </video>
Nov 18 17:05:22 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:05:22 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:05:22 user nova-compute[74743]:     </rng>
Nov 18 17:05:22 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:05:22 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:05:22 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:05:22 user nova-compute[74743]:     </memballoon>
Nov 18 17:05:22 user nova-compute[74743]:   </devices>
Nov 18 17:05:22 user nova-compute[74743]: </domain>
Nov 18 17:05:22 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:05:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-136508521',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-136508521',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1365085',id=12,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCY9v376v12iHPTn5Jtyl4n1foaPCisWGmqHQBpFJ6SNiXM2qGq2yc0TuZ+fOvMFYq8onwGKyqOghMBII2zwzVUbwRaBy+CSo/wQfbKk4gGo14xOqlcPyO+UpVFA9zibTA==',key_name='tempest-keypair-1893785406',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b814ffb2501544a6a5c669df102db2d4',ramdisk_id='',reservation_id='r-n0bec0hg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-204264382',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:05:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c20e517153644747a9284535f032c3cb',uuid=39e15045-0a84-4b48-a962-c006b6c747b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eec59f5d-4379-4f07-b4cb-f56b388fca0a", "address": "fa:16:3e:1e:8b:be", "network": {"id": "0aaa14d8-7754-499d-8438-fd1229fddc6a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-589739381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b814ffb2501544a6a5c669df102db2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeec59f5d-43", "ovs_interfaceid": "eec59f5d-4379-4f07-b4cb-f56b388fca0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Converting VIF {"id": "eec59f5d-4379-4f07-b4cb-f56b388fca0a", "address": "fa:16:3e:1e:8b:be", "network": {"id": "0aaa14d8-7754-499d-8438-fd1229fddc6a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-589739381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b814ffb2501544a6a5c669df102db2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeec59f5d-43", "ovs_interfaceid": "eec59f5d-4379-4f07-b4cb-f56b388fca0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:8b:be,bridge_name='br-int',has_traffic_filtering=True,id=eec59f5d-4379-4f07-b4cb-f56b388fca0a,network=Network(0aaa14d8-7754-499d-8438-fd1229fddc6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeec59f5d-43') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG os_vif [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:8b:be,bridge_name='br-int',has_traffic_filtering=True,id=eec59f5d-4379-4f07-b4cb-f56b388fca0a,network=Network(0aaa14d8-7754-499d-8438-fd1229fddc6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeec59f5d-43') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e7b12bbf-1b11-5765-b56d-8ee242ce5d06', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2a7ff40-310e-481f-8459-cde1034a0fbd/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2a7ff40-310e-481f-8459-cde1034a0fbd/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeec59f5d-43, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeec59f5d-43, col_values=(('qos', UUID('043af2a4-9ac7-4ba0-946d-90b7c85875f2')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeec59f5d-43, col_values=(('external_ids', {'iface-id': 'eec59f5d-4379-4f07-b4cb-f56b388fca0a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:8b:be', 'vm-uuid': '39e15045-0a84-4b48-a962-c006b6c747b3'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:22 user nova-compute[74743]: INFO os_vif [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:8b:be,bridge_name='br-int',has_traffic_filtering=True,id=eec59f5d-4379-4f07-b4cb-f56b388fca0a,network=Network(0aaa14d8-7754-499d-8438-fd1229fddc6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeec59f5d-43')
Nov 18 17:05:22 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] No VIF found with MAC fa:16:3e:1e:8b:be, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd663679-1e52-48e8-b331-fa1c19226f62 tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Calling os-brick to attach iSCSI Volume {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd663679-1e52-48e8-b331-fa1c19226f62 tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ad14a9dc-3caf-47ea-8ef6-ef0c490d35be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bykIDmUa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:05:22 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-dd663679-1e52-48e8-b331-fa1c19226f62 tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:05:22 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-dd663679-1e52-48e8-b331-fa1c19226f62 tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-dd663679-1e52-48e8-b331-fa1c19226f62 tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:05:22 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-dd663679-1e52-48e8-b331-fa1c19226f62 tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:05:22 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-dd663679-1e52-48e8-b331-fa1c19226f62 tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad14a9dc-3caf-47ea-8ef6-ef0c490d35be" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-dd663679-1e52-48e8-b331-fa1c19226f62 tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad14a9dc-3caf-47ea-8ef6-ef0c490d35be" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:05:22 user nova-compute[74743]: INFO os_brick.initiator.connectors.iscsi [None req-dd663679-1e52-48e8-b331-fa1c19226f62 tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 17:05:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2a7ff40-310e-481f-8459-cde1034a0fbd/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad14a9dc-3caf-47ea-8ef6-ef0c490d35be -p 172.16.0.220:3260 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d30a49de-abf1-4985-8dc5-6f7f24d51d2f/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad14a9dc-3caf-47ea-8ef6-ef0c490d35be -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[245a5c57-f6cb-479c-8923-96e8233a5dfe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd663679-1e52-48e8-b331-fa1c19226f62 tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 17:05:22 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad14a9dc-3caf-47ea-8ef6-ef0c490d35be -p 172.16.0.220:3260 --interface default --op new {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad14a9dc-3caf-47ea-8ef6-ef0c490d35be -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2e86fb-ad46-4c69-8c9a-92339b6d53ba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad14a9dc-3caf-47ea-8ef6-ef0c490d35be] added\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd663679-1e52-48e8-b331-fa1c19226f62 tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad14a9dc-3caf-47ea-8ef6-ef0c490d35be] added
Nov 18 17:05:22 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad14a9dc-3caf-47ea-8ef6-ef0c490d35be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad14a9dc-3caf-47ea-8ef6-ef0c490d35be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[88472abe-2fe2-4728-ae23-76ce97e518e1]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd663679-1e52-48e8-b331-fa1c19226f62 tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad14a9dc-3caf-47ea-8ef6-ef0c490d35be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad14a9dc-3caf-47ea-8ef6-ef0c490d35be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3dd615-e050-4f22-b838-bb8efbc58b16]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd663679-1e52-48e8-b331-fa1c19226f62 tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad14a9dc-3caf-47ea-8ef6-ef0c490d35be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bykIDmUa {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG nova.network.neutron [req-0cfd78c9-3f2a-4af4-9f00-754adc51e948 req-5070c662-0afc-43f9-b8af-9c4774d9c9a4 service nova] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Updated VIF entry in instance network info cache for port eec59f5d-4379-4f07-b4cb-f56b388fca0a. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:05:22 user nova-compute[74743]: DEBUG nova.network.neutron [req-0cfd78c9-3f2a-4af4-9f00-754adc51e948 req-5070c662-0afc-43f9-b8af-9c4774d9c9a4 service nova] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Updating instance_info_cache with network_info: [{"id": "eec59f5d-4379-4f07-b4cb-f56b388fca0a", "address": "fa:16:3e:1e:8b:be", "network": {"id": "0aaa14d8-7754-499d-8438-fd1229fddc6a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-589739381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b814ffb2501544a6a5c669df102db2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeec59f5d-43", "ovs_interfaceid": "eec59f5d-4379-4f07-b4cb-f56b388fca0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:05:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-0cfd78c9-3f2a-4af4-9f00-754adc51e948 req-5070c662-0afc-43f9-b8af-9c4774d9c9a4 service nova] Releasing lock "refresh_cache-39e15045-0a84-4b48-a962-c006b6c747b3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:05:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad14a9dc-3caf-47ea-8ef6-ef0c490d35be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bykIDmUa" returned: 0 in 0.024s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:23 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4e4fe3-ed18-4efd-b21e-365e9fa5f8cb]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd663679-1e52-48e8-b331-fa1c19226f62 tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bykIDmUa'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:05:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad14a9dc-3caf-47ea-8ef6-ef0c490d35be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad14a9dc-3caf-47ea-8ef6-ef0c490d35be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:23 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd04663-0863-4153-91e3-c1b29c4274c1]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd663679-1e52-48e8-b331-fa1c19226f62 tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:05:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d30a49de-abf1-4985-8dc5-6f7f24d51d2f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d30a49de-abf1-4985-8dc5-6f7f24d51d2f/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:23 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af2c842-7496-4e0d-971a-d736eb92e864]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd663679-1e52-48e8-b331-fa1c19226f62 tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:05:23 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:05:23 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:05:23 user nova-compute[74743]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)
Nov 18 17:05:23 user nova-compute[74743]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)
Nov 18 17:05:23 user nova-compute[74743]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)
Nov 18 17:05:23 user nova-compute[74743]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)
Nov 18 17:05:23 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:05:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd663679-1e52-48e8-b331-fa1c19226f62 tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:05:23 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:05:23 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:05:23 user nova-compute[74743]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)
Nov 18 17:05:23 user nova-compute[74743]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)
Nov 18 17:05:23 user nova-compute[74743]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)
Nov 18 17:05:23 user nova-compute[74743]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)
Nov 18 17:05:23 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:05:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad14a9dc-3caf-47ea-8ef6-ef0c490d35be -p 172.16.0.220:3260 --login {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:23 user nova-compute[74743]: DEBUG nova.compute.manager [req-2ca6b674-4767-49b2-99d9-dfbb44ec824d req-e8627845-3763-4874-9b88-8954ad36481d service nova] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Received event network-changed-999980cf-efd0-4b78-aa42-f4e80073b5a9 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:05:23 user nova-compute[74743]: DEBUG nova.compute.manager [req-2ca6b674-4767-49b2-99d9-dfbb44ec824d req-e8627845-3763-4874-9b88-8954ad36481d service nova] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Refreshing instance network info cache due to event network-changed-999980cf-efd0-4b78-aa42-f4e80073b5a9. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:05:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-2ca6b674-4767-49b2-99d9-dfbb44ec824d req-e8627845-3763-4874-9b88-8954ad36481d service nova] Acquiring lock "refresh_cache-c006a4ad-a8e2-4108-9af1-dec4dd53fcda" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:05:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-2ca6b674-4767-49b2-99d9-dfbb44ec824d req-e8627845-3763-4874-9b88-8954ad36481d service nova] Acquired lock "refresh_cache-c006a4ad-a8e2-4108-9af1-dec4dd53fcda" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:05:23 user nova-compute[74743]: DEBUG nova.network.neutron [req-2ca6b674-4767-49b2-99d9-dfbb44ec824d req-e8627845-3763-4874-9b88-8954ad36481d service nova] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Refreshing network info cache for port 999980cf-efd0-4b78-aa42-f4e80073b5a9 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:05:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad14a9dc-3caf-47ea-8ef6-ef0c490d35be -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:23 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[58fcc09f-6ff3-45e4-a5e9-8249a74dd862]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad14a9dc-3caf-47ea-8ef6-ef0c490d35be, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ad14a9dc-3caf-47ea-8ef6-ef0c490d35be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd663679-1e52-48e8-b331-fa1c19226f62 tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad14a9dc-3caf-47ea-8ef6-ef0c490d35be, portal: 172.16.0.220,3260]
Nov 18 17:05:23 user nova-compute[74743]: Login to [iface: default, target: iqn.2010-10.org.openstack:ad14a9dc-3caf-47ea-8ef6-ef0c490d35be, portal: 172.16.0.220,3260] successful.
Nov 18 17:05:23 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:05:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad14a9dc-3caf-47ea-8ef6-ef0c490d35be -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad14a9dc-3caf-47ea-8ef6-ef0c490d35be -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:23 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4428aa-9158-4cf9-a6bd-9f740c8f01de]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd663679-1e52-48e8-b331-fa1c19226f62 tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:05:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d30a49de-abf1-4985-8dc5-6f7f24d51d2f/disk --force-share --output=json" returned: 0 in 0.455s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:23 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[e931d977-559e-4128-aed5-2334629923c4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad14a9dc-3caf-47ea-8ef6-ef0c490d35be (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd663679-1e52-48e8-b331-fa1c19226f62 tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:05:23 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:05:23 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:05:23 user nova-compute[74743]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)
Nov 18 17:05:23 user nova-compute[74743]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)
Nov 18 17:05:23 user nova-compute[74743]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)
Nov 18 17:05:23 user nova-compute[74743]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)
Nov 18 17:05:23 user nova-compute[74743]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad14a9dc-3caf-47ea-8ef6-ef0c490d35be (non-flash)
Nov 18 17:05:23 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:05:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd663679-1e52-48e8-b331-fa1c19226f62 tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:05:23 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:05:23 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:05:23 user nova-compute[74743]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)
Nov 18 17:05:23 user nova-compute[74743]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)
Nov 18 17:05:23 user nova-compute[74743]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)
Nov 18 17:05:23 user nova-compute[74743]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)
Nov 18 17:05:23 user nova-compute[74743]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad14a9dc-3caf-47ea-8ef6-ef0c490d35be (non-flash)
Nov 18 17:05:23 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:05:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-dd663679-1e52-48e8-b331-fa1c19226f62 tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad14a9dc-3caf-47ea-8ef6-ef0c490d35be" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.704s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:05:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd663679-1e52-48e8-b331-fa1c19226f62 tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Connected to 172.16.0.220:3260 {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 17:05:23 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-dd663679-1e52-48e8-b331-fa1c19226f62 tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=74743) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 17:05:23 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-dd663679-1e52-48e8-b331-fa1c19226f62 tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=74743) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 17:05:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.027s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:23 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc03ed8-ac8d-47e7-90ab-88f50aab988b]: (4, ('- - 0', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:23 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-dd663679-1e52-48e8-b331-fa1c19226f62 tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:05:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd663679-1e52-48e8-b331-fa1c19226f62 tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:ad14a9dc-3caf-47ea-8ef6-ef0c490d35be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bykIDmUa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 17:05:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:23 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:05:23 user nova-compute[74743]: DEBUG nova.network.neutron [req-2ca6b674-4767-49b2-99d9-dfbb44ec824d req-e8627845-3763-4874-9b88-8954ad36481d service nova] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Updated VIF entry in instance network info cache for port 999980cf-efd0-4b78-aa42-f4e80073b5a9. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:05:23 user nova-compute[74743]: DEBUG nova.network.neutron [req-2ca6b674-4767-49b2-99d9-dfbb44ec824d req-e8627845-3763-4874-9b88-8954ad36481d service nova] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Updating instance_info_cache with network_info: [{"id": "999980cf-efd0-4b78-aa42-f4e80073b5a9", "address": "fa:16:3e:e4:7e:f3", "network": {"id": "fd98f398-6576-449b-a737-887906eb6656", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668610993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb8f5850162c479b8d185e48c03be7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap999980cf-ef", "ovs_interfaceid": "999980cf-efd0-4b78-aa42-f4e80073b5a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:05:23 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:05:23 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:05:23 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:05:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-2ca6b674-4767-49b2-99d9-dfbb44ec824d req-e8627845-3763-4874-9b88-8954ad36481d service nova] Releasing lock "refresh_cache-c006a4ad-a8e2-4108-9af1-dec4dd53fcda" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:05:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:24 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:24 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:24 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:24 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6111e9-59e9-4a30-870c-3d308a5d4936/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:24 user nova-compute[74743]: DEBUG nova.compute.manager [req-af61a9e6-6e89-4ab9-924d-2fe9cff82e25 req-50a7a866-fb55-42e5-9e00-3e753c0d52ad service nova] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Received event network-vif-plugged-eec59f5d-4379-4f07-b4cb-f56b388fca0a {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:05:24 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-af61a9e6-6e89-4ab9-924d-2fe9cff82e25 req-50a7a866-fb55-42e5-9e00-3e753c0d52ad service nova] Acquiring lock "39e15045-0a84-4b48-a962-c006b6c747b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:05:24 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-af61a9e6-6e89-4ab9-924d-2fe9cff82e25 req-50a7a866-fb55-42e5-9e00-3e753c0d52ad service nova] Lock "39e15045-0a84-4b48-a962-c006b6c747b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:05:24 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-af61a9e6-6e89-4ab9-924d-2fe9cff82e25 req-50a7a866-fb55-42e5-9e00-3e753c0d52ad service nova] Lock "39e15045-0a84-4b48-a962-c006b6c747b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:05:24 user nova-compute[74743]: DEBUG nova.compute.manager [req-af61a9e6-6e89-4ab9-924d-2fe9cff82e25 req-50a7a866-fb55-42e5-9e00-3e753c0d52ad service nova] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] No waiting events found dispatching network-vif-plugged-eec59f5d-4379-4f07-b4cb-f56b388fca0a {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:05:24 user nova-compute[74743]: WARNING nova.compute.manager [req-af61a9e6-6e89-4ab9-924d-2fe9cff82e25 req-50a7a866-fb55-42e5-9e00-3e753c0d52ad service nova] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Received unexpected event network-vif-plugged-eec59f5d-4379-4f07-b4cb-f56b388fca0a for instance with vm_state building and task_state spawning.
Nov 18 17:05:24 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6111e9-59e9-4a30-870c-3d308a5d4936/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6111e9-59e9-4a30-870c-3d308a5d4936/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:24 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-dd663679-1e52-48e8-b331-fa1c19226f62 tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.756s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:05:24 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd663679-1e52-48e8-b331-fa1c19226f62 tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] <== connect_volume: return (1759ms) {'type': 'block', 'scsi_wwn': '23762323235323839', 'path': '/dev/sdi'} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:05:24 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd663679-1e52-48e8-b331-fa1c19226f62 tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762323235323839', 'path': '/dev/sdi'} {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 17:05:24 user nova-compute[74743]: DEBUG nova.objects.instance [None req-dd663679-1e52-48e8-b331-fa1c19226f62 tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Lazy-loading 'flavor' on Instance uuid d30a49de-abf1-4985-8dc5-6f7f24d51d2f {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:05:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6111e9-59e9-4a30-870c-3d308a5d4936/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55192f7b-5aaf-42e6-926a-cf9f43e460ca/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:24 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-dd663679-1e52-48e8-b331-fa1c19226f62 tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 17:05:24 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:05:24 user nova-compute[74743]:   <source dev="/dev/sdi"/>
Nov 18 17:05:24 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:05:24 user nova-compute[74743]:   <serial>ad14a9dc-3caf-47ea-8ef6-ef0c490d35be</serial>
Nov 18 17:05:24 user nova-compute[74743]: </disk>
Nov 18 17:05:24 user nova-compute[74743]:  {{(pid=74743) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 17:05:24 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:24 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55192f7b-5aaf-42e6-926a-cf9f43e460ca/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55192f7b-5aaf-42e6-926a-cf9f43e460ca/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55192f7b-5aaf-42e6-926a-cf9f43e460ca/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:25 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:05:25 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:05:25 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:05:26 user nova-compute[74743]: DEBUG nova.compute.manager [req-bc00117a-f0c6-4277-9d42-0bfc963bf76e req-be678bba-ca58-46f8-9dd3-4eb3fb922733 service nova] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Received event network-vif-plugged-eec59f5d-4379-4f07-b4cb-f56b388fca0a {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:05:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-bc00117a-f0c6-4277-9d42-0bfc963bf76e req-be678bba-ca58-46f8-9dd3-4eb3fb922733 service nova] Acquiring lock "39e15045-0a84-4b48-a962-c006b6c747b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:05:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-bc00117a-f0c6-4277-9d42-0bfc963bf76e req-be678bba-ca58-46f8-9dd3-4eb3fb922733 service nova] Lock "39e15045-0a84-4b48-a962-c006b6c747b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:05:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-bc00117a-f0c6-4277-9d42-0bfc963bf76e req-be678bba-ca58-46f8-9dd3-4eb3fb922733 service nova] Lock "39e15045-0a84-4b48-a962-c006b6c747b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:05:26 user nova-compute[74743]: DEBUG nova.compute.manager [req-bc00117a-f0c6-4277-9d42-0bfc963bf76e req-be678bba-ca58-46f8-9dd3-4eb3fb922733 service nova] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] No waiting events found dispatching network-vif-plugged-eec59f5d-4379-4f07-b4cb-f56b388fca0a {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:05:26 user nova-compute[74743]: WARNING nova.compute.manager [req-bc00117a-f0c6-4277-9d42-0bfc963bf76e req-be678bba-ca58-46f8-9dd3-4eb3fb922733 service nova] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Received unexpected event network-vif-plugged-eec59f5d-4379-4f07-b4cb-f56b388fca0a for instance with vm_state building and task_state spawning.
Nov 18 17:05:26 user nova-compute[74743]: DEBUG nova.compute.manager [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:05:26 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Guest created on hypervisor {{(pid=74743) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 17:05:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Acquiring lock "abf14b55-522e-4497-a799-cdc914072515" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:05:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Lock "abf14b55-522e-4497-a799-cdc914072515" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:05:26 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:05:26 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:05:26 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Hypervisor/Node resource view: name=user free_ram=6909MB free_disk=25.661148071289062GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74743) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 17:05:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:05:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:05:26 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Instance spawned successfully.
Nov 18 17:05:26 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 17:05:26 user nova-compute[74743]: DEBUG nova.compute.manager [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] [instance: abf14b55-522e-4497-a799-cdc914072515] Starting instance... {{(pid=74743) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 17:05:26 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Found default for hw_cdrom_bus of ide {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:05:26 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Found default for hw_disk_bus of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:05:26 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Found default for hw_input_bus of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:05:26 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Found default for hw_pointer_model of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:05:26 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Found default for hw_video_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:05:26 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Found default for hw_vif_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:05:26 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-dd663679-1e52-48e8-b331-fa1c19226f62 tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:05:26 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-dd663679-1e52-48e8-b331-fa1c19226f62 tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:05:26 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-dd663679-1e52-48e8-b331-fa1c19226f62 tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] No VIF found with MAC fa:16:3e:cf:af:24, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:05:26 user nova-compute[74743]: INFO nova.compute.manager [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Took 6.16 seconds to spawn the instance on the hypervisor.
Nov 18 17:05:26 user nova-compute[74743]: DEBUG nova.compute.manager [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:05:26 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 8e6111e9-59e9-4a30-870c-3d308a5d4936 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:05:26 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 4cce1628-2dcb-40c7-abd4-6a327a432de3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:05:26 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance e9668e1c-1e8d-4dd7-8f58-d453db294557 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:05:26 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 58edd8cc-a455-4922-8de8-c800a61e7b43 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:05:26 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance d30a49de-abf1-4985-8dc5-6f7f24d51d2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:05:26 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance e2a7ff40-310e-481f-8459-cde1034a0fbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:05:26 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 567feb03-a356-4347-b146-d8930ad60c11 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:05:26 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 8ed74254-d845-4810-965f-300a97ce3817 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:05:26 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 39e15045-0a84-4b48-a962-c006b6c747b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:05:26 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance fc4cdeb6-51ff-4090-a29d-d4f6105e15f3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:05:26 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 55192f7b-5aaf-42e6-926a-cf9f43e460ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:05:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:05:26 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance abf14b55-522e-4497-a799-cdc914072515 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 18 17:05:26 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance c006a4ad-a8e2-4108-9af1-dec4dd53fcda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:05:26 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 17:05:26 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 17:05:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-dd663679-1e52-48e8-b331-fa1c19226f62 tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Lock "d30a49de-abf1-4985-8dc5-6f7f24d51d2f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.291s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:05:26 user nova-compute[74743]: INFO nova.compute.manager [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Took 7.40 seconds to build instance.
Nov 18 17:05:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-fd7e060c-8eb4-477c-865a-33054042585d tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Lock "39e15045-0a84-4b48-a962-c006b6c747b3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.515s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:05:27 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:05:27 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:05:27 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Compute_service record updated for user:user {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 17:05:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.727s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:05:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.553s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:05:27 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74743) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 17:05:27 user nova-compute[74743]: INFO nova.compute.claims [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] [instance: abf14b55-522e-4497-a799-cdc914072515] Claim successful on node user
Nov 18 17:05:27 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-c87054a8-e7f3-404a-b0e2-c36204d3eecf tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Acquiring lock "d30a49de-abf1-4985-8dc5-6f7f24d51d2f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:05:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-c87054a8-e7f3-404a-b0e2-c36204d3eecf tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Lock "d30a49de-abf1-4985-8dc5-6f7f24d51d2f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:05:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-c87054a8-e7f3-404a-b0e2-c36204d3eecf tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Acquiring lock "d30a49de-abf1-4985-8dc5-6f7f24d51d2f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:05:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-c87054a8-e7f3-404a-b0e2-c36204d3eecf tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Lock "d30a49de-abf1-4985-8dc5-6f7f24d51d2f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:05:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-c87054a8-e7f3-404a-b0e2-c36204d3eecf tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Lock "d30a49de-abf1-4985-8dc5-6f7f24d51d2f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:05:27 user nova-compute[74743]: INFO nova.compute.manager [None req-c87054a8-e7f3-404a-b0e2-c36204d3eecf tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Terminating instance
Nov 18 17:05:27 user nova-compute[74743]: DEBUG nova.compute.manager [None req-c87054a8-e7f3-404a-b0e2-c36204d3eecf tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Start destroying the instance on the hypervisor. {{(pid=74743) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 17:05:27 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:05:27 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:05:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.515s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:05:27 user nova-compute[74743]: DEBUG nova.compute.manager [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] [instance: abf14b55-522e-4497-a799-cdc914072515] Start building networks asynchronously for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 17:05:27 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:27 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:27 user nova-compute[74743]: DEBUG nova.compute.manager [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] [instance: abf14b55-522e-4497-a799-cdc914072515] Allocating IP information in the background. {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 17:05:27 user nova-compute[74743]: DEBUG nova.network.neutron [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] [instance: abf14b55-522e-4497-a799-cdc914072515] allocate_for_instance() {{(pid=74743) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 17:05:27 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] [instance: abf14b55-522e-4497-a799-cdc914072515] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 17:05:27 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:27 user nova-compute[74743]: DEBUG nova.compute.manager [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] [instance: abf14b55-522e-4497-a799-cdc914072515] Start building block device mappings for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG nova.policy [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fd7084ff003c425fa79affcde8a547ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5e099a27494eabb547f8d5203cb0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74743) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG nova.compute.manager [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] [instance: abf14b55-522e-4497-a799-cdc914072515] Start spawning the instance on the hypervisor. {{(pid=74743) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] [instance: abf14b55-522e-4497-a799-cdc914072515] Creating instance directory {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 17:05:28 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] [instance: abf14b55-522e-4497-a799-cdc914072515] Creating image(s)
Nov 18 17:05:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Acquiring lock "/opt/stack/data/nova/instances/abf14b55-522e-4497-a799-cdc914072515/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Lock "/opt/stack/data/nova/instances/abf14b55-522e-4497-a799-cdc914072515/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Lock "/opt/stack/data/nova/instances/abf14b55-522e-4497-a799-cdc914072515/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.235s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Acquiring lock "c188b3a997bfafa42fa341f9dcc326545681eed9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG nova.compute.manager [req-872ba074-f34e-456c-9760-505aba39fbdd req-4353ce4e-9c4b-4daa-a4de-5f3e44def593 service nova] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Received event network-vif-unplugged-de102d31-a76d-4945-a89a-bdc58bf0f3a6 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-872ba074-f34e-456c-9760-505aba39fbdd req-4353ce4e-9c4b-4daa-a4de-5f3e44def593 service nova] Acquiring lock "d30a49de-abf1-4985-8dc5-6f7f24d51d2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-872ba074-f34e-456c-9760-505aba39fbdd req-4353ce4e-9c4b-4daa-a4de-5f3e44def593 service nova] Lock "d30a49de-abf1-4985-8dc5-6f7f24d51d2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-872ba074-f34e-456c-9760-505aba39fbdd req-4353ce4e-9c4b-4daa-a4de-5f3e44def593 service nova] Lock "d30a49de-abf1-4985-8dc5-6f7f24d51d2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG nova.compute.manager [req-872ba074-f34e-456c-9760-505aba39fbdd req-4353ce4e-9c4b-4daa-a4de-5f3e44def593 service nova] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] No waiting events found dispatching network-vif-unplugged-de102d31-a76d-4945-a89a-bdc58bf0f3a6 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG nova.compute.manager [req-872ba074-f34e-456c-9760-505aba39fbdd req-4353ce4e-9c4b-4daa-a4de-5f3e44def593 service nova] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Received event network-vif-unplugged-de102d31-a76d-4945-a89a-bdc58bf0f3a6 for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG nova.compute.manager [req-872ba074-f34e-456c-9760-505aba39fbdd req-4353ce4e-9c4b-4daa-a4de-5f3e44def593 service nova] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Received event network-vif-plugged-de102d31-a76d-4945-a89a-bdc58bf0f3a6 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-872ba074-f34e-456c-9760-505aba39fbdd req-4353ce4e-9c4b-4daa-a4de-5f3e44def593 service nova] Acquiring lock "d30a49de-abf1-4985-8dc5-6f7f24d51d2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-872ba074-f34e-456c-9760-505aba39fbdd req-4353ce4e-9c4b-4daa-a4de-5f3e44def593 service nova] Lock "d30a49de-abf1-4985-8dc5-6f7f24d51d2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-872ba074-f34e-456c-9760-505aba39fbdd req-4353ce4e-9c4b-4daa-a4de-5f3e44def593 service nova] Lock "d30a49de-abf1-4985-8dc5-6f7f24d51d2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG nova.compute.manager [req-872ba074-f34e-456c-9760-505aba39fbdd req-4353ce4e-9c4b-4daa-a4de-5f3e44def593 service nova] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] No waiting events found dispatching network-vif-plugged-de102d31-a76d-4945-a89a-bdc58bf0f3a6 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:05:28 user nova-compute[74743]: WARNING nova.compute.manager [req-872ba074-f34e-456c-9760-505aba39fbdd req-4353ce4e-9c4b-4daa-a4de-5f3e44def593 service nova] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Received unexpected event network-vif-plugged-de102d31-a76d-4945-a89a-bdc58bf0f3a6 for instance with vm_state active and task_state deleting.
Nov 18 17:05:28 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Instance destroyed successfully.
Nov 18 17:05:28 user nova-compute[74743]: DEBUG nova.objects.instance [None req-c87054a8-e7f3-404a-b0e2-c36204d3eecf tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Lazy-loading 'resources' on Instance uuid d30a49de-abf1-4985-8dc5-6f7f24d51d2f {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-c87054a8-e7f3-404a-b0e2-c36204d3eecf tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:03:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-613349512',display_name='tempest-DeleteServersTestJSON-server-613349512',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-613349512',id=3,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:03:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='59182c66c6724be494c78af579b03340',ramdisk_id='',reservation_id='r-692hrcsg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-65485011',owner_user_name='tempest-DeleteServersTestJSON-65485011-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:03:36Z,user_data=None,user_id='6dc2a1332121452e8d468f97b041369e',uuid=d30a49de-abf1-4985-8dc5-6f7f24d51d2f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de102d31-a76d-4945-a89a-bdc58bf0f3a6", "address": "fa:16:3e:cf:af:24", "network": {"id": "4b7bc82e-3fb4-4696-827e-095227957f6b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1107221061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59182c66c6724be494c78af579b03340", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde102d31-a7", "ovs_interfaceid": "de102d31-a76d-4945-a89a-bdc58bf0f3a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-c87054a8-e7f3-404a-b0e2-c36204d3eecf tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Converting VIF {"id": "de102d31-a76d-4945-a89a-bdc58bf0f3a6", "address": "fa:16:3e:cf:af:24", "network": {"id": "4b7bc82e-3fb4-4696-827e-095227957f6b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1107221061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59182c66c6724be494c78af579b03340", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde102d31-a7", "ovs_interfaceid": "de102d31-a76d-4945-a89a-bdc58bf0f3a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-c87054a8-e7f3-404a-b0e2-c36204d3eecf tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:af:24,bridge_name='br-int',has_traffic_filtering=True,id=de102d31-a76d-4945-a89a-bdc58bf0f3a6,network=Network(4b7bc82e-3fb4-4696-827e-095227957f6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde102d31-a7') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG os_vif [None req-c87054a8-e7f3-404a-b0e2-c36204d3eecf tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:af:24,bridge_name='br-int',has_traffic_filtering=True,id=de102d31-a76d-4945-a89a-bdc58bf0f3a6,network=Network(4b7bc82e-3fb4-4696-827e-095227957f6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde102d31-a7') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapde102d31-a7, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=34ea50a9-ee5e-4015-97f6-cb9190290a93) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.199s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/abf14b55-522e-4497-a799-cdc914072515/disk 1073741824 {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:05:28 user nova-compute[74743]: INFO os_vif [None req-c87054a8-e7f3-404a-b0e2-c36204d3eecf tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:af:24,bridge_name='br-int',has_traffic_filtering=True,id=de102d31-a76d-4945-a89a-bdc58bf0f3a6,network=Network(4b7bc82e-3fb4-4696-827e-095227957f6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde102d31-a7')
Nov 18 17:05:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/abf14b55-522e-4497-a799-cdc914072515/disk 1073741824" returned: 0 in 0.048s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c87054a8-e7f3-404a-b0e2-c36204d3eecf tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] calling os-brick to detach iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-c87054a8-e7f3-404a-b0e2-c36204d3eecf tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, {'target_iqn': 'iqn.2010-10.org.openstack:ad14a9dc-3caf-47ea-8ef6-ef0c490d35be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bykIDmUa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:05:28 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-c87054a8-e7f3-404a-b0e2-c36204d3eecf tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:05:28 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-c87054a8-e7f3-404a-b0e2-c36204d3eecf tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-c87054a8-e7f3-404a-b0e2-c36204d3eecf tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[6380f04d-b467-4ddf-aeaf-abff8ea2b411]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ad14a9dc-3caf-47ea-8ef6-ef0c490d35be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-c87054a8-e7f3-404a-b0e2-c36204d3eecf tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 17:05:28 user nova-compute[74743]: No targets found.
Nov 18 17:05:28 user nova-compute[74743]: iSNS:
Nov 18 17:05:28 user nova-compute[74743]: No targets found.
Nov 18 17:05:28 user nova-compute[74743]: STATIC:
Nov 18 17:05:28 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:ad14a9dc-3caf-47ea-8ef6-ef0c490d35be
Nov 18 17:05:28 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:05:28 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:05:28 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc
Nov 18 17:05:28 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:05:28 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:05:28 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3
Nov 18 17:05:28 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:05:28 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:05:28 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa
Nov 18 17:05:28 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:05:28 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:05:28 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe
Nov 18 17:05:28 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:05:28 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:05:28 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8
Nov 18 17:05:28 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:05:28 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:05:28 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f
Nov 18 17:05:28 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:05:28 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:05:28 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd
Nov 18 17:05:28 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:05:28 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:05:28 user nova-compute[74743]: FIRMWARE:
Nov 18 17:05:28 user nova-compute[74743]: No targets found.
Nov 18 17:05:28 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-c87054a8-e7f3-404a-b0e2-c36204d3eecf tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 17:05:28 user nova-compute[74743]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 17:05:28 user nova-compute[74743]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74743) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-c87054a8-e7f3-404a-b0e2-c36204d3eecf tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad14a9dc-3caf-47ea-8ef6-ef0c490d35be', 0)] {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e86f69-d2ac-419a-a687-2d56e8b4906c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad14a9dc-3caf-47ea-8ef6-ef0c490d35be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f32e36e-eb82-4e61-b3fb-c3d415f9ec4e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad14a9dc-3caf-47ea-8ef6-ef0c490d35be (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-c87054a8-e7f3-404a-b0e2-c36204d3eecf tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:05:28 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:05:28 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:05:28 user nova-compute[74743]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)
Nov 18 17:05:28 user nova-compute[74743]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)
Nov 18 17:05:28 user nova-compute[74743]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)
Nov 18 17:05:28 user nova-compute[74743]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)
Nov 18 17:05:28 user nova-compute[74743]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad14a9dc-3caf-47ea-8ef6-ef0c490d35be (non-flash)
Nov 18 17:05:28 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-c87054a8-e7f3-404a-b0e2-c36204d3eecf tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:05:28 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:05:28 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:05:28 user nova-compute[74743]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)
Nov 18 17:05:28 user nova-compute[74743]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)
Nov 18 17:05:28 user nova-compute[74743]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)
Nov 18 17:05:28 user nova-compute[74743]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)
Nov 18 17:05:28 user nova-compute[74743]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad14a9dc-3caf-47ea-8ef6-ef0c490d35be (non-flash)
Nov 18 17:05:28 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-c87054a8-e7f3-404a-b0e2-c36204d3eecf tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb282984c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad14a9dc-3caf-47ea-8ef6-ef0c490d35be'): ({'sdi'}, set())}) {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-c87054a8-e7f3-404a-b0e2-c36204d3eecf tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Removing single pathed devices sdi {{(pid=74743) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48b2156-bd8c-4b75-8e38-b949c9e08f8c]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.185s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Checking if we can resize image /opt/stack/data/nova/instances/abf14b55-522e-4497-a799-cdc914072515/disk. size=1073741824 {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abf14b55-522e-4497-a799-cdc914072515/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac7778c-f47a-47bd-9cd2-c377ffb97e36]: (4, ('ok\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-c87054a8-e7f3-404a-b0e2-c36204d3eecf tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Flushing IO for device /dev/sdi {{(pid=74743) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.015s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd3a790-c8e1-4fc7-b60c-a88e62ee436a]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-c87054a8-e7f3-404a-b0e2-c36204d3eecf tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74743) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.043s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca7eee6-fa27-432e-8485-b97dbfb699cd]: (4, ('1', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-c87054a8-e7f3-404a-b0e2-c36204d3eecf tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-c87054a8-e7f3-404a-b0e2-c36204d3eecf tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] SCSI volumes sdi have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-c87054a8-e7f3-404a-b0e2-c36204d3eecf tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad14a9dc-3caf-47ea-8ef6-ef0c490d35be')] {{(pid=74743) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad14a9dc-3caf-47ea-8ef6-ef0c490d35be -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad14a9dc-3caf-47ea-8ef6-ef0c490d35be -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04d54c6-1dda-4486-8094-31fcd9d355ce]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-c87054a8-e7f3-404a-b0e2-c36204d3eecf tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:05:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad14a9dc-3caf-47ea-8ef6-ef0c490d35be -p 172.16.0.220:3260 --logout {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abf14b55-522e-4497-a799-cdc914072515/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:29 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Cannot resize image /opt/stack/data/nova/instances/abf14b55-522e-4497-a799-cdc914072515/disk to a smaller size. {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 17:05:29 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] [instance: abf14b55-522e-4497-a799-cdc914072515] Created local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 17:05:29 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] [instance: abf14b55-522e-4497-a799-cdc914072515] Ensure instance console log exists: /opt/stack/data/nova/instances/abf14b55-522e-4497-a799-cdc914072515/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:05:29 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:05:29 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:05:29 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:05:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad14a9dc-3caf-47ea-8ef6-ef0c490d35be -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:29 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c9ffe0-e27e-49f5-ad44-8e1b3f71d4bf]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:ad14a9dc-3caf-47ea-8ef6-ef0c490d35be, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:ad14a9dc-3caf-47ea-8ef6-ef0c490d35be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:29 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-c87054a8-e7f3-404a-b0e2-c36204d3eecf tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:ad14a9dc-3caf-47ea-8ef6-ef0c490d35be, portal: 172.16.0.220,3260]
Nov 18 17:05:29 user nova-compute[74743]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:ad14a9dc-3caf-47ea-8ef6-ef0c490d35be, portal: 172.16.0.220,3260] successful.
Nov 18 17:05:29 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:05:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad14a9dc-3caf-47ea-8ef6-ef0c490d35be -p 172.16.0.220:3260 --op delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad14a9dc-3caf-47ea-8ef6-ef0c490d35be -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:29 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[802eb7ae-a373-413a-8905-c8d2ccabca9b]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:29 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-c87054a8-e7f3-404a-b0e2-c36204d3eecf tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:05:29 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-c87054a8-e7f3-404a-b0e2-c36204d3eecf tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:05:29 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-c87054a8-e7f3-404a-b0e2-c36204d3eecf tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] <== disconnect_volume: return (400ms) None {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:05:29 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c87054a8-e7f3-404a-b0e2-c36204d3eecf tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Disconnected iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 17:05:29 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-c87054a8-e7f3-404a-b0e2-c36204d3eecf tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Deleting instance files /opt/stack/data/nova/instances/d30a49de-abf1-4985-8dc5-6f7f24d51d2f_del
Nov 18 17:05:29 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-c87054a8-e7f3-404a-b0e2-c36204d3eecf tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Deletion of /opt/stack/data/nova/instances/d30a49de-abf1-4985-8dc5-6f7f24d51d2f_del complete
Nov 18 17:05:29 user nova-compute[74743]: DEBUG nova.network.neutron [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] [instance: abf14b55-522e-4497-a799-cdc914072515] Successfully created port: b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:05:29 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-c87054a8-e7f3-404a-b0e2-c36204d3eecf tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74743) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 18 17:05:29 user nova-compute[74743]: INFO nova.virt.libvirt.host [None req-c87054a8-e7f3-404a-b0e2-c36204d3eecf tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] UEFI support detected
Nov 18 17:05:29 user nova-compute[74743]: INFO nova.compute.manager [None req-c87054a8-e7f3-404a-b0e2-c36204d3eecf tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Took 1.53 seconds to destroy the instance on the hypervisor.
Nov 18 17:05:29 user nova-compute[74743]: DEBUG oslo.service.loopingcall [None req-c87054a8-e7f3-404a-b0e2-c36204d3eecf tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74743) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 17:05:29 user nova-compute[74743]: DEBUG nova.compute.manager [-] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Deallocating network for instance {{(pid=74743) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 17:05:29 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] deallocate_for_instance() {{(pid=74743) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 17:05:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:29 user nova-compute[74743]: DEBUG nova.network.neutron [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] [instance: abf14b55-522e-4497-a799-cdc914072515] Successfully updated port: b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:05:29 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Acquiring lock "refresh_cache-abf14b55-522e-4497-a799-cdc914072515" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:05:29 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Acquired lock "refresh_cache-abf14b55-522e-4497-a799-cdc914072515" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:05:29 user nova-compute[74743]: DEBUG nova.network.neutron [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] [instance: abf14b55-522e-4497-a799-cdc914072515] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:05:29 user nova-compute[74743]: DEBUG nova.compute.manager [req-71069bf0-9f68-4853-81fb-a613141be2f1 req-b2b89a10-df96-4192-aa01-b127d4ac9e59 service nova] [instance: abf14b55-522e-4497-a799-cdc914072515] Received event network-changed-b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:05:29 user nova-compute[74743]: DEBUG nova.compute.manager [req-71069bf0-9f68-4853-81fb-a613141be2f1 req-b2b89a10-df96-4192-aa01-b127d4ac9e59 service nova] [instance: abf14b55-522e-4497-a799-cdc914072515] Refreshing instance network info cache due to event network-changed-b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:05:29 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-71069bf0-9f68-4853-81fb-a613141be2f1 req-b2b89a10-df96-4192-aa01-b127d4ac9e59 service nova] Acquiring lock "refresh_cache-abf14b55-522e-4497-a799-cdc914072515" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:05:29 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:05:29 user nova-compute[74743]: DEBUG nova.network.neutron [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] [instance: abf14b55-522e-4497-a799-cdc914072515] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:05:29 user nova-compute[74743]: INFO nova.compute.manager [-] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Took 0.68 seconds to deallocate network for instance.
Nov 18 17:05:30 user nova-compute[74743]: DEBUG nova.network.neutron [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] [instance: abf14b55-522e-4497-a799-cdc914072515] Updating instance_info_cache with network_info: [{"id": "b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e", "address": "fa:16:3e:0a:90:a3", "network": {"id": "a5153a19-cb61-4511-9fd6-d4a48226e4cc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e135c3aa00df41149fab95db3d88532f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d0dbbe-3d", "ovs_interfaceid": "b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:05:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Releasing lock "refresh_cache-abf14b55-522e-4497-a799-cdc914072515" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:05:30 user nova-compute[74743]: DEBUG nova.compute.manager [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] [instance: abf14b55-522e-4497-a799-cdc914072515] Instance network_info: |[{"id": "b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e", "address": "fa:16:3e:0a:90:a3", "network": {"id": "a5153a19-cb61-4511-9fd6-d4a48226e4cc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e135c3aa00df41149fab95db3d88532f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d0dbbe-3d", "ovs_interfaceid": "b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 17:05:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-71069bf0-9f68-4853-81fb-a613141be2f1 req-b2b89a10-df96-4192-aa01-b127d4ac9e59 service nova] Acquired lock "refresh_cache-abf14b55-522e-4497-a799-cdc914072515" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:05:30 user nova-compute[74743]: DEBUG nova.network.neutron [req-71069bf0-9f68-4853-81fb-a613141be2f1 req-b2b89a10-df96-4192-aa01-b127d4ac9e59 service nova] [instance: abf14b55-522e-4497-a799-cdc914072515] Refreshing network info cache for port b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:05:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] [instance: abf14b55-522e-4497-a799-cdc914072515] Start _get_guest_xml network_info=[{"id": "b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e", "address": "fa:16:3e:0a:90:a3", "network": {"id": "a5153a19-cb61-4511-9fd6-d4a48226e4cc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e135c3aa00df41149fab95db3d88532f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d0dbbe-3d", "ovs_interfaceid": "b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '9536f6cf-95c4-40e2-864a-09a91525678a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:05:30 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:05:30 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:05:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:05:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:05:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:05:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:05:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:05:30 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:05:30 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:05:30 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:05:30 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:05:30 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:05:30 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:05:30 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:05:30 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:05:30 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:05:30 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:05:30 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:05:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:05:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1511794040',display_name='tempest-VolumesNegativeTest-instance-1511794040',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1511794040',id=13,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de5e099a27494eabb547f8d5203cb0e5',ramdisk_id='',reservation_id='r-n6l3qldv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-450589239',owner_user_name='tempest-VolumesNegativeTest-450589239-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:05:28Z,user_data=None,user_id='fd7084ff003c425fa79affcde8a547ee',uuid=abf14b55-522e-4497-a799-cdc914072515,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e", "address": "fa:16:3e:0a:90:a3", "network": {"id": "a5153a19-cb61-4511-9fd6-d4a48226e4cc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e135c3aa00df41149fab95db3d88532f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d0dbbe-3d", "ovs_interfaceid": "b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:05:30 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Converting VIF {"id": "b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e", "address": "fa:16:3e:0a:90:a3", "network": {"id": "a5153a19-cb61-4511-9fd6-d4a48226e4cc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e135c3aa00df41149fab95db3d88532f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d0dbbe-3d", "ovs_interfaceid": "b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:05:30 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:90:a3,bridge_name='br-int',has_traffic_filtering=True,id=b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e,network=Network(a5153a19-cb61-4511-9fd6-d4a48226e4cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0d0dbbe-3d') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:05:30 user nova-compute[74743]: DEBUG nova.objects.instance [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Lazy-loading 'pci_devices' on Instance uuid abf14b55-522e-4497-a799-cdc914072515 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:05:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] [instance: abf14b55-522e-4497-a799-cdc914072515] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:05:30 user nova-compute[74743]:   <uuid>abf14b55-522e-4497-a799-cdc914072515</uuid>
Nov 18 17:05:30 user nova-compute[74743]:   <name>instance-0000000d</name>
Nov 18 17:05:30 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:05:30 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:05:30 user nova-compute[74743]:   <metadata>
Nov 18 17:05:30 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:05:30 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:05:30 user nova-compute[74743]:       <nova:name>tempest-VolumesNegativeTest-instance-1511794040</nova:name>
Nov 18 17:05:30 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:05:30</nova:creationTime>
Nov 18 17:05:30 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:05:30 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:05:30 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:05:30 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:05:30 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:05:30 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:05:30 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:05:30 user nova-compute[74743]:       <nova:owner>
Nov 18 17:05:30 user nova-compute[74743]:         <nova:user uuid="fd7084ff003c425fa79affcde8a547ee">tempest-VolumesNegativeTest-450589239-project-member</nova:user>
Nov 18 17:05:30 user nova-compute[74743]:         <nova:project uuid="de5e099a27494eabb547f8d5203cb0e5">tempest-VolumesNegativeTest-450589239</nova:project>
Nov 18 17:05:30 user nova-compute[74743]:       </nova:owner>
Nov 18 17:05:30 user nova-compute[74743]:       <nova:root type="image" uuid="9536f6cf-95c4-40e2-864a-09a91525678a"/>
Nov 18 17:05:30 user nova-compute[74743]:       <nova:ports>
Nov 18 17:05:30 user nova-compute[74743]:         <nova:port uuid="b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e">
Nov 18 17:05:30 user nova-compute[74743]:           <nova:ip type="fixed" address="192.168.233.12" ipVersion="4"/>
Nov 18 17:05:30 user nova-compute[74743]:         </nova:port>
Nov 18 17:05:30 user nova-compute[74743]:       </nova:ports>
Nov 18 17:05:30 user nova-compute[74743]:     </nova:instance>
Nov 18 17:05:30 user nova-compute[74743]:   </metadata>
Nov 18 17:05:30 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:05:30 user nova-compute[74743]:     <system>
Nov 18 17:05:30 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:05:30 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:05:30 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:05:30 user nova-compute[74743]:       <entry name="serial">abf14b55-522e-4497-a799-cdc914072515</entry>
Nov 18 17:05:30 user nova-compute[74743]:       <entry name="uuid">abf14b55-522e-4497-a799-cdc914072515</entry>
Nov 18 17:05:30 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:05:30 user nova-compute[74743]:     </system>
Nov 18 17:05:30 user nova-compute[74743]:   </sysinfo>
Nov 18 17:05:30 user nova-compute[74743]:   <os>
Nov 18 17:05:30 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:05:30 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:05:30 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:05:30 user nova-compute[74743]:   </os>
Nov 18 17:05:30 user nova-compute[74743]:   <features>
Nov 18 17:05:30 user nova-compute[74743]:     <acpi/>
Nov 18 17:05:30 user nova-compute[74743]:     <apic/>
Nov 18 17:05:30 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:05:30 user nova-compute[74743]:   </features>
Nov 18 17:05:30 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:05:30 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:05:30 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:05:30 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:05:30 user nova-compute[74743]:   </clock>
Nov 18 17:05:30 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:05:30 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:05:30 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:05:30 user nova-compute[74743]:   </cpu>
Nov 18 17:05:30 user nova-compute[74743]:   <devices>
Nov 18 17:05:30 user nova-compute[74743]:     <disk type="file" device="disk">
Nov 18 17:05:30 user nova-compute[74743]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 17:05:30 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/abf14b55-522e-4497-a799-cdc914072515/disk"/>
Nov 18 17:05:30 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:05:30 user nova-compute[74743]:     </disk>
Nov 18 17:05:30 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:05:30 user nova-compute[74743]:       <mac address="fa:16:3e:0a:90:a3"/>
Nov 18 17:05:30 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:05:30 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:05:30 user nova-compute[74743]:       <target dev="tapb0d0dbbe-3d"/>
Nov 18 17:05:30 user nova-compute[74743]:     </interface>
Nov 18 17:05:30 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:05:30 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/abf14b55-522e-4497-a799-cdc914072515/console.log" append="off"/>
Nov 18 17:05:30 user nova-compute[74743]:     </serial>
Nov 18 17:05:30 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:05:30 user nova-compute[74743]:     <video>
Nov 18 17:05:30 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:05:30 user nova-compute[74743]:     </video>
Nov 18 17:05:30 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:05:30 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:05:30 user nova-compute[74743]:     </rng>
Nov 18 17:05:30 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:05:30 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:05:30 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:05:30 user nova-compute[74743]:     </memballoon>
Nov 18 17:05:30 user nova-compute[74743]:   </devices>
Nov 18 17:05:30 user nova-compute[74743]: </domain>
Nov 18 17:05:30 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:05:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:05:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1511794040',display_name='tempest-VolumesNegativeTest-instance-1511794040',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1511794040',id=13,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de5e099a27494eabb547f8d5203cb0e5',ramdisk_id='',reservation_id='r-n6l3qldv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-450589239',owner_user_name='tempest-VolumesNegativeTest-450589239-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:05:28Z,user_data=None,user_id='fd7084ff003c425fa79affcde8a547ee',uuid=abf14b55-522e-4497-a799-cdc914072515,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e", "address": "fa:16:3e:0a:90:a3", "network": {"id": "a5153a19-cb61-4511-9fd6-d4a48226e4cc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e135c3aa00df41149fab95db3d88532f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d0dbbe-3d", "ovs_interfaceid": "b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:05:30 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Converting VIF {"id": "b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e", "address": "fa:16:3e:0a:90:a3", "network": {"id": "a5153a19-cb61-4511-9fd6-d4a48226e4cc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e135c3aa00df41149fab95db3d88532f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d0dbbe-3d", "ovs_interfaceid": "b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:05:30 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:90:a3,bridge_name='br-int',has_traffic_filtering=True,id=b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e,network=Network(a5153a19-cb61-4511-9fd6-d4a48226e4cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0d0dbbe-3d') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:05:30 user nova-compute[74743]: DEBUG os_vif [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:90:a3,bridge_name='br-int',has_traffic_filtering=True,id=b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e,network=Network(a5153a19-cb61-4511-9fd6-d4a48226e4cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0d0dbbe-3d') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:05:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:05:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:05:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7f1ec991-ad50-5386-aa5d-f400b22455e8', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:05:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:05:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb0d0dbbe-3d, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:05:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb0d0dbbe-3d, col_values=(('qos', UUID('0c403a38-74b7-42d4-8078-7f71d6746955')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:05:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb0d0dbbe-3d, col_values=(('external_ids', {'iface-id': 'b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:90:a3', 'vm-uuid': 'abf14b55-522e-4497-a799-cdc914072515'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:05:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:05:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:30 user nova-compute[74743]: INFO os_vif [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:90:a3,bridge_name='br-int',has_traffic_filtering=True,id=b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e,network=Network(a5153a19-cb61-4511-9fd6-d4a48226e4cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0d0dbbe-3d')
Nov 18 17:05:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:05:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] No VIF found with MAC fa:16:3e:0a:90:a3, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:05:30 user nova-compute[74743]: DEBUG nova.compute.manager [req-6fe6fafe-007e-462f-bd93-7009c39bfa57 req-3fcf5d7d-983e-45f0-8c39-e4580e2ce2d5 service nova] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Received event network-vif-deleted-de102d31-a76d-4945-a89a-bdc58bf0f3a6 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:05:30 user nova-compute[74743]: DEBUG nova.network.neutron [req-71069bf0-9f68-4853-81fb-a613141be2f1 req-b2b89a10-df96-4192-aa01-b127d4ac9e59 service nova] [instance: abf14b55-522e-4497-a799-cdc914072515] Updated VIF entry in instance network info cache for port b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:05:30 user nova-compute[74743]: DEBUG nova.network.neutron [req-71069bf0-9f68-4853-81fb-a613141be2f1 req-b2b89a10-df96-4192-aa01-b127d4ac9e59 service nova] [instance: abf14b55-522e-4497-a799-cdc914072515] Updating instance_info_cache with network_info: [{"id": "b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e", "address": "fa:16:3e:0a:90:a3", "network": {"id": "a5153a19-cb61-4511-9fd6-d4a48226e4cc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e135c3aa00df41149fab95db3d88532f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d0dbbe-3d", "ovs_interfaceid": "b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:05:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-71069bf0-9f68-4853-81fb-a613141be2f1 req-b2b89a10-df96-4192-aa01-b127d4ac9e59 service nova] Releasing lock "refresh_cache-abf14b55-522e-4497-a799-cdc914072515" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:05:30 user nova-compute[74743]: DEBUG nova.compute.manager [req-149a6c68-504c-46f7-aa86-1d0207eb3b3f req-1a50d796-1e6f-45f5-a8da-ffd30c16d023 service nova] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Received event network-changed-3fecf596-29c4-44af-bbe1-25589e8aa794 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:05:30 user nova-compute[74743]: DEBUG nova.compute.manager [req-149a6c68-504c-46f7-aa86-1d0207eb3b3f req-1a50d796-1e6f-45f5-a8da-ffd30c16d023 service nova] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Refreshing instance network info cache due to event network-changed-3fecf596-29c4-44af-bbe1-25589e8aa794. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:05:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-149a6c68-504c-46f7-aa86-1d0207eb3b3f req-1a50d796-1e6f-45f5-a8da-ffd30c16d023 service nova] Acquiring lock "refresh_cache-55192f7b-5aaf-42e6-926a-cf9f43e460ca" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:05:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-149a6c68-504c-46f7-aa86-1d0207eb3b3f req-1a50d796-1e6f-45f5-a8da-ffd30c16d023 service nova] Acquired lock "refresh_cache-55192f7b-5aaf-42e6-926a-cf9f43e460ca" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:05:30 user nova-compute[74743]: DEBUG nova.network.neutron [req-149a6c68-504c-46f7-aa86-1d0207eb3b3f req-1a50d796-1e6f-45f5-a8da-ffd30c16d023 service nova] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Refreshing network info cache for port 3fecf596-29c4-44af-bbe1-25589e8aa794 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:05:30 user nova-compute[74743]: INFO nova.compute.manager [None req-c87054a8-e7f3-404a-b0e2-c36204d3eecf tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] [instance: d30a49de-abf1-4985-8dc5-6f7f24d51d2f] Took 0.86 seconds to detach 1 volumes for instance.
Nov 18 17:05:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-c87054a8-e7f3-404a-b0e2-c36204d3eecf tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:05:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-c87054a8-e7f3-404a-b0e2-c36204d3eecf tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:05:31 user nova-compute[74743]: DEBUG nova.network.neutron [req-149a6c68-504c-46f7-aa86-1d0207eb3b3f req-1a50d796-1e6f-45f5-a8da-ffd30c16d023 service nova] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Updated VIF entry in instance network info cache for port 3fecf596-29c4-44af-bbe1-25589e8aa794. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:05:31 user nova-compute[74743]: DEBUG nova.network.neutron [req-149a6c68-504c-46f7-aa86-1d0207eb3b3f req-1a50d796-1e6f-45f5-a8da-ffd30c16d023 service nova] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Updating instance_info_cache with network_info: [{"id": "3fecf596-29c4-44af-bbe1-25589e8aa794", "address": "fa:16:3e:1c:10:2b", "network": {"id": "7537df91-4e59-4569-88de-6dbbd9d5a4e4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1983739170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c967f66b058543878a89b86b4791d5fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fecf596-29", "ovs_interfaceid": "3fecf596-29c4-44af-bbe1-25589e8aa794", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:05:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-149a6c68-504c-46f7-aa86-1d0207eb3b3f req-1a50d796-1e6f-45f5-a8da-ffd30c16d023 service nova] Releasing lock "refresh_cache-55192f7b-5aaf-42e6-926a-cf9f43e460ca" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:05:31 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-c87054a8-e7f3-404a-b0e2-c36204d3eecf tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:05:31 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-c87054a8-e7f3-404a-b0e2-c36204d3eecf tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:05:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-c87054a8-e7f3-404a-b0e2-c36204d3eecf tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.727s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:05:31 user nova-compute[74743]: INFO nova.scheduler.client.report [None req-c87054a8-e7f3-404a-b0e2-c36204d3eecf tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Deleted allocations for instance d30a49de-abf1-4985-8dc5-6f7f24d51d2f
Nov 18 17:05:31 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-c87054a8-e7f3-404a-b0e2-c36204d3eecf tempest-DeleteServersTestJSON-65485011 tempest-DeleteServersTestJSON-65485011-project-member] Lock "d30a49de-abf1-4985-8dc5-6f7f24d51d2f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.032s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:05:31 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:32 user nova-compute[74743]: DEBUG nova.compute.manager [req-40dff4d4-7e51-445d-8069-c6c430c23c19 req-a475636e-d2e4-4a06-a3f4-e4b00ae8f7b1 service nova] [instance: abf14b55-522e-4497-a799-cdc914072515] Received event network-vif-plugged-b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:05:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-40dff4d4-7e51-445d-8069-c6c430c23c19 req-a475636e-d2e4-4a06-a3f4-e4b00ae8f7b1 service nova] Acquiring lock "abf14b55-522e-4497-a799-cdc914072515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:05:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-40dff4d4-7e51-445d-8069-c6c430c23c19 req-a475636e-d2e4-4a06-a3f4-e4b00ae8f7b1 service nova] Lock "abf14b55-522e-4497-a799-cdc914072515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:05:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-40dff4d4-7e51-445d-8069-c6c430c23c19 req-a475636e-d2e4-4a06-a3f4-e4b00ae8f7b1 service nova] Lock "abf14b55-522e-4497-a799-cdc914072515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:05:32 user nova-compute[74743]: DEBUG nova.compute.manager [req-40dff4d4-7e51-445d-8069-c6c430c23c19 req-a475636e-d2e4-4a06-a3f4-e4b00ae8f7b1 service nova] [instance: abf14b55-522e-4497-a799-cdc914072515] No waiting events found dispatching network-vif-plugged-b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:05:32 user nova-compute[74743]: WARNING nova.compute.manager [req-40dff4d4-7e51-445d-8069-c6c430c23c19 req-a475636e-d2e4-4a06-a3f4-e4b00ae8f7b1 service nova] [instance: abf14b55-522e-4497-a799-cdc914072515] Received unexpected event network-vif-plugged-b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e for instance with vm_state building and task_state spawning.
Nov 18 17:05:32 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:32 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:32 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:32 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f183e497-22f2-4ddc-ac01-2d95c355b771 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Acquiring lock "55192f7b-5aaf-42e6-926a-cf9f43e460ca" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:05:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f183e497-22f2-4ddc-ac01-2d95c355b771 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Lock "55192f7b-5aaf-42e6-926a-cf9f43e460ca" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:05:33 user nova-compute[74743]: DEBUG nova.objects.instance [None req-f183e497-22f2-4ddc-ac01-2d95c355b771 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Lazy-loading 'flavor' on Instance uuid 55192f7b-5aaf-42e6-926a-cf9f43e460ca {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:05:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f183e497-22f2-4ddc-ac01-2d95c355b771 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Lock "55192f7b-5aaf-42e6-926a-cf9f43e460ca" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:05:34 user nova-compute[74743]: DEBUG nova.compute.manager [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] [instance: abf14b55-522e-4497-a799-cdc914072515] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:05:34 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] [instance: abf14b55-522e-4497-a799-cdc914072515] Guest created on hypervisor {{(pid=74743) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 17:05:34 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: abf14b55-522e-4497-a799-cdc914072515] Instance spawned successfully.
Nov 18 17:05:34 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] [instance: abf14b55-522e-4497-a799-cdc914072515] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 17:05:34 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] [instance: abf14b55-522e-4497-a799-cdc914072515] Found default for hw_cdrom_bus of ide {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:05:34 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] [instance: abf14b55-522e-4497-a799-cdc914072515] Found default for hw_disk_bus of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:05:34 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] [instance: abf14b55-522e-4497-a799-cdc914072515] Found default for hw_input_bus of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:05:34 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] [instance: abf14b55-522e-4497-a799-cdc914072515] Found default for hw_pointer_model of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:05:34 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] [instance: abf14b55-522e-4497-a799-cdc914072515] Found default for hw_video_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:05:34 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] [instance: abf14b55-522e-4497-a799-cdc914072515] Found default for hw_vif_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:05:34 user nova-compute[74743]: INFO nova.compute.manager [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] [instance: abf14b55-522e-4497-a799-cdc914072515] Took 6.00 seconds to spawn the instance on the hypervisor.
Nov 18 17:05:34 user nova-compute[74743]: DEBUG nova.compute.manager [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] [instance: abf14b55-522e-4497-a799-cdc914072515] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:05:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f183e497-22f2-4ddc-ac01-2d95c355b771 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Acquiring lock "55192f7b-5aaf-42e6-926a-cf9f43e460ca" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:05:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f183e497-22f2-4ddc-ac01-2d95c355b771 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Lock "55192f7b-5aaf-42e6-926a-cf9f43e460ca" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:05:34 user nova-compute[74743]: INFO nova.compute.manager [None req-f183e497-22f2-4ddc-ac01-2d95c355b771 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Attaching volume 77f318e2-b968-4220-9506-0a121a1e68e5 to /dev/vdb
Nov 18 17:05:34 user nova-compute[74743]: DEBUG nova.compute.manager [req-cb71dc9a-494a-4f81-887c-0c6b1e875677 req-36a59217-d002-469e-b6a8-b3b45073ecd2 service nova] [instance: abf14b55-522e-4497-a799-cdc914072515] Received event network-vif-plugged-b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:05:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-cb71dc9a-494a-4f81-887c-0c6b1e875677 req-36a59217-d002-469e-b6a8-b3b45073ecd2 service nova] Acquiring lock "abf14b55-522e-4497-a799-cdc914072515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:05:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-cb71dc9a-494a-4f81-887c-0c6b1e875677 req-36a59217-d002-469e-b6a8-b3b45073ecd2 service nova] Lock "abf14b55-522e-4497-a799-cdc914072515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:05:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-cb71dc9a-494a-4f81-887c-0c6b1e875677 req-36a59217-d002-469e-b6a8-b3b45073ecd2 service nova] Lock "abf14b55-522e-4497-a799-cdc914072515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:05:34 user nova-compute[74743]: DEBUG nova.compute.manager [req-cb71dc9a-494a-4f81-887c-0c6b1e875677 req-36a59217-d002-469e-b6a8-b3b45073ecd2 service nova] [instance: abf14b55-522e-4497-a799-cdc914072515] No waiting events found dispatching network-vif-plugged-b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:05:34 user nova-compute[74743]: WARNING nova.compute.manager [req-cb71dc9a-494a-4f81-887c-0c6b1e875677 req-36a59217-d002-469e-b6a8-b3b45073ecd2 service nova] [instance: abf14b55-522e-4497-a799-cdc914072515] Received unexpected event network-vif-plugged-b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e for instance with vm_state building and task_state spawning.
Nov 18 17:05:34 user nova-compute[74743]: DEBUG os_brick.utils [None req-f183e497-22f2-4ddc-ac01-2d95c355b771 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:05:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:34 user nova-compute[74743]: INFO nova.compute.manager [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] [instance: abf14b55-522e-4497-a799-cdc914072515] Took 7.50 seconds to build instance.
Nov 18 17:05:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:34 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[feffb89f-f863-4e89-909d-c9616d35733e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1116acd8874d\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:34 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e53dece-1347-48ab-9e92-9d3ecfc1bc3d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-80ded1f6-ba3b-440e-bc52-96021a4612e4 tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Lock "abf14b55-522e-4497-a799-cdc914072515" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.680s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:05:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:34 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df0fd30-d90d-4ffd-bffb-0f997efe560a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:34 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f994d67-95bf-49d9-9fb7-a9d7c7343fc0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-f183e497-22f2-4ddc-ac01-2d95c355b771 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Running cmd (subprocess): nvme version {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-f183e497-22f2-4ddc-ac01-2d95c355b771 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] 'nvme version' failed. Not Retrying. {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:05:34 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f183e497-22f2-4ddc-ac01-2d95c355b771 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] nvme not present on system {{(pid=74743) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 17:05:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:05:34 user nova-compute[74743]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 17:05:34 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4bd6f0-ce1f-431d-a0ba-0ba77b5ec086]: (4, '') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:34 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-f183e497-22f2-4ddc-ac01-2d95c355b771 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74743) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 17:05:34 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-f183e497-22f2-4ddc-ac01-2d95c355b771 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 17:05:34 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-f183e497-22f2-4ddc-ac01-2d95c355b771 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] LIGHTOS: no hostnqn found. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 17:05:34 user nova-compute[74743]: DEBUG os_brick.utils [None req-f183e497-22f2-4ddc-ac01-2d95c355b771 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1116acd8874d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:05:34 user nova-compute[74743]: DEBUG nova.virt.block_device [None req-f183e497-22f2-4ddc-ac01-2d95c355b771 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Updating existing volume attachment record: 450682cb-0f4e-4076-962a-2f05c9da6040 {{(pid=74743) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 17:05:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:35 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:38 user nova-compute[74743]: DEBUG nova.compute.manager [req-3d813cee-8249-4c61-bb79-cd1a41040d8a req-01720e09-5f0a-4e97-a5a2-d974924c16f4 service nova] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Received event network-changed-3b8c6ca6-189a-44fc-b8d5-d8ae5c501188 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:05:38 user nova-compute[74743]: DEBUG nova.compute.manager [req-3d813cee-8249-4c61-bb79-cd1a41040d8a req-01720e09-5f0a-4e97-a5a2-d974924c16f4 service nova] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Refreshing instance network info cache due to event network-changed-3b8c6ca6-189a-44fc-b8d5-d8ae5c501188. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:05:38 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3d813cee-8249-4c61-bb79-cd1a41040d8a req-01720e09-5f0a-4e97-a5a2-d974924c16f4 service nova] Acquiring lock "refresh_cache-8e6111e9-59e9-4a30-870c-3d308a5d4936" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:05:38 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3d813cee-8249-4c61-bb79-cd1a41040d8a req-01720e09-5f0a-4e97-a5a2-d974924c16f4 service nova] Acquired lock "refresh_cache-8e6111e9-59e9-4a30-870c-3d308a5d4936" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:05:38 user nova-compute[74743]: DEBUG nova.network.neutron [req-3d813cee-8249-4c61-bb79-cd1a41040d8a req-01720e09-5f0a-4e97-a5a2-d974924c16f4 service nova] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Refreshing network info cache for port 3b8c6ca6-189a-44fc-b8d5-d8ae5c501188 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:05:38 user nova-compute[74743]: DEBUG nova.network.neutron [req-3d813cee-8249-4c61-bb79-cd1a41040d8a req-01720e09-5f0a-4e97-a5a2-d974924c16f4 service nova] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Updated VIF entry in instance network info cache for port 3b8c6ca6-189a-44fc-b8d5-d8ae5c501188. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:05:38 user nova-compute[74743]: DEBUG nova.network.neutron [req-3d813cee-8249-4c61-bb79-cd1a41040d8a req-01720e09-5f0a-4e97-a5a2-d974924c16f4 service nova] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Updating instance_info_cache with network_info: [{"id": "3b8c6ca6-189a-44fc-b8d5-d8ae5c501188", "address": "fa:16:3e:8c:b5:bb", "network": {"id": "cf1ba269-6100-4ad9-88bb-9693137fd478", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1280411595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16de5043b38d4b3f8b1eccc4fed18acb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b8c6ca6-18", "ovs_interfaceid": "3b8c6ca6-189a-44fc-b8d5-d8ae5c501188", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:05:38 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3d813cee-8249-4c61-bb79-cd1a41040d8a req-01720e09-5f0a-4e97-a5a2-d974924c16f4 service nova] Releasing lock "refresh_cache-8e6111e9-59e9-4a30-870c-3d308a5d4936" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:05:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f183e497-22f2-4ddc-ac01-2d95c355b771 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Calling os-brick to attach iSCSI Volume {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-f183e497-22f2-4ddc-ac01-2d95c355b771 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pYilrUnB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:05:40 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-f183e497-22f2-4ddc-ac01-2d95c355b771 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:05:40 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-f183e497-22f2-4ddc-ac01-2d95c355b771 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-f183e497-22f2-4ddc-ac01-2d95c355b771 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:05:40 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-f183e497-22f2-4ddc-ac01-2d95c355b771 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:05:40 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-f183e497-22f2-4ddc-ac01-2d95c355b771 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-f183e497-22f2-4ddc-ac01-2d95c355b771 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:05:40 user nova-compute[74743]: INFO os_brick.initiator.connectors.iscsi [None req-f183e497-22f2-4ddc-ac01-2d95c355b771 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 17:05:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 -p 172.16.0.220:3260 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c525d2-4b43-4d16-9f99-b846cc5ae78e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-f183e497-22f2-4ddc-ac01-2d95c355b771 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 17:05:40 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0b4313-3bba-4ef2-82b8-45559a4d75f3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5] added\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-f183e497-22f2-4ddc-ac01-2d95c355b771 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5] added
Nov 18 17:05:40 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[420f3be6-efd7-458b-a488-decfa9ac65a2]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-f183e497-22f2-4ddc-ac01-2d95c355b771 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d491e44d-cc67-4f17-8c5a-c6b92c11863c]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-f183e497-22f2-4ddc-ac01-2d95c355b771 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pYilrUnB {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pYilrUnB" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[29defeb0-6697-47ad-b3c3-e5faf2a4155d]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-f183e497-22f2-4ddc-ac01-2d95c355b771 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pYilrUnB'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1482e96-80bb-435d-abf3-0bf564c59965]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-f183e497-22f2-4ddc-ac01-2d95c355b771 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[179670bf-bd7b-4083-adb0-f476fb202c09]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-f183e497-22f2-4ddc-ac01-2d95c355b771 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:05:40 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:05:40 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:05:40 user nova-compute[74743]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)
Nov 18 17:05:40 user nova-compute[74743]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)
Nov 18 17:05:40 user nova-compute[74743]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)
Nov 18 17:05:40 user nova-compute[74743]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)
Nov 18 17:05:40 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-f183e497-22f2-4ddc-ac01-2d95c355b771 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:05:40 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:05:40 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:05:40 user nova-compute[74743]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)
Nov 18 17:05:40 user nova-compute[74743]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)
Nov 18 17:05:40 user nova-compute[74743]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)
Nov 18 17:05:40 user nova-compute[74743]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)
Nov 18 17:05:40 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 -p 172.16.0.220:3260 --login {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[899f3798-8f2e-43d6-a3aa-374d2863bf6d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-f183e497-22f2-4ddc-ac01-2d95c355b771 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5, portal: 172.16.0.220,3260]
Nov 18 17:05:40 user nova-compute[74743]: Login to [iface: default, target: iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5, portal: 172.16.0.220,3260] successful.
Nov 18 17:05:40 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c8e97a-8925-4838-a30e-0d0893d3a63f]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-f183e497-22f2-4ddc-ac01-2d95c355b771 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5491765-9166-415a-8f9f-6f6bedfd02c8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-f183e497-22f2-4ddc-ac01-2d95c355b771 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 (non-flash)
Nov 18 17:05:40 user nova-compute[74743]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:05:40 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:05:40 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:05:40 user nova-compute[74743]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)
Nov 18 17:05:40 user nova-compute[74743]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)
Nov 18 17:05:40 user nova-compute[74743]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)
Nov 18 17:05:40 user nova-compute[74743]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)
Nov 18 17:05:40 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-f183e497-22f2-4ddc-ac01-2d95c355b771 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 (non-flash)
Nov 18 17:05:40 user nova-compute[74743]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:05:40 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:05:40 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:05:40 user nova-compute[74743]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)
Nov 18 17:05:40 user nova-compute[74743]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)
Nov 18 17:05:40 user nova-compute[74743]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)
Nov 18 17:05:40 user nova-compute[74743]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)
Nov 18 17:05:40 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-f183e497-22f2-4ddc-ac01-2d95c355b771 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-f183e497-22f2-4ddc-ac01-2d95c355b771 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Connected to 172.16.0.220:3260 {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-f183e497-22f2-4ddc-ac01-2d95c355b771 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=74743) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-f183e497-22f2-4ddc-ac01-2d95c355b771 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=74743) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df2f94b-6ff2-4364-8bfa-618eb1236526]: (4, ('- - 0', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-f183e497-22f2-4ddc-ac01-2d95c355b771 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-f183e497-22f2-4ddc-ac01-2d95c355b771 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pYilrUnB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-54fc8da2-c0bb-4ac3-9eeb-389545276c75 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Acquiring lock "8e6111e9-59e9-4a30-870c-3d308a5d4936" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-54fc8da2-c0bb-4ac3-9eeb-389545276c75 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Lock "8e6111e9-59e9-4a30-870c-3d308a5d4936" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG nova.objects.instance [None req-54fc8da2-c0bb-4ac3-9eeb-389545276c75 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Lazy-loading 'flavor' on Instance uuid 8e6111e9-59e9-4a30-870c-3d308a5d4936 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:05:40 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-54fc8da2-c0bb-4ac3-9eeb-389545276c75 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Lock "8e6111e9-59e9-4a30-870c-3d308a5d4936" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:05:41 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-54fc8da2-c0bb-4ac3-9eeb-389545276c75 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Acquiring lock "8e6111e9-59e9-4a30-870c-3d308a5d4936" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:05:41 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-54fc8da2-c0bb-4ac3-9eeb-389545276c75 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Lock "8e6111e9-59e9-4a30-870c-3d308a5d4936" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:05:41 user nova-compute[74743]: INFO nova.compute.manager [None req-54fc8da2-c0bb-4ac3-9eeb-389545276c75 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Attaching volume b63ebb65-371d-4d00-91c6-4e3cf0dcd074 to /dev/sdc
Nov 18 17:05:41 user nova-compute[74743]: DEBUG os_brick.utils [None req-54fc8da2-c0bb-4ac3-9eeb-389545276c75 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:05:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:41 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0955eab8-df99-4e8d-aaae-96d9e23c9b6a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1116acd8874d\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:41 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52c8f79-609f-4f9c-b329-a897f142abac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:41 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e6f2fe-543f-461e-8e84-4cf970bff269]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:41 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e3581a-af14-4e7c-a684-210cfae4e831]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-54fc8da2-c0bb-4ac3-9eeb-389545276c75 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Running cmd (subprocess): nvme version {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-54fc8da2-c0bb-4ac3-9eeb-389545276c75 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] 'nvme version' failed. Not Retrying. {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:05:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.nvmeof [None req-54fc8da2-c0bb-4ac3-9eeb-389545276c75 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] nvme not present on system {{(pid=74743) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 17:05:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:05:41 user nova-compute[74743]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 17:05:41 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29a5950-4c5d-4472-8020-f8d867d4f811]: (4, '') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-54fc8da2-c0bb-4ac3-9eeb-389545276c75 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74743) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 17:05:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-54fc8da2-c0bb-4ac3-9eeb-389545276c75 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 17:05:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-54fc8da2-c0bb-4ac3-9eeb-389545276c75 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] LIGHTOS: no hostnqn found. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 17:05:41 user nova-compute[74743]: DEBUG os_brick.utils [None req-54fc8da2-c0bb-4ac3-9eeb-389545276c75 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1116acd8874d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:05:41 user nova-compute[74743]: DEBUG nova.virt.block_device [None req-54fc8da2-c0bb-4ac3-9eeb-389545276c75 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Updating existing volume attachment record: cd79e3ae-43bc-4ad4-a8c5-cf18b9a102be {{(pid=74743) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 17:05:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-f183e497-22f2-4ddc-ac01-2d95c355b771 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:05:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-f183e497-22f2-4ddc-ac01-2d95c355b771 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '23835353730343662', 'path': '/dev/sdi'} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:05:41 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f183e497-22f2-4ddc-ac01-2d95c355b771 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835353730343662', 'path': '/dev/sdi'} {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 17:05:41 user nova-compute[74743]: DEBUG nova.objects.instance [None req-f183e497-22f2-4ddc-ac01-2d95c355b771 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Lazy-loading 'flavor' on Instance uuid 55192f7b-5aaf-42e6-926a-cf9f43e460ca {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:05:41 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-f183e497-22f2-4ddc-ac01-2d95c355b771 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 17:05:41 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:05:41 user nova-compute[74743]:   <source dev="/dev/sdi"/>
Nov 18 17:05:41 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:05:41 user nova-compute[74743]:   <serial>77f318e2-b968-4220-9506-0a121a1e68e5</serial>
Nov 18 17:05:41 user nova-compute[74743]: </disk>
Nov 18 17:05:41 user nova-compute[74743]:  {{(pid=74743) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 17:05:42 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-f183e497-22f2-4ddc-ac01-2d95c355b771 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:05:42 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-f183e497-22f2-4ddc-ac01-2d95c355b771 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:05:42 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-f183e497-22f2-4ddc-ac01-2d95c355b771 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] No VIF found with MAC fa:16:3e:1c:10:2b, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:05:42 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f183e497-22f2-4ddc-ac01-2d95c355b771 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Lock "55192f7b-5aaf-42e6-926a-cf9f43e460ca" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.304s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:05:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-36f6992c-4926-425a-ac05-f38d0c045997 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Acquiring lock "55192f7b-5aaf-42e6-926a-cf9f43e460ca" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:05:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-36f6992c-4926-425a-ac05-f38d0c045997 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Lock "55192f7b-5aaf-42e6-926a-cf9f43e460ca" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:05:43 user nova-compute[74743]: INFO nova.compute.manager [None req-36f6992c-4926-425a-ac05-f38d0c045997 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Detaching volume 77f318e2-b968-4220-9506-0a121a1e68e5
Nov 18 17:05:43 user nova-compute[74743]: INFO nova.virt.block_device [None req-36f6992c-4926-425a-ac05-f38d0c045997 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Attempting to driver detach volume 77f318e2-b968-4220-9506-0a121a1e68e5 from mountpoint /dev/vdb
Nov 18 17:05:43 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-36f6992c-4926-425a-ac05-f38d0c045997 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Attempting to detach device vdb from instance 55192f7b-5aaf-42e6-926a-cf9f43e460ca from the persistent domain config. {{(pid=74743) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 17:05:43 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-36f6992c-4926-425a-ac05-f38d0c045997 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 17:05:43 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:05:43 user nova-compute[74743]:   <source dev="/dev/sdi"/>
Nov 18 17:05:43 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:05:43 user nova-compute[74743]:   <serial>77f318e2-b968-4220-9506-0a121a1e68e5</serial>
Nov 18 17:05:43 user nova-compute[74743]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 17:05:43 user nova-compute[74743]: </disk>
Nov 18 17:05:43 user nova-compute[74743]:  {{(pid=74743) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 17:05:43 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-36f6992c-4926-425a-ac05-f38d0c045997 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Successfully detached device vdb from instance 55192f7b-5aaf-42e6-926a-cf9f43e460ca from the persistent domain config.
Nov 18 17:05:43 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-36f6992c-4926-425a-ac05-f38d0c045997 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 55192f7b-5aaf-42e6-926a-cf9f43e460ca from the live domain config. {{(pid=74743) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 17:05:43 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-36f6992c-4926-425a-ac05-f38d0c045997 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 17:05:43 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:05:43 user nova-compute[74743]:   <source dev="/dev/sdi"/>
Nov 18 17:05:43 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:05:43 user nova-compute[74743]:   <serial>77f318e2-b968-4220-9506-0a121a1e68e5</serial>
Nov 18 17:05:43 user nova-compute[74743]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 17:05:43 user nova-compute[74743]: </disk>
Nov 18 17:05:43 user nova-compute[74743]:  {{(pid=74743) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 17:05:44 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-36f6992c-4926-425a-ac05-f38d0c045997 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 55192f7b-5aaf-42e6-926a-cf9f43e460ca {{(pid=74743) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 17:05:44 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:44 user nova-compute[74743]: DEBUG nova.compute.manager [req-de6ae60d-67ba-4c0c-848d-f74dcc8aee32 req-73ed6890-a326-4014-ad6c-978c3a1c7790 service nova] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Received event network-changed-8b4ff8a1-a6e9-45bc-bea0-ea343801011d {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:05:44 user nova-compute[74743]: DEBUG nova.compute.manager [req-de6ae60d-67ba-4c0c-848d-f74dcc8aee32 req-73ed6890-a326-4014-ad6c-978c3a1c7790 service nova] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Refreshing instance network info cache due to event network-changed-8b4ff8a1-a6e9-45bc-bea0-ea343801011d. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:05:44 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-de6ae60d-67ba-4c0c-848d-f74dcc8aee32 req-73ed6890-a326-4014-ad6c-978c3a1c7790 service nova] Acquiring lock "refresh_cache-567feb03-a356-4347-b146-d8930ad60c11" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:05:44 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-de6ae60d-67ba-4c0c-848d-f74dcc8aee32 req-73ed6890-a326-4014-ad6c-978c3a1c7790 service nova] Acquired lock "refresh_cache-567feb03-a356-4347-b146-d8930ad60c11" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:05:44 user nova-compute[74743]: DEBUG nova.network.neutron [req-de6ae60d-67ba-4c0c-848d-f74dcc8aee32 req-73ed6890-a326-4014-ad6c-978c3a1c7790 service nova] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Refreshing network info cache for port 8b4ff8a1-a6e9-45bc-bea0-ea343801011d {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:05:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-5e31f7a5-e9c6-4ab8-b097-ae408ddf5e18 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Acquiring lock "567feb03-a356-4347-b146-d8930ad60c11" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:05:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-5e31f7a5-e9c6-4ab8-b097-ae408ddf5e18 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Lock "567feb03-a356-4347-b146-d8930ad60c11" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:05:45 user nova-compute[74743]: DEBUG nova.objects.instance [None req-5e31f7a5-e9c6-4ab8-b097-ae408ddf5e18 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Lazy-loading 'flavor' on Instance uuid 567feb03-a356-4347-b146-d8930ad60c11 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:05:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-5e31f7a5-e9c6-4ab8-b097-ae408ddf5e18 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Lock "567feb03-a356-4347-b146-d8930ad60c11" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:05:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-5e31f7a5-e9c6-4ab8-b097-ae408ddf5e18 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Acquiring lock "567feb03-a356-4347-b146-d8930ad60c11" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:05:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-5e31f7a5-e9c6-4ab8-b097-ae408ddf5e18 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Lock "567feb03-a356-4347-b146-d8930ad60c11" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:05:45 user nova-compute[74743]: INFO nova.compute.manager [None req-5e31f7a5-e9c6-4ab8-b097-ae408ddf5e18 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Attaching volume 03db838c-5e3c-4ff0-a374-b0540da43f83 to /dev/vdb
Nov 18 17:05:45 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:45 user nova-compute[74743]: DEBUG os_brick.utils [None req-5e31f7a5-e9c6-4ab8-b097-ae408ddf5e18 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:05:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:45 user nova-compute[74743]: DEBUG nova.network.neutron [req-de6ae60d-67ba-4c0c-848d-f74dcc8aee32 req-73ed6890-a326-4014-ad6c-978c3a1c7790 service nova] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Updated VIF entry in instance network info cache for port 8b4ff8a1-a6e9-45bc-bea0-ea343801011d. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:05:45 user nova-compute[74743]: DEBUG nova.network.neutron [req-de6ae60d-67ba-4c0c-848d-f74dcc8aee32 req-73ed6890-a326-4014-ad6c-978c3a1c7790 service nova] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Updating instance_info_cache with network_info: [{"id": "8b4ff8a1-a6e9-45bc-bea0-ea343801011d", "address": "fa:16:3e:b3:b4:6a", "network": {"id": "0db4e9a5-ebe1-4af2-a7a4-25ae3a070a1a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-868857269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "944d66befe2a46dc85d3c3aded3495f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4ff8a1-a6", "ovs_interfaceid": "8b4ff8a1-a6e9-45bc-bea0-ea343801011d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:05:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:45 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[be962bea-0aba-47fe-afd5-f68d5353ee6f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1116acd8874d\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-de6ae60d-67ba-4c0c-848d-f74dcc8aee32 req-73ed6890-a326-4014-ad6c-978c3a1c7790 service nova] Releasing lock "refresh_cache-567feb03-a356-4347-b146-d8930ad60c11" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:05:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:45 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0692677-19ef-456e-a797-93cd9265e534]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:45 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f90860f-68b7-4947-affd-d24c0cec53a2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:45 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[386fa1d5-f5a5-4fc5-ab99-9d6f2b5613bf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-5e31f7a5-e9c6-4ab8-b097-ae408ddf5e18 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Running cmd (subprocess): nvme version {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-5e31f7a5-e9c6-4ab8-b097-ae408ddf5e18 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] 'nvme version' failed. Not Retrying. {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:05:45 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5e31f7a5-e9c6-4ab8-b097-ae408ddf5e18 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] nvme not present on system {{(pid=74743) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 17:05:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:05:45 user nova-compute[74743]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 17:05:45 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7d50e4-a7f2-4c15-988f-5bf2159516c5]: (4, '') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:45 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-5e31f7a5-e9c6-4ab8-b097-ae408ddf5e18 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74743) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 17:05:45 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-5e31f7a5-e9c6-4ab8-b097-ae408ddf5e18 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 17:05:45 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-5e31f7a5-e9c6-4ab8-b097-ae408ddf5e18 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] LIGHTOS: no hostnqn found. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 17:05:45 user nova-compute[74743]: DEBUG os_brick.utils [None req-5e31f7a5-e9c6-4ab8-b097-ae408ddf5e18 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1116acd8874d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:05:45 user nova-compute[74743]: DEBUG nova.virt.block_device [None req-5e31f7a5-e9c6-4ab8-b097-ae408ddf5e18 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Updating existing volume attachment record: b6a36a0a-79c8-4743-9388-705e7ebf7ab0 {{(pid=74743) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 17:05:47 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54fc8da2-c0bb-4ac3-9eeb-389545276c75 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Calling os-brick to attach iSCSI Volume {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 17:05:47 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-54fc8da2-c0bb-4ac3-9eeb-389545276c75 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NnZJlURY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:05:47 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-54fc8da2-c0bb-4ac3-9eeb-389545276c75 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:05:47 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-54fc8da2-c0bb-4ac3-9eeb-389545276c75 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:05:47 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-54fc8da2-c0bb-4ac3-9eeb-389545276c75 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:05:47 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-54fc8da2-c0bb-4ac3-9eeb-389545276c75 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:05:47 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-54fc8da2-c0bb-4ac3-9eeb-389545276c75 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:05:47 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-54fc8da2-c0bb-4ac3-9eeb-389545276c75 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:05:47 user nova-compute[74743]: INFO os_brick.initiator.connectors.iscsi [None req-54fc8da2-c0bb-4ac3-9eeb-389545276c75 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 17:05:47 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 -p 172.16.0.220:3260 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:47 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:47 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[329cfff5-8b04-41e7-965c-d3b4cebff044]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:47 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-54fc8da2-c0bb-4ac3-9eeb-389545276c75 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 17:05:47 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:05:47 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 -p 172.16.0.220:3260 --interface default --op new {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:47 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:47 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32b642c-6dc4-4b43-a18d-598fe29113b6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074] added\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:47 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-54fc8da2-c0bb-4ac3-9eeb-389545276c75 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074] added
Nov 18 17:05:47 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:05:47 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:47 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:47 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[2155b5ae-1cfc-450f-8f31-e1667e3065ec]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:47 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-54fc8da2-c0bb-4ac3-9eeb-389545276c75 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:05:47 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:47 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:47 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f44e20-35c9-45de-a91d-1ba8a7d977cb]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:47 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-54fc8da2-c0bb-4ac3-9eeb-389545276c75 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:05:47 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NnZJlURY {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:47 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NnZJlURY" returned: 0 in 0.023s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:47 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[407ee7af-4164-4e0a-9cdd-421209477d0b]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:47 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-54fc8da2-c0bb-4ac3-9eeb-389545276c75 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NnZJlURY'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:05:47 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:47 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:47 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[1517b2e2-e725-4022-9660-03906ecd0774]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:47 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-54fc8da2-c0bb-4ac3-9eeb-389545276c75 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:05:47 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:47 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:47 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[5417a329-04ae-4b40-b612-3e71692d448a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:47 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-54fc8da2-c0bb-4ac3-9eeb-389545276c75 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 (non-flash)
Nov 18 17:05:47 user nova-compute[74743]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:05:47 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:05:47 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:05:47 user nova-compute[74743]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)
Nov 18 17:05:47 user nova-compute[74743]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)
Nov 18 17:05:47 user nova-compute[74743]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)
Nov 18 17:05:47 user nova-compute[74743]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)
Nov 18 17:05:47 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:05:47 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-54fc8da2-c0bb-4ac3-9eeb-389545276c75 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 (non-flash)
Nov 18 17:05:47 user nova-compute[74743]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:05:47 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:05:47 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:05:47 user nova-compute[74743]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)
Nov 18 17:05:47 user nova-compute[74743]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)
Nov 18 17:05:47 user nova-compute[74743]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)
Nov 18 17:05:47 user nova-compute[74743]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)
Nov 18 17:05:47 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:05:47 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 -p 172.16.0.220:3260 --login {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:47 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:47 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[47430a14-9ed4-40b1-9014-775e92beb82f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:47 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-54fc8da2-c0bb-4ac3-9eeb-389545276c75 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074, portal: 172.16.0.220,3260]
Nov 18 17:05:47 user nova-compute[74743]: Login to [iface: default, target: iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074, portal: 172.16.0.220,3260] successful.
Nov 18 17:05:47 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:05:47 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:47 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:47 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[f374a4b3-66df-477d-b19f-50f17d40c706]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:47 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-54fc8da2-c0bb-4ac3-9eeb-389545276c75 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:05:47 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:48 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed667bd-3766-47d4-b1af-f10ea94f56c0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:48 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-54fc8da2-c0bb-4ac3-9eeb-389545276c75 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 (non-flash)
Nov 18 17:05:48 user nova-compute[74743]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 (non-flash)
Nov 18 17:05:48 user nova-compute[74743]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:05:48 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:05:48 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:05:48 user nova-compute[74743]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)
Nov 18 17:05:48 user nova-compute[74743]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)
Nov 18 17:05:48 user nova-compute[74743]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)
Nov 18 17:05:48 user nova-compute[74743]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)
Nov 18 17:05:48 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:05:48 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-54fc8da2-c0bb-4ac3-9eeb-389545276c75 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 (non-flash)
Nov 18 17:05:48 user nova-compute[74743]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 (non-flash)
Nov 18 17:05:48 user nova-compute[74743]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:05:48 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:05:48 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:05:48 user nova-compute[74743]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)
Nov 18 17:05:48 user nova-compute[74743]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)
Nov 18 17:05:48 user nova-compute[74743]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)
Nov 18 17:05:48 user nova-compute[74743]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)
Nov 18 17:05:48 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:05:48 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-54fc8da2-c0bb-4ac3-9eeb-389545276c75 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.356s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:05:48 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-54fc8da2-c0bb-4ac3-9eeb-389545276c75 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Connected to 172.16.0.220:3260 {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 17:05:48 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-54fc8da2-c0bb-4ac3-9eeb-389545276c75 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=74743) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 17:05:48 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-54fc8da2-c0bb-4ac3-9eeb-389545276c75 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=74743) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 17:05:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.047s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:48 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f184838-8496-4e19-85f4-fbd1622e9842]: (4, ('- - 0', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:48 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-54fc8da2-c0bb-4ac3-9eeb-389545276c75 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:05:48 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-54fc8da2-c0bb-4ac3-9eeb-389545276c75 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NnZJlURY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 17:05:49 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-54fc8da2-c0bb-4ac3-9eeb-389545276c75 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.432s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:05:49 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-54fc8da2-c0bb-4ac3-9eeb-389545276c75 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] <== connect_volume: return (1434ms) {'type': 'block', 'scsi_wwn': '23035643765383534', 'path': '/dev/sdj'} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:05:49 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54fc8da2-c0bb-4ac3-9eeb-389545276c75 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035643765383534', 'path': '/dev/sdj'} {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 17:05:49 user nova-compute[74743]: DEBUG nova.objects.instance [None req-54fc8da2-c0bb-4ac3-9eeb-389545276c75 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Lazy-loading 'flavor' on Instance uuid 8e6111e9-59e9-4a30-870c-3d308a5d4936 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:05:49 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-54fc8da2-c0bb-4ac3-9eeb-389545276c75 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 17:05:49 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:05:49 user nova-compute[74743]:   <source dev="/dev/sdj"/>
Nov 18 17:05:49 user nova-compute[74743]:   <target dev="sdc" bus="scsi"/>
Nov 18 17:05:49 user nova-compute[74743]:   <serial>b63ebb65-371d-4d00-91c6-4e3cf0dcd074</serial>
Nov 18 17:05:49 user nova-compute[74743]:   <address type="drive" controller="0" unit="2"/>
Nov 18 17:05:49 user nova-compute[74743]: </disk>
Nov 18 17:05:49 user nova-compute[74743]:  {{(pid=74743) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 17:05:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:49 user nova-compute[74743]: DEBUG nova.compute.manager [req-812ac422-db91-4635-8752-68ec930e680c req-6065f6a6-98fa-4b0f-b8ae-2ae863f93d11 service nova] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Received event network-changed-9abd882a-72d9-46b9-9dc0-8bdd727125b2 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:05:49 user nova-compute[74743]: DEBUG nova.compute.manager [req-812ac422-db91-4635-8752-68ec930e680c req-6065f6a6-98fa-4b0f-b8ae-2ae863f93d11 service nova] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Refreshing instance network info cache due to event network-changed-9abd882a-72d9-46b9-9dc0-8bdd727125b2. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:05:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-812ac422-db91-4635-8752-68ec930e680c req-6065f6a6-98fa-4b0f-b8ae-2ae863f93d11 service nova] Acquiring lock "refresh_cache-fc4cdeb6-51ff-4090-a29d-d4f6105e15f3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:05:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-812ac422-db91-4635-8752-68ec930e680c req-6065f6a6-98fa-4b0f-b8ae-2ae863f93d11 service nova] Acquired lock "refresh_cache-fc4cdeb6-51ff-4090-a29d-d4f6105e15f3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:05:49 user nova-compute[74743]: DEBUG nova.network.neutron [req-812ac422-db91-4635-8752-68ec930e680c req-6065f6a6-98fa-4b0f-b8ae-2ae863f93d11 service nova] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Refreshing network info cache for port 9abd882a-72d9-46b9-9dc0-8bdd727125b2 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:05:49 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-54fc8da2-c0bb-4ac3-9eeb-389545276c75 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] No BDM found with device name sda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:05:49 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-54fc8da2-c0bb-4ac3-9eeb-389545276c75 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:05:49 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-54fc8da2-c0bb-4ac3-9eeb-389545276c75 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:05:49 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-54fc8da2-c0bb-4ac3-9eeb-389545276c75 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] No VIF found with MAC fa:16:3e:8c:b5:bb, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:05:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-54fc8da2-c0bb-4ac3-9eeb-389545276c75 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Lock "8e6111e9-59e9-4a30-870c-3d308a5d4936" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.628s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:05:50 user nova-compute[74743]: DEBUG nova.network.neutron [req-812ac422-db91-4635-8752-68ec930e680c req-6065f6a6-98fa-4b0f-b8ae-2ae863f93d11 service nova] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Updated VIF entry in instance network info cache for port 9abd882a-72d9-46b9-9dc0-8bdd727125b2. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:05:50 user nova-compute[74743]: DEBUG nova.network.neutron [req-812ac422-db91-4635-8752-68ec930e680c req-6065f6a6-98fa-4b0f-b8ae-2ae863f93d11 service nova] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Updating instance_info_cache with network_info: [{"id": "9abd882a-72d9-46b9-9dc0-8bdd727125b2", "address": "fa:16:3e:b0:f7:a6", "network": {"id": "b9dd5bf0-7dcc-4428-8496-f77a6e0ddbef", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-386192241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba340b1c9b03442ca58b2fef8ec6d60d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9abd882a-72", "ovs_interfaceid": "9abd882a-72d9-46b9-9dc0-8bdd727125b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:05:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-812ac422-db91-4635-8752-68ec930e680c req-6065f6a6-98fa-4b0f-b8ae-2ae863f93d11 service nova] Releasing lock "refresh_cache-fc4cdeb6-51ff-4090-a29d-d4f6105e15f3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:05:50 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:50 user nova-compute[74743]: INFO nova.compute.manager [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Rebuilding instance
Nov 18 17:05:50 user nova-compute[74743]: DEBUG nova.compute.manager [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:05:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cbdc3761-36af-4824-b435-85dcca760fb6 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] Acquiring lock "e2a7ff40-310e-481f-8459-cde1034a0fbd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:05:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cbdc3761-36af-4824-b435-85dcca760fb6 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] Lock "e2a7ff40-310e-481f-8459-cde1034a0fbd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:05:50 user nova-compute[74743]: DEBUG nova.objects.instance [None req-cbdc3761-36af-4824-b435-85dcca760fb6 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] Lazy-loading 'flavor' on Instance uuid e2a7ff40-310e-481f-8459-cde1034a0fbd {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cbdc3761-36af-4824-b435-85dcca760fb6 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] Lock "e2a7ff40-310e-481f-8459-cde1034a0fbd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.097s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cbdc3761-36af-4824-b435-85dcca760fb6 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] Acquiring lock "e2a7ff40-310e-481f-8459-cde1034a0fbd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cbdc3761-36af-4824-b435-85dcca760fb6 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] Lock "e2a7ff40-310e-481f-8459-cde1034a0fbd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:05:51 user nova-compute[74743]: INFO nova.compute.manager [None req-cbdc3761-36af-4824-b435-85dcca760fb6 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Attaching volume 5480db9f-0880-49cc-9188-6b47977561a9 to /dev/vdb
Nov 18 17:05:51 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7122a91e-dc20-4f95-abfe-028bb4c5f20e tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Acquiring lock "8e6111e9-59e9-4a30-870c-3d308a5d4936" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7122a91e-dc20-4f95-abfe-028bb4c5f20e tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Lock "8e6111e9-59e9-4a30-870c-3d308a5d4936" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG os_brick.utils [None req-cbdc3761-36af-4824-b435-85dcca760fb6 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:51 user nova-compute[74743]: INFO nova.compute.manager [None req-7122a91e-dc20-4f95-abfe-028bb4c5f20e tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Detaching volume b63ebb65-371d-4d00-91c6-4e3cf0dcd074
Nov 18 17:05:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c51510-77be-4eb3-9a46-527e882f70a9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1116acd8874d\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[828ce8b3-9002-4bd9-a4d5-04e9a90b6a29]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e751e10-69ef-447b-be97-1d16e93c7ab3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[586c4cdd-219d-4b55-9a8c-f2bb0d8c8be0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cbdc3761-36af-4824-b435-85dcca760fb6 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] Running cmd (subprocess): nvme version {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cbdc3761-36af-4824-b435-85dcca760fb6 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:05:51 user nova-compute[74743]: INFO nova.virt.block_device [None req-7122a91e-dc20-4f95-abfe-028bb4c5f20e tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Attempting to driver detach volume b63ebb65-371d-4d00-91c6-4e3cf0dcd074 from mountpoint /dev/sdc
Nov 18 17:05:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cbdc3761-36af-4824-b435-85dcca760fb6 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] nvme not present on system {{(pid=74743) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG nova.compute.manager [req-7b0fbea9-5fbf-4708-8f51-11341e9f7fd0 req-8d1bd6ab-7581-4bb4-863b-cd0500937035 service nova] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Received event network-vif-unplugged-9abd882a-72d9-46b9-9dc0-8bdd727125b2 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-7b0fbea9-5fbf-4708-8f51-11341e9f7fd0 req-8d1bd6ab-7581-4bb4-863b-cd0500937035 service nova] Acquiring lock "fc4cdeb6-51ff-4090-a29d-d4f6105e15f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-7b0fbea9-5fbf-4708-8f51-11341e9f7fd0 req-8d1bd6ab-7581-4bb4-863b-cd0500937035 service nova] Lock "fc4cdeb6-51ff-4090-a29d-d4f6105e15f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-7b0fbea9-5fbf-4708-8f51-11341e9f7fd0 req-8d1bd6ab-7581-4bb4-863b-cd0500937035 service nova] Lock "fc4cdeb6-51ff-4090-a29d-d4f6105e15f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG nova.compute.manager [req-7b0fbea9-5fbf-4708-8f51-11341e9f7fd0 req-8d1bd6ab-7581-4bb4-863b-cd0500937035 service nova] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] No waiting events found dispatching network-vif-unplugged-9abd882a-72d9-46b9-9dc0-8bdd727125b2 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:05:51 user nova-compute[74743]: WARNING nova.compute.manager [req-7b0fbea9-5fbf-4708-8f51-11341e9f7fd0 req-8d1bd6ab-7581-4bb4-863b-cd0500937035 service nova] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Received unexpected event network-vif-unplugged-9abd882a-72d9-46b9-9dc0-8bdd727125b2 for instance with vm_state active and task_state rebuilding.
Nov 18 17:05:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:05:51 user nova-compute[74743]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 17:05:51 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95be1b4-ce61-4ee2-9402-82dd8eb03f6a]: (4, '') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-cbdc3761-36af-4824-b435-85dcca760fb6 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74743) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-cbdc3761-36af-4824-b435-85dcca760fb6 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-cbdc3761-36af-4824-b435-85dcca760fb6 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] LIGHTOS: no hostnqn found. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG os_brick.utils [None req-cbdc3761-36af-4824-b435-85dcca760fb6 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1116acd8874d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG nova.virt.block_device [None req-cbdc3761-36af-4824-b435-85dcca760fb6 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Updating existing volume attachment record: 18b29648-cc33-49b8-bd66-34a03048c80a {{(pid=74743) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-7122a91e-dc20-4f95-abfe-028bb4c5f20e tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Attempting to detach device sdc from instance 8e6111e9-59e9-4a30-870c-3d308a5d4936 from the persistent domain config. {{(pid=74743) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-7122a91e-dc20-4f95-abfe-028bb4c5f20e tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 17:05:51 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:05:51 user nova-compute[74743]:   <source dev="/dev/sdj"/>
Nov 18 17:05:51 user nova-compute[74743]:   <target dev="sdc" bus="scsi"/>
Nov 18 17:05:51 user nova-compute[74743]:   <serial>b63ebb65-371d-4d00-91c6-4e3cf0dcd074</serial>
Nov 18 17:05:51 user nova-compute[74743]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 18 17:05:51 user nova-compute[74743]: </disk>
Nov 18 17:05:51 user nova-compute[74743]:  {{(pid=74743) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 17:05:51 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-7122a91e-dc20-4f95-abfe-028bb4c5f20e tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Successfully detached device sdc from instance 8e6111e9-59e9-4a30-870c-3d308a5d4936 from the persistent domain config.
Nov 18 17:05:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-7122a91e-dc20-4f95-abfe-028bb4c5f20e tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 8e6111e9-59e9-4a30-870c-3d308a5d4936 from the live domain config. {{(pid=74743) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-7122a91e-dc20-4f95-abfe-028bb4c5f20e tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 17:05:51 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:05:51 user nova-compute[74743]:   <source dev="/dev/sdj"/>
Nov 18 17:05:51 user nova-compute[74743]:   <target dev="sdc" bus="scsi"/>
Nov 18 17:05:51 user nova-compute[74743]:   <serial>b63ebb65-371d-4d00-91c6-4e3cf0dcd074</serial>
Nov 18 17:05:51 user nova-compute[74743]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 18 17:05:51 user nova-compute[74743]: </disk>
Nov 18 17:05:51 user nova-compute[74743]:  {{(pid=74743) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e31f7a5-e9c6-4ab8-b097-ae408ddf5e18 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Calling os-brick to attach iSCSI Volume {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e31f7a5-e9c6-4ab8-b097-ae408ddf5e18 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ClPUfcSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:05:51 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-5e31f7a5-e9c6-4ab8-b097-ae408ddf5e18 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:05:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-5e31f7a5-e9c6-4ab8-b097-ae408ddf5e18 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-5e31f7a5-e9c6-4ab8-b097-ae408ddf5e18 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:05:51 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-5e31f7a5-e9c6-4ab8-b097-ae408ddf5e18 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:05:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-5e31f7a5-e9c6-4ab8-b097-ae408ddf5e18 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-5e31f7a5-e9c6-4ab8-b097-ae408ddf5e18 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:05:51 user nova-compute[74743]: INFO os_brick.initiator.connectors.iscsi [None req-5e31f7a5-e9c6-4ab8-b097-ae408ddf5e18 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 17:05:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 -p 172.16.0.220:3260 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a28b25-f66b-4081-ba31-4b9de09b5852]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e31f7a5-e9c6-4ab8-b097-ae408ddf5e18 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 17:05:51 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 -p 172.16.0.220:3260 --interface default --op new {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG nova.compute.manager [req-ceddd7d5-dbfa-4fed-9d64-d732b37fe07b req-bf4a6968-d8ac-4e83-b594-8256bcb62249 service nova] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Received event network-changed-9c7850d5-314e-4854-bbc1-b4e08037abd1 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG nova.compute.manager [req-ceddd7d5-dbfa-4fed-9d64-d732b37fe07b req-bf4a6968-d8ac-4e83-b594-8256bcb62249 service nova] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Refreshing instance network info cache due to event network-changed-9c7850d5-314e-4854-bbc1-b4e08037abd1. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ceddd7d5-dbfa-4fed-9d64-d732b37fe07b req-bf4a6968-d8ac-4e83-b594-8256bcb62249 service nova] Acquiring lock "refresh_cache-e2a7ff40-310e-481f-8459-cde1034a0fbd" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ceddd7d5-dbfa-4fed-9d64-d732b37fe07b req-bf4a6968-d8ac-4e83-b594-8256bcb62249 service nova] Acquired lock "refresh_cache-e2a7ff40-310e-481f-8459-cde1034a0fbd" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG nova.network.neutron [req-ceddd7d5-dbfa-4fed-9d64-d732b37fe07b req-bf4a6968-d8ac-4e83-b594-8256bcb62249 service nova] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Refreshing network info cache for port 9c7850d5-314e-4854-bbc1-b4e08037abd1 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[943623b9-8bec-4b62-9020-4b92fae6cc63]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83] added\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e31f7a5-e9c6-4ab8-b097-ae408ddf5e18 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83] added
Nov 18 17:05:51 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5ef6b6-5aff-4d06-91c4-3f0779d34e0a]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e31f7a5-e9c6-4ab8-b097-ae408ddf5e18 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e7e92c-ebb6-49f7-8198-1652b7cf2d73]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e31f7a5-e9c6-4ab8-b097-ae408ddf5e18 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ClPUfcSH {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ClPUfcSH" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aecf38a-4b8c-4502-99e0-bee89ce85991]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e31f7a5-e9c6-4ab8-b097-ae408ddf5e18 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ClPUfcSH'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf26496a-7276-450f-82d6-8a0558c37eee]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e31f7a5-e9c6-4ab8-b097-ae408ddf5e18 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6656262-10c9-449f-8b16-d5e3588bcd38]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e31f7a5-e9c6-4ab8-b097-ae408ddf5e18 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 (non-flash)
Nov 18 17:05:51 user nova-compute[74743]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 (non-flash)
Nov 18 17:05:51 user nova-compute[74743]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:05:51 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:05:51 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:05:51 user nova-compute[74743]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)
Nov 18 17:05:51 user nova-compute[74743]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)
Nov 18 17:05:51 user nova-compute[74743]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)
Nov 18 17:05:51 user nova-compute[74743]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)
Nov 18 17:05:51 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e31f7a5-e9c6-4ab8-b097-ae408ddf5e18 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 (non-flash)
Nov 18 17:05:51 user nova-compute[74743]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 (non-flash)
Nov 18 17:05:51 user nova-compute[74743]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:05:51 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:05:51 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:05:51 user nova-compute[74743]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)
Nov 18 17:05:51 user nova-compute[74743]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)
Nov 18 17:05:51 user nova-compute[74743]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)
Nov 18 17:05:51 user nova-compute[74743]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)
Nov 18 17:05:51 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 -p 172.16.0.220:3260 --login {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 -p 172.16.0.220:3260 --login" returned: 0 in 0.126s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[cede1d4a-57aa-4682-bb39-c6bb86eadb6c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e31f7a5-e9c6-4ab8-b097-ae408ddf5e18 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83, portal: 172.16.0.220,3260]
Nov 18 17:05:51 user nova-compute[74743]: Login to [iface: default, target: iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83, portal: 172.16.0.220,3260] successful.
Nov 18 17:05:51 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:05:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:52 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0767a1-ddbd-440d-8882-ea4a6150fa20]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:52 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e31f7a5-e9c6-4ab8-b097-ae408ddf5e18 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:05:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:52 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d30bb7-0ba4-4346-a44e-05292c815546]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:52 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e31f7a5-e9c6-4ab8-b097-ae408ddf5e18 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 (non-flash)
Nov 18 17:05:52 user nova-compute[74743]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 (non-flash)
Nov 18 17:05:52 user nova-compute[74743]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 (non-flash)
Nov 18 17:05:52 user nova-compute[74743]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:05:52 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:05:52 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:05:52 user nova-compute[74743]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)
Nov 18 17:05:52 user nova-compute[74743]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)
Nov 18 17:05:52 user nova-compute[74743]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)
Nov 18 17:05:52 user nova-compute[74743]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)
Nov 18 17:05:52 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:05:52 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e31f7a5-e9c6-4ab8-b097-ae408ddf5e18 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 (non-flash)
Nov 18 17:05:52 user nova-compute[74743]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 (non-flash)
Nov 18 17:05:52 user nova-compute[74743]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 (non-flash)
Nov 18 17:05:52 user nova-compute[74743]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:05:52 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:05:52 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:05:52 user nova-compute[74743]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)
Nov 18 17:05:52 user nova-compute[74743]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)
Nov 18 17:05:52 user nova-compute[74743]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)
Nov 18 17:05:52 user nova-compute[74743]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)
Nov 18 17:05:52 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:05:52 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-5e31f7a5-e9c6-4ab8-b097-ae408ddf5e18 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.407s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:05:52 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e31f7a5-e9c6-4ab8-b097-ae408ddf5e18 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Connected to 172.16.0.220:3260 {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 17:05:52 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-5e31f7a5-e9c6-4ab8-b097-ae408ddf5e18 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] HCTL ('42', '-', '-', 0) found on session 12 with lun 0 {{(pid=74743) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 17:05:52 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-5e31f7a5-e9c6-4ab8-b097-ae408ddf5e18 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=74743) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 17:05:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:52 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66d41f6-eee6-4542-8e6f-add80176384d]: (4, ('- - 0', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:52 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-5e31f7a5-e9c6-4ab8-b097-ae408ddf5e18 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Searching for a device in session 12 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:05:52 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e31f7a5-e9c6-4ab8-b097-ae408ddf5e18 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ClPUfcSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 17:05:52 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-7122a91e-dc20-4f95-abfe-028bb4c5f20e tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 8e6111e9-59e9-4a30-870c-3d308a5d4936 {{(pid=74743) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 17:05:52 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Instance destroyed successfully.
Nov 18 17:05:52 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Instance destroyed successfully.
Nov 18 17:05:52 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:03:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1230106308',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-249778714',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM28SzHspmmwqm/7BfauIk9VldwafpsWIykch7gczsKSmKWidDt9xX54sYh31kKA3ijdAH08ekJdERVxFWwJ5PxDpqwRxmcm6s/pJQsbUZ4m6+AK3rHMz90lQEaJaoFkvQ==',key_name='tempest-keypair-2066506709',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:04:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ba340b1c9b03442ca58b2fef8ec6d60d',ramdisk_id='',reservation_id='r-9w700wic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-507265829',owner_user_name='tempest-ServerActionsV293TestJSON-507265829-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:05:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c39539fc6bbd40628ff16ddd50054661',uuid=fc4cdeb6-51ff-4090-a29d-d4f6105e15f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9abd882a-72d9-46b9-9dc0-8bdd727125b2", "address": "fa:16:3e:b0:f7:a6", "network": {"id": "b9dd5bf0-7dcc-4428-8496-f77a6e0ddbef", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-386192241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba340b1c9b03442ca58b2fef8ec6d60d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9abd882a-72", "ovs_interfaceid": "9abd882a-72d9-46b9-9dc0-8bdd727125b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:05:52 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Converting VIF {"id": "9abd882a-72d9-46b9-9dc0-8bdd727125b2", "address": "fa:16:3e:b0:f7:a6", "network": {"id": "b9dd5bf0-7dcc-4428-8496-f77a6e0ddbef", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-386192241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba340b1c9b03442ca58b2fef8ec6d60d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9abd882a-72", "ovs_interfaceid": "9abd882a-72d9-46b9-9dc0-8bdd727125b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:05:52 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:f7:a6,bridge_name='br-int',has_traffic_filtering=True,id=9abd882a-72d9-46b9-9dc0-8bdd727125b2,network=Network(b9dd5bf0-7dcc-4428-8496-f77a6e0ddbef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9abd882a-72') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:05:52 user nova-compute[74743]: DEBUG os_vif [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:f7:a6,bridge_name='br-int',has_traffic_filtering=True,id=9abd882a-72d9-46b9-9dc0-8bdd727125b2,network=Network(b9dd5bf0-7dcc-4428-8496-f77a6e0ddbef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9abd882a-72') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:05:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9abd882a-72, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:05:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:05:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=479c80b0-aab4-4aaf-b86a-f2cd8320cd32) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:05:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:52 user nova-compute[74743]: INFO os_vif [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:f7:a6,bridge_name='br-int',has_traffic_filtering=True,id=9abd882a-72d9-46b9-9dc0-8bdd727125b2,network=Network(b9dd5bf0-7dcc-4428-8496-f77a6e0ddbef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9abd882a-72')
Nov 18 17:05:52 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] calling os-brick to detach iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 17:05:52 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, {'target_iqn': 'iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KPiubrlw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:05:52 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 18 17:05:52 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:05:52 user nova-compute[74743]: DEBUG nova.network.neutron [req-ceddd7d5-dbfa-4fed-9d64-d732b37fe07b req-bf4a6968-d8ac-4e83-b594-8256bcb62249 service nova] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Updated VIF entry in instance network info cache for port 9c7850d5-314e-4854-bbc1-b4e08037abd1. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:05:52 user nova-compute[74743]: DEBUG nova.network.neutron [req-ceddd7d5-dbfa-4fed-9d64-d732b37fe07b req-bf4a6968-d8ac-4e83-b594-8256bcb62249 service nova] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Updating instance_info_cache with network_info: [{"id": "9c7850d5-314e-4854-bbc1-b4e08037abd1", "address": "fa:16:3e:05:50:5c", "network": {"id": "55694218-7eff-4083-b98f-0604e4ac3c20", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-34716983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7771c1adef144c06bc2635a551bf1c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c7850d5-31", "ovs_interfaceid": "9c7850d5-314e-4854-bbc1-b4e08037abd1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:05:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ceddd7d5-dbfa-4fed-9d64-d732b37fe07b req-bf4a6968-d8ac-4e83-b594-8256bcb62249 service nova] Releasing lock "refresh_cache-e2a7ff40-310e-481f-8459-cde1034a0fbd" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-5e31f7a5-e9c6-4ab8-b097-ae408ddf5e18 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.455s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e31f7a5-e9c6-4ab8-b097-ae408ddf5e18 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] <== connect_volume: return (1456ms) {'type': 'block', 'scsi_wwn': '26332626538373364', 'path': '/dev/sdk'} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e31f7a5-e9c6-4ab8-b097-ae408ddf5e18 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332626538373364', 'path': '/dev/sdk'} {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.930s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG nova.objects.instance [None req-5e31f7a5-e9c6-4ab8-b097-ae408ddf5e18 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Lazy-loading 'flavor' on Instance uuid 567feb03-a356-4347-b146-d8930ad60c11 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2a2495-cb18-46b1-9fa6-ad99b7ae1b45]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 17:05:53 user nova-compute[74743]: No targets found.
Nov 18 17:05:53 user nova-compute[74743]: iSNS:
Nov 18 17:05:53 user nova-compute[74743]: No targets found.
Nov 18 17:05:53 user nova-compute[74743]: STATIC:
Nov 18 17:05:53 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc
Nov 18 17:05:53 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:05:53 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:05:53 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3
Nov 18 17:05:53 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:05:53 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:05:53 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074
Nov 18 17:05:53 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:05:53 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:05:53 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa
Nov 18 17:05:53 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:05:53 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:05:53 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe
Nov 18 17:05:53 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:05:53 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:05:53 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8
Nov 18 17:05:53 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:05:53 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:05:53 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5
Nov 18 17:05:53 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:05:53 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:05:53 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f
Nov 18 17:05:53 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:05:53 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:05:53 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83
Nov 18 17:05:53 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:05:53 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:05:53 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd
Nov 18 17:05:53 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:05:53 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:05:53 user nova-compute[74743]: FIRMWARE:
Nov 18 17:05:53 user nova-compute[74743]: No targets found.
Nov 18 17:05:53 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 17:05:53 user nova-compute[74743]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 17:05:53 user nova-compute[74743]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74743) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8', 0)] {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c87145e-c363-44db-aad8-2bc8032e9f02]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-5e31f7a5-e9c6-4ab8-b097-ae408ddf5e18 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 17:05:53 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:05:53 user nova-compute[74743]:   <source dev="/dev/sdk"/>
Nov 18 17:05:53 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:05:53 user nova-compute[74743]:   <serial>03db838c-5e3c-4ff0-a374-b0540da43f83</serial>
Nov 18 17:05:53 user nova-compute[74743]: </disk>
Nov 18 17:05:53 user nova-compute[74743]:  {{(pid=74743) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba58f54d-33b7-4087-8638-1a47a868a1fa]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 (non-flash)
Nov 18 17:05:53 user nova-compute[74743]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 (non-flash)
Nov 18 17:05:53 user nova-compute[74743]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 (non-flash)
Nov 18 17:05:53 user nova-compute[74743]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:05:53 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:05:53 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:05:53 user nova-compute[74743]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)
Nov 18 17:05:53 user nova-compute[74743]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)
Nov 18 17:05:53 user nova-compute[74743]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)
Nov 18 17:05:53 user nova-compute[74743]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)
Nov 18 17:05:53 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 (non-flash)
Nov 18 17:05:53 user nova-compute[74743]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 (non-flash)
Nov 18 17:05:53 user nova-compute[74743]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 (non-flash)
Nov 18 17:05:53 user nova-compute[74743]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:05:53 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:05:53 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:05:53 user nova-compute[74743]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)
Nov 18 17:05:53 user nova-compute[74743]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)
Nov 18 17:05:53 user nova-compute[74743]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)
Nov 18 17:05:53 user nova-compute[74743]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)
Nov 18 17:05:53 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb2858ff40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8'): ({'sdb'}, set())}) {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Removing single pathed devices sdb {{(pid=74743) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd4b62e-eee1-4853-b79e-cc448ed849af]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ffae16-9e78-4d19-8a30-2b0e69d2f259]: (4, ('ok\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Flushing IO for device /dev/sdb {{(pid=74743) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee016f02-4a84-40af-abcd-3e7768802ad0]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74743) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48003de-3060-4d1e-ba2c-243045afd32f]: (4, ('1', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] SCSI volumes sdb have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8')] {{(pid=74743) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b1ff33-497c-418f-b6d7-7139085f7aa4]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 -p 172.16.0.220:3260 --logout {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b184d5e-a882-49bd-a28e-d9aa18a1c949]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8, portal: 172.16.0.220,3260]
Nov 18 17:05:53 user nova-compute[74743]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8, portal: 172.16.0.220,3260] successful.
Nov 18 17:05:53 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 -p 172.16.0.220:3260 --op delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3059b53-bc78-4ceb-b7e2-a22fdced5fc0]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] <== disconnect_volume: return (1307ms) None {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Disconnected iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 17:05:53 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Deleting instance files /opt/stack/data/nova/instances/fc4cdeb6-51ff-4090-a29d-d4f6105e15f3_del
Nov 18 17:05:53 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Deletion of /opt/stack/data/nova/instances/fc4cdeb6-51ff-4090-a29d-d4f6105e15f3_del complete
Nov 18 17:05:53 user nova-compute[74743]: DEBUG nova.compute.manager [req-2025ec68-11e9-49be-8f21-9bbdc772c248 req-b97bf8a4-049a-41b7-ae91-ba224903c168 service nova] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Received event network-vif-plugged-9abd882a-72d9-46b9-9dc0-8bdd727125b2 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-2025ec68-11e9-49be-8f21-9bbdc772c248 req-b97bf8a4-049a-41b7-ae91-ba224903c168 service nova] Acquiring lock "fc4cdeb6-51ff-4090-a29d-d4f6105e15f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-2025ec68-11e9-49be-8f21-9bbdc772c248 req-b97bf8a4-049a-41b7-ae91-ba224903c168 service nova] Lock "fc4cdeb6-51ff-4090-a29d-d4f6105e15f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-2025ec68-11e9-49be-8f21-9bbdc772c248 req-b97bf8a4-049a-41b7-ae91-ba224903c168 service nova] Lock "fc4cdeb6-51ff-4090-a29d-d4f6105e15f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG nova.compute.manager [req-2025ec68-11e9-49be-8f21-9bbdc772c248 req-b97bf8a4-049a-41b7-ae91-ba224903c168 service nova] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] No waiting events found dispatching network-vif-plugged-9abd882a-72d9-46b9-9dc0-8bdd727125b2 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:05:53 user nova-compute[74743]: WARNING nova.compute.manager [req-2025ec68-11e9-49be-8f21-9bbdc772c248 req-b97bf8a4-049a-41b7-ae91-ba224903c168 service nova] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Received unexpected event network-vif-plugged-9abd882a-72d9-46b9-9dc0-8bdd727125b2 for instance with vm_state active and task_state rebuilding.
Nov 18 17:05:53 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-5e31f7a5-e9c6-4ab8-b097-ae408ddf5e18 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-5e31f7a5-e9c6-4ab8-b097-ae408ddf5e18 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-5e31f7a5-e9c6-4ab8-b097-ae408ddf5e18 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] No VIF found with MAC fa:16:3e:b3:b4:6a, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:05:53 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance fc4cdeb6-51ff-4090-a29d-d4f6105e15f3 could not be found.
Nov 18 17:05:53 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] calling os-brick to detach iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, {'target_iqn': 'iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KPiubrlw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:05:53 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 18 17:05:53 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9ead2f-eb8c-46fb-8c8f-4739fd396b66]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 17:05:53 user nova-compute[74743]: No targets found.
Nov 18 17:05:53 user nova-compute[74743]: iSNS:
Nov 18 17:05:53 user nova-compute[74743]: No targets found.
Nov 18 17:05:53 user nova-compute[74743]: STATIC:
Nov 18 17:05:53 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc
Nov 18 17:05:53 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:05:53 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:05:53 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3
Nov 18 17:05:53 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:05:53 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:05:53 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074
Nov 18 17:05:53 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:05:53 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:05:53 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa
Nov 18 17:05:53 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:05:53 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:05:53 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe
Nov 18 17:05:53 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:05:53 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:05:53 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5
Nov 18 17:05:53 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:05:53 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:05:53 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f
Nov 18 17:05:53 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:05:53 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:05:53 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83
Nov 18 17:05:53 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:05:53 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:05:53 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd
Nov 18 17:05:53 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:05:53 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:05:53 user nova-compute[74743]: FIRMWARE:
Nov 18 17:05:53 user nova-compute[74743]: No targets found.
Nov 18 17:05:53 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 17:05:53 user nova-compute[74743]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 17:05:53 user nova-compute[74743]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74743) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8', 0)] {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-5e31f7a5-e9c6-4ab8-b097-ae408ddf5e18 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Lock "567feb03-a356-4347-b146-d8930ad60c11" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.397s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f16f63c-ca1f-4d96-b220-e836fbd0a9e5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[287b883d-9337-4a55-9a51-ab6ef0cc84a4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 (non-flash)
Nov 18 17:05:53 user nova-compute[74743]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 (non-flash)
Nov 18 17:05:53 user nova-compute[74743]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 (non-flash)
Nov 18 17:05:53 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:05:53 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:05:53 user nova-compute[74743]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)
Nov 18 17:05:53 user nova-compute[74743]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)
Nov 18 17:05:53 user nova-compute[74743]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)
Nov 18 17:05:53 user nova-compute[74743]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)
Nov 18 17:05:53 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 (non-flash)
Nov 18 17:05:53 user nova-compute[74743]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 (non-flash)
Nov 18 17:05:53 user nova-compute[74743]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 (non-flash)
Nov 18 17:05:53 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:05:53 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:05:53 user nova-compute[74743]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)
Nov 18 17:05:53 user nova-compute[74743]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)
Nov 18 17:05:53 user nova-compute[74743]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)
Nov 18 17:05:53 user nova-compute[74743]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)
Nov 18 17:05:53 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb08593d90>, {}) {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Disconnecting from: [] {{(pid=74743) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.089s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] <== disconnect_volume: return (90ms) None {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:05:53 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Disconnected iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 17:05:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Acquiring lock "567feb03-a356-4347-b146-d8930ad60c11" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:05:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Lock "567feb03-a356-4347-b146-d8930ad60c11" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:05:54 user nova-compute[74743]: DEBUG os_brick.utils [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:05:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:54 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f22966-c6f0-4aae-a27a-9c28b6b6ade3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1116acd8874d\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:54 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82f94df-4c7c-4a60-8dae-443f5eee09b8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:54 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1b17f6-410f-4f4e-bc8c-f402f1b8bd15]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:54 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[142269a6-776a-444c-9a98-1e46e26f8bee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Running cmd (subprocess): nvme version {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:05:54 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] nvme not present on system {{(pid=74743) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 17:05:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:05:54 user nova-compute[74743]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 17:05:54 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fe048d-3655-4806-bff4-764408e2d730]: (4, '') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:54 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74743) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 17:05:54 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 17:05:54 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] LIGHTOS: no hostnqn found. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 17:05:54 user nova-compute[74743]: DEBUG os_brick.utils [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1116acd8874d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:05:54 user nova-compute[74743]: DEBUG nova.compute.manager [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Preparing to wait for external event volume-reimaged-47861a8d-8eb0-4239-a9b5-962337012ed8 {{(pid=74743) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 18 17:05:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Acquiring lock "fc4cdeb6-51ff-4090-a29d-d4f6105e15f3-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:05:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Lock "fc4cdeb6-51ff-4090-a29d-d4f6105e15f3-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:05:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Lock "fc4cdeb6-51ff-4090-a29d-d4f6105e15f3-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:05:54 user nova-compute[74743]: INFO nova.compute.manager [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Swapping volume 03db838c-5e3c-4ff0-a374-b0540da43f83 for 2a462824-d8b3-4e9a-83f0-803b379cc387
Nov 18 17:05:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbdc3761-36af-4824-b435-85dcca760fb6 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Calling os-brick to attach iSCSI Volume {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 17:05:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdc3761-36af-4824-b435-85dcca760fb6 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZMbJKgTy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:05:57 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-cbdc3761-36af-4824-b435-85dcca760fb6 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:05:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-cbdc3761-36af-4824-b435-85dcca760fb6 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:05:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-cbdc3761-36af-4824-b435-85dcca760fb6 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:05:57 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-cbdc3761-36af-4824-b435-85dcca760fb6 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:05:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-cbdc3761-36af-4824-b435-85dcca760fb6 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:05:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-cbdc3761-36af-4824-b435-85dcca760fb6 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:05:57 user nova-compute[74743]: INFO os_brick.initiator.connectors.iscsi [None req-cbdc3761-36af-4824-b435-85dcca760fb6 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 17:05:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 -p 172.16.0.220:3260 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:57 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[71984be8-d4b0-4294-9703-66bb62a55d3c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdc3761-36af-4824-b435-85dcca760fb6 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 17:05:57 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:05:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:57 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[be36bf99-3af8-42e8-a437-02998f774987]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9] added\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdc3761-36af-4824-b435-85dcca760fb6 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9] added
Nov 18 17:05:57 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:05:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:57 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d34bd4-5f3c-4b91-bada-22a5b4ab6192]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdc3761-36af-4824-b435-85dcca760fb6 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:05:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:57 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe4c74c-2c0f-4daa-872b-cdb86ba244bc]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdc3761-36af-4824-b435-85dcca760fb6 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:05:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZMbJKgTy {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZMbJKgTy" returned: 0 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:57 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6682bf-841f-493a-b5c7-a7ad9dcb5198]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdc3761-36af-4824-b435-85dcca760fb6 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZMbJKgTy'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:05:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:57 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34639f0-a75d-4511-ac3b-dcd1e2c1f637]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdc3761-36af-4824-b435-85dcca760fb6 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:05:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:57 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[49bea2d5-74b5-4113-b12e-144981c6742a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdc3761-36af-4824-b435-85dcca760fb6 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 (non-flash)
Nov 18 17:05:57 user nova-compute[74743]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 (non-flash)
Nov 18 17:05:57 user nova-compute[74743]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 (non-flash)
Nov 18 17:05:57 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:05:57 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:05:57 user nova-compute[74743]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)
Nov 18 17:05:57 user nova-compute[74743]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)
Nov 18 17:05:57 user nova-compute[74743]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)
Nov 18 17:05:57 user nova-compute[74743]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)
Nov 18 17:05:57 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:05:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdc3761-36af-4824-b435-85dcca760fb6 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 (non-flash)
Nov 18 17:05:57 user nova-compute[74743]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 (non-flash)
Nov 18 17:05:57 user nova-compute[74743]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 (non-flash)
Nov 18 17:05:57 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:05:57 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:05:57 user nova-compute[74743]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)
Nov 18 17:05:57 user nova-compute[74743]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)
Nov 18 17:05:57 user nova-compute[74743]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)
Nov 18 17:05:57 user nova-compute[74743]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)
Nov 18 17:05:57 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:05:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 -p 172.16.0.220:3260 --login {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:57 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[50760c1d-ef37-4ada-9026-f878b217f6b3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdc3761-36af-4824-b435-85dcca760fb6 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9, portal: 172.16.0.220,3260]
Nov 18 17:05:57 user nova-compute[74743]: Login to [iface: default, target: iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9, portal: 172.16.0.220,3260] successful.
Nov 18 17:05:57 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:05:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:57 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc7af7a-753c-4fc9-8362-1692d1edf391]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdc3761-36af-4824-b435-85dcca760fb6 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:05:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:57 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[4299d9f4-04aa-4982-aa5e-ec9475368ea7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdc3761-36af-4824-b435-85dcca760fb6 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 (non-flash)
Nov 18 17:05:57 user nova-compute[74743]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 (non-flash)
Nov 18 17:05:57 user nova-compute[74743]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 (non-flash)
Nov 18 17:05:57 user nova-compute[74743]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 (non-flash)
Nov 18 17:05:57 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:05:57 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:05:57 user nova-compute[74743]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)
Nov 18 17:05:57 user nova-compute[74743]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)
Nov 18 17:05:57 user nova-compute[74743]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)
Nov 18 17:05:57 user nova-compute[74743]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)
Nov 18 17:05:57 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:05:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdc3761-36af-4824-b435-85dcca760fb6 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 (non-flash)
Nov 18 17:05:57 user nova-compute[74743]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 (non-flash)
Nov 18 17:05:57 user nova-compute[74743]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 (non-flash)
Nov 18 17:05:57 user nova-compute[74743]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 (non-flash)
Nov 18 17:05:57 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:05:57 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:05:57 user nova-compute[74743]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)
Nov 18 17:05:57 user nova-compute[74743]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)
Nov 18 17:05:57 user nova-compute[74743]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)
Nov 18 17:05:57 user nova-compute[74743]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)
Nov 18 17:05:57 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:05:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-cbdc3761-36af-4824-b435-85dcca760fb6 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:05:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdc3761-36af-4824-b435-85dcca760fb6 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] Connected to 172.16.0.220:3260 {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 17:05:57 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-cbdc3761-36af-4824-b435-85dcca760fb6 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=74743) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 17:05:57 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-cbdc3761-36af-4824-b435-85dcca760fb6 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=74743) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 17:05:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:05:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:05:57 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[52137fdc-808e-482a-8956-41fb43ea32cf]: (4, ('- - 0', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:05:57 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-cbdc3761-36af-4824-b435-85dcca760fb6 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:05:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdc3761-36af-4824-b435-85dcca760fb6 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZMbJKgTy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 17:05:58 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-cbdc3761-36af-4824-b435-85dcca760fb6 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:05:58 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdc3761-36af-4824-b435-85dcca760fb6 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '23830633565363933', 'path': '/dev/sdb'} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:05:58 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbdc3761-36af-4824-b435-85dcca760fb6 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830633565363933', 'path': '/dev/sdb'} {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 17:05:58 user nova-compute[74743]: DEBUG nova.objects.instance [None req-cbdc3761-36af-4824-b435-85dcca760fb6 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] Lazy-loading 'flavor' on Instance uuid e2a7ff40-310e-481f-8459-cde1034a0fbd {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:05:59 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-cbdc3761-36af-4824-b435-85dcca760fb6 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] attach device xml: <disk type="block" device="disk">
Nov 18 17:05:59 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:05:59 user nova-compute[74743]:   <source dev="/dev/sdb"/>
Nov 18 17:05:59 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:05:59 user nova-compute[74743]:   <serial>5480db9f-0880-49cc-9188-6b47977561a9</serial>
Nov 18 17:05:59 user nova-compute[74743]: </disk>
Nov 18 17:05:59 user nova-compute[74743]:  {{(pid=74743) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 17:05:59 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cbdc3761-36af-4824-b435-85dcca760fb6 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:05:59 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cbdc3761-36af-4824-b435-85dcca760fb6 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:05:59 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cbdc3761-36af-4824-b435-85dcca760fb6 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] No VIF found with MAC fa:16:3e:05:50:5c, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:05:59 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:05:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cbdc3761-36af-4824-b435-85dcca760fb6 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] Lock "e2a7ff40-310e-481f-8459-cde1034a0fbd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.313s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:00 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-5e8a4e08-92d7-45c4-a245-27141bec6681 tempest-VolumesAssistedSnapshotsTest-2039807784 tempest-VolumesAssistedSnapshotsTest-2039807784-project] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] volume_snapshot_create: create_info: {'snapshot_id': '6ac72d90-edff-4c66-9e9c-30c9f1cb462c', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74743) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 18 17:06:00 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-5e8a4e08-92d7-45c4-a245-27141bec6681 tempest-VolumesAssistedSnapshotsTest-2039807784 tempest-VolumesAssistedSnapshotsTest-2039807784-project] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] snap xml: <domainsnapshot>
Nov 18 17:06:00 user nova-compute[74743]:   <disks>
Nov 18 17:06:00 user nova-compute[74743]:     <disk name="/dev/sdb" snapshot="external" type="file">
Nov 18 17:06:00 user nova-compute[74743]:       <source file="/dev/new_file"/>
Nov 18 17:06:00 user nova-compute[74743]:     </disk>
Nov 18 17:06:00 user nova-compute[74743]:     <disk name="vda" snapshot="no"/>
Nov 18 17:06:00 user nova-compute[74743]:   </disks>
Nov 18 17:06:00 user nova-compute[74743]: </domainsnapshot>
Nov 18 17:06:00 user nova-compute[74743]:  {{(pid=74743) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 18 17:06:00 user nova-compute[74743]: DEBUG nova.objects.instance [None req-5e8a4e08-92d7-45c4-a245-27141bec6681 tempest-VolumesAssistedSnapshotsTest-2039807784 tempest-VolumesAssistedSnapshotsTest-2039807784-project] Lazy-loading 'system_metadata' on Instance uuid e2a7ff40-310e-481f-8459-cde1034a0fbd {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:06:00 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-5e8a4e08-92d7-45c4-a245-27141bec6681 tempest-VolumesAssistedSnapshotsTest-2039807784 tempest-VolumesAssistedSnapshotsTest-2039807784-project] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver [None req-5e8a4e08-92d7-45c4-a245-27141bec6681 tempest-VolumesAssistedSnapshotsTest-2039807784 tempest-VolumesAssistedSnapshotsTest-2039807784-project] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Traceback (most recent call last):
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd]     rv = execute(f, *args, **kwargs)
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd]     six.reraise(c, e, tb)
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd]     raise value
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd]     rv = meth(*args, **kwargs)
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] 
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver [None req-5e8a4e08-92d7-45c4-a245-27141bec6681 tempest-VolumesAssistedSnapshotsTest-2039807784 tempest-VolumesAssistedSnapshotsTest-2039807784-project] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Traceback (most recent call last):
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd]     self._volume_snapshot_create(context, instance, guest,
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd]     rv = execute(f, *args, **kwargs)
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd]     six.reraise(c, e, tb)
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd]     raise value
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd]     rv = meth(*args, **kwargs)
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] 
Nov 18 17:06:00 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-a93d59ee-5574-43e6-9eb7-949e8034056e tempest-VolumesAssistedSnapshotsTest-2039807784 tempest-VolumesAssistedSnapshotsTest-2039807784-project] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] volume_snapshot_delete: delete_info: {'volume_id': '5480db9f-0880-49cc-9188-6b47977561a9'} {{(pid=74743) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver [None req-a93d59ee-5574-43e6-9eb7-949e8034056e tempest-VolumesAssistedSnapshotsTest-2039807784 tempest-VolumesAssistedSnapshotsTest-2039807784-project] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Traceback (most recent call last):
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd]     if delete_info['type'] != 'qcow2':
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] KeyError: 'type'
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] 
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver [None req-5e8a4e08-92d7-45c4-a245-27141bec6681 tempest-VolumesAssistedSnapshotsTest-2039807784 tempest-VolumesAssistedSnapshotsTest-2039807784-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 6ac72d90-edff-4c66-9e9c-30c9f1cb462c could not be found.
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver     raise value
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver 
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver 
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 6ac72d90-edff-4c66-9e9c-30c9f1cb462c could not be found. (HTTP 404) (Request-ID: req-ad9d15a0-4570-4604-9ddb-840f2859072b)
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver 
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver 
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 6ac72d90-edff-4c66-9e9c-30c9f1cb462c could not be found.
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver 
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server [None req-5e8a4e08-92d7-45c4-a245-27141bec6681 tempest-VolumesAssistedSnapshotsTest-2039807784 tempest-VolumesAssistedSnapshotsTest-2039807784-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     raise value
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server 
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver [None req-a93d59ee-5574-43e6-9eb7-949e8034056e tempest-VolumesAssistedSnapshotsTest-2039807784 tempest-VolumesAssistedSnapshotsTest-2039807784-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver 
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver 
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-75cf0c1d-9e71-4ccb-b214-c46024f21316)
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver 
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver 
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 18 17:06:00 user nova-compute[74743]: ERROR nova.virt.libvirt.driver 
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server [None req-a93d59ee-5574-43e6-9eb7-949e8034056e tempest-VolumesAssistedSnapshotsTest-2039807784 tempest-VolumesAssistedSnapshotsTest-2039807784-project] Exception during message handling: KeyError: 'type'
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 18 17:06:00 user nova-compute[74743]: ERROR oslo_messaging.rpc.server 
Nov 18 17:06:00 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-c824a1db-a3b6-40cf-b41c-219a547749a4 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] Acquiring lock "e2a7ff40-310e-481f-8459-cde1034a0fbd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:00 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-c824a1db-a3b6-40cf-b41c-219a547749a4 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] Lock "e2a7ff40-310e-481f-8459-cde1034a0fbd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:00 user nova-compute[74743]: INFO nova.compute.manager [None req-c824a1db-a3b6-40cf-b41c-219a547749a4 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Detaching volume 5480db9f-0880-49cc-9188-6b47977561a9
Nov 18 17:06:00 user nova-compute[74743]: INFO nova.virt.block_device [None req-c824a1db-a3b6-40cf-b41c-219a547749a4 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Attempting to driver detach volume 5480db9f-0880-49cc-9188-6b47977561a9 from mountpoint /dev/vdb
Nov 18 17:06:00 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-c824a1db-a3b6-40cf-b41c-219a547749a4 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] Attempting to detach device vdb from instance e2a7ff40-310e-481f-8459-cde1034a0fbd from the persistent domain config. {{(pid=74743) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 17:06:00 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-c824a1db-a3b6-40cf-b41c-219a547749a4 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] detach device xml: <disk type="block" device="disk">
Nov 18 17:06:00 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:06:00 user nova-compute[74743]:   <source dev="/dev/sdb"/>
Nov 18 17:06:00 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:06:00 user nova-compute[74743]:   <serial>5480db9f-0880-49cc-9188-6b47977561a9</serial>
Nov 18 17:06:00 user nova-compute[74743]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 17:06:00 user nova-compute[74743]: </disk>
Nov 18 17:06:00 user nova-compute[74743]:  {{(pid=74743) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 17:06:00 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-c824a1db-a3b6-40cf-b41c-219a547749a4 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] Successfully detached device vdb from instance e2a7ff40-310e-481f-8459-cde1034a0fbd from the persistent domain config.
Nov 18 17:06:00 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-c824a1db-a3b6-40cf-b41c-219a547749a4 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e2a7ff40-310e-481f-8459-cde1034a0fbd from the live domain config. {{(pid=74743) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 17:06:00 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-c824a1db-a3b6-40cf-b41c-219a547749a4 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] detach device xml: <disk type="block" device="disk">
Nov 18 17:06:00 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:06:00 user nova-compute[74743]:   <source dev="/dev/sdb"/>
Nov 18 17:06:00 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:06:00 user nova-compute[74743]:   <serial>5480db9f-0880-49cc-9188-6b47977561a9</serial>
Nov 18 17:06:00 user nova-compute[74743]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 17:06:00 user nova-compute[74743]: </disk>
Nov 18 17:06:00 user nova-compute[74743]:  {{(pid=74743) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 17:06:00 user nova-compute[74743]: DEBUG nova.compute.manager [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] [instance: 567feb03-a356-4347-b146-d8930ad60c11] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'smbfuYAx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '567feb03-a356-4347-b146-d8930ad60c11', 'attached_at': '', 'detached_at': '', 'volume_id': '2a462824-d8b3-4e9a-83f0-803b379cc387', 'serial': '2a462824-d8b3-4e9a-83f0-803b379cc387'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ClPUfcSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, 'status': 'reserved', 'instance': '567feb03-a356-4347-b146-d8930ad60c11', 'attached_at': '', 'detached_at': '', 'volume_id': '03db838c-5e3c-4ff0-a374-b0540da43f83', 'serial'} {{(pid=74743) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 18 17:06:00 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Calling os-brick to attach iSCSI Volume {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 17:06:00 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'smbfuYAx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:06:00 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:06:00 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:06:00 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:06:00 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:06:01 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:06:01 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:06:01 user nova-compute[74743]: INFO os_brick.initiator.connectors.iscsi [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 17:06:01 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 -p 172.16.0.220:3260 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:01 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:01 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b945a5d-b242-4a55-b37d-34f686315beb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:01 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 17:06:01 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:01 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 -p 172.16.0.220:3260 --interface default --op new {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:01 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:01 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[500af83d-eeb7-46d5-841d-1fbb9c6e577d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387] added\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:01 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387] added
Nov 18 17:06:01 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:01 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:01 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:01 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21d3a81-6d5e-4f8a-897a-6216d46fdf91]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:01 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:01 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:01 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:01 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7daa95a-7405-49ff-9e55-495cdd487234]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:01 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:01 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v smbfuYAx {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:01 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v smbfuYAx" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:01 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[c485b456-dc06-4365-84f2-b590ee3cb8a3]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:01 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'smbfuYAx'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:01 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:01 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:01 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6f6cf9-b059-467d-901f-9297ffdf9bc0]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:01 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:01 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:01 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:01 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18df7c7-d252-4085-9b84-969c1d4c84bd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:01 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 (non-flash)
Nov 18 17:06:01 user nova-compute[74743]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 (non-flash)
Nov 18 17:06:01 user nova-compute[74743]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 (non-flash)
Nov 18 17:06:01 user nova-compute[74743]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 (non-flash)
Nov 18 17:06:01 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:06:01 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:06:01 user nova-compute[74743]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)
Nov 18 17:06:01 user nova-compute[74743]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)
Nov 18 17:06:01 user nova-compute[74743]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)
Nov 18 17:06:01 user nova-compute[74743]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)
Nov 18 17:06:01 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:06:01 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 (non-flash)
Nov 18 17:06:01 user nova-compute[74743]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 (non-flash)
Nov 18 17:06:01 user nova-compute[74743]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 (non-flash)
Nov 18 17:06:01 user nova-compute[74743]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 (non-flash)
Nov 18 17:06:01 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:06:01 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:06:01 user nova-compute[74743]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)
Nov 18 17:06:01 user nova-compute[74743]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)
Nov 18 17:06:01 user nova-compute[74743]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)
Nov 18 17:06:01 user nova-compute[74743]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)
Nov 18 17:06:01 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:06:01 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 -p 172.16.0.220:3260 --login {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:01 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-c824a1db-a3b6-40cf-b41c-219a547749a4 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e2a7ff40-310e-481f-8459-cde1034a0fbd {{(pid=74743) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 17:06:01 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 -p 172.16.0.220:3260 --login" returned: 0 in 0.151s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:01 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[77bd2a5f-d71d-4322-aa73-68196a545d32]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:01 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387, portal: 172.16.0.220,3260]
Nov 18 17:06:01 user nova-compute[74743]: Login to [iface: default, target: iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387, portal: 172.16.0.220,3260] successful.
Nov 18 17:06:01 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:01 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:01 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:01 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[8446972f-5fe1-401c-9076-388962ab1550]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:01 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:01 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:01 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:01 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f097365-1b9a-41e8-82b3-27ba0f4c41a4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:01 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 (non-flash)
Nov 18 17:06:01 user nova-compute[74743]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 (non-flash)
Nov 18 17:06:01 user nova-compute[74743]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 (non-flash)
Nov 18 17:06:01 user nova-compute[74743]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 (non-flash)
Nov 18 17:06:01 user nova-compute[74743]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 (non-flash)
Nov 18 17:06:01 user nova-compute[74743]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:06:01 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:06:01 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:06:01 user nova-compute[74743]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)
Nov 18 17:06:01 user nova-compute[74743]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)
Nov 18 17:06:01 user nova-compute[74743]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)
Nov 18 17:06:01 user nova-compute[74743]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)
Nov 18 17:06:01 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:06:01 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 (non-flash)
Nov 18 17:06:01 user nova-compute[74743]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 (non-flash)
Nov 18 17:06:01 user nova-compute[74743]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 (non-flash)
Nov 18 17:06:01 user nova-compute[74743]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 (non-flash)
Nov 18 17:06:01 user nova-compute[74743]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 (non-flash)
Nov 18 17:06:01 user nova-compute[74743]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:06:01 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:06:01 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:06:01 user nova-compute[74743]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)
Nov 18 17:06:01 user nova-compute[74743]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)
Nov 18 17:06:01 user nova-compute[74743]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)
Nov 18 17:06:01 user nova-compute[74743]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)
Nov 18 17:06:01 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:06:01 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.407s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:06:01 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Connected to 172.16.0.220:3260 {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 17:06:01 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] HCTL ('43', '-', '-', 0) found on session 14 with lun 0 {{(pid=74743) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 17:06:01 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Scanning host 43 c: -, t: -, l: 0) {{(pid=74743) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 17:06:01 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host43/scan {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:01 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host43/scan" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:01 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ac060d-3552-4a53-be7d-8343906fc9d2]: (4, ('- - 0', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:01 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Searching for a device in session 14 and hctl ['43', '*', '*', 0] yield: sdl {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:06:01 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Connected to sdl using {'target_iqn': 'iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'smbfuYAx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 17:06:02 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:02 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.449s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:06:02 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] <== connect_volume: return (1451ms) {'type': 'block', 'scsi_wwn': '23732656339366338', 'path': '/dev/sdl'} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:06:02 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732656339366338', 'path': '/dev/sdl'} {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 17:06:02 user nova-compute[74743]: DEBUG nova.objects.instance [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Lazy-loading 'flavor' on Instance uuid 567feb03-a356-4347-b146-d8930ad60c11 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:06:02 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] COPY block job progress, current cursor: 5242880 final cursor: 1073741824 {{(pid=74743) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 17:06:03 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] COPY block job progress, current cursor: 182452224 final cursor: 1073741824 {{(pid=74743) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 17:06:03 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] COPY block job progress, current cursor: 327155712 final cursor: 1073741824 {{(pid=74743) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 17:06:04 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] COPY block job progress, current cursor: 465567744 final cursor: 1073741824 {{(pid=74743) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 17:06:04 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-36f6992c-4926-425a-ac05-f38d0c045997 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 55192f7b-5aaf-42e6-926a-cf9f43e460ca is timed out.
Nov 18 17:06:04 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-36f6992c-4926-425a-ac05-f38d0c045997 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Successfully detached device vdb from instance 55192f7b-5aaf-42e6-926a-cf9f43e460ca from the live domain config.
Nov 18 17:06:04 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36f6992c-4926-425a-ac05-f38d0c045997 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] calling os-brick to detach iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 17:06:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f6992c-4926-425a-ac05-f38d0c045997 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, {'target_iqn': 'iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pYilrUnB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:06:04 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-36f6992c-4926-425a-ac05-f38d0c045997 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:06:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-36f6992c-4926-425a-ac05-f38d0c045997 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:06:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-36f6992c-4926-425a-ac05-f38d0c045997 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:06:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:04 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:04 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd254e74-a994-4894-b4c7-a325905e82b7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f6992c-4926-425a-ac05-f38d0c045997 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 17:06:04 user nova-compute[74743]: No targets found.
Nov 18 17:06:04 user nova-compute[74743]: iSNS:
Nov 18 17:06:04 user nova-compute[74743]: No targets found.
Nov 18 17:06:04 user nova-compute[74743]: STATIC:
Nov 18 17:06:04 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc
Nov 18 17:06:04 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:04 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:04 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3
Nov 18 17:06:04 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:04 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:04 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387
Nov 18 17:06:04 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:04 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:04 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074
Nov 18 17:06:04 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:04 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:04 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa
Nov 18 17:06:04 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:04 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:04 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe
Nov 18 17:06:04 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:04 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:04 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8
Nov 18 17:06:04 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:04 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:04 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5
Nov 18 17:06:04 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:04 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:04 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9
Nov 18 17:06:04 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:04 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:04 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f
Nov 18 17:06:04 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:04 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:04 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83
Nov 18 17:06:04 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:04 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:04 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd
Nov 18 17:06:04 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:04 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:04 user nova-compute[74743]: FIRMWARE:
Nov 18 17:06:04 user nova-compute[74743]: No targets found.
Nov 18 17:06:04 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:06:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f6992c-4926-425a-ac05-f38d0c045997 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 17:06:04 user nova-compute[74743]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 17:06:04 user nova-compute[74743]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74743) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 17:06:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f6992c-4926-425a-ac05-f38d0c045997 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5', 0)] {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 17:06:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:04 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e0590c-2c31-4a06-a8fd-0e5c8438f221]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:04 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a08e49-7e27-415c-bf8a-d37399b60298]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f6992c-4926-425a-ac05-f38d0c045997 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 (non-flash)
Nov 18 17:06:04 user nova-compute[74743]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 (non-flash)
Nov 18 17:06:04 user nova-compute[74743]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 (non-flash)
Nov 18 17:06:04 user nova-compute[74743]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 (non-flash)
Nov 18 17:06:04 user nova-compute[74743]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 (non-flash)
Nov 18 17:06:04 user nova-compute[74743]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:06:04 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:06:04 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:06:04 user nova-compute[74743]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)
Nov 18 17:06:04 user nova-compute[74743]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)
Nov 18 17:06:04 user nova-compute[74743]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)
Nov 18 17:06:04 user nova-compute[74743]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)
Nov 18 17:06:04 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:06:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f6992c-4926-425a-ac05-f38d0c045997 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 (non-flash)
Nov 18 17:06:04 user nova-compute[74743]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 (non-flash)
Nov 18 17:06:04 user nova-compute[74743]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 (non-flash)
Nov 18 17:06:04 user nova-compute[74743]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 (non-flash)
Nov 18 17:06:04 user nova-compute[74743]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 (non-flash)
Nov 18 17:06:04 user nova-compute[74743]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:06:04 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:06:04 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:06:04 user nova-compute[74743]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)
Nov 18 17:06:04 user nova-compute[74743]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)
Nov 18 17:06:04 user nova-compute[74743]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)
Nov 18 17:06:04 user nova-compute[74743]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)
Nov 18 17:06:04 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:06:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f6992c-4926-425a-ac05-f38d0c045997 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb28446560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5'): ({'sdi'}, set())}) {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 17:06:04 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-36f6992c-4926-425a-ac05-f38d0c045997 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Removing single pathed devices sdi {{(pid=74743) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 17:06:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:04 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[184a4fb5-6ae6-4b0d-9300-f012f9825430]: (4, ('path checker states:\nup                  12\n\npaths: 0\nbusy: False\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.027s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:04 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[563503d8-7ca7-4244-8565-01eac845731e]: (4, ('ok\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:04 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-36f6992c-4926-425a-ac05-f38d0c045997 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Flushing IO for device /dev/sdi {{(pid=74743) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 17:06:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.015s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:04 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf47851f-ed53-4d91-8d08-fe5fa7373964]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:04 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-36f6992c-4926-425a-ac05-f38d0c045997 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74743) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 17:06:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.061s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:04 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af5528d-2bed-4ff6-a38b-c681cc9c96e7]: (4, ('1', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:04 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-36f6992c-4926-425a-ac05-f38d0c045997 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 17:06:04 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-36f6992c-4926-425a-ac05-f38d0c045997 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] SCSI volumes sdi have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 17:06:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f6992c-4926-425a-ac05-f38d0c045997 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5')] {{(pid=74743) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 17:06:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.034s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:04 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd417d5-ab47-4ed6-a542-7e38360cbb42]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f6992c-4926-425a-ac05-f38d0c045997 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 -p 172.16.0.220:3260 --logout {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.096s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:04 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[814b57e1-7b19-42a7-adee-a0bf48837eb3]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f6992c-4926-425a-ac05-f38d0c045997 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5, portal: 172.16.0.220,3260]
Nov 18 17:06:04 user nova-compute[74743]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5, portal: 172.16.0.220,3260] successful.
Nov 18 17:06:04 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 -p 172.16.0.220:3260 --op delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77f318e2-b968-4220-9506-0a121a1e68e5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.046s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:04 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[09fbdddf-dff4-443b-bd39-136a97cab546]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f6992c-4926-425a-ac05-f38d0c045997 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-36f6992c-4926-425a-ac05-f38d0c045997 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.469s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:06:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f6992c-4926-425a-ac05-f38d0c045997 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] <== disconnect_volume: return (470ms) None {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:06:04 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36f6992c-4926-425a-ac05-f38d0c045997 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Disconnected iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 17:06:04 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] COPY block job progress, current cursor: 584056832 final cursor: 1073741824 {{(pid=74743) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 17:06:05 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] COPY block job progress, current cursor: 723517440 final cursor: 1073741824 {{(pid=74743) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 17:06:06 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] COPY block job progress, current cursor: 875560960 final cursor: 1073741824 {{(pid=74743) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 17:06:06 user nova-compute[74743]: DEBUG nova.objects.instance [None req-36f6992c-4926-425a-ac05-f38d0c045997 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Lazy-loading 'flavor' on Instance uuid 55192f7b-5aaf-42e6-926a-cf9f43e460ca {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:06:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-36f6992c-4926-425a-ac05-f38d0c045997 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Lock "55192f7b-5aaf-42e6-926a-cf9f43e460ca" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.452s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:06 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] COPY block job progress, current cursor: 984612864 final cursor: 1073741824 {{(pid=74743) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 17:06:07 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74743) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 17:06:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:07 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] [instance: 567feb03-a356-4347-b146-d8930ad60c11] calling os-brick to detach iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 17:06:07 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, {'target_iqn': 'iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ClPUfcSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:06:07 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:06:07 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:06:07 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:06:07 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:07 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:07 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0919c23c-a327-4bf3-9ad5-0034e4869973]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:07 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 17:06:07 user nova-compute[74743]: No targets found.
Nov 18 17:06:07 user nova-compute[74743]: iSNS:
Nov 18 17:06:07 user nova-compute[74743]: No targets found.
Nov 18 17:06:07 user nova-compute[74743]: STATIC:
Nov 18 17:06:07 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc
Nov 18 17:06:07 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:07 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:07 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3
Nov 18 17:06:07 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:07 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:07 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387
Nov 18 17:06:07 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:07 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:07 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074
Nov 18 17:06:07 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:07 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:07 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa
Nov 18 17:06:07 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:07 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:07 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe
Nov 18 17:06:07 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:07 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:07 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8
Nov 18 17:06:07 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:07 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:07 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9
Nov 18 17:06:07 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:07 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:07 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f
Nov 18 17:06:07 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:07 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:07 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83
Nov 18 17:06:07 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:07 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:07 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd
Nov 18 17:06:07 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:07 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:07 user nova-compute[74743]: FIRMWARE:
Nov 18 17:06:07 user nova-compute[74743]: No targets found.
Nov 18 17:06:07 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:06:07 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 17:06:07 user nova-compute[74743]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 17:06:07 user nova-compute[74743]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74743) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 17:06:07 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83', 0)] {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 17:06:07 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:07 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:07 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e93f54-2739-4d0b-b51f-3e058a1dd6ac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:07 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:07 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:07 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[52403e40-80cf-44e9-8a55-e0d26526d666]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:07 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 (non-flash)
Nov 18 17:06:07 user nova-compute[74743]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 (non-flash)
Nov 18 17:06:07 user nova-compute[74743]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 (non-flash)
Nov 18 17:06:07 user nova-compute[74743]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 (non-flash)
Nov 18 17:06:07 user nova-compute[74743]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:06:07 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:06:07 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:06:07 user nova-compute[74743]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)
Nov 18 17:06:07 user nova-compute[74743]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)
Nov 18 17:06:07 user nova-compute[74743]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)
Nov 18 17:06:07 user nova-compute[74743]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)
Nov 18 17:06:07 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:06:07 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 (non-flash)
Nov 18 17:06:07 user nova-compute[74743]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 (non-flash)
Nov 18 17:06:07 user nova-compute[74743]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 (non-flash)
Nov 18 17:06:07 user nova-compute[74743]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 (non-flash)
Nov 18 17:06:07 user nova-compute[74743]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:06:07 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:06:07 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:06:07 user nova-compute[74743]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)
Nov 18 17:06:07 user nova-compute[74743]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)
Nov 18 17:06:07 user nova-compute[74743]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)
Nov 18 17:06:07 user nova-compute[74743]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)
Nov 18 17:06:07 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:06:07 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb2842c040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83'): ({'sdk'}, set())}) {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 17:06:07 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Removing single pathed devices sdk {{(pid=74743) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 17:06:07 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:07 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:07 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6f83d8-d9cb-4efe-ab9e-7806c41a3ecf]: (4, ('path checker states:\nup                  11\n\npaths: 0\nbusy: False\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:07 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:07 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:07 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[78372421-83ae-4937-a236-3f0e9702d59d]: (4, ('ok\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:07 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Flushing IO for device /dev/sdk {{(pid=74743) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 17:06:07 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:07 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.012s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:07 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d58700-5361-4da5-9127-832600e7d538]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:07 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=74743) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 17:06:07 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:07 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.038s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:07 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa2a707-de3a-4a7f-9a66-9ffe1601adb1]: (4, ('1', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:07 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Checking to see if SCSI volumes sdk have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 17:06:07 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] SCSI volumes sdk have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 17:06:07 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83')] {{(pid=74743) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 17:06:07 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:07 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:07 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8731af-b287-4e8b-ba9d-7c00d2821436]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:07 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:07 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 -p 172.16.0.220:3260 --logout {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:07 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 -p 172.16.0.220:3260 --logout" returned: 0 in 0.093s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:07 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead8ff27-7b62-481d-88e5-345ecf7ae456]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:07 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83, portal: 172.16.0.220,3260]
Nov 18 17:06:07 user nova-compute[74743]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83, portal: 172.16.0.220,3260] successful.
Nov 18 17:06:07 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:07 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 -p 172.16.0.220:3260 --op delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:07 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:07 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c60e935-301f-4ec5-a185-24f88499a08b]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:07 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:07 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:06:07 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] <== disconnect_volume: return (360ms) None {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:06:07 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Disconnected iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 17:06:07 user nova-compute[74743]: DEBUG nova.compute.manager [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'smbfuYAx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl'}, 'status': 'reserved', 'instance': '567feb03-a356-4347-b146-d8930ad60c11', 'attached_at': '', 'detached_at': '', 'volume_id': '2a462824-d8b3-4e9a-83f0-803b379cc387', 'serial'} {{(pid=74743) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 18 17:06:07 user nova-compute[74743]: DEBUG nova.compute.manager [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] [instance: 567feb03-a356-4347-b146-d8930ad60c11] swap_volume: removing Cinder connection for volume 03db838c-5e3c-4ff0-a374-b0540da43f83 {{(pid=74743) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 18 17:06:08 user nova-compute[74743]: DEBUG nova.compute.manager [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] [instance: 567feb03-a356-4347-b146-d8930ad60c11] swap_volume: Updating volume 03db838c-5e3c-4ff0-a374-b0540da43f83 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "smbfuYAx", "auth_password": "1wUAFg8eaTkIPE", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdl", "volume_id": "2a462824-d8b3-4e9a-83f0-803b379cc387"}, "status": "reserved", "instance": "567feb03-a356-4347-b146-d8930ad60c11", "attached_at": "", "detached_at": "", "volume_id": "2a462824-d8b3-4e9a-83f0-803b379cc387", "serial": "2a462824-d8b3-4e9a-83f0-803b379cc387"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '2a462824-d8b3-4e9a-83f0-803b379cc387', 'no_device': None, 'attachment_id': '9f7cca6d-5d38-4d1c-97fb-1663c4c1f9ea'} {{(pid=74743) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 18 17:06:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ec0ba9b6-1ccb-4042-9518-6a8a013b3bf5 tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Lock "567feb03-a356-4347-b146-d8930ad60c11" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 14.034s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:09 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Acquiring lock "567feb03-a356-4347-b146-d8930ad60c11" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Lock "567feb03-a356-4347-b146-d8930ad60c11" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:10 user nova-compute[74743]: DEBUG os_brick.utils [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:06:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:10 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d953402-5d53-46b3-b5ac-29545dc34513]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1116acd8874d\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:10 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8a678a-3784-43e6-8237-9d8f863afe0e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:10 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[259692fd-1080-4fc5-abed-7eeb83ab38a6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:10 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0293c120-44a7-4148-9a5c-28f6b832be2c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Running cmd (subprocess): nvme version {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:06:10 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] nvme not present on system {{(pid=74743) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 17:06:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:06:10 user nova-compute[74743]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 17:06:10 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[888d7a0a-4f95-4300-ac1f-575e3ea0f4ac]: (4, '') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:10 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74743) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 17:06:10 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 17:06:10 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] LIGHTOS: no hostnqn found. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 17:06:10 user nova-compute[74743]: DEBUG os_brick.utils [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1116acd8874d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:06:10 user nova-compute[74743]: INFO nova.compute.manager [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Swapping volume 2a462824-d8b3-4e9a-83f0-803b379cc387 for 03db838c-5e3c-4ff0-a374-b0540da43f83
Nov 18 17:06:10 user nova-compute[74743]: DEBUG nova.compute.manager [req-69fb090d-880c-434c-bbef-05122dd39e68 req-11ef0836-91f0-492a-8b4b-0eb39eaec527 service nova] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Received event volume-reimaged-47861a8d-8eb0-4239-a9b5-962337012ed8 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:06:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-69fb090d-880c-434c-bbef-05122dd39e68 req-11ef0836-91f0-492a-8b4b-0eb39eaec527 service nova] Acquiring lock "fc4cdeb6-51ff-4090-a29d-d4f6105e15f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-69fb090d-880c-434c-bbef-05122dd39e68 req-11ef0836-91f0-492a-8b4b-0eb39eaec527 service nova] Lock "fc4cdeb6-51ff-4090-a29d-d4f6105e15f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-69fb090d-880c-434c-bbef-05122dd39e68 req-11ef0836-91f0-492a-8b4b-0eb39eaec527 service nova] Lock "fc4cdeb6-51ff-4090-a29d-d4f6105e15f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:10 user nova-compute[74743]: DEBUG nova.compute.manager [req-69fb090d-880c-434c-bbef-05122dd39e68 req-11ef0836-91f0-492a-8b4b-0eb39eaec527 service nova] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Processing event volume-reimaged-47861a8d-8eb0-4239-a9b5-962337012ed8 {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 18 17:06:10 user nova-compute[74743]: DEBUG nova.compute.manager [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Instance event wait completed in 15 seconds for volume-reimaged {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:06:10 user nova-compute[74743]: INFO nova.virt.block_device [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Booting with volume 47861a8d-8eb0-4239-a9b5-962337012ed8 at /dev/vda
Nov 18 17:06:10 user nova-compute[74743]: DEBUG os_brick.utils [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:06:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:10 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d57813-d3ff-4ce9-99e4-49caf5d241a1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1116acd8874d\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:10 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[122979c5-ecad-47f4-9a89-6c646f7ca9af]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:10 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6f15e6-e595-4bc3-a6ca-a59aa57e454e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:10 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86e795a-91ea-4931-a8c1-33ab01a83e55]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Running cmd (subprocess): nvme version {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] 'nvme version' failed. Not Retrying. {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:06:10 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.nvmeof [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] nvme not present on system {{(pid=74743) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 17:06:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:06:10 user nova-compute[74743]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 17:06:10 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[225cf408-3399-4def-8f3b-a0061c5510b5]: (4, '') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:10 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74743) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 17:06:10 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 17:06:10 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] LIGHTOS: no hostnqn found. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 17:06:10 user nova-compute[74743]: DEBUG os_brick.utils [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1116acd8874d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:06:10 user nova-compute[74743]: DEBUG nova.virt.block_device [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Updating existing volume attachment record: d4efc133-2556-4d74-82d0-ae974bc2e156 {{(pid=74743) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 17:06:12 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-7122a91e-dc20-4f95-abfe-028bb4c5f20e tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 8e6111e9-59e9-4a30-870c-3d308a5d4936 is timed out.
Nov 18 17:06:12 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-7122a91e-dc20-4f95-abfe-028bb4c5f20e tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Successfully detached device sdc from instance 8e6111e9-59e9-4a30-870c-3d308a5d4936 from the live domain config.
Nov 18 17:06:12 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7122a91e-dc20-4f95-abfe-028bb4c5f20e tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] calling os-brick to detach iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 17:06:12 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-7122a91e-dc20-4f95-abfe-028bb4c5f20e tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, {'target_iqn': 'iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NnZJlURY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:06:12 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-7122a91e-dc20-4f95-abfe-028bb4c5f20e tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:06:12 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-7122a91e-dc20-4f95-abfe-028bb4c5f20e tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:06:12 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-7122a91e-dc20-4f95-abfe-028bb4c5f20e tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:06:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:12 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d11fad-63c9-4ad7-8868-646a51b6c929]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:12 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-7122a91e-dc20-4f95-abfe-028bb4c5f20e tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 17:06:12 user nova-compute[74743]: No targets found.
Nov 18 17:06:12 user nova-compute[74743]: iSNS:
Nov 18 17:06:12 user nova-compute[74743]: No targets found.
Nov 18 17:06:12 user nova-compute[74743]: STATIC:
Nov 18 17:06:12 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc
Nov 18 17:06:12 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:12 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:12 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3
Nov 18 17:06:12 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:12 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:12 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387
Nov 18 17:06:12 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:12 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:12 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074
Nov 18 17:06:12 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:12 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:12 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa
Nov 18 17:06:12 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:12 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:12 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe
Nov 18 17:06:12 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:12 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:12 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9
Nov 18 17:06:12 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:12 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:12 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f
Nov 18 17:06:12 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:12 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:12 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd
Nov 18 17:06:12 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:12 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:12 user nova-compute[74743]: FIRMWARE:
Nov 18 17:06:12 user nova-compute[74743]: No targets found.
Nov 18 17:06:12 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:06:12 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-7122a91e-dc20-4f95-abfe-028bb4c5f20e tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 17:06:12 user nova-compute[74743]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 17:06:12 user nova-compute[74743]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74743) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 17:06:12 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-7122a91e-dc20-4f95-abfe-028bb4c5f20e tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074', 0)] {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 17:06:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:12 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:12 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[51635724-0fc2-40b3-a599-5739a804ea0f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:12 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f756f7-0197-406b-bc12-bb72c23f2060]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:12 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-7122a91e-dc20-4f95-abfe-028bb4c5f20e tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 (non-flash)
Nov 18 17:06:12 user nova-compute[74743]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 (non-flash)
Nov 18 17:06:12 user nova-compute[74743]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 (non-flash)
Nov 18 17:06:12 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:06:12 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:06:12 user nova-compute[74743]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)
Nov 18 17:06:12 user nova-compute[74743]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)
Nov 18 17:06:12 user nova-compute[74743]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)
Nov 18 17:06:12 user nova-compute[74743]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)
Nov 18 17:06:12 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:06:12 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-7122a91e-dc20-4f95-abfe-028bb4c5f20e tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 (non-flash)
Nov 18 17:06:12 user nova-compute[74743]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 (non-flash)
Nov 18 17:06:12 user nova-compute[74743]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 (non-flash)
Nov 18 17:06:12 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:06:12 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:06:12 user nova-compute[74743]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)
Nov 18 17:06:12 user nova-compute[74743]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)
Nov 18 17:06:12 user nova-compute[74743]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)
Nov 18 17:06:12 user nova-compute[74743]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)
Nov 18 17:06:12 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:06:12 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-7122a91e-dc20-4f95-abfe-028bb4c5f20e tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb28444ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074'): ({'sdj'}, set())}) {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 17:06:12 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-7122a91e-dc20-4f95-abfe-028bb4c5f20e tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Removing single pathed devices sdj {{(pid=74743) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 17:06:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:12 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[355baaeb-3a77-4091-b401-a932e12f5901]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:12 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae90f45e-3b8b-47f7-9c9c-e24d1fbf062b]: (4, ('ok\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:12 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-7122a91e-dc20-4f95-abfe-028bb4c5f20e tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Flushing IO for device /dev/sdj {{(pid=74743) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 17:06:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.012s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:12 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ad4254-b657-4a1f-b229-155d54f8bdf1]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:12 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-7122a91e-dc20-4f95-abfe-028bb4c5f20e tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=74743) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 17:06:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.041s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:12 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[be88deba-ca69-4ceb-8807-2111c409a54a]: (4, ('1', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:12 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-7122a91e-dc20-4f95-abfe-028bb4c5f20e tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 17:06:12 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-7122a91e-dc20-4f95-abfe-028bb4c5f20e tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] SCSI volumes sdj have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 17:06:12 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-7122a91e-dc20-4f95-abfe-028bb4c5f20e tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074')] {{(pid=74743) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 17:06:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:12 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e239ea-1ea5-415e-b854-ba524ae8a4ed]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:12 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-7122a91e-dc20-4f95-abfe-028bb4c5f20e tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 -p 172.16.0.220:3260 --logout {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:12 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[9362df1f-6065-41b7-8c36-062852dfae55]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:12 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-7122a91e-dc20-4f95-abfe-028bb4c5f20e tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074, portal: 172.16.0.220,3260]
Nov 18 17:06:12 user nova-compute[74743]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074, portal: 172.16.0.220,3260] successful.
Nov 18 17:06:12 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 -p 172.16.0.220:3260 --op delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b63ebb65-371d-4d00-91c6-4e3cf0dcd074 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:12 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[18008673-a40c-4e7c-b0fb-bc81be5dee7d]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:12 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-7122a91e-dc20-4f95-abfe-028bb4c5f20e tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:12 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-7122a91e-dc20-4f95-abfe-028bb4c5f20e tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:06:12 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-7122a91e-dc20-4f95-abfe-028bb4c5f20e tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] <== disconnect_volume: return (369ms) None {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:06:12 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7122a91e-dc20-4f95-abfe-028bb4c5f20e tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Disconnected iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 17:06:12 user nova-compute[74743]: DEBUG nova.compute.manager [req-6310aaf0-1bda-4455-92b9-d5e66293a1b0 req-4ae584b6-3d10-4c86-be82-afcf2167e17d service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received event network-changed-34bfd284-1ef1-415a-9c96-f5ae24114a6a {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:06:12 user nova-compute[74743]: DEBUG nova.compute.manager [req-6310aaf0-1bda-4455-92b9-d5e66293a1b0 req-4ae584b6-3d10-4c86-be82-afcf2167e17d service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Refreshing instance network info cache due to event network-changed-34bfd284-1ef1-415a-9c96-f5ae24114a6a. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:06:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-6310aaf0-1bda-4455-92b9-d5e66293a1b0 req-4ae584b6-3d10-4c86-be82-afcf2167e17d service nova] Acquiring lock "refresh_cache-58edd8cc-a455-4922-8de8-c800a61e7b43" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:06:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-6310aaf0-1bda-4455-92b9-d5e66293a1b0 req-4ae584b6-3d10-4c86-be82-afcf2167e17d service nova] Acquired lock "refresh_cache-58edd8cc-a455-4922-8de8-c800a61e7b43" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:06:12 user nova-compute[74743]: DEBUG nova.network.neutron [req-6310aaf0-1bda-4455-92b9-d5e66293a1b0 req-4ae584b6-3d10-4c86-be82-afcf2167e17d service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Refreshing network info cache for port 34bfd284-1ef1-415a-9c96-f5ae24114a6a {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:06:13 user nova-compute[74743]: DEBUG nova.objects.instance [None req-7122a91e-dc20-4f95-abfe-028bb4c5f20e tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Lazy-loading 'flavor' on Instance uuid 8e6111e9-59e9-4a30-870c-3d308a5d4936 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:06:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7122a91e-dc20-4f95-abfe-028bb4c5f20e tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Lock "8e6111e9-59e9-4a30-870c-3d308a5d4936" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.985s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:13 user nova-compute[74743]: DEBUG nova.network.neutron [req-6310aaf0-1bda-4455-92b9-d5e66293a1b0 req-4ae584b6-3d10-4c86-be82-afcf2167e17d service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Updated VIF entry in instance network info cache for port 34bfd284-1ef1-415a-9c96-f5ae24114a6a. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:06:13 user nova-compute[74743]: DEBUG nova.network.neutron [req-6310aaf0-1bda-4455-92b9-d5e66293a1b0 req-4ae584b6-3d10-4c86-be82-afcf2167e17d service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Updating instance_info_cache with network_info: [{"id": "34bfd284-1ef1-415a-9c96-f5ae24114a6a", "address": "fa:16:3e:3f:ad:b1", "network": {"id": "1638ba59-8de1-4e32-ab20-8cd8c688de5f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1073649476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34bfd284-1e", "ovs_interfaceid": "34bfd284-1ef1-415a-9c96-f5ae24114a6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f7d1b2be-29b6-45a1-9917-d16b576a84b2", "address": "fa:16:3e:c2:43:ab", "network": {"id": "4501b03b-0b17-40b9-8545-c3385627d276", "bridge": "br-int", "label": "tempest-device-tagging-net1-1630322313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7d1b2be-29", "ovs_interfaceid": "f7d1b2be-29b6-45a1-9917-d16b576a84b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2629b394-59bc-4ddd-9d05-3fa4fbb15b55", "address": "fa:16:3e:6c:2d:b7", "network": {"id": "4501b03b-0b17-40b9-8545-c3385627d276", "bridge": "br-int", "label": "tempest-device-tagging-net1-1630322313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2629b394-59", "ovs_interfaceid": "2629b394-59bc-4ddd-9d05-3fa4fbb15b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "64686449-f344-4a65-ac45-8e7ff3f8cd84", "address": "fa:16:3e:8b:69:97", "network": {"id": "4501b03b-0b17-40b9-8545-c3385627d276", "bridge": "br-int", "label": "tempest-device-tagging-net1-1630322313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64686449-f3", "ovs_interfaceid": "64686449-f344-4a65-ac45-8e7ff3f8cd84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9dd57873-8274-4099-b5a7-cefeabbbc308", "address": "fa:16:3e:3d:0f:1e", "network": {"id": "4501b03b-0b17-40b9-8545-c3385627d276", "bridge": "br-int", "label": "tempest-device-tagging-net1-1630322313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dd57873-82", "ovs_interfaceid": "9dd57873-8274-4099-b5a7-cefeabbbc308", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c658955e-999b-40cf-bed4-b59459a8953a", "address": "fa:16:3e:20:e9:d3", "network": {"id": "a14a0aa7-2798-4429-9394-a35ee3367c86", "bridge": "br-int", "label": "tempest-device-tagging-net2-808383388", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc658955e-99", "ovs_interfaceid": "c658955e-999b-40cf-bed4-b59459a8953a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a44b1589-f08b-4d65-a6a0-bb0e95fcf2ab", "address": "fa:16:3e:aa:65:f0", "network": {"id": "a14a0aa7-2798-4429-9394-a35ee3367c86", "bridge": "br-int", "label": "tempest-device-tagging-net2-808383388", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa44b1589-f0", "ovs_interfaceid": "a44b1589-f08b-4d65-a6a0-bb0e95fcf2ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:06:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-6310aaf0-1bda-4455-92b9-d5e66293a1b0 req-4ae584b6-3d10-4c86-be82-afcf2167e17d service nova] Releasing lock "refresh_cache-58edd8cc-a455-4922-8de8-c800a61e7b43" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:06:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-06771f01-49b0-461d-83d1-e59475e7fd60 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Acquiring lock "8e6111e9-59e9-4a30-870c-3d308a5d4936" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-06771f01-49b0-461d-83d1-e59475e7fd60 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Lock "8e6111e9-59e9-4a30-870c-3d308a5d4936" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-06771f01-49b0-461d-83d1-e59475e7fd60 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Acquiring lock "8e6111e9-59e9-4a30-870c-3d308a5d4936-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-06771f01-49b0-461d-83d1-e59475e7fd60 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Lock "8e6111e9-59e9-4a30-870c-3d308a5d4936-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-06771f01-49b0-461d-83d1-e59475e7fd60 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Lock "8e6111e9-59e9-4a30-870c-3d308a5d4936-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:13 user nova-compute[74743]: INFO nova.compute.manager [None req-06771f01-49b0-461d-83d1-e59475e7fd60 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Terminating instance
Nov 18 17:06:13 user nova-compute[74743]: DEBUG nova.compute.manager [None req-06771f01-49b0-461d-83d1-e59475e7fd60 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Start destroying the instance on the hypervisor. {{(pid=74743) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 17:06:13 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:13 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:13 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:13 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:13 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:14 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Instance destroyed successfully.
Nov 18 17:06:14 user nova-compute[74743]: DEBUG nova.objects.instance [None req-06771f01-49b0-461d-83d1-e59475e7fd60 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Lazy-loading 'resources' on Instance uuid 8e6111e9-59e9-4a30-870c-3d308a5d4936 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:06:14 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-06771f01-49b0-461d-83d1-e59475e7fd60 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T17:03:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-466821373',display_name='tempest-AttachSCSIVolumeTestJSON-server-466821373',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-466821373',id=6,image_ref='322d9677-06f7-4b08-be88-9fffc98cac29',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVayI6NJDJ6ndIrTQnGbHVl/zmbaufeiiLi9nS36Dia8lGCf9LIzHdhMloHXaFlyYWzcXaa4WOyMzaECwK2FjDqYqUSVgzKin34Zm0v05Yd4TyxIk3HYanaBkRLff3V0w==',key_name='tempest-keypair-1043222923',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:03:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16de5043b38d4b3f8b1eccc4fed18acb',ramdisk_id='',reservation_id='r-lr0uviy2',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='322d9677-06f7-4b08-be88-9fffc98cac29',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-74434130',owner_user_name='tempest-AttachSCSIVolumeTestJSON-74434130-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:03:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2edb384cc4d249a2b07528a6e2d90ead',uuid=8e6111e9-59e9-4a30-870c-3d308a5d4936,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b8c6ca6-189a-44fc-b8d5-d8ae5c501188", "address": "fa:16:3e:8c:b5:bb", "network": {"id": "cf1ba269-6100-4ad9-88bb-9693137fd478", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1280411595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16de5043b38d4b3f8b1eccc4fed18acb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b8c6ca6-18", "ovs_interfaceid": "3b8c6ca6-189a-44fc-b8d5-d8ae5c501188", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:06:14 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-06771f01-49b0-461d-83d1-e59475e7fd60 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Converting VIF {"id": "3b8c6ca6-189a-44fc-b8d5-d8ae5c501188", "address": "fa:16:3e:8c:b5:bb", "network": {"id": "cf1ba269-6100-4ad9-88bb-9693137fd478", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1280411595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16de5043b38d4b3f8b1eccc4fed18acb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b8c6ca6-18", "ovs_interfaceid": "3b8c6ca6-189a-44fc-b8d5-d8ae5c501188", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:06:14 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-06771f01-49b0-461d-83d1-e59475e7fd60 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:b5:bb,bridge_name='br-int',has_traffic_filtering=True,id=3b8c6ca6-189a-44fc-b8d5-d8ae5c501188,network=Network(cf1ba269-6100-4ad9-88bb-9693137fd478),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b8c6ca6-18') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:06:14 user nova-compute[74743]: DEBUG os_vif [None req-06771f01-49b0-461d-83d1-e59475e7fd60 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:b5:bb,bridge_name='br-int',has_traffic_filtering=True,id=3b8c6ca6-189a-44fc-b8d5-d8ae5c501188,network=Network(cf1ba269-6100-4ad9-88bb-9693137fd478),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b8c6ca6-18') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:06:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b8c6ca6-18, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:06:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:06:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=733140b5-f083-4365-89db-71e5e07eb700) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:06:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:06:14 user nova-compute[74743]: INFO os_vif [None req-06771f01-49b0-461d-83d1-e59475e7fd60 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:b5:bb,bridge_name='br-int',has_traffic_filtering=True,id=3b8c6ca6-189a-44fc-b8d5-d8ae5c501188,network=Network(cf1ba269-6100-4ad9-88bb-9693137fd478),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b8c6ca6-18')
Nov 18 17:06:14 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-06771f01-49b0-461d-83d1-e59475e7fd60 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Deleting instance files /opt/stack/data/nova/instances/8e6111e9-59e9-4a30-870c-3d308a5d4936_del
Nov 18 17:06:14 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-06771f01-49b0-461d-83d1-e59475e7fd60 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Deletion of /opt/stack/data/nova/instances/8e6111e9-59e9-4a30-870c-3d308a5d4936_del complete
Nov 18 17:06:14 user nova-compute[74743]: INFO nova.compute.manager [None req-06771f01-49b0-461d-83d1-e59475e7fd60 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 18 17:06:14 user nova-compute[74743]: DEBUG oslo.service.loopingcall [None req-06771f01-49b0-461d-83d1-e59475e7fd60 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74743) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 17:06:14 user nova-compute[74743]: DEBUG nova.compute.manager [-] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Deallocating network for instance {{(pid=74743) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 17:06:14 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] deallocate_for_instance() {{(pid=74743) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 17:06:14 user nova-compute[74743]: DEBUG nova.compute.manager [req-a6bc4907-5995-4bfe-a0d6-983f67f2b092 req-4f4a3952-9865-403b-bb3c-4a8fed27e98a service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received event network-changed-c646e401-7317-4e71-9ec5-5720fbc4b449 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:06:14 user nova-compute[74743]: DEBUG nova.compute.manager [req-a6bc4907-5995-4bfe-a0d6-983f67f2b092 req-4f4a3952-9865-403b-bb3c-4a8fed27e98a service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Refreshing instance network info cache due to event network-changed-c646e401-7317-4e71-9ec5-5720fbc4b449. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:06:14 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a6bc4907-5995-4bfe-a0d6-983f67f2b092 req-4f4a3952-9865-403b-bb3c-4a8fed27e98a service nova] Acquiring lock "refresh_cache-8ed74254-d845-4810-965f-300a97ce3817" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:06:14 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a6bc4907-5995-4bfe-a0d6-983f67f2b092 req-4f4a3952-9865-403b-bb3c-4a8fed27e98a service nova] Acquired lock "refresh_cache-8ed74254-d845-4810-965f-300a97ce3817" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:06:14 user nova-compute[74743]: DEBUG nova.network.neutron [req-a6bc4907-5995-4bfe-a0d6-983f67f2b092 req-4f4a3952-9865-403b-bb3c-4a8fed27e98a service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Refreshing network info cache for port c646e401-7317-4e71-9ec5-5720fbc4b449 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:06:15 user nova-compute[74743]: DEBUG nova.network.neutron [req-a6bc4907-5995-4bfe-a0d6-983f67f2b092 req-4f4a3952-9865-403b-bb3c-4a8fed27e98a service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Updated VIF entry in instance network info cache for port c646e401-7317-4e71-9ec5-5720fbc4b449. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:06:15 user nova-compute[74743]: DEBUG nova.network.neutron [req-a6bc4907-5995-4bfe-a0d6-983f67f2b092 req-4f4a3952-9865-403b-bb3c-4a8fed27e98a service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Updating instance_info_cache with network_info: [{"id": "c646e401-7317-4e71-9ec5-5720fbc4b449", "address": "fa:16:3e:af:d8:d7", "network": {"id": "b0e24bcb-e9d6-4a04-bbb1-b3a0744f245a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1528865723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc646e401-73", "ovs_interfaceid": "c646e401-7317-4e71-9ec5-5720fbc4b449", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "36ac949f-e4af-432f-b042-62e8614b5b84", "address": "fa:16:3e:d8:e1:eb", "network": {"id": "c4ed0e46-c74d-44bb-94ee-d1b2dc871d15", "bridge": "br-int", "label": "tempest-device-tagging-net1-2003876734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36ac949f-e4", "ovs_interfaceid": "36ac949f-e4af-432f-b042-62e8614b5b84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2937523f-15c9-4fe4-9f7c-174b941035e8", "address": "fa:16:3e:3e:90:e2", "network": {"id": "c4ed0e46-c74d-44bb-94ee-d1b2dc871d15", "bridge": "br-int", "label": "tempest-device-tagging-net1-2003876734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2937523f-15", "ovs_interfaceid": "2937523f-15c9-4fe4-9f7c-174b941035e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8ba0c408-cb71-4fe5-88de-5ec1c8a81704", "address": "fa:16:3e:aa:1e:86", "network": {"id": "c4ed0e46-c74d-44bb-94ee-d1b2dc871d15", "bridge": "br-int", "label": "tempest-device-tagging-net1-2003876734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba0c408-cb", "ovs_interfaceid": "8ba0c408-cb71-4fe5-88de-5ec1c8a81704", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "587569cd-f07c-4087-b7e7-66967dfcfcf7", "address": "fa:16:3e:c3:d6:8a", "network": {"id": "c4ed0e46-c74d-44bb-94ee-d1b2dc871d15", "bridge": "br-int", "label": "tempest-device-tagging-net1-2003876734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap587569cd-f0", "ovs_interfaceid": "587569cd-f07c-4087-b7e7-66967dfcfcf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f4532d74-be0a-451a-ad58-d7b0d3aeb757", "address": "fa:16:3e:51:3a:05", "network": {"id": "29131171-10e1-4628-9763-a74023087bca", "bridge": "br-int", "label": "tempest-device-tagging-net2-1600450954", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4532d74-be", "ovs_interfaceid": "f4532d74-be0a-451a-ad58-d7b0d3aeb757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2a12256b-0d24-4ffa-aac0-451c27187fc7", "address": "fa:16:3e:d4:68:ae", "network": {"id": "29131171-10e1-4628-9763-a74023087bca", "bridge": "br-int", "label": "tempest-device-tagging-net2-1600450954", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a12256b-0d", "ovs_interfaceid": "2a12256b-0d24-4ffa-aac0-451c27187fc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:06:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a6bc4907-5995-4bfe-a0d6-983f67f2b092 req-4f4a3952-9865-403b-bb3c-4a8fed27e98a service nova] Releasing lock "refresh_cache-8ed74254-d845-4810-965f-300a97ce3817" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:06:15 user nova-compute[74743]: DEBUG nova.compute.manager [req-a6bc4907-5995-4bfe-a0d6-983f67f2b092 req-4f4a3952-9865-403b-bb3c-4a8fed27e98a service nova] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Received event network-vif-unplugged-3b8c6ca6-189a-44fc-b8d5-d8ae5c501188 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:06:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a6bc4907-5995-4bfe-a0d6-983f67f2b092 req-4f4a3952-9865-403b-bb3c-4a8fed27e98a service nova] Acquiring lock "8e6111e9-59e9-4a30-870c-3d308a5d4936-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a6bc4907-5995-4bfe-a0d6-983f67f2b092 req-4f4a3952-9865-403b-bb3c-4a8fed27e98a service nova] Lock "8e6111e9-59e9-4a30-870c-3d308a5d4936-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a6bc4907-5995-4bfe-a0d6-983f67f2b092 req-4f4a3952-9865-403b-bb3c-4a8fed27e98a service nova] Lock "8e6111e9-59e9-4a30-870c-3d308a5d4936-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:15 user nova-compute[74743]: DEBUG nova.compute.manager [req-a6bc4907-5995-4bfe-a0d6-983f67f2b092 req-4f4a3952-9865-403b-bb3c-4a8fed27e98a service nova] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] No waiting events found dispatching network-vif-unplugged-3b8c6ca6-189a-44fc-b8d5-d8ae5c501188 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:06:15 user nova-compute[74743]: DEBUG nova.compute.manager [req-a6bc4907-5995-4bfe-a0d6-983f67f2b092 req-4f4a3952-9865-403b-bb3c-4a8fed27e98a service nova] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Received event network-vif-unplugged-3b8c6ca6-189a-44fc-b8d5-d8ae5c501188 for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:06:15 user nova-compute[74743]: DEBUG nova.compute.manager [req-a6bc4907-5995-4bfe-a0d6-983f67f2b092 req-4f4a3952-9865-403b-bb3c-4a8fed27e98a service nova] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Received event network-vif-plugged-3b8c6ca6-189a-44fc-b8d5-d8ae5c501188 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:06:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a6bc4907-5995-4bfe-a0d6-983f67f2b092 req-4f4a3952-9865-403b-bb3c-4a8fed27e98a service nova] Acquiring lock "8e6111e9-59e9-4a30-870c-3d308a5d4936-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a6bc4907-5995-4bfe-a0d6-983f67f2b092 req-4f4a3952-9865-403b-bb3c-4a8fed27e98a service nova] Lock "8e6111e9-59e9-4a30-870c-3d308a5d4936-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a6bc4907-5995-4bfe-a0d6-983f67f2b092 req-4f4a3952-9865-403b-bb3c-4a8fed27e98a service nova] Lock "8e6111e9-59e9-4a30-870c-3d308a5d4936-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:15 user nova-compute[74743]: DEBUG nova.compute.manager [req-a6bc4907-5995-4bfe-a0d6-983f67f2b092 req-4f4a3952-9865-403b-bb3c-4a8fed27e98a service nova] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] No waiting events found dispatching network-vif-plugged-3b8c6ca6-189a-44fc-b8d5-d8ae5c501188 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:06:15 user nova-compute[74743]: WARNING nova.compute.manager [req-a6bc4907-5995-4bfe-a0d6-983f67f2b092 req-4f4a3952-9865-403b-bb3c-4a8fed27e98a service nova] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Received unexpected event network-vif-plugged-3b8c6ca6-189a-44fc-b8d5-d8ae5c501188 for instance with vm_state active and task_state deleting.
Nov 18 17:06:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Acquiring lock "58edd8cc-a455-4922-8de8-c800a61e7b43" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Acquiring lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:15 user nova-compute[74743]: INFO nova.compute.manager [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Terminating instance
Nov 18 17:06:15 user nova-compute[74743]: DEBUG nova.compute.manager [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Start destroying the instance on the hypervisor. {{(pid=74743) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 17:06:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Acquiring lock "8ed74254-d845-4810-965f-300a97ce3817" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Lock "8ed74254-d845-4810-965f-300a97ce3817" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Acquiring lock "8ed74254-d845-4810-965f-300a97ce3817-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:16 user nova-compute[74743]: INFO nova.compute.manager [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Terminating instance
Nov 18 17:06:16 user nova-compute[74743]: DEBUG nova.compute.manager [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Start destroying the instance on the hypervisor. {{(pid=74743) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG nova.compute.manager [req-e4e380c3-125b-4a70-b958-a0f15bd5d280 req-0fc0921d-d871-4bf7-b847-cc97d5ec228c service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received event network-vif-unplugged-64686449-f344-4a65-ac45-8e7ff3f8cd84 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e4e380c3-125b-4a70-b958-a0f15bd5d280 req-0fc0921d-d871-4bf7-b847-cc97d5ec228c service nova] Acquiring lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e4e380c3-125b-4a70-b958-a0f15bd5d280 req-0fc0921d-d871-4bf7-b847-cc97d5ec228c service nova] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e4e380c3-125b-4a70-b958-a0f15bd5d280 req-0fc0921d-d871-4bf7-b847-cc97d5ec228c service nova] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG nova.compute.manager [req-e4e380c3-125b-4a70-b958-a0f15bd5d280 req-0fc0921d-d871-4bf7-b847-cc97d5ec228c service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] No waiting events found dispatching network-vif-unplugged-64686449-f344-4a65-ac45-8e7ff3f8cd84 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG nova.compute.manager [req-e4e380c3-125b-4a70-b958-a0f15bd5d280 req-0fc0921d-d871-4bf7-b847-cc97d5ec228c service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received event network-vif-unplugged-64686449-f344-4a65-ac45-8e7ff3f8cd84 for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG nova.compute.manager [req-86bfe927-1645-4051-9a0c-c13896252a60 req-d97768eb-2b74-4611-acb2-e2bb66cfed6e service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received event network-vif-unplugged-f7d1b2be-29b6-45a1-9917-d16b576a84b2 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-86bfe927-1645-4051-9a0c-c13896252a60 req-d97768eb-2b74-4611-acb2-e2bb66cfed6e service nova] Acquiring lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-86bfe927-1645-4051-9a0c-c13896252a60 req-d97768eb-2b74-4611-acb2-e2bb66cfed6e service nova] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-86bfe927-1645-4051-9a0c-c13896252a60 req-d97768eb-2b74-4611-acb2-e2bb66cfed6e service nova] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG nova.compute.manager [req-86bfe927-1645-4051-9a0c-c13896252a60 req-d97768eb-2b74-4611-acb2-e2bb66cfed6e service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] No waiting events found dispatching network-vif-unplugged-f7d1b2be-29b6-45a1-9917-d16b576a84b2 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG nova.compute.manager [req-86bfe927-1645-4051-9a0c-c13896252a60 req-d97768eb-2b74-4611-acb2-e2bb66cfed6e service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received event network-vif-unplugged-f7d1b2be-29b6-45a1-9917-d16b576a84b2 for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:06:16 user nova-compute[74743]: INFO nova.compute.manager [-] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Took 1.92 seconds to deallocate network for instance.
Nov 18 17:06:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-06771f01-49b0-461d-83d1-e59475e7fd60 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-06771f01-49b0-461d-83d1-e59475e7fd60 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG nova.compute.manager [req-ee7e0e95-7aa0-4c04-9e9d-588529a5b5dc req-e51205f8-e740-4976-9b8e-2f8ae7396004 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received event network-vif-unplugged-34bfd284-1ef1-415a-9c96-f5ae24114a6a {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ee7e0e95-7aa0-4c04-9e9d-588529a5b5dc req-e51205f8-e740-4976-9b8e-2f8ae7396004 service nova] Acquiring lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ee7e0e95-7aa0-4c04-9e9d-588529a5b5dc req-e51205f8-e740-4976-9b8e-2f8ae7396004 service nova] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ee7e0e95-7aa0-4c04-9e9d-588529a5b5dc req-e51205f8-e740-4976-9b8e-2f8ae7396004 service nova] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG nova.compute.manager [req-ee7e0e95-7aa0-4c04-9e9d-588529a5b5dc req-e51205f8-e740-4976-9b8e-2f8ae7396004 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] No waiting events found dispatching network-vif-unplugged-34bfd284-1ef1-415a-9c96-f5ae24114a6a {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG nova.compute.manager [req-ee7e0e95-7aa0-4c04-9e9d-588529a5b5dc req-e51205f8-e740-4976-9b8e-2f8ae7396004 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received event network-vif-unplugged-34bfd284-1ef1-415a-9c96-f5ae24114a6a for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG nova.compute.manager [req-ee7e0e95-7aa0-4c04-9e9d-588529a5b5dc req-e51205f8-e740-4976-9b8e-2f8ae7396004 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received event network-vif-plugged-34bfd284-1ef1-415a-9c96-f5ae24114a6a {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ee7e0e95-7aa0-4c04-9e9d-588529a5b5dc req-e51205f8-e740-4976-9b8e-2f8ae7396004 service nova] Acquiring lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ee7e0e95-7aa0-4c04-9e9d-588529a5b5dc req-e51205f8-e740-4976-9b8e-2f8ae7396004 service nova] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ee7e0e95-7aa0-4c04-9e9d-588529a5b5dc req-e51205f8-e740-4976-9b8e-2f8ae7396004 service nova] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG nova.compute.manager [req-ee7e0e95-7aa0-4c04-9e9d-588529a5b5dc req-e51205f8-e740-4976-9b8e-2f8ae7396004 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] No waiting events found dispatching network-vif-plugged-34bfd284-1ef1-415a-9c96-f5ae24114a6a {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:06:16 user nova-compute[74743]: WARNING nova.compute.manager [req-ee7e0e95-7aa0-4c04-9e9d-588529a5b5dc req-e51205f8-e740-4976-9b8e-2f8ae7396004 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received unexpected event network-vif-plugged-34bfd284-1ef1-415a-9c96-f5ae24114a6a for instance with vm_state active and task_state deleting.
Nov 18 17:06:16 user nova-compute[74743]: DEBUG nova.compute.manager [req-ee7e0e95-7aa0-4c04-9e9d-588529a5b5dc req-e51205f8-e740-4976-9b8e-2f8ae7396004 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received event network-vif-unplugged-2629b394-59bc-4ddd-9d05-3fa4fbb15b55 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ee7e0e95-7aa0-4c04-9e9d-588529a5b5dc req-e51205f8-e740-4976-9b8e-2f8ae7396004 service nova] Acquiring lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ee7e0e95-7aa0-4c04-9e9d-588529a5b5dc req-e51205f8-e740-4976-9b8e-2f8ae7396004 service nova] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ee7e0e95-7aa0-4c04-9e9d-588529a5b5dc req-e51205f8-e740-4976-9b8e-2f8ae7396004 service nova] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG nova.compute.manager [req-ee7e0e95-7aa0-4c04-9e9d-588529a5b5dc req-e51205f8-e740-4976-9b8e-2f8ae7396004 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] No waiting events found dispatching network-vif-unplugged-2629b394-59bc-4ddd-9d05-3fa4fbb15b55 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG nova.compute.manager [req-ee7e0e95-7aa0-4c04-9e9d-588529a5b5dc req-e51205f8-e740-4976-9b8e-2f8ae7396004 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received event network-vif-unplugged-2629b394-59bc-4ddd-9d05-3fa4fbb15b55 for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG nova.compute.manager [req-ee7e0e95-7aa0-4c04-9e9d-588529a5b5dc req-e51205f8-e740-4976-9b8e-2f8ae7396004 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received event network-vif-plugged-2629b394-59bc-4ddd-9d05-3fa4fbb15b55 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ee7e0e95-7aa0-4c04-9e9d-588529a5b5dc req-e51205f8-e740-4976-9b8e-2f8ae7396004 service nova] Acquiring lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ee7e0e95-7aa0-4c04-9e9d-588529a5b5dc req-e51205f8-e740-4976-9b8e-2f8ae7396004 service nova] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ee7e0e95-7aa0-4c04-9e9d-588529a5b5dc req-e51205f8-e740-4976-9b8e-2f8ae7396004 service nova] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG nova.compute.manager [req-ee7e0e95-7aa0-4c04-9e9d-588529a5b5dc req-e51205f8-e740-4976-9b8e-2f8ae7396004 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] No waiting events found dispatching network-vif-plugged-2629b394-59bc-4ddd-9d05-3fa4fbb15b55 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:06:16 user nova-compute[74743]: WARNING nova.compute.manager [req-ee7e0e95-7aa0-4c04-9e9d-588529a5b5dc req-e51205f8-e740-4976-9b8e-2f8ae7396004 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received unexpected event network-vif-plugged-2629b394-59bc-4ddd-9d05-3fa4fbb15b55 for instance with vm_state active and task_state deleting.
Nov 18 17:06:16 user nova-compute[74743]: DEBUG nova.compute.manager [req-ee7e0e95-7aa0-4c04-9e9d-588529a5b5dc req-e51205f8-e740-4976-9b8e-2f8ae7396004 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received event network-vif-unplugged-36ac949f-e4af-432f-b042-62e8614b5b84 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ee7e0e95-7aa0-4c04-9e9d-588529a5b5dc req-e51205f8-e740-4976-9b8e-2f8ae7396004 service nova] Acquiring lock "8ed74254-d845-4810-965f-300a97ce3817-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ee7e0e95-7aa0-4c04-9e9d-588529a5b5dc req-e51205f8-e740-4976-9b8e-2f8ae7396004 service nova] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ee7e0e95-7aa0-4c04-9e9d-588529a5b5dc req-e51205f8-e740-4976-9b8e-2f8ae7396004 service nova] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG nova.compute.manager [req-ee7e0e95-7aa0-4c04-9e9d-588529a5b5dc req-e51205f8-e740-4976-9b8e-2f8ae7396004 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] No waiting events found dispatching network-vif-unplugged-36ac949f-e4af-432f-b042-62e8614b5b84 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG nova.compute.manager [req-ee7e0e95-7aa0-4c04-9e9d-588529a5b5dc req-e51205f8-e740-4976-9b8e-2f8ae7396004 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received event network-vif-unplugged-36ac949f-e4af-432f-b042-62e8614b5b84 for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:17 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-06771f01-49b0-461d-83d1-e59475e7fd60 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:06:17 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-06771f01-49b0-461d-83d1-e59475e7fd60 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:06:17 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-06771f01-49b0-461d-83d1-e59475e7fd60 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.703s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:17 user nova-compute[74743]: INFO nova.scheduler.client.report [None req-06771f01-49b0-461d-83d1-e59475e7fd60 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Deleted allocations for instance 8e6111e9-59e9-4a30-870c-3d308a5d4936
Nov 18 17:06:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:17 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Instance destroyed successfully.
Nov 18 17:06:17 user nova-compute[74743]: DEBUG nova.objects.instance [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Lazy-loading 'resources' on Instance uuid 58edd8cc-a455-4922-8de8-c800a61e7b43 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:06:17 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T17:04:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1317300551',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1317300551',id=10,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5BDO9C8x4KBW8CgUPnSx7E01ZR+pcKEml0/t6Gj2w4MmQpDst8vuwOeiuCSmZUUzT19BBkzO9wQBMDEcUuTHO37Nx1as9VWeLZ/OjxIDUYzc9Z6H/jeRdfuIP00EqKSg==',key_name='tempest-keypair-1501335207',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:04:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='499d0dc41fbb400ab2b83b5d5091d880',ramdisk_id='',reservation_id='r-x8o6nc9i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1747303038',owner_user_name='tempest-TaggedBootDevicesTest_v242-1747303038-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:04:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cad6e6d43b3d474a888f6b02458b2ac8',uuid=58edd8cc-a455-4922-8de8-c800a61e7b43,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "34bfd284-1ef1-415a-9c96-f5ae24114a6a", "address": "fa:16:3e:3f:ad:b1", "network": {"id": "1638ba59-8de1-4e32-ab20-8cd8c688de5f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1073649476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34bfd284-1e", "ovs_interfaceid": "34bfd284-1ef1-415a-9c96-f5ae24114a6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:06:17 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Converting VIF {"id": "34bfd284-1ef1-415a-9c96-f5ae24114a6a", "address": "fa:16:3e:3f:ad:b1", "network": {"id": "1638ba59-8de1-4e32-ab20-8cd8c688de5f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1073649476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34bfd284-1e", "ovs_interfaceid": "34bfd284-1ef1-415a-9c96-f5ae24114a6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:06:17 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:ad:b1,bridge_name='br-int',has_traffic_filtering=True,id=34bfd284-1ef1-415a-9c96-f5ae24114a6a,network=Network(1638ba59-8de1-4e32-ab20-8cd8c688de5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34bfd284-1e') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:06:17 user nova-compute[74743]: DEBUG os_vif [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:ad:b1,bridge_name='br-int',has_traffic_filtering=True,id=34bfd284-1ef1-415a-9c96-f5ae24114a6a,network=Network(1638ba59-8de1-4e32-ab20-8cd8c688de5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34bfd284-1e') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:06:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap34bfd284-1e, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:06:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:17 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-06771f01-49b0-461d-83d1-e59475e7fd60 tempest-AttachSCSIVolumeTestJSON-74434130 tempest-AttachSCSIVolumeTestJSON-74434130-project-member] Lock "8e6111e9-59e9-4a30-870c-3d308a5d4936" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.834s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:06:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1a2795b3-d74a-4893-bda4-897b69021f9c) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:06:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:06:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:17 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Instance destroyed successfully.
Nov 18 17:06:17 user nova-compute[74743]: DEBUG nova.objects.instance [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Lazy-loading 'resources' on Instance uuid 8ed74254-d845-4810-965f-300a97ce3817 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:06:17 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T17:04:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1943040326',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1943040326',id=11,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjnTCPkQxuEtLzy+XmBSDH56QrRsiiTpaDkmMTDnxMmMj6n9lDqW72cXc9PIo+K+Uncg1A8ETn0FYi2Bgr/OTSN79EbcvpXNaaew5fh55Enmun/lTqwO1/r1tUwCcUz8Q==',key_name='tempest-keypair-2114506226',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:05:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='94a9888c9a4349e896e6bdf2af37ef98',ramdisk_id='',reservation_id='r-fa2gzleq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-951253911',owner_user_name='tempest-TaggedBootDevicesTest-951253911-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:05:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='480793b3fb7848a89ae4add6c6cf2d90',uuid=8ed74254-d845-4810-965f-300a97ce3817,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c646e401-7317-4e71-9ec5-5720fbc4b449", "address": "fa:16:3e:af:d8:d7", "network": {"id": "b0e24bcb-e9d6-4a04-bbb1-b3a0744f245a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1528865723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc646e401-73", "ovs_interfaceid": "c646e401-7317-4e71-9ec5-5720fbc4b449", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:06:17 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Converting VIF {"id": "c646e401-7317-4e71-9ec5-5720fbc4b449", "address": "fa:16:3e:af:d8:d7", "network": {"id": "b0e24bcb-e9d6-4a04-bbb1-b3a0744f245a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1528865723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc646e401-73", "ovs_interfaceid": "c646e401-7317-4e71-9ec5-5720fbc4b449", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:06:17 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:d8:d7,bridge_name='br-int',has_traffic_filtering=True,id=c646e401-7317-4e71-9ec5-5720fbc4b449,network=Network(b0e24bcb-e9d6-4a04-bbb1-b3a0744f245a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc646e401-73') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:06:17 user nova-compute[74743]: DEBUG os_vif [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:d8:d7,bridge_name='br-int',has_traffic_filtering=True,id=c646e401-7317-4e71-9ec5-5720fbc4b449,network=Network(b0e24bcb-e9d6-4a04-bbb1-b3a0744f245a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc646e401-73') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:06:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc646e401-73, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:06:17 user nova-compute[74743]: INFO os_vif [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:ad:b1,bridge_name='br-int',has_traffic_filtering=True,id=34bfd284-1ef1-415a-9c96-f5ae24114a6a,network=Network(1638ba59-8de1-4e32-ab20-8cd8c688de5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34bfd284-1e')
Nov 18 17:06:17 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T17:04:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1317300551',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1317300551',id=10,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5BDO9C8x4KBW8CgUPnSx7E01ZR+pcKEml0/t6Gj2w4MmQpDst8vuwOeiuCSmZUUzT19BBkzO9wQBMDEcUuTHO37Nx1as9VWeLZ/OjxIDUYzc9Z6H/jeRdfuIP00EqKSg==',key_name='tempest-keypair-1501335207',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:04:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='499d0dc41fbb400ab2b83b5d5091d880',ramdisk_id='',reservation_id='r-x8o6nc9i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1747303038',owner_user_name='tempest-TaggedBootDevicesTest_v242-1747303038-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:04:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cad6e6d43b3d474a888f6b02458b2ac8',uuid=58edd8cc-a455-4922-8de8-c800a61e7b43,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f7d1b2be-29b6-45a1-9917-d16b576a84b2", "address": "fa:16:3e:c2:43:ab", "network": {"id": "4501b03b-0b17-40b9-8545-c3385627d276", "bridge": "br-int", "label": "tempest-device-tagging-net1-1630322313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7d1b2be-29", "ovs_interfaceid": "f7d1b2be-29b6-45a1-9917-d16b576a84b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:06:17 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Converting VIF {"id": "f7d1b2be-29b6-45a1-9917-d16b576a84b2", "address": "fa:16:3e:c2:43:ab", "network": {"id": "4501b03b-0b17-40b9-8545-c3385627d276", "bridge": "br-int", "label": "tempest-device-tagging-net1-1630322313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7d1b2be-29", "ovs_interfaceid": "f7d1b2be-29b6-45a1-9917-d16b576a84b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:06:17 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:43:ab,bridge_name='br-int',has_traffic_filtering=True,id=f7d1b2be-29b6-45a1-9917-d16b576a84b2,network=Network(4501b03b-0b17-40b9-8545-c3385627d276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf7d1b2be-29') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:06:17 user nova-compute[74743]: DEBUG os_vif [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:43:ab,bridge_name='br-int',has_traffic_filtering=True,id=f7d1b2be-29b6-45a1-9917-d16b576a84b2,network=Network(4501b03b-0b17-40b9-8545-c3385627d276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf7d1b2be-29') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:06:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf7d1b2be-29, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c7d96fbf-fbdf-427b-b962-2405a33b1461) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-947e8a16-dbe9-445d-bb34-7caceda127ef req-78657352-d958-4026-af35-258eae3c80ae service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received event network-vif-plugged-64686449-f344-4a65-ac45-8e7ff3f8cd84 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-947e8a16-dbe9-445d-bb34-7caceda127ef req-78657352-d958-4026-af35-258eae3c80ae service nova] Acquiring lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-947e8a16-dbe9-445d-bb34-7caceda127ef req-78657352-d958-4026-af35-258eae3c80ae service nova] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-947e8a16-dbe9-445d-bb34-7caceda127ef req-78657352-d958-4026-af35-258eae3c80ae service nova] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-947e8a16-dbe9-445d-bb34-7caceda127ef req-78657352-d958-4026-af35-258eae3c80ae service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] No waiting events found dispatching network-vif-plugged-64686449-f344-4a65-ac45-8e7ff3f8cd84 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:06:18 user nova-compute[74743]: WARNING nova.compute.manager [req-947e8a16-dbe9-445d-bb34-7caceda127ef req-78657352-d958-4026-af35-258eae3c80ae service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received unexpected event network-vif-plugged-64686449-f344-4a65-ac45-8e7ff3f8cd84 for instance with vm_state active and task_state deleting.
Nov 18 17:06:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-947e8a16-dbe9-445d-bb34-7caceda127ef req-78657352-d958-4026-af35-258eae3c80ae service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received event network-vif-unplugged-c658955e-999b-40cf-bed4-b59459a8953a {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-947e8a16-dbe9-445d-bb34-7caceda127ef req-78657352-d958-4026-af35-258eae3c80ae service nova] Acquiring lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-947e8a16-dbe9-445d-bb34-7caceda127ef req-78657352-d958-4026-af35-258eae3c80ae service nova] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-947e8a16-dbe9-445d-bb34-7caceda127ef req-78657352-d958-4026-af35-258eae3c80ae service nova] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-947e8a16-dbe9-445d-bb34-7caceda127ef req-78657352-d958-4026-af35-258eae3c80ae service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] No waiting events found dispatching network-vif-unplugged-c658955e-999b-40cf-bed4-b59459a8953a {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-947e8a16-dbe9-445d-bb34-7caceda127ef req-78657352-d958-4026-af35-258eae3c80ae service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received event network-vif-unplugged-c658955e-999b-40cf-bed4-b59459a8953a for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-947e8a16-dbe9-445d-bb34-7caceda127ef req-78657352-d958-4026-af35-258eae3c80ae service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received event network-vif-plugged-c658955e-999b-40cf-bed4-b59459a8953a {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-947e8a16-dbe9-445d-bb34-7caceda127ef req-78657352-d958-4026-af35-258eae3c80ae service nova] Acquiring lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-947e8a16-dbe9-445d-bb34-7caceda127ef req-78657352-d958-4026-af35-258eae3c80ae service nova] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-947e8a16-dbe9-445d-bb34-7caceda127ef req-78657352-d958-4026-af35-258eae3c80ae service nova] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-947e8a16-dbe9-445d-bb34-7caceda127ef req-78657352-d958-4026-af35-258eae3c80ae service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] No waiting events found dispatching network-vif-plugged-c658955e-999b-40cf-bed4-b59459a8953a {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:06:18 user nova-compute[74743]: WARNING nova.compute.manager [req-947e8a16-dbe9-445d-bb34-7caceda127ef req-78657352-d958-4026-af35-258eae3c80ae service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received unexpected event network-vif-plugged-c658955e-999b-40cf-bed4-b59459a8953a for instance with vm_state active and task_state deleting.
Nov 18 17:06:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-947e8a16-dbe9-445d-bb34-7caceda127ef req-78657352-d958-4026-af35-258eae3c80ae service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received event network-vif-unplugged-c646e401-7317-4e71-9ec5-5720fbc4b449 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-947e8a16-dbe9-445d-bb34-7caceda127ef req-78657352-d958-4026-af35-258eae3c80ae service nova] Acquiring lock "8ed74254-d845-4810-965f-300a97ce3817-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-947e8a16-dbe9-445d-bb34-7caceda127ef req-78657352-d958-4026-af35-258eae3c80ae service nova] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-947e8a16-dbe9-445d-bb34-7caceda127ef req-78657352-d958-4026-af35-258eae3c80ae service nova] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-947e8a16-dbe9-445d-bb34-7caceda127ef req-78657352-d958-4026-af35-258eae3c80ae service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] No waiting events found dispatching network-vif-unplugged-c646e401-7317-4e71-9ec5-5720fbc4b449 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-947e8a16-dbe9-445d-bb34-7caceda127ef req-78657352-d958-4026-af35-258eae3c80ae service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received event network-vif-unplugged-c646e401-7317-4e71-9ec5-5720fbc4b449 for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-947e8a16-dbe9-445d-bb34-7caceda127ef req-78657352-d958-4026-af35-258eae3c80ae service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received event network-vif-plugged-c646e401-7317-4e71-9ec5-5720fbc4b449 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-947e8a16-dbe9-445d-bb34-7caceda127ef req-78657352-d958-4026-af35-258eae3c80ae service nova] Acquiring lock "8ed74254-d845-4810-965f-300a97ce3817-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-947e8a16-dbe9-445d-bb34-7caceda127ef req-78657352-d958-4026-af35-258eae3c80ae service nova] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-947e8a16-dbe9-445d-bb34-7caceda127ef req-78657352-d958-4026-af35-258eae3c80ae service nova] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-947e8a16-dbe9-445d-bb34-7caceda127ef req-78657352-d958-4026-af35-258eae3c80ae service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] No waiting events found dispatching network-vif-plugged-c646e401-7317-4e71-9ec5-5720fbc4b449 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:06:18 user nova-compute[74743]: WARNING nova.compute.manager [req-947e8a16-dbe9-445d-bb34-7caceda127ef req-78657352-d958-4026-af35-258eae3c80ae service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received unexpected event network-vif-plugged-c646e401-7317-4e71-9ec5-5720fbc4b449 for instance with vm_state active and task_state deleting.
Nov 18 17:06:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d92bdfba-49d0-4ede-8298-bb10f2cc78ff) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:18 user nova-compute[74743]: INFO os_vif [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:d8:d7,bridge_name='br-int',has_traffic_filtering=True,id=c646e401-7317-4e71-9ec5-5720fbc4b449,network=Network(b0e24bcb-e9d6-4a04-bbb1-b3a0744f245a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc646e401-73')
Nov 18 17:06:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T17:04:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1943040326',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1943040326',id=11,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjnTCPkQxuEtLzy+XmBSDH56QrRsiiTpaDkmMTDnxMmMj6n9lDqW72cXc9PIo+K+Uncg1A8ETn0FYi2Bgr/OTSN79EbcvpXNaaew5fh55Enmun/lTqwO1/r1tUwCcUz8Q==',key_name='tempest-keypair-2114506226',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:05:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='94a9888c9a4349e896e6bdf2af37ef98',ramdisk_id='',reservation_id='r-fa2gzleq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-951253911',owner_user_name='tempest-TaggedBootDevicesTest-951253911-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:05:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='480793b3fb7848a89ae4add6c6cf2d90',uuid=8ed74254-d845-4810-965f-300a97ce3817,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36ac949f-e4af-432f-b042-62e8614b5b84", "address": "fa:16:3e:d8:e1:eb", "network": {"id": "c4ed0e46-c74d-44bb-94ee-d1b2dc871d15", "bridge": "br-int", "label": "tempest-device-tagging-net1-2003876734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36ac949f-e4", "ovs_interfaceid": "36ac949f-e4af-432f-b042-62e8614b5b84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Converting VIF {"id": "36ac949f-e4af-432f-b042-62e8614b5b84", "address": "fa:16:3e:d8:e1:eb", "network": {"id": "c4ed0e46-c74d-44bb-94ee-d1b2dc871d15", "bridge": "br-int", "label": "tempest-device-tagging-net1-2003876734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36ac949f-e4", "ovs_interfaceid": "36ac949f-e4af-432f-b042-62e8614b5b84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:e1:eb,bridge_name='br-int',has_traffic_filtering=True,id=36ac949f-e4af-432f-b042-62e8614b5b84,network=Network(c4ed0e46-c74d-44bb-94ee-d1b2dc871d15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap36ac949f-e4') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG os_vif [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:e1:eb,bridge_name='br-int',has_traffic_filtering=True,id=36ac949f-e4af-432f-b042-62e8614b5b84,network=Network(c4ed0e46-c74d-44bb-94ee-d1b2dc871d15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap36ac949f-e4') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-3c4c0a3b-b9be-472e-861e-bb55d192a1cd req-be336800-3de7-4d7c-b929-cd7a3970c76e service nova] [instance: 8e6111e9-59e9-4a30-870c-3d308a5d4936] Received event network-vif-deleted-3b8c6ca6-189a-44fc-b8d5-d8ae5c501188 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-3c4c0a3b-b9be-472e-861e-bb55d192a1cd req-be336800-3de7-4d7c-b929-cd7a3970c76e service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received event network-vif-plugged-f7d1b2be-29b6-45a1-9917-d16b576a84b2 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3c4c0a3b-b9be-472e-861e-bb55d192a1cd req-be336800-3de7-4d7c-b929-cd7a3970c76e service nova] Acquiring lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3c4c0a3b-b9be-472e-861e-bb55d192a1cd req-be336800-3de7-4d7c-b929-cd7a3970c76e service nova] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3c4c0a3b-b9be-472e-861e-bb55d192a1cd req-be336800-3de7-4d7c-b929-cd7a3970c76e service nova] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-3c4c0a3b-b9be-472e-861e-bb55d192a1cd req-be336800-3de7-4d7c-b929-cd7a3970c76e service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] No waiting events found dispatching network-vif-plugged-f7d1b2be-29b6-45a1-9917-d16b576a84b2 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:06:18 user nova-compute[74743]: WARNING nova.compute.manager [req-3c4c0a3b-b9be-472e-861e-bb55d192a1cd req-be336800-3de7-4d7c-b929-cd7a3970c76e service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received unexpected event network-vif-plugged-f7d1b2be-29b6-45a1-9917-d16b576a84b2 for instance with vm_state active and task_state deleting.
Nov 18 17:06:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-3c4c0a3b-b9be-472e-861e-bb55d192a1cd req-be336800-3de7-4d7c-b929-cd7a3970c76e service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received event network-vif-unplugged-9dd57873-8274-4099-b5a7-cefeabbbc308 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3c4c0a3b-b9be-472e-861e-bb55d192a1cd req-be336800-3de7-4d7c-b929-cd7a3970c76e service nova] Acquiring lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3c4c0a3b-b9be-472e-861e-bb55d192a1cd req-be336800-3de7-4d7c-b929-cd7a3970c76e service nova] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3c4c0a3b-b9be-472e-861e-bb55d192a1cd req-be336800-3de7-4d7c-b929-cd7a3970c76e service nova] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-3c4c0a3b-b9be-472e-861e-bb55d192a1cd req-be336800-3de7-4d7c-b929-cd7a3970c76e service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] No waiting events found dispatching network-vif-unplugged-9dd57873-8274-4099-b5a7-cefeabbbc308 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-3c4c0a3b-b9be-472e-861e-bb55d192a1cd req-be336800-3de7-4d7c-b929-cd7a3970c76e service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received event network-vif-unplugged-9dd57873-8274-4099-b5a7-cefeabbbc308 for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-3c4c0a3b-b9be-472e-861e-bb55d192a1cd req-be336800-3de7-4d7c-b929-cd7a3970c76e service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received event network-vif-plugged-9dd57873-8274-4099-b5a7-cefeabbbc308 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3c4c0a3b-b9be-472e-861e-bb55d192a1cd req-be336800-3de7-4d7c-b929-cd7a3970c76e service nova] Acquiring lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3c4c0a3b-b9be-472e-861e-bb55d192a1cd req-be336800-3de7-4d7c-b929-cd7a3970c76e service nova] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3c4c0a3b-b9be-472e-861e-bb55d192a1cd req-be336800-3de7-4d7c-b929-cd7a3970c76e service nova] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-3c4c0a3b-b9be-472e-861e-bb55d192a1cd req-be336800-3de7-4d7c-b929-cd7a3970c76e service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] No waiting events found dispatching network-vif-plugged-9dd57873-8274-4099-b5a7-cefeabbbc308 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:06:18 user nova-compute[74743]: WARNING nova.compute.manager [req-3c4c0a3b-b9be-472e-861e-bb55d192a1cd req-be336800-3de7-4d7c-b929-cd7a3970c76e service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received unexpected event network-vif-plugged-9dd57873-8274-4099-b5a7-cefeabbbc308 for instance with vm_state active and task_state deleting.
Nov 18 17:06:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-3c4c0a3b-b9be-472e-861e-bb55d192a1cd req-be336800-3de7-4d7c-b929-cd7a3970c76e service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received event network-vif-unplugged-a44b1589-f08b-4d65-a6a0-bb0e95fcf2ab {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3c4c0a3b-b9be-472e-861e-bb55d192a1cd req-be336800-3de7-4d7c-b929-cd7a3970c76e service nova] Acquiring lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3c4c0a3b-b9be-472e-861e-bb55d192a1cd req-be336800-3de7-4d7c-b929-cd7a3970c76e service nova] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3c4c0a3b-b9be-472e-861e-bb55d192a1cd req-be336800-3de7-4d7c-b929-cd7a3970c76e service nova] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-3c4c0a3b-b9be-472e-861e-bb55d192a1cd req-be336800-3de7-4d7c-b929-cd7a3970c76e service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] No waiting events found dispatching network-vif-unplugged-a44b1589-f08b-4d65-a6a0-bb0e95fcf2ab {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-3c4c0a3b-b9be-472e-861e-bb55d192a1cd req-be336800-3de7-4d7c-b929-cd7a3970c76e service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received event network-vif-unplugged-a44b1589-f08b-4d65-a6a0-bb0e95fcf2ab for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-3c4c0a3b-b9be-472e-861e-bb55d192a1cd req-be336800-3de7-4d7c-b929-cd7a3970c76e service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received event network-vif-plugged-a44b1589-f08b-4d65-a6a0-bb0e95fcf2ab {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3c4c0a3b-b9be-472e-861e-bb55d192a1cd req-be336800-3de7-4d7c-b929-cd7a3970c76e service nova] Acquiring lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3c4c0a3b-b9be-472e-861e-bb55d192a1cd req-be336800-3de7-4d7c-b929-cd7a3970c76e service nova] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3c4c0a3b-b9be-472e-861e-bb55d192a1cd req-be336800-3de7-4d7c-b929-cd7a3970c76e service nova] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-3c4c0a3b-b9be-472e-861e-bb55d192a1cd req-be336800-3de7-4d7c-b929-cd7a3970c76e service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] No waiting events found dispatching network-vif-plugged-a44b1589-f08b-4d65-a6a0-bb0e95fcf2ab {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:06:18 user nova-compute[74743]: WARNING nova.compute.manager [req-3c4c0a3b-b9be-472e-861e-bb55d192a1cd req-be336800-3de7-4d7c-b929-cd7a3970c76e service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received unexpected event network-vif-plugged-a44b1589-f08b-4d65-a6a0-bb0e95fcf2ab for instance with vm_state active and task_state deleting.
Nov 18 17:06:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-3c4c0a3b-b9be-472e-861e-bb55d192a1cd req-be336800-3de7-4d7c-b929-cd7a3970c76e service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received event network-vif-unplugged-2937523f-15c9-4fe4-9f7c-174b941035e8 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3c4c0a3b-b9be-472e-861e-bb55d192a1cd req-be336800-3de7-4d7c-b929-cd7a3970c76e service nova] Acquiring lock "8ed74254-d845-4810-965f-300a97ce3817-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3c4c0a3b-b9be-472e-861e-bb55d192a1cd req-be336800-3de7-4d7c-b929-cd7a3970c76e service nova] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3c4c0a3b-b9be-472e-861e-bb55d192a1cd req-be336800-3de7-4d7c-b929-cd7a3970c76e service nova] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-3c4c0a3b-b9be-472e-861e-bb55d192a1cd req-be336800-3de7-4d7c-b929-cd7a3970c76e service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] No waiting events found dispatching network-vif-unplugged-2937523f-15c9-4fe4-9f7c-174b941035e8 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-3c4c0a3b-b9be-472e-861e-bb55d192a1cd req-be336800-3de7-4d7c-b929-cd7a3970c76e service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received event network-vif-unplugged-2937523f-15c9-4fe4-9f7c-174b941035e8 for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-3c4c0a3b-b9be-472e-861e-bb55d192a1cd req-be336800-3de7-4d7c-b929-cd7a3970c76e service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received event network-vif-plugged-2937523f-15c9-4fe4-9f7c-174b941035e8 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3c4c0a3b-b9be-472e-861e-bb55d192a1cd req-be336800-3de7-4d7c-b929-cd7a3970c76e service nova] Acquiring lock "8ed74254-d845-4810-965f-300a97ce3817-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3c4c0a3b-b9be-472e-861e-bb55d192a1cd req-be336800-3de7-4d7c-b929-cd7a3970c76e service nova] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3c4c0a3b-b9be-472e-861e-bb55d192a1cd req-be336800-3de7-4d7c-b929-cd7a3970c76e service nova] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-3c4c0a3b-b9be-472e-861e-bb55d192a1cd req-be336800-3de7-4d7c-b929-cd7a3970c76e service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] No waiting events found dispatching network-vif-plugged-2937523f-15c9-4fe4-9f7c-174b941035e8 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:06:18 user nova-compute[74743]: WARNING nova.compute.manager [req-3c4c0a3b-b9be-472e-861e-bb55d192a1cd req-be336800-3de7-4d7c-b929-cd7a3970c76e service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received unexpected event network-vif-plugged-2937523f-15c9-4fe4-9f7c-174b941035e8 for instance with vm_state active and task_state deleting.
Nov 18 17:06:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap36ac949f-e4, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:06:18 user nova-compute[74743]: INFO os_vif [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:43:ab,bridge_name='br-int',has_traffic_filtering=True,id=f7d1b2be-29b6-45a1-9917-d16b576a84b2,network=Network(4501b03b-0b17-40b9-8545-c3385627d276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf7d1b2be-29')
Nov 18 17:06:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T17:04:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1317300551',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1317300551',id=10,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5BDO9C8x4KBW8CgUPnSx7E01ZR+pcKEml0/t6Gj2w4MmQpDst8vuwOeiuCSmZUUzT19BBkzO9wQBMDEcUuTHO37Nx1as9VWeLZ/OjxIDUYzc9Z6H/jeRdfuIP00EqKSg==',key_name='tempest-keypair-1501335207',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:04:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='499d0dc41fbb400ab2b83b5d5091d880',ramdisk_id='',reservation_id='r-x8o6nc9i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1747303038',owner_user_name='tempest-TaggedBootDevicesTest_v242-1747303038-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:04:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cad6e6d43b3d474a888f6b02458b2ac8',uuid=58edd8cc-a455-4922-8de8-c800a61e7b43,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2629b394-59bc-4ddd-9d05-3fa4fbb15b55", "address": "fa:16:3e:6c:2d:b7", "network": {"id": "4501b03b-0b17-40b9-8545-c3385627d276", "bridge": "br-int", "label": "tempest-device-tagging-net1-1630322313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2629b394-59", "ovs_interfaceid": "2629b394-59bc-4ddd-9d05-3fa4fbb15b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Converting VIF {"id": "2629b394-59bc-4ddd-9d05-3fa4fbb15b55", "address": "fa:16:3e:6c:2d:b7", "network": {"id": "4501b03b-0b17-40b9-8545-c3385627d276", "bridge": "br-int", "label": "tempest-device-tagging-net1-1630322313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2629b394-59", "ovs_interfaceid": "2629b394-59bc-4ddd-9d05-3fa4fbb15b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:2d:b7,bridge_name='br-int',has_traffic_filtering=True,id=2629b394-59bc-4ddd-9d05-3fa4fbb15b55,network=Network(4501b03b-0b17-40b9-8545-c3385627d276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2629b394-59') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG os_vif [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:2d:b7,bridge_name='br-int',has_traffic_filtering=True,id=2629b394-59bc-4ddd-9d05-3fa4fbb15b55,network=Network(4501b03b-0b17-40b9-8545-c3385627d276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2629b394-59') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2629b394-59, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=659185d7-c10f-406d-aa7d-4b175807ec87) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-674c815a-0c09-46ea-959e-9f89095b8b6a req-cd5b4e83-095b-4e88-b29c-f775e0eb22f9 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received event network-vif-plugged-36ac949f-e4af-432f-b042-62e8614b5b84 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-674c815a-0c09-46ea-959e-9f89095b8b6a req-cd5b4e83-095b-4e88-b29c-f775e0eb22f9 service nova] Acquiring lock "8ed74254-d845-4810-965f-300a97ce3817-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-674c815a-0c09-46ea-959e-9f89095b8b6a req-cd5b4e83-095b-4e88-b29c-f775e0eb22f9 service nova] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-674c815a-0c09-46ea-959e-9f89095b8b6a req-cd5b4e83-095b-4e88-b29c-f775e0eb22f9 service nova] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-674c815a-0c09-46ea-959e-9f89095b8b6a req-cd5b4e83-095b-4e88-b29c-f775e0eb22f9 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] No waiting events found dispatching network-vif-plugged-36ac949f-e4af-432f-b042-62e8614b5b84 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:06:18 user nova-compute[74743]: WARNING nova.compute.manager [req-674c815a-0c09-46ea-959e-9f89095b8b6a req-cd5b4e83-095b-4e88-b29c-f775e0eb22f9 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received unexpected event network-vif-plugged-36ac949f-e4af-432f-b042-62e8614b5b84 for instance with vm_state active and task_state deleting.
Nov 18 17:06:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-674c815a-0c09-46ea-959e-9f89095b8b6a req-cd5b4e83-095b-4e88-b29c-f775e0eb22f9 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received event network-vif-unplugged-587569cd-f07c-4087-b7e7-66967dfcfcf7 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-674c815a-0c09-46ea-959e-9f89095b8b6a req-cd5b4e83-095b-4e88-b29c-f775e0eb22f9 service nova] Acquiring lock "8ed74254-d845-4810-965f-300a97ce3817-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-674c815a-0c09-46ea-959e-9f89095b8b6a req-cd5b4e83-095b-4e88-b29c-f775e0eb22f9 service nova] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-674c815a-0c09-46ea-959e-9f89095b8b6a req-cd5b4e83-095b-4e88-b29c-f775e0eb22f9 service nova] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-674c815a-0c09-46ea-959e-9f89095b8b6a req-cd5b4e83-095b-4e88-b29c-f775e0eb22f9 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] No waiting events found dispatching network-vif-unplugged-587569cd-f07c-4087-b7e7-66967dfcfcf7 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-674c815a-0c09-46ea-959e-9f89095b8b6a req-cd5b4e83-095b-4e88-b29c-f775e0eb22f9 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received event network-vif-unplugged-587569cd-f07c-4087-b7e7-66967dfcfcf7 for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-674c815a-0c09-46ea-959e-9f89095b8b6a req-cd5b4e83-095b-4e88-b29c-f775e0eb22f9 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received event network-vif-plugged-587569cd-f07c-4087-b7e7-66967dfcfcf7 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-674c815a-0c09-46ea-959e-9f89095b8b6a req-cd5b4e83-095b-4e88-b29c-f775e0eb22f9 service nova] Acquiring lock "8ed74254-d845-4810-965f-300a97ce3817-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-674c815a-0c09-46ea-959e-9f89095b8b6a req-cd5b4e83-095b-4e88-b29c-f775e0eb22f9 service nova] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-674c815a-0c09-46ea-959e-9f89095b8b6a req-cd5b4e83-095b-4e88-b29c-f775e0eb22f9 service nova] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-674c815a-0c09-46ea-959e-9f89095b8b6a req-cd5b4e83-095b-4e88-b29c-f775e0eb22f9 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] No waiting events found dispatching network-vif-plugged-587569cd-f07c-4087-b7e7-66967dfcfcf7 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:06:18 user nova-compute[74743]: WARNING nova.compute.manager [req-674c815a-0c09-46ea-959e-9f89095b8b6a req-cd5b4e83-095b-4e88-b29c-f775e0eb22f9 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received unexpected event network-vif-plugged-587569cd-f07c-4087-b7e7-66967dfcfcf7 for instance with vm_state active and task_state deleting.
Nov 18 17:06:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-674c815a-0c09-46ea-959e-9f89095b8b6a req-cd5b4e83-095b-4e88-b29c-f775e0eb22f9 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received event network-vif-unplugged-2a12256b-0d24-4ffa-aac0-451c27187fc7 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-674c815a-0c09-46ea-959e-9f89095b8b6a req-cd5b4e83-095b-4e88-b29c-f775e0eb22f9 service nova] Acquiring lock "8ed74254-d845-4810-965f-300a97ce3817-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-674c815a-0c09-46ea-959e-9f89095b8b6a req-cd5b4e83-095b-4e88-b29c-f775e0eb22f9 service nova] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-674c815a-0c09-46ea-959e-9f89095b8b6a req-cd5b4e83-095b-4e88-b29c-f775e0eb22f9 service nova] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-674c815a-0c09-46ea-959e-9f89095b8b6a req-cd5b4e83-095b-4e88-b29c-f775e0eb22f9 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] No waiting events found dispatching network-vif-unplugged-2a12256b-0d24-4ffa-aac0-451c27187fc7 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-674c815a-0c09-46ea-959e-9f89095b8b6a req-cd5b4e83-095b-4e88-b29c-f775e0eb22f9 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received event network-vif-unplugged-2a12256b-0d24-4ffa-aac0-451c27187fc7 for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-674c815a-0c09-46ea-959e-9f89095b8b6a req-cd5b4e83-095b-4e88-b29c-f775e0eb22f9 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received event network-vif-plugged-2a12256b-0d24-4ffa-aac0-451c27187fc7 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-674c815a-0c09-46ea-959e-9f89095b8b6a req-cd5b4e83-095b-4e88-b29c-f775e0eb22f9 service nova] Acquiring lock "8ed74254-d845-4810-965f-300a97ce3817-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-674c815a-0c09-46ea-959e-9f89095b8b6a req-cd5b4e83-095b-4e88-b29c-f775e0eb22f9 service nova] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-674c815a-0c09-46ea-959e-9f89095b8b6a req-cd5b4e83-095b-4e88-b29c-f775e0eb22f9 service nova] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-674c815a-0c09-46ea-959e-9f89095b8b6a req-cd5b4e83-095b-4e88-b29c-f775e0eb22f9 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] No waiting events found dispatching network-vif-plugged-2a12256b-0d24-4ffa-aac0-451c27187fc7 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:06:18 user nova-compute[74743]: WARNING nova.compute.manager [req-674c815a-0c09-46ea-959e-9f89095b8b6a req-cd5b4e83-095b-4e88-b29c-f775e0eb22f9 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received unexpected event network-vif-plugged-2a12256b-0d24-4ffa-aac0-451c27187fc7 for instance with vm_state active and task_state deleting.
Nov 18 17:06:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a5f231e6-0241-4c72-8dc7-d124257b60be) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:18 user nova-compute[74743]: INFO os_vif [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:e1:eb,bridge_name='br-int',has_traffic_filtering=True,id=36ac949f-e4af-432f-b042-62e8614b5b84,network=Network(c4ed0e46-c74d-44bb-94ee-d1b2dc871d15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap36ac949f-e4')
Nov 18 17:06:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T17:04:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1943040326',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1943040326',id=11,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjnTCPkQxuEtLzy+XmBSDH56QrRsiiTpaDkmMTDnxMmMj6n9lDqW72cXc9PIo+K+Uncg1A8ETn0FYi2Bgr/OTSN79EbcvpXNaaew5fh55Enmun/lTqwO1/r1tUwCcUz8Q==',key_name='tempest-keypair-2114506226',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:05:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='94a9888c9a4349e896e6bdf2af37ef98',ramdisk_id='',reservation_id='r-fa2gzleq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-951253911',owner_user_name='tempest-TaggedBootDevicesTest-951253911-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:05:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='480793b3fb7848a89ae4add6c6cf2d90',uuid=8ed74254-d845-4810-965f-300a97ce3817,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2937523f-15c9-4fe4-9f7c-174b941035e8", "address": "fa:16:3e:3e:90:e2", "network": {"id": "c4ed0e46-c74d-44bb-94ee-d1b2dc871d15", "bridge": "br-int", "label": "tempest-device-tagging-net1-2003876734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2937523f-15", "ovs_interfaceid": "2937523f-15c9-4fe4-9f7c-174b941035e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Converting VIF {"id": "2937523f-15c9-4fe4-9f7c-174b941035e8", "address": "fa:16:3e:3e:90:e2", "network": {"id": "c4ed0e46-c74d-44bb-94ee-d1b2dc871d15", "bridge": "br-int", "label": "tempest-device-tagging-net1-2003876734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2937523f-15", "ovs_interfaceid": "2937523f-15c9-4fe4-9f7c-174b941035e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:90:e2,bridge_name='br-int',has_traffic_filtering=True,id=2937523f-15c9-4fe4-9f7c-174b941035e8,network=Network(c4ed0e46-c74d-44bb-94ee-d1b2dc871d15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2937523f-15') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG os_vif [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:90:e2,bridge_name='br-int',has_traffic_filtering=True,id=2937523f-15c9-4fe4-9f7c-174b941035e8,network=Network(c4ed0e46-c74d-44bb-94ee-d1b2dc871d15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2937523f-15') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2937523f-15, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:06:18 user nova-compute[74743]: INFO os_vif [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:2d:b7,bridge_name='br-int',has_traffic_filtering=True,id=2629b394-59bc-4ddd-9d05-3fa4fbb15b55,network=Network(4501b03b-0b17-40b9-8545-c3385627d276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2629b394-59')
Nov 18 17:06:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T17:04:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1317300551',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1317300551',id=10,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5BDO9C8x4KBW8CgUPnSx7E01ZR+pcKEml0/t6Gj2w4MmQpDst8vuwOeiuCSmZUUzT19BBkzO9wQBMDEcUuTHO37Nx1as9VWeLZ/OjxIDUYzc9Z6H/jeRdfuIP00EqKSg==',key_name='tempest-keypair-1501335207',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:04:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='499d0dc41fbb400ab2b83b5d5091d880',ramdisk_id='',reservation_id='r-x8o6nc9i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1747303038',owner_user_name='tempest-TaggedBootDevicesTest_v242-1747303038-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:04:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cad6e6d43b3d474a888f6b02458b2ac8',uuid=58edd8cc-a455-4922-8de8-c800a61e7b43,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64686449-f344-4a65-ac45-8e7ff3f8cd84", "address": "fa:16:3e:8b:69:97", "network": {"id": "4501b03b-0b17-40b9-8545-c3385627d276", "bridge": "br-int", "label": "tempest-device-tagging-net1-1630322313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64686449-f3", "ovs_interfaceid": "64686449-f344-4a65-ac45-8e7ff3f8cd84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Converting VIF {"id": "64686449-f344-4a65-ac45-8e7ff3f8cd84", "address": "fa:16:3e:8b:69:97", "network": {"id": "4501b03b-0b17-40b9-8545-c3385627d276", "bridge": "br-int", "label": "tempest-device-tagging-net1-1630322313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64686449-f3", "ovs_interfaceid": "64686449-f344-4a65-ac45-8e7ff3f8cd84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:69:97,bridge_name='br-int',has_traffic_filtering=True,id=64686449-f344-4a65-ac45-8e7ff3f8cd84,network=Network(4501b03b-0b17-40b9-8545-c3385627d276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64686449-f3') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG os_vif [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:69:97,bridge_name='br-int',has_traffic_filtering=True,id=64686449-f344-4a65-ac45-8e7ff3f8cd84,network=Network(4501b03b-0b17-40b9-8545-c3385627d276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64686449-f3') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:06:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap64686449-f3, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=030474ff-bdb4-4cbe-b492-33fdfc28a493) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bd55e3a6-fab5-42ff-a983-ce94c812a066) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:06:19 user nova-compute[74743]: INFO os_vif [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:90:e2,bridge_name='br-int',has_traffic_filtering=True,id=2937523f-15c9-4fe4-9f7c-174b941035e8,network=Network(c4ed0e46-c74d-44bb-94ee-d1b2dc871d15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2937523f-15')
Nov 18 17:06:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T17:04:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1943040326',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1943040326',id=11,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjnTCPkQxuEtLzy+XmBSDH56QrRsiiTpaDkmMTDnxMmMj6n9lDqW72cXc9PIo+K+Uncg1A8ETn0FYi2Bgr/OTSN79EbcvpXNaaew5fh55Enmun/lTqwO1/r1tUwCcUz8Q==',key_name='tempest-keypair-2114506226',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:05:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='94a9888c9a4349e896e6bdf2af37ef98',ramdisk_id='',reservation_id='r-fa2gzleq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-951253911',owner_user_name='tempest-TaggedBootDevicesTest-951253911-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:05:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='480793b3fb7848a89ae4add6c6cf2d90',uuid=8ed74254-d845-4810-965f-300a97ce3817,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ba0c408-cb71-4fe5-88de-5ec1c8a81704", "address": "fa:16:3e:aa:1e:86", "network": {"id": "c4ed0e46-c74d-44bb-94ee-d1b2dc871d15", "bridge": "br-int", "label": "tempest-device-tagging-net1-2003876734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba0c408-cb", "ovs_interfaceid": "8ba0c408-cb71-4fe5-88de-5ec1c8a81704", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Converting VIF {"id": "8ba0c408-cb71-4fe5-88de-5ec1c8a81704", "address": "fa:16:3e:aa:1e:86", "network": {"id": "c4ed0e46-c74d-44bb-94ee-d1b2dc871d15", "bridge": "br-int", "label": "tempest-device-tagging-net1-2003876734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba0c408-cb", "ovs_interfaceid": "8ba0c408-cb71-4fe5-88de-5ec1c8a81704", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:1e:86,bridge_name='br-int',has_traffic_filtering=True,id=8ba0c408-cb71-4fe5-88de-5ec1c8a81704,network=Network(c4ed0e46-c74d-44bb-94ee-d1b2dc871d15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ba0c408-cb') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG os_vif [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:1e:86,bridge_name='br-int',has_traffic_filtering=True,id=8ba0c408-cb71-4fe5-88de-5ec1c8a81704,network=Network(c4ed0e46-c74d-44bb-94ee-d1b2dc871d15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ba0c408-cb') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ba0c408-cb, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:06:19 user nova-compute[74743]: INFO os_vif [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:69:97,bridge_name='br-int',has_traffic_filtering=True,id=64686449-f344-4a65-ac45-8e7ff3f8cd84,network=Network(4501b03b-0b17-40b9-8545-c3385627d276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64686449-f3')
Nov 18 17:06:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T17:04:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1317300551',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1317300551',id=10,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5BDO9C8x4KBW8CgUPnSx7E01ZR+pcKEml0/t6Gj2w4MmQpDst8vuwOeiuCSmZUUzT19BBkzO9wQBMDEcUuTHO37Nx1as9VWeLZ/OjxIDUYzc9Z6H/jeRdfuIP00EqKSg==',key_name='tempest-keypair-1501335207',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:04:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='499d0dc41fbb400ab2b83b5d5091d880',ramdisk_id='',reservation_id='r-x8o6nc9i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1747303038',owner_user_name='tempest-TaggedBootDevicesTest_v242-1747303038-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:04:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cad6e6d43b3d474a888f6b02458b2ac8',uuid=58edd8cc-a455-4922-8de8-c800a61e7b43,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9dd57873-8274-4099-b5a7-cefeabbbc308", "address": "fa:16:3e:3d:0f:1e", "network": {"id": "4501b03b-0b17-40b9-8545-c3385627d276", "bridge": "br-int", "label": "tempest-device-tagging-net1-1630322313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dd57873-82", "ovs_interfaceid": "9dd57873-8274-4099-b5a7-cefeabbbc308", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Converting VIF {"id": "9dd57873-8274-4099-b5a7-cefeabbbc308", "address": "fa:16:3e:3d:0f:1e", "network": {"id": "4501b03b-0b17-40b9-8545-c3385627d276", "bridge": "br-int", "label": "tempest-device-tagging-net1-1630322313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dd57873-82", "ovs_interfaceid": "9dd57873-8274-4099-b5a7-cefeabbbc308", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:0f:1e,bridge_name='br-int',has_traffic_filtering=True,id=9dd57873-8274-4099-b5a7-cefeabbbc308,network=Network(4501b03b-0b17-40b9-8545-c3385627d276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dd57873-82') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG os_vif [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:0f:1e,bridge_name='br-int',has_traffic_filtering=True,id=9dd57873-8274-4099-b5a7-cefeabbbc308,network=Network(4501b03b-0b17-40b9-8545-c3385627d276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dd57873-82') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9dd57873-82, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1830832a-1c1b-43e5-995d-854e3d6bb57a) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7971e975-7062-408d-96ba-285154906744) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:19 user nova-compute[74743]: INFO os_vif [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:1e:86,bridge_name='br-int',has_traffic_filtering=True,id=8ba0c408-cb71-4fe5-88de-5ec1c8a81704,network=Network(c4ed0e46-c74d-44bb-94ee-d1b2dc871d15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ba0c408-cb')
Nov 18 17:06:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T17:04:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1943040326',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1943040326',id=11,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjnTCPkQxuEtLzy+XmBSDH56QrRsiiTpaDkmMTDnxMmMj6n9lDqW72cXc9PIo+K+Uncg1A8ETn0FYi2Bgr/OTSN79EbcvpXNaaew5fh55Enmun/lTqwO1/r1tUwCcUz8Q==',key_name='tempest-keypair-2114506226',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:05:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='94a9888c9a4349e896e6bdf2af37ef98',ramdisk_id='',reservation_id='r-fa2gzleq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-951253911',owner_user_name='tempest-TaggedBootDevicesTest-951253911-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:05:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='480793b3fb7848a89ae4add6c6cf2d90',uuid=8ed74254-d845-4810-965f-300a97ce3817,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "587569cd-f07c-4087-b7e7-66967dfcfcf7", "address": "fa:16:3e:c3:d6:8a", "network": {"id": "c4ed0e46-c74d-44bb-94ee-d1b2dc871d15", "bridge": "br-int", "label": "tempest-device-tagging-net1-2003876734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap587569cd-f0", "ovs_interfaceid": "587569cd-f07c-4087-b7e7-66967dfcfcf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Converting VIF {"id": "587569cd-f07c-4087-b7e7-66967dfcfcf7", "address": "fa:16:3e:c3:d6:8a", "network": {"id": "c4ed0e46-c74d-44bb-94ee-d1b2dc871d15", "bridge": "br-int", "label": "tempest-device-tagging-net1-2003876734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap587569cd-f0", "ovs_interfaceid": "587569cd-f07c-4087-b7e7-66967dfcfcf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:d6:8a,bridge_name='br-int',has_traffic_filtering=True,id=587569cd-f07c-4087-b7e7-66967dfcfcf7,network=Network(c4ed0e46-c74d-44bb-94ee-d1b2dc871d15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap587569cd-f0') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG os_vif [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:d6:8a,bridge_name='br-int',has_traffic_filtering=True,id=587569cd-f07c-4087-b7e7-66967dfcfcf7,network=Network(c4ed0e46-c74d-44bb-94ee-d1b2dc871d15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap587569cd-f0') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap587569cd-f0, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:19 user nova-compute[74743]: INFO os_vif [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:0f:1e,bridge_name='br-int',has_traffic_filtering=True,id=9dd57873-8274-4099-b5a7-cefeabbbc308,network=Network(4501b03b-0b17-40b9-8545-c3385627d276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dd57873-82')
Nov 18 17:06:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T17:04:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1317300551',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1317300551',id=10,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5BDO9C8x4KBW8CgUPnSx7E01ZR+pcKEml0/t6Gj2w4MmQpDst8vuwOeiuCSmZUUzT19BBkzO9wQBMDEcUuTHO37Nx1as9VWeLZ/OjxIDUYzc9Z6H/jeRdfuIP00EqKSg==',key_name='tempest-keypair-1501335207',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:04:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='499d0dc41fbb400ab2b83b5d5091d880',ramdisk_id='',reservation_id='r-x8o6nc9i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1747303038',owner_user_name='tempest-TaggedBootDevicesTest_v242-1747303038-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:04:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cad6e6d43b3d474a888f6b02458b2ac8',uuid=58edd8cc-a455-4922-8de8-c800a61e7b43,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c658955e-999b-40cf-bed4-b59459a8953a", "address": "fa:16:3e:20:e9:d3", "network": {"id": "a14a0aa7-2798-4429-9394-a35ee3367c86", "bridge": "br-int", "label": "tempest-device-tagging-net2-808383388", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc658955e-99", "ovs_interfaceid": "c658955e-999b-40cf-bed4-b59459a8953a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Converting VIF {"id": "c658955e-999b-40cf-bed4-b59459a8953a", "address": "fa:16:3e:20:e9:d3", "network": {"id": "a14a0aa7-2798-4429-9394-a35ee3367c86", "bridge": "br-int", "label": "tempest-device-tagging-net2-808383388", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc658955e-99", "ovs_interfaceid": "c658955e-999b-40cf-bed4-b59459a8953a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:e9:d3,bridge_name='br-int',has_traffic_filtering=True,id=c658955e-999b-40cf-bed4-b59459a8953a,network=Network(a14a0aa7-2798-4429-9394-a35ee3367c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc658955e-99') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG os_vif [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:e9:d3,bridge_name='br-int',has_traffic_filtering=True,id=c658955e-999b-40cf-bed4-b59459a8953a,network=Network(a14a0aa7-2798-4429-9394-a35ee3367c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc658955e-99') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc658955e-99, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b0baabab-ae62-4506-9282-ea081b9e6151) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1cfe3f79-6720-42a1-a277-e0da257c87d8) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:06:19 user nova-compute[74743]: INFO os_vif [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:d6:8a,bridge_name='br-int',has_traffic_filtering=True,id=587569cd-f07c-4087-b7e7-66967dfcfcf7,network=Network(c4ed0e46-c74d-44bb-94ee-d1b2dc871d15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap587569cd-f0')
Nov 18 17:06:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T17:04:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1943040326',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1943040326',id=11,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjnTCPkQxuEtLzy+XmBSDH56QrRsiiTpaDkmMTDnxMmMj6n9lDqW72cXc9PIo+K+Uncg1A8ETn0FYi2Bgr/OTSN79EbcvpXNaaew5fh55Enmun/lTqwO1/r1tUwCcUz8Q==',key_name='tempest-keypair-2114506226',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:05:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='94a9888c9a4349e896e6bdf2af37ef98',ramdisk_id='',reservation_id='r-fa2gzleq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-951253911',owner_user_name='tempest-TaggedBootDevicesTest-951253911-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:05:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='480793b3fb7848a89ae4add6c6cf2d90',uuid=8ed74254-d845-4810-965f-300a97ce3817,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4532d74-be0a-451a-ad58-d7b0d3aeb757", "address": "fa:16:3e:51:3a:05", "network": {"id": "29131171-10e1-4628-9763-a74023087bca", "bridge": "br-int", "label": "tempest-device-tagging-net2-1600450954", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4532d74-be", "ovs_interfaceid": "f4532d74-be0a-451a-ad58-d7b0d3aeb757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Converting VIF {"id": "f4532d74-be0a-451a-ad58-d7b0d3aeb757", "address": "fa:16:3e:51:3a:05", "network": {"id": "29131171-10e1-4628-9763-a74023087bca", "bridge": "br-int", "label": "tempest-device-tagging-net2-1600450954", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4532d74-be", "ovs_interfaceid": "f4532d74-be0a-451a-ad58-d7b0d3aeb757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:3a:05,bridge_name='br-int',has_traffic_filtering=True,id=f4532d74-be0a-451a-ad58-d7b0d3aeb757,network=Network(29131171-10e1-4628-9763-a74023087bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4532d74-be') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG os_vif [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:3a:05,bridge_name='br-int',has_traffic_filtering=True,id=f4532d74-be0a-451a-ad58-d7b0d3aeb757,network=Network(29131171-10e1-4628-9763-a74023087bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4532d74-be') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4532d74-be, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:06:19 user nova-compute[74743]: INFO os_vif [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:e9:d3,bridge_name='br-int',has_traffic_filtering=True,id=c658955e-999b-40cf-bed4-b59459a8953a,network=Network(a14a0aa7-2798-4429-9394-a35ee3367c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc658955e-99')
Nov 18 17:06:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T17:04:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1317300551',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1317300551',id=10,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5BDO9C8x4KBW8CgUPnSx7E01ZR+pcKEml0/t6Gj2w4MmQpDst8vuwOeiuCSmZUUzT19BBkzO9wQBMDEcUuTHO37Nx1as9VWeLZ/OjxIDUYzc9Z6H/jeRdfuIP00EqKSg==',key_name='tempest-keypair-1501335207',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:04:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='499d0dc41fbb400ab2b83b5d5091d880',ramdisk_id='',reservation_id='r-x8o6nc9i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1747303038',owner_user_name='tempest-TaggedBootDevicesTest_v242-1747303038-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:04:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cad6e6d43b3d474a888f6b02458b2ac8',uuid=58edd8cc-a455-4922-8de8-c800a61e7b43,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a44b1589-f08b-4d65-a6a0-bb0e95fcf2ab", "address": "fa:16:3e:aa:65:f0", "network": {"id": "a14a0aa7-2798-4429-9394-a35ee3367c86", "bridge": "br-int", "label": "tempest-device-tagging-net2-808383388", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa44b1589-f0", "ovs_interfaceid": "a44b1589-f08b-4d65-a6a0-bb0e95fcf2ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Converting VIF {"id": "a44b1589-f08b-4d65-a6a0-bb0e95fcf2ab", "address": "fa:16:3e:aa:65:f0", "network": {"id": "a14a0aa7-2798-4429-9394-a35ee3367c86", "bridge": "br-int", "label": "tempest-device-tagging-net2-808383388", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa44b1589-f0", "ovs_interfaceid": "a44b1589-f08b-4d65-a6a0-bb0e95fcf2ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:65:f0,bridge_name='br-int',has_traffic_filtering=True,id=a44b1589-f08b-4d65-a6a0-bb0e95fcf2ab,network=Network(a14a0aa7-2798-4429-9394-a35ee3367c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa44b1589-f0') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG os_vif [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:65:f0,bridge_name='br-int',has_traffic_filtering=True,id=a44b1589-f08b-4d65-a6a0-bb0e95fcf2ab,network=Network(a14a0aa7-2798-4429-9394-a35ee3367c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa44b1589-f0') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa44b1589-f0, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7226981a-fad7-4822-9b2e-75b06e164919) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=72505b6d-9ff6-4bb4-8605-a70523dbcc1b) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:19 user nova-compute[74743]: INFO os_vif [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:3a:05,bridge_name='br-int',has_traffic_filtering=True,id=f4532d74-be0a-451a-ad58-d7b0d3aeb757,network=Network(29131171-10e1-4628-9763-a74023087bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4532d74-be')
Nov 18 17:06:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T17:04:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1943040326',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1943040326',id=11,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjnTCPkQxuEtLzy+XmBSDH56QrRsiiTpaDkmMTDnxMmMj6n9lDqW72cXc9PIo+K+Uncg1A8ETn0FYi2Bgr/OTSN79EbcvpXNaaew5fh55Enmun/lTqwO1/r1tUwCcUz8Q==',key_name='tempest-keypair-2114506226',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:05:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='94a9888c9a4349e896e6bdf2af37ef98',ramdisk_id='',reservation_id='r-fa2gzleq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-951253911',owner_user_name='tempest-TaggedBootDevicesTest-951253911-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:05:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='480793b3fb7848a89ae4add6c6cf2d90',uuid=8ed74254-d845-4810-965f-300a97ce3817,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a12256b-0d24-4ffa-aac0-451c27187fc7", "address": "fa:16:3e:d4:68:ae", "network": {"id": "29131171-10e1-4628-9763-a74023087bca", "bridge": "br-int", "label": "tempest-device-tagging-net2-1600450954", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a12256b-0d", "ovs_interfaceid": "2a12256b-0d24-4ffa-aac0-451c27187fc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Converting VIF {"id": "2a12256b-0d24-4ffa-aac0-451c27187fc7", "address": "fa:16:3e:d4:68:ae", "network": {"id": "29131171-10e1-4628-9763-a74023087bca", "bridge": "br-int", "label": "tempest-device-tagging-net2-1600450954", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a12256b-0d", "ovs_interfaceid": "2a12256b-0d24-4ffa-aac0-451c27187fc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:68:ae,bridge_name='br-int',has_traffic_filtering=True,id=2a12256b-0d24-4ffa-aac0-451c27187fc7,network=Network(29131171-10e1-4628-9763-a74023087bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a12256b-0d') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG os_vif [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:68:ae,bridge_name='br-int',has_traffic_filtering=True,id=2a12256b-0d24-4ffa-aac0-451c27187fc7,network=Network(29131171-10e1-4628-9763-a74023087bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a12256b-0d') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a12256b-0d, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:06:19 user nova-compute[74743]: INFO os_vif [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:65:f0,bridge_name='br-int',has_traffic_filtering=True,id=a44b1589-f08b-4d65-a6a0-bb0e95fcf2ab,network=Network(a14a0aa7-2798-4429-9394-a35ee3367c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa44b1589-f0')
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] calling os-brick to detach iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, {'target_iqn': 'iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aAwgKMiD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:06:19 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:06:19 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=265776d9-4f9d-4e89-a891-cb0b38d9ca44) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:19 user nova-compute[74743]: INFO os_vif [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:68:ae,bridge_name='br-int',has_traffic_filtering=True,id=2a12256b-0d24-4ffa-aac0-451c27187fc7,network=Network(29131171-10e1-4628-9763-a74023087bca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a12256b-0d')
Nov 18 17:06:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] calling os-brick to detach iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, {'target_iqn': 'iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qfFdOuJE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:06:19 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:06:19 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[feca793f-ff01-41ad-bbb3-f30d7f186bfa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 17:06:19 user nova-compute[74743]: No targets found.
Nov 18 17:06:19 user nova-compute[74743]: iSNS:
Nov 18 17:06:19 user nova-compute[74743]: No targets found.
Nov 18 17:06:19 user nova-compute[74743]: STATIC:
Nov 18 17:06:19 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc
Nov 18 17:06:19 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:19 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:19 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3
Nov 18 17:06:19 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:19 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:19 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387
Nov 18 17:06:19 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:19 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:19 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa
Nov 18 17:06:19 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:19 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:19 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe
Nov 18 17:06:19 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:19 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:19 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9
Nov 18 17:06:19 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:19 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:19 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f
Nov 18 17:06:19 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:19 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:19 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd
Nov 18 17:06:19 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:19 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:19 user nova-compute[74743]: FIRMWARE:
Nov 18 17:06:19 user nova-compute[74743]: No targets found.
Nov 18 17:06:19 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 17:06:19 user nova-compute[74743]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 17:06:19 user nova-compute[74743]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74743) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe', 0)] {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a3f400-a825-4f7d-8adf-b724f8ce93cc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba5c19e-a2d9-4bbb-adae-0c54769b24cb]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 (non-flash)
Nov 18 17:06:19 user nova-compute[74743]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 (non-flash)
Nov 18 17:06:19 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:06:19 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:06:19 user nova-compute[74743]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)
Nov 18 17:06:19 user nova-compute[74743]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)
Nov 18 17:06:19 user nova-compute[74743]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)
Nov 18 17:06:19 user nova-compute[74743]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)
Nov 18 17:06:19 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 (non-flash)
Nov 18 17:06:19 user nova-compute[74743]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 (non-flash)
Nov 18 17:06:19 user nova-compute[74743]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe (non-flash)
Nov 18 17:06:19 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:06:19 user nova-compute[74743]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)
Nov 18 17:06:19 user nova-compute[74743]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)
Nov 18 17:06:19 user nova-compute[74743]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)
Nov 18 17:06:19 user nova-compute[74743]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)
Nov 18 17:06:19 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb284468c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe'): ({'sdc'}, set())}) {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Removing single pathed devices sdc {{(pid=74743) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[8979d869-115c-4ab5-a8cc-031bcb812ffe]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b295b8e-9692-4e8a-93f8-1627108615dc]: (4, ('ok\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Flushing IO for device /dev/sdc {{(pid=74743) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a9a497-410b-453a-a2f7-57f6ce4df87b]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74743) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 17:06:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded6839b-a78d-4241-8ead-a5f1784232ce]: (4, ('1', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] SCSI volumes sdc have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe')] {{(pid=74743) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[550dd0d1-4219-4b1b-9a92-405d8c89d7f1]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe -p 172.16.0.220:3260 --logout {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5ba7b7-c3ec-4ee8-85aa-05ba024291e5]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe, portal: 172.16.0.220,3260]
Nov 18 17:06:20 user nova-compute[74743]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe, portal: 172.16.0.220,3260] successful.
Nov 18 17:06:20 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe -p 172.16.0.220:3260 --op delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f522558-51f6-48e8-baf6-d7e55732e9fe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[c896765e-435c-4452-b560-ced6e6aa140f]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] <== disconnect_volume: return (345ms) None {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Disconnected iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.334s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] calling os-brick to detach iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, {'target_iqn': 'iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NscaIDYg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:06:20 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[353c2a63-3011-489a-a841-838366c3bc0a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 17:06:20 user nova-compute[74743]: No targets found.
Nov 18 17:06:20 user nova-compute[74743]: iSNS:
Nov 18 17:06:20 user nova-compute[74743]: No targets found.
Nov 18 17:06:20 user nova-compute[74743]: STATIC:
Nov 18 17:06:20 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc
Nov 18 17:06:20 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:20 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:20 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3
Nov 18 17:06:20 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:20 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:20 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387
Nov 18 17:06:20 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:20 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:20 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa
Nov 18 17:06:20 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:20 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:20 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9
Nov 18 17:06:20 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:20 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:20 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f
Nov 18 17:06:20 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:20 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:20 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd
Nov 18 17:06:20 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:20 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:20 user nova-compute[74743]: FIRMWARE:
Nov 18 17:06:20 user nova-compute[74743]: No targets found.
Nov 18 17:06:20 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 17:06:20 user nova-compute[74743]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 17:06:20 user nova-compute[74743]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74743) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc', 0)] {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc812d61-b984-46f7-b08c-76891866fb53]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c584bf5-5bdd-4467-a1c2-2c13e1f74bf8]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 (non-flash)
Nov 18 17:06:20 user nova-compute[74743]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 (non-flash)
Nov 18 17:06:20 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:06:20 user nova-compute[74743]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)
Nov 18 17:06:20 user nova-compute[74743]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)
Nov 18 17:06:20 user nova-compute[74743]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)
Nov 18 17:06:20 user nova-compute[74743]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)
Nov 18 17:06:20 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 (non-flash)
Nov 18 17:06:20 user nova-compute[74743]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 (non-flash)
Nov 18 17:06:20 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:06:20 user nova-compute[74743]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc (non-flash)
Nov 18 17:06:20 user nova-compute[74743]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)
Nov 18 17:06:20 user nova-compute[74743]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)
Nov 18 17:06:20 user nova-compute[74743]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)
Nov 18 17:06:20 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb284468c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc'): ({'sde'}, set())}) {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Removing single pathed devices sde {{(pid=74743) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc765b7-1545-411f-8249-93c04ceac648]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5da1fa-f5f0-4500-b908-9d8d9d8c0f72]: (4, ('ok\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Flushing IO for device /dev/sde {{(pid=74743) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f098c62-8f89-4180-a382-a3a51b7a7c9d]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74743) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc36b68-eaa3-410d-b09e-8047baf62854]: (4, ('1', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] SCSI volumes sde have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc')] {{(pid=74743) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG nova.compute.manager [req-667b2700-67df-40b0-97b7-8d828a5cd7b1 req-9a230805-99c3-46a9-9be0-6b1ea244f027 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received event network-vif-unplugged-8ba0c408-cb71-4fe5-88de-5ec1c8a81704 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-667b2700-67df-40b0-97b7-8d828a5cd7b1 req-9a230805-99c3-46a9-9be0-6b1ea244f027 service nova] Acquiring lock "8ed74254-d845-4810-965f-300a97ce3817-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-667b2700-67df-40b0-97b7-8d828a5cd7b1 req-9a230805-99c3-46a9-9be0-6b1ea244f027 service nova] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-667b2700-67df-40b0-97b7-8d828a5cd7b1 req-9a230805-99c3-46a9-9be0-6b1ea244f027 service nova] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG nova.compute.manager [req-667b2700-67df-40b0-97b7-8d828a5cd7b1 req-9a230805-99c3-46a9-9be0-6b1ea244f027 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] No waiting events found dispatching network-vif-unplugged-8ba0c408-cb71-4fe5-88de-5ec1c8a81704 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG nova.compute.manager [req-667b2700-67df-40b0-97b7-8d828a5cd7b1 req-9a230805-99c3-46a9-9be0-6b1ea244f027 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received event network-vif-unplugged-8ba0c408-cb71-4fe5-88de-5ec1c8a81704 for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG nova.compute.manager [req-667b2700-67df-40b0-97b7-8d828a5cd7b1 req-9a230805-99c3-46a9-9be0-6b1ea244f027 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received event network-vif-plugged-8ba0c408-cb71-4fe5-88de-5ec1c8a81704 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-667b2700-67df-40b0-97b7-8d828a5cd7b1 req-9a230805-99c3-46a9-9be0-6b1ea244f027 service nova] Acquiring lock "8ed74254-d845-4810-965f-300a97ce3817-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-667b2700-67df-40b0-97b7-8d828a5cd7b1 req-9a230805-99c3-46a9-9be0-6b1ea244f027 service nova] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-667b2700-67df-40b0-97b7-8d828a5cd7b1 req-9a230805-99c3-46a9-9be0-6b1ea244f027 service nova] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG nova.compute.manager [req-667b2700-67df-40b0-97b7-8d828a5cd7b1 req-9a230805-99c3-46a9-9be0-6b1ea244f027 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] No waiting events found dispatching network-vif-plugged-8ba0c408-cb71-4fe5-88de-5ec1c8a81704 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:06:20 user nova-compute[74743]: WARNING nova.compute.manager [req-667b2700-67df-40b0-97b7-8d828a5cd7b1 req-9a230805-99c3-46a9-9be0-6b1ea244f027 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received unexpected event network-vif-plugged-8ba0c408-cb71-4fe5-88de-5ec1c8a81704 for instance with vm_state active and task_state deleting.
Nov 18 17:06:20 user nova-compute[74743]: DEBUG nova.compute.manager [req-667b2700-67df-40b0-97b7-8d828a5cd7b1 req-9a230805-99c3-46a9-9be0-6b1ea244f027 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received event network-vif-unplugged-f4532d74-be0a-451a-ad58-d7b0d3aeb757 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-667b2700-67df-40b0-97b7-8d828a5cd7b1 req-9a230805-99c3-46a9-9be0-6b1ea244f027 service nova] Acquiring lock "8ed74254-d845-4810-965f-300a97ce3817-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-667b2700-67df-40b0-97b7-8d828a5cd7b1 req-9a230805-99c3-46a9-9be0-6b1ea244f027 service nova] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-667b2700-67df-40b0-97b7-8d828a5cd7b1 req-9a230805-99c3-46a9-9be0-6b1ea244f027 service nova] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG nova.compute.manager [req-667b2700-67df-40b0-97b7-8d828a5cd7b1 req-9a230805-99c3-46a9-9be0-6b1ea244f027 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] No waiting events found dispatching network-vif-unplugged-f4532d74-be0a-451a-ad58-d7b0d3aeb757 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG nova.compute.manager [req-667b2700-67df-40b0-97b7-8d828a5cd7b1 req-9a230805-99c3-46a9-9be0-6b1ea244f027 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received event network-vif-unplugged-f4532d74-be0a-451a-ad58-d7b0d3aeb757 for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG nova.compute.manager [req-667b2700-67df-40b0-97b7-8d828a5cd7b1 req-9a230805-99c3-46a9-9be0-6b1ea244f027 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received event network-vif-plugged-f4532d74-be0a-451a-ad58-d7b0d3aeb757 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-667b2700-67df-40b0-97b7-8d828a5cd7b1 req-9a230805-99c3-46a9-9be0-6b1ea244f027 service nova] Acquiring lock "8ed74254-d845-4810-965f-300a97ce3817-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-667b2700-67df-40b0-97b7-8d828a5cd7b1 req-9a230805-99c3-46a9-9be0-6b1ea244f027 service nova] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-667b2700-67df-40b0-97b7-8d828a5cd7b1 req-9a230805-99c3-46a9-9be0-6b1ea244f027 service nova] Lock "8ed74254-d845-4810-965f-300a97ce3817-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG nova.compute.manager [req-667b2700-67df-40b0-97b7-8d828a5cd7b1 req-9a230805-99c3-46a9-9be0-6b1ea244f027 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] No waiting events found dispatching network-vif-plugged-f4532d74-be0a-451a-ad58-d7b0d3aeb757 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:06:20 user nova-compute[74743]: WARNING nova.compute.manager [req-667b2700-67df-40b0-97b7-8d828a5cd7b1 req-9a230805-99c3-46a9-9be0-6b1ea244f027 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received unexpected event network-vif-plugged-f4532d74-be0a-451a-ad58-d7b0d3aeb757 for instance with vm_state active and task_state deleting.
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[158c3f6a-7443-40cb-a06d-e57315c52429]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc -p 172.16.0.220:3260 --logout {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[11458132-b92b-4ba2-9e8f-e744f1adefe3]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc, portal: 172.16.0.220,3260]
Nov 18 17:06:20 user nova-compute[74743]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc, portal: 172.16.0.220,3260] successful.
Nov 18 17:06:20 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc -p 172.16.0.220:3260 --op delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b0fcb91-3634-461b-acd1-c69cb0d51abc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf95e8c-1c2b-4efd-be81-db412f498011]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] <== disconnect_volume: return (688ms) None {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Disconnected iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.353s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] calling os-brick to detach iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, {'target_iqn': 'iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'idvQfnOr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:06:20 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d806f216-e37c-4892-8f11-407895be4b03]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 17:06:20 user nova-compute[74743]: No targets found.
Nov 18 17:06:20 user nova-compute[74743]: iSNS:
Nov 18 17:06:20 user nova-compute[74743]: No targets found.
Nov 18 17:06:20 user nova-compute[74743]: STATIC:
Nov 18 17:06:20 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3
Nov 18 17:06:20 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:20 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:20 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387
Nov 18 17:06:20 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:20 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:20 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa
Nov 18 17:06:20 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:20 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:20 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9
Nov 18 17:06:20 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:20 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:20 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f
Nov 18 17:06:20 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:20 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:20 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd
Nov 18 17:06:20 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:20 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:20 user nova-compute[74743]: FIRMWARE:
Nov 18 17:06:20 user nova-compute[74743]: No targets found.
Nov 18 17:06:20 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 17:06:20 user nova-compute[74743]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 17:06:20 user nova-compute[74743]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74743) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f', 0)] {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f275b6c-093b-4011-838c-044d93acedac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[52717680-c09b-4f91-85b5-72d5a5669beb]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 (non-flash)
Nov 18 17:06:20 user nova-compute[74743]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 (non-flash)
Nov 18 17:06:20 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:06:20 user nova-compute[74743]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)
Nov 18 17:06:20 user nova-compute[74743]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)
Nov 18 17:06:20 user nova-compute[74743]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)
Nov 18 17:06:20 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 (non-flash)
Nov 18 17:06:20 user nova-compute[74743]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 (non-flash)
Nov 18 17:06:20 user nova-compute[74743]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f (non-flash)
Nov 18 17:06:20 user nova-compute[74743]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)
Nov 18 17:06:20 user nova-compute[74743]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)
Nov 18 17:06:20 user nova-compute[74743]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)
Nov 18 17:06:20 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb083376d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f'): ({'sdd'}, set())}) {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Removing single pathed devices sdd {{(pid=74743) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0251e6d1-a1ba-41af-b019-33377c1012b8]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[cffd0836-e353-425e-a794-89e417c5d181]: (4, ('ok\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Flushing IO for device /dev/sdd {{(pid=74743) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[43cde3d8-d72b-4479-90a7-22eb495bcca2]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74743) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ae2554-97f7-45c2-ab30-38ee6dc62644]: (4, ('1', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] SCSI volumes sdd have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f')] {{(pid=74743) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4508bc8-3be6-4e1f-b4e5-78c224432b23]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f -p 172.16.0.220:3260 --logout {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc1af98-22e3-4a7a-9c7a-950814339698]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f, portal: 172.16.0.220,3260]
Nov 18 17:06:20 user nova-compute[74743]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f, portal: 172.16.0.220,3260] successful.
Nov 18 17:06:20 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f -p 172.16.0.220:3260 --op delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09d9fafc-921d-4018-91a8-ea22e51fcb9f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9fc28d-52bb-4b05-962c-f79daa24a5ff]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] <== disconnect_volume: return (673ms) None {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Disconnected iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.318s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] calling os-brick to detach iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, {'target_iqn': 'iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cVueLGFk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:06:20 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d740768-5103-42cb-8b16-aaa0bef66795]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 17:06:20 user nova-compute[74743]: No targets found.
Nov 18 17:06:20 user nova-compute[74743]: iSNS:
Nov 18 17:06:20 user nova-compute[74743]: No targets found.
Nov 18 17:06:20 user nova-compute[74743]: STATIC:
Nov 18 17:06:20 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3
Nov 18 17:06:20 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:20 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:20 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387
Nov 18 17:06:20 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:20 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:20 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa
Nov 18 17:06:20 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:20 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:20 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9
Nov 18 17:06:20 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:20 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:20 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd
Nov 18 17:06:20 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:20 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:20 user nova-compute[74743]: FIRMWARE:
Nov 18 17:06:20 user nova-compute[74743]: No targets found.
Nov 18 17:06:20 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 17:06:20 user nova-compute[74743]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 17:06:20 user nova-compute[74743]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74743) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd', 0)] {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba6ea24-3a1d-4c3e-a456-af3ed5686781]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[31eb6f4e-ffa0-4050-a4f3-7711d2613372]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 (non-flash)
Nov 18 17:06:20 user nova-compute[74743]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 (non-flash)
Nov 18 17:06:20 user nova-compute[74743]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)
Nov 18 17:06:20 user nova-compute[74743]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)
Nov 18 17:06:20 user nova-compute[74743]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)
Nov 18 17:06:20 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 (non-flash)
Nov 18 17:06:20 user nova-compute[74743]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 (non-flash)
Nov 18 17:06:20 user nova-compute[74743]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)
Nov 18 17:06:20 user nova-compute[74743]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd (non-flash)
Nov 18 17:06:20 user nova-compute[74743]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)
Nov 18 17:06:20 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb08334820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd'): ({'sdg'}, set())}) {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Removing single pathed devices sdg {{(pid=74743) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdd94f8-abc3-47e2-9a9b-c8e0257892c0]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3522b4-b966-4a94-8ce0-7989306bc76f]: (4, ('ok\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Flushing IO for device /dev/sdg {{(pid=74743) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[4316c08e-a6a1-422c-8b99-43c51d81be89]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74743) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 17:06:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.034s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6bfe78-fd77-453e-b2ea-1447b462adf7]: (4, ('1', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] SCSI volumes sdg have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd')] {{(pid=74743) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[3127f94d-1d04-4225-97b8-e2f269c95a7c]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd -p 172.16.0.220:3260 --logout {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4427a25-23f1-4d6c-94a1-795fa07923fd]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd, portal: 172.16.0.220,3260]
Nov 18 17:06:21 user nova-compute[74743]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd, portal: 172.16.0.220,3260] successful.
Nov 18 17:06:21 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd -p 172.16.0.220:3260 --op delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8acd2ae2-7bae-49e7-99e2-e5dd725746fd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[218d2edc-1b5d-4c25-a1ef-1bb9bc970ae8]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] <== disconnect_volume: return (649ms) None {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Disconnected iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.329s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] calling os-brick to detach iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, {'target_iqn': 'iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PSecUtMD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:06:21 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce4a8cf-f55e-4987-ab7a-42027b21d530]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 17:06:21 user nova-compute[74743]: No targets found.
Nov 18 17:06:21 user nova-compute[74743]: iSNS:
Nov 18 17:06:21 user nova-compute[74743]: No targets found.
Nov 18 17:06:21 user nova-compute[74743]: STATIC:
Nov 18 17:06:21 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3
Nov 18 17:06:21 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:21 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:21 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387
Nov 18 17:06:21 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:21 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:21 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa
Nov 18 17:06:21 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:21 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:21 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9
Nov 18 17:06:21 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:21 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:21 user nova-compute[74743]: FIRMWARE:
Nov 18 17:06:21 user nova-compute[74743]: No targets found.
Nov 18 17:06:21 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 17:06:21 user nova-compute[74743]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 17:06:21 user nova-compute[74743]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74743) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3', 0)] {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73e11b0-80f2-4c65-b3ef-8ede2433dee3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:21 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-c824a1db-a3b6-40cf-b41c-219a547749a4 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e2a7ff40-310e-481f-8459-cde1034a0fbd is timed out.
Nov 18 17:06:21 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-c824a1db-a3b6-40cf-b41c-219a547749a4 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] Successfully detached device vdb from instance e2a7ff40-310e-481f-8459-cde1034a0fbd from the live domain config.
Nov 18 17:06:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c824a1db-a3b6-40cf-b41c-219a547749a4 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] calling os-brick to detach iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-c824a1db-a3b6-40cf-b41c-219a547749a4 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, {'target_iqn': 'iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZMbJKgTy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:06:21 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-c824a1db-a3b6-40cf-b41c-219a547749a4 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-c824a1db-a3b6-40cf-b41c-219a547749a4 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e49398-de88-443b-94d1-6f7fd2477b71]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 (non-flash)
Nov 18 17:06:21 user nova-compute[74743]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 (non-flash)
Nov 18 17:06:21 user nova-compute[74743]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)
Nov 18 17:06:21 user nova-compute[74743]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)
Nov 18 17:06:21 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 (non-flash)
Nov 18 17:06:21 user nova-compute[74743]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 (non-flash)
Nov 18 17:06:21 user nova-compute[74743]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 (non-flash)
Nov 18 17:06:21 user nova-compute[74743]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)
Nov 18 17:06:21 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb08334820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3'): ({'sdf'}, set())}) {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Removing single pathed devices sdf {{(pid=74743) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb89512d-5106-45bb-a52b-9d13c4afc809]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f46caa2-dbcd-4c48-be77-c6c65d1eef14]: (4, ('ok\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Flushing IO for device /dev/sdf {{(pid=74743) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[714573e2-43db-4830-aefd-a32cd957b8b1]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74743) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.039s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c7ddcd-b76b-4e69-88c5-b016981423d3]: (4, ('1', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] SCSI volumes sdf have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3')] {{(pid=74743) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b7e1f6-6f71-4db5-9dc8-020caf6c610f]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 -p 172.16.0.220:3260 --logout {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4ceb8c-d715-40c9-9483-4d980d18695e]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3, portal: 172.16.0.220,3260]
Nov 18 17:06:21 user nova-compute[74743]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3, portal: 172.16.0.220,3260] successful.
Nov 18 17:06:21 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 -p 172.16.0.220:3260 --op delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a394185-bc59-47fb-8214-07aa026083a3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ecfdbce-f5cf-48b1-b34c-a74a57785cfb]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] <== disconnect_volume: return (644ms) None {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Disconnected iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 17:06:21 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Deleting instance files /opt/stack/data/nova/instances/58edd8cc-a455-4922-8de8-c800a61e7b43_del
Nov 18 17:06:21 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Deletion of /opt/stack/data/nova/instances/58edd8cc-a455-4922-8de8-c800a61e7b43_del complete
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.319s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c599fe-72dd-4ed1-a6bf-8a3c5309c266]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 17:06:21 user nova-compute[74743]: No targets found.
Nov 18 17:06:21 user nova-compute[74743]: iSNS:
Nov 18 17:06:21 user nova-compute[74743]: No targets found.
Nov 18 17:06:21 user nova-compute[74743]: STATIC:
Nov 18 17:06:21 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387
Nov 18 17:06:21 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:21 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:21 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa
Nov 18 17:06:21 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:21 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:21 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9
Nov 18 17:06:21 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:21 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:21 user nova-compute[74743]: FIRMWARE:
Nov 18 17:06:21 user nova-compute[74743]: No targets found.
Nov 18 17:06:21 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 17:06:21 user nova-compute[74743]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 17:06:21 user nova-compute[74743]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74743) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa', 0)] {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a99749d-cd66-4bc0-814c-5054d2fbb6e9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:21 user nova-compute[74743]: INFO nova.compute.manager [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Took 6.14 seconds to destroy the instance on the hypervisor.
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo.service.loopingcall [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74743) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG nova.compute.manager [-] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Deallocating network for instance {{(pid=74743) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] deallocate_for_instance() {{(pid=74743) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13301c4-a2c4-48b4-a2c7-181af8fd1bea]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 (non-flash)
Nov 18 17:06:21 user nova-compute[74743]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 (non-flash)
Nov 18 17:06:21 user nova-compute[74743]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)
Nov 18 17:06:21 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 (non-flash)
Nov 18 17:06:21 user nova-compute[74743]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 (non-flash)
Nov 18 17:06:21 user nova-compute[74743]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa (non-flash)
Nov 18 17:06:21 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb083365f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa'): ({'sdh'}, set())}) {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Removing single pathed devices sdh {{(pid=74743) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23a6fa3-a488-4552-ae47-8b31ad2d4215]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b956bac-ab64-4186-a1c3-56e90d094bec]: (4, ('ok\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Flushing IO for device /dev/sdh {{(pid=74743) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1a2fc2-1ec8-4994-afdd-14734fd04393]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74743) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.032s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[516f2658-52fd-44fc-849d-3596f6fc9d62]: (4, ('1', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] SCSI volumes sdh have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa')] {{(pid=74743) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[f645672b-f406-4bc0-8040-8883f7bfb94e]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa -p 172.16.0.220:3260 --logout {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23fde11-a53b-45df-809b-ac1601428977]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa, portal: 172.16.0.220,3260]
Nov 18 17:06:21 user nova-compute[74743]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa, portal: 172.16.0.220,3260] successful.
Nov 18 17:06:21 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa -p 172.16.0.220:3260 --op delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c320c2fa-d0f0-461e-ac7a-2bec3693bbaa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2c45e7-7c91-42b2-bad0-994983445076]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] <== disconnect_volume: return (614ms) None {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Disconnected iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 17:06:21 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Deleting instance files /opt/stack/data/nova/instances/8ed74254-d845-4810-965f-300a97ce3817_del
Nov 18 17:06:21 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Deletion of /opt/stack/data/nova/instances/8ed74254-d845-4810-965f-300a97ce3817_del complete
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-c824a1db-a3b6-40cf-b41c-219a547749a4 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.563s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b73b7c0-5538-4289-a039-3b3ef8839d1a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-c824a1db-a3b6-40cf-b41c-219a547749a4 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 17:06:21 user nova-compute[74743]: No targets found.
Nov 18 17:06:21 user nova-compute[74743]: iSNS:
Nov 18 17:06:21 user nova-compute[74743]: No targets found.
Nov 18 17:06:21 user nova-compute[74743]: STATIC:
Nov 18 17:06:21 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387
Nov 18 17:06:21 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:21 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:21 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9
Nov 18 17:06:21 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:21 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:21 user nova-compute[74743]: FIRMWARE:
Nov 18 17:06:21 user nova-compute[74743]: No targets found.
Nov 18 17:06:21 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-c824a1db-a3b6-40cf-b41c-219a547749a4 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 17:06:21 user nova-compute[74743]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 17:06:21 user nova-compute[74743]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74743) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-c824a1db-a3b6-40cf-b41c-219a547749a4 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9', 0)] {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4b3280-ce43-4f03-8e85-bc5d97fa5d7a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:21 user nova-compute[74743]: INFO nova.compute.manager [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Took 5.78 seconds to destroy the instance on the hypervisor.
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo.service.loopingcall [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74743) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG nova.compute.manager [-] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Deallocating network for instance {{(pid=74743) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 8ed74254-d845-4810-965f-300a97ce3817] deallocate_for_instance() {{(pid=74743) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[67974d64-4f67-4572-b89e-184be2b87097]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-c824a1db-a3b6-40cf-b41c-219a547749a4 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 (non-flash)
Nov 18 17:06:21 user nova-compute[74743]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 (non-flash)
Nov 18 17:06:21 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-c824a1db-a3b6-40cf-b41c-219a547749a4 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 (non-flash)
Nov 18 17:06:21 user nova-compute[74743]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 (non-flash)
Nov 18 17:06:21 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-c824a1db-a3b6-40cf-b41c-219a547749a4 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb08334670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9'): ({'sdb'}, set())}) {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-c824a1db-a3b6-40cf-b41c-219a547749a4 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] Removing single pathed devices sdb {{(pid=74743) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad959609-83e7-4ca0-b67c-0b48548a24f0]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f38ded6-46c5-4d86-b97a-a7b7994bc9ad]: (4, ('ok\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-c824a1db-a3b6-40cf-b41c-219a547749a4 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] Flushing IO for device /dev/sdb {{(pid=74743) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ef0581-08c8-4da8-8d5d-b21180f14a48]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-c824a1db-a3b6-40cf-b41c-219a547749a4 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74743) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[02885cf6-0e03-44fe-b2b4-494119e658f8]: (4, ('1', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-c824a1db-a3b6-40cf-b41c-219a547749a4 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-c824a1db-a3b6-40cf-b41c-219a547749a4 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] SCSI volumes sdb have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-c824a1db-a3b6-40cf-b41c-219a547749a4 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9')] {{(pid=74743) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 17:06:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:22 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[531d2a4a-6327-4298-a120-ce5a99930957]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:22 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-c824a1db-a3b6-40cf-b41c-219a547749a4 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 -p 172.16.0.220:3260 --logout {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:22 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd5c548-b8aa-426a-a5df-85a502e14e36]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:22 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-c824a1db-a3b6-40cf-b41c-219a547749a4 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9, portal: 172.16.0.220,3260]
Nov 18 17:06:22 user nova-compute[74743]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9, portal: 172.16.0.220,3260] successful.
Nov 18 17:06:22 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 -p 172.16.0.220:3260 --op delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5480db9f-0880-49cc-9188-6b47977561a9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:22 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32e726f-8015-4664-9acc-39d9db9c3ecf]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:22 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-c824a1db-a3b6-40cf-b41c-219a547749a4 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:22 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-c824a1db-a3b6-40cf-b41c-219a547749a4 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:06:22 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-c824a1db-a3b6-40cf-b41c-219a547749a4 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] <== disconnect_volume: return (858ms) None {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:06:22 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c824a1db-a3b6-40cf-b41c-219a547749a4 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Disconnected iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 17:06:22 user nova-compute[74743]: DEBUG nova.objects.instance [None req-c824a1db-a3b6-40cf-b41c-219a547749a4 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] Lazy-loading 'flavor' on Instance uuid e2a7ff40-310e-481f-8459-cde1034a0fbd {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:06:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-c824a1db-a3b6-40cf-b41c-219a547749a4 tempest-VolumesAssistedSnapshotsTest-215305423 tempest-VolumesAssistedSnapshotsTest-215305423-project-admin] Lock "e2a7ff40-310e-481f-8459-cde1034a0fbd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.252s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG nova.compute.manager [req-6fc7139d-ead6-41ff-91bc-d8581ef9600e req-ee9fed33-4e81-4f79-8f20-0e89b58c2773 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received event network-vif-deleted-a44b1589-f08b-4d65-a6a0-bb0e95fcf2ab {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:06:23 user nova-compute[74743]: INFO nova.compute.manager [req-6fc7139d-ead6-41ff-91bc-d8581ef9600e req-ee9fed33-4e81-4f79-8f20-0e89b58c2773 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Neutron deleted interface a44b1589-f08b-4d65-a6a0-bb0e95fcf2ab; detaching it from the instance and deleting it from the info cache
Nov 18 17:06:23 user nova-compute[74743]: DEBUG nova.network.neutron [req-6fc7139d-ead6-41ff-91bc-d8581ef9600e req-ee9fed33-4e81-4f79-8f20-0e89b58c2773 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Updating instance_info_cache with network_info: [{"id": "34bfd284-1ef1-415a-9c96-f5ae24114a6a", "address": "fa:16:3e:3f:ad:b1", "network": {"id": "1638ba59-8de1-4e32-ab20-8cd8c688de5f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1073649476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34bfd284-1e", "ovs_interfaceid": "34bfd284-1ef1-415a-9c96-f5ae24114a6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f7d1b2be-29b6-45a1-9917-d16b576a84b2", "address": "fa:16:3e:c2:43:ab", "network": {"id": "4501b03b-0b17-40b9-8545-c3385627d276", "bridge": "br-int", "label": "tempest-device-tagging-net1-1630322313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7d1b2be-29", "ovs_interfaceid": "f7d1b2be-29b6-45a1-9917-d16b576a84b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2629b394-59bc-4ddd-9d05-3fa4fbb15b55", "address": "fa:16:3e:6c:2d:b7", "network": {"id": "4501b03b-0b17-40b9-8545-c3385627d276", "bridge": "br-int", "label": "tempest-device-tagging-net1-1630322313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2629b394-59", "ovs_interfaceid": "2629b394-59bc-4ddd-9d05-3fa4fbb15b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "64686449-f344-4a65-ac45-8e7ff3f8cd84", "address": "fa:16:3e:8b:69:97", "network": {"id": "4501b03b-0b17-40b9-8545-c3385627d276", "bridge": "br-int", "label": "tempest-device-tagging-net1-1630322313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64686449-f3", "ovs_interfaceid": "64686449-f344-4a65-ac45-8e7ff3f8cd84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9dd57873-8274-4099-b5a7-cefeabbbc308", "address": "fa:16:3e:3d:0f:1e", "network": {"id": "4501b03b-0b17-40b9-8545-c3385627d276", "bridge": "br-int", "label": "tempest-device-tagging-net1-1630322313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dd57873-82", "ovs_interfaceid": "9dd57873-8274-4099-b5a7-cefeabbbc308", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c658955e-999b-40cf-bed4-b59459a8953a", "address": "fa:16:3e:20:e9:d3", "network": {"id": "a14a0aa7-2798-4429-9394-a35ee3367c86", "bridge": "br-int", "label": "tempest-device-tagging-net2-808383388", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "499d0dc41fbb400ab2b83b5d5091d880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc658955e-99", "ovs_interfaceid": "c658955e-999b-40cf-bed4-b59459a8953a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG nova.compute.manager [req-6fc7139d-ead6-41ff-91bc-d8581ef9600e req-ee9fed33-4e81-4f79-8f20-0e89b58c2773 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Detach interface failed, port_id=a44b1589-f08b-4d65-a6a0-bb0e95fcf2ab, reason: Instance 58edd8cc-a455-4922-8de8-c800a61e7b43 could not be found. {{(pid=74743) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG nova.compute.manager [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] [instance: 567feb03-a356-4347-b146-d8930ad60c11] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ClPUfcSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '567feb03-a356-4347-b146-d8930ad60c11', 'attached_at': '', 'detached_at': '', 'volume_id': '03db838c-5e3c-4ff0-a374-b0540da43f83', 'serial': '03db838c-5e3c-4ff0-a374-b0540da43f83'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'smbfuYAx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl', 'volume_id': '2a462824-d8b3-4e9a-83f0-803b379cc387'}, 'status': 'reserved', 'instance': '567feb03-a356-4347-b146-d8930ad60c11', 'attached_at': '', 'detached_at': '', 'volume_id': '2a462824-d8b3-4e9a-83f0-803b379cc387', 'serial'} {{(pid=74743) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Calling os-brick to attach iSCSI Volume {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ClPUfcSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:06:23 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:06:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:06:23 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:06:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:06:23 user nova-compute[74743]: INFO os_brick.initiator.connectors.iscsi [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 17:06:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 -p 172.16.0.220:3260 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[718b3ea0-9f9f-48c5-906a-98dff95f21e4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 17:06:23 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 -p 172.16.0.220:3260 --interface default --op new {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6b0312-64ea-4e8b-aab0-99c4e274e9d2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83] added\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83] added
Nov 18 17:06:23 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5c8726-5d58-4001-ab05-b310463ef5a5]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8f48e2-0736-4a98-b06e-b1c74ebca80b]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ClPUfcSH {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ClPUfcSH" returned: 0 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[7527cc5f-6eca-45b5-b865-84f662c65135]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ClPUfcSH'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[4172b4c5-1619-40df-be48-957ec7c583f9]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b4e8e5-9c94-4302-97d7-445b86924716]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 (non-flash)
Nov 18 17:06:23 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 (non-flash)
Nov 18 17:06:23 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 -p 172.16.0.220:3260 --login {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Creating instance directory {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 17:06:23 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Creating image(s)
Nov 18 17:06:23 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Did not create local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Ensure instance console log exists: /opt/stack/data/nova/instances/fc4cdeb6-51ff-4090-a29d-d4f6105e15f3/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Start _get_guest_xml network_info=[{"id": "9abd882a-72d9-46b9-9dc0-8bdd727125b2", "address": "fa:16:3e:b0:f7:a6", "network": {"id": "b9dd5bf0-7dcc-4428-8496-f77a6e0ddbef", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-386192241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba340b1c9b03442ca58b2fef8ec6d60d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9abd882a-72", "ovs_interfaceid": "9abd882a-72d9-46b9-9dc0-8bdd727125b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': 'd4efc133-2556-4d74-82d0-ae974bc2e156', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KPiubrlw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fc4cdeb6-51ff-4090-a29d-d4f6105e15f3', 'attached_at': '', 'detached_at': '', 'volume_id': '47861a8d-8eb0-4239-a9b5-962337012ed8', 'serial': '47861a8d-8eb0-4239-a9b5-962337012ed8'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:06:23 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 18 17:06:23 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 18 17:06:23 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG nova.objects.instance [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Lazy-loading 'vcpu_model' on Instance uuid fc4cdeb6-51ff-4090-a29d-d4f6105e15f3 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[655b3899-b782-483c-ae52-7b1895e028b4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83, portal: 172.16.0.220,3260]
Nov 18 17:06:23 user nova-compute[74743]: Login to [iface: default, target: iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83, portal: 172.16.0.220,3260] successful.
Nov 18 17:06:23 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Calling os-brick to attach iSCSI Volume {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KPiubrlw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:06:23 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 18 17:06:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[5add3f4f-396e-46bf-ba2e-1fa00fe75495]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[f742d4d5-f9eb-4a79-921d-f7c137848ed6]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 (non-flash)
Nov 18 17:06:23 user nova-compute[74743]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 (non-flash)
Nov 18 17:06:23 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 (non-flash)
Nov 18 17:06:23 user nova-compute[74743]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 (non-flash)
Nov 18 17:06:23 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Connected to 172.16.0.220:3260 {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=74743) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=74743) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG nova.compute.manager [req-590a9831-2f1d-4d63-9f24-22e65ec3a29e req-59eb473e-9ded-44ef-9b38-0e077ea8ccf2 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received event network-vif-deleted-2a12256b-0d24-4ffa-aac0-451c27187fc7 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:06:23 user nova-compute[74743]: INFO nova.compute.manager [req-590a9831-2f1d-4d63-9f24-22e65ec3a29e req-59eb473e-9ded-44ef-9b38-0e077ea8ccf2 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Neutron deleted interface 2a12256b-0d24-4ffa-aac0-451c27187fc7; detaching it from the instance and deleting it from the info cache
Nov 18 17:06:23 user nova-compute[74743]: DEBUG nova.network.neutron [req-590a9831-2f1d-4d63-9f24-22e65ec3a29e req-59eb473e-9ded-44ef-9b38-0e077ea8ccf2 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Updating instance_info_cache with network_info: [{"id": "c646e401-7317-4e71-9ec5-5720fbc4b449", "address": "fa:16:3e:af:d8:d7", "network": {"id": "b0e24bcb-e9d6-4a04-bbb1-b3a0744f245a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1528865723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc646e401-73", "ovs_interfaceid": "c646e401-7317-4e71-9ec5-5720fbc4b449", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "36ac949f-e4af-432f-b042-62e8614b5b84", "address": "fa:16:3e:d8:e1:eb", "network": {"id": "c4ed0e46-c74d-44bb-94ee-d1b2dc871d15", "bridge": "br-int", "label": "tempest-device-tagging-net1-2003876734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36ac949f-e4", "ovs_interfaceid": "36ac949f-e4af-432f-b042-62e8614b5b84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2937523f-15c9-4fe4-9f7c-174b941035e8", "address": "fa:16:3e:3e:90:e2", "network": {"id": "c4ed0e46-c74d-44bb-94ee-d1b2dc871d15", "bridge": "br-int", "label": "tempest-device-tagging-net1-2003876734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2937523f-15", "ovs_interfaceid": "2937523f-15c9-4fe4-9f7c-174b941035e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8ba0c408-cb71-4fe5-88de-5ec1c8a81704", "address": "fa:16:3e:aa:1e:86", "network": {"id": "c4ed0e46-c74d-44bb-94ee-d1b2dc871d15", "bridge": "br-int", "label": "tempest-device-tagging-net1-2003876734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba0c408-cb", "ovs_interfaceid": "8ba0c408-cb71-4fe5-88de-5ec1c8a81704", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "587569cd-f07c-4087-b7e7-66967dfcfcf7", "address": "fa:16:3e:c3:d6:8a", "network": {"id": "c4ed0e46-c74d-44bb-94ee-d1b2dc871d15", "bridge": "br-int", "label": "tempest-device-tagging-net1-2003876734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap587569cd-f0", "ovs_interfaceid": "587569cd-f07c-4087-b7e7-66967dfcfcf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f4532d74-be0a-451a-ad58-d7b0d3aeb757", "address": "fa:16:3e:51:3a:05", "network": {"id": "29131171-10e1-4628-9763-a74023087bca", "bridge": "br-int", "label": "tempest-device-tagging-net2-1600450954", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4532d74-be", "ovs_interfaceid": "f4532d74-be0a-451a-ad58-d7b0d3aeb757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e9ef33-ed4e-45bf-92cf-575c54359b66]: (4, ('- - 0', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ClPUfcSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 17:06:23 user nova-compute[74743]: DEBUG nova.compute.manager [req-590a9831-2f1d-4d63-9f24-22e65ec3a29e req-59eb473e-9ded-44ef-9b38-0e077ea8ccf2 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Detach interface failed, port_id=2a12256b-0d24-4ffa-aac0-451c27187fc7, reason: Instance 8ed74254-d845-4810-965f-300a97ce3817 could not be found. {{(pid=74743) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 17:06:24 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:24 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.493s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] <== connect_volume: return (1499ms) {'type': 'block', 'scsi_wwn': '26332626538373364', 'path': '/dev/sdb'} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332626538373364', 'path': '/dev/sdb'} {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.215s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:06:25 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 18 17:06:25 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.008s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:06:25 user nova-compute[74743]: INFO os_brick.initiator.connectors.iscsi [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 17:06:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 -p 172.16.0.220:3260 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG nova.objects.instance [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Lazy-loading 'flavor' on Instance uuid 567feb03-a356-4347-b146-d8930ad60c11 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4956d7d-88ed-4989-b538-16a3b268ec8a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 17:06:25 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[7153e98a-5ec3-4042-b116-a90a951e99ab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8] added\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8] added
Nov 18 17:06:25 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[546dfae6-6cc1-4eb0-850a-f6b131638b1a]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe9db93-2d60-4430-82ca-60878fabe9b8]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:25 user nova-compute[74743]: INFO nova.compute.manager [-] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Took 3.60 seconds to deallocate network for instance.
Nov 18 17:06:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KPiubrlw {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KPiubrlw" returned: 0 in 0.032s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f28d3cb-2196-4ac1-a5bf-b02d1f837b9b]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KPiubrlw'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e06698a-f6a6-4696-be1e-7c16332e3913]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[75cd06a8-bfa6-47b3-913b-59eb975e2895]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 (non-flash)
Nov 18 17:06:25 user nova-compute[74743]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 (non-flash)
Nov 18 17:06:25 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 (non-flash)
Nov 18 17:06:25 user nova-compute[74743]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 (non-flash)
Nov 18 17:06:25 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 -p 172.16.0.220:3260 --login {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG nova.compute.manager [req-64cd50c6-5d6d-4202-9948-34343573dd15 req-a413e535-a10d-4f5b-9ad0-1de3e205d9e7 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received event network-vif-deleted-9dd57873-8274-4099-b5a7-cefeabbbc308 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG nova.compute.manager [req-64cd50c6-5d6d-4202-9948-34343573dd15 req-a413e535-a10d-4f5b-9ad0-1de3e205d9e7 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received event network-vif-deleted-34bfd284-1ef1-415a-9c96-f5ae24114a6a {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG nova.compute.manager [req-64cd50c6-5d6d-4202-9948-34343573dd15 req-a413e535-a10d-4f5b-9ad0-1de3e205d9e7 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received event network-vif-deleted-64686449-f344-4a65-ac45-8e7ff3f8cd84 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG nova.compute.manager [req-64cd50c6-5d6d-4202-9948-34343573dd15 req-a413e535-a10d-4f5b-9ad0-1de3e205d9e7 service nova] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Received event network-vif-deleted-c658955e-999b-40cf-bed4-b59459a8953a {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[9983315b-a506-4240-9e0f-9f423e3b56bc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8, portal: 172.16.0.220,3260]
Nov 18 17:06:25 user nova-compute[74743]: Login to [iface: default, target: iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8, portal: 172.16.0.220,3260] successful.
Nov 18 17:06:25 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa2c42f-ca5c-4bdb-b89c-26d08276d927]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[01426697-0980-4354-8f75-b8ab159e9cb1]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 (non-flash)
Nov 18 17:06:25 user nova-compute[74743]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 (non-flash)
Nov 18 17:06:25 user nova-compute[74743]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:06:25 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 (non-flash)
Nov 18 17:06:25 user nova-compute[74743]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 (non-flash)
Nov 18 17:06:25 user nova-compute[74743]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:06:25 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.362s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Connected to 172.16.0.220:3260 {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=74743) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74743) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f883a1-d079-46cb-8088-589db936f671]: (4, ('- - 0', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KPiubrlw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74743) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG nova.compute.manager [req-5b00cb3e-289c-4634-b394-ebb62ce60b05 req-1df19216-7e76-4c60-835e-8ac78799ae38 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received event network-vif-deleted-8ba0c408-cb71-4fe5-88de-5ec1c8a81704 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:06:25 user nova-compute[74743]: INFO nova.compute.manager [req-5b00cb3e-289c-4634-b394-ebb62ce60b05 req-1df19216-7e76-4c60-835e-8ac78799ae38 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Neutron deleted interface 8ba0c408-cb71-4fe5-88de-5ec1c8a81704; detaching it from the instance and deleting it from the info cache
Nov 18 17:06:25 user nova-compute[74743]: DEBUG nova.network.neutron [req-5b00cb3e-289c-4634-b394-ebb62ce60b05 req-1df19216-7e76-4c60-835e-8ac78799ae38 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Updating instance_info_cache with network_info: [{"id": "c646e401-7317-4e71-9ec5-5720fbc4b449", "address": "fa:16:3e:af:d8:d7", "network": {"id": "b0e24bcb-e9d6-4a04-bbb1-b3a0744f245a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1528865723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc646e401-73", "ovs_interfaceid": "c646e401-7317-4e71-9ec5-5720fbc4b449", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "36ac949f-e4af-432f-b042-62e8614b5b84", "address": "fa:16:3e:d8:e1:eb", "network": {"id": "c4ed0e46-c74d-44bb-94ee-d1b2dc871d15", "bridge": "br-int", "label": "tempest-device-tagging-net1-2003876734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36ac949f-e4", "ovs_interfaceid": "36ac949f-e4af-432f-b042-62e8614b5b84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2937523f-15c9-4fe4-9f7c-174b941035e8", "address": "fa:16:3e:3e:90:e2", "network": {"id": "c4ed0e46-c74d-44bb-94ee-d1b2dc871d15", "bridge": "br-int", "label": "tempest-device-tagging-net1-2003876734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2937523f-15", "ovs_interfaceid": "2937523f-15c9-4fe4-9f7c-174b941035e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "587569cd-f07c-4087-b7e7-66967dfcfcf7", "address": "fa:16:3e:c3:d6:8a", "network": {"id": "c4ed0e46-c74d-44bb-94ee-d1b2dc871d15", "bridge": "br-int", "label": "tempest-device-tagging-net1-2003876734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap587569cd-f0", "ovs_interfaceid": "587569cd-f07c-4087-b7e7-66967dfcfcf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f4532d74-be0a-451a-ad58-d7b0d3aeb757", "address": "fa:16:3e:51:3a:05", "network": {"id": "29131171-10e1-4628-9763-a74023087bca", "bridge": "br-int", "label": "tempest-device-tagging-net2-1600450954", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4532d74-be", "ovs_interfaceid": "f4532d74-be0a-451a-ad58-d7b0d3aeb757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG nova.compute.manager [req-5b00cb3e-289c-4634-b394-ebb62ce60b05 req-1df19216-7e76-4c60-835e-8ac78799ae38 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Detach interface failed, port_id=8ba0c408-cb71-4fe5-88de-5ec1c8a81704, reason: Instance 8ed74254-d845-4810-965f-300a97ce3817 could not be found. {{(pid=74743) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG nova.compute.manager [req-5b00cb3e-289c-4634-b394-ebb62ce60b05 req-1df19216-7e76-4c60-835e-8ac78799ae38 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received event network-vif-deleted-587569cd-f07c-4087-b7e7-66967dfcfcf7 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:06:25 user nova-compute[74743]: INFO nova.compute.manager [req-5b00cb3e-289c-4634-b394-ebb62ce60b05 req-1df19216-7e76-4c60-835e-8ac78799ae38 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Neutron deleted interface 587569cd-f07c-4087-b7e7-66967dfcfcf7; detaching it from the instance and deleting it from the info cache
Nov 18 17:06:25 user nova-compute[74743]: DEBUG nova.network.neutron [req-5b00cb3e-289c-4634-b394-ebb62ce60b05 req-1df19216-7e76-4c60-835e-8ac78799ae38 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Updating instance_info_cache with network_info: [{"id": "c646e401-7317-4e71-9ec5-5720fbc4b449", "address": "fa:16:3e:af:d8:d7", "network": {"id": "b0e24bcb-e9d6-4a04-bbb1-b3a0744f245a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1528865723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc646e401-73", "ovs_interfaceid": "c646e401-7317-4e71-9ec5-5720fbc4b449", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "36ac949f-e4af-432f-b042-62e8614b5b84", "address": "fa:16:3e:d8:e1:eb", "network": {"id": "c4ed0e46-c74d-44bb-94ee-d1b2dc871d15", "bridge": "br-int", "label": "tempest-device-tagging-net1-2003876734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36ac949f-e4", "ovs_interfaceid": "36ac949f-e4af-432f-b042-62e8614b5b84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2937523f-15c9-4fe4-9f7c-174b941035e8", "address": "fa:16:3e:3e:90:e2", "network": {"id": "c4ed0e46-c74d-44bb-94ee-d1b2dc871d15", "bridge": "br-int", "label": "tempest-device-tagging-net1-2003876734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2937523f-15", "ovs_interfaceid": "2937523f-15c9-4fe4-9f7c-174b941035e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f4532d74-be0a-451a-ad58-d7b0d3aeb757", "address": "fa:16:3e:51:3a:05", "network": {"id": "29131171-10e1-4628-9763-a74023087bca", "bridge": "br-int", "label": "tempest-device-tagging-net2-1600450954", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4532d74-be", "ovs_interfaceid": "f4532d74-be0a-451a-ad58-d7b0d3aeb757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG nova.compute.manager [req-5b00cb3e-289c-4634-b394-ebb62ce60b05 req-1df19216-7e76-4c60-835e-8ac78799ae38 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Detach interface failed, port_id=587569cd-f07c-4087-b7e7-66967dfcfcf7, reason: Instance 8ed74254-d845-4810-965f-300a97ce3817 could not be found. {{(pid=74743) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 17:06:25 user nova-compute[74743]: DEBUG nova.compute.manager [req-5b00cb3e-289c-4634-b394-ebb62ce60b05 req-1df19216-7e76-4c60-835e-8ac78799ae38 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received event network-vif-deleted-f4532d74-be0a-451a-ad58-d7b0d3aeb757 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:06:25 user nova-compute[74743]: INFO nova.compute.manager [req-5b00cb3e-289c-4634-b394-ebb62ce60b05 req-1df19216-7e76-4c60-835e-8ac78799ae38 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Neutron deleted interface f4532d74-be0a-451a-ad58-d7b0d3aeb757; detaching it from the instance and deleting it from the info cache
Nov 18 17:06:26 user nova-compute[74743]: DEBUG nova.network.neutron [req-5b00cb3e-289c-4634-b394-ebb62ce60b05 req-1df19216-7e76-4c60-835e-8ac78799ae38 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Updating instance_info_cache with network_info: [{"id": "c646e401-7317-4e71-9ec5-5720fbc4b449", "address": "fa:16:3e:af:d8:d7", "network": {"id": "b0e24bcb-e9d6-4a04-bbb1-b3a0744f245a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1528865723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc646e401-73", "ovs_interfaceid": "c646e401-7317-4e71-9ec5-5720fbc4b449", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "36ac949f-e4af-432f-b042-62e8614b5b84", "address": "fa:16:3e:d8:e1:eb", "network": {"id": "c4ed0e46-c74d-44bb-94ee-d1b2dc871d15", "bridge": "br-int", "label": "tempest-device-tagging-net1-2003876734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36ac949f-e4", "ovs_interfaceid": "36ac949f-e4af-432f-b042-62e8614b5b84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2937523f-15c9-4fe4-9f7c-174b941035e8", "address": "fa:16:3e:3e:90:e2", "network": {"id": "c4ed0e46-c74d-44bb-94ee-d1b2dc871d15", "bridge": "br-int", "label": "tempest-device-tagging-net1-2003876734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "94a9888c9a4349e896e6bdf2af37ef98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2937523f-15", "ovs_interfaceid": "2937523f-15c9-4fe4-9f7c-174b941035e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:06:26 user nova-compute[74743]: DEBUG nova.compute.manager [req-5b00cb3e-289c-4634-b394-ebb62ce60b05 req-1df19216-7e76-4c60-835e-8ac78799ae38 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Detach interface failed, port_id=f4532d74-be0a-451a-ad58-d7b0d3aeb757, reason: Instance 8ed74254-d845-4810-965f-300a97ce3817 could not be found. {{(pid=74743) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 17:06:26 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] COPY block job progress, current cursor: 119537664 final cursor: 1073741824 {{(pid=74743) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 17:06:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.410s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:06:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] <== connect_volume: return (2625ms) {'type': 'block', 'scsi_wwn': '26262396233373563', 'path': '/dev/sdc'} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:06:26 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262396233373563', 'path': '/dev/sdc'} {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 17:06:26 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-18T17:03:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1230106308',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-249778714',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM28SzHspmmwqm/7BfauIk9VldwafpsWIykch7gczsKSmKWidDt9xX54sYh31kKA3ijdAH08ekJdERVxFWwJ5PxDpqwRxmcm6s/pJQsbUZ4m6+AK3rHMz90lQEaJaoFkvQ==',key_name='tempest-keypair-2066506709',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:04:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ba340b1c9b03442ca58b2fef8ec6d60d',ramdisk_id='',reservation_id='r-9w700wic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-507265829',owner_user_name='tempest-ServerActionsV293TestJSON-507265829-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:06:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c39539fc6bbd40628ff16ddd50054661',uuid=fc4cdeb6-51ff-4090-a29d-d4f6105e15f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9abd882a-72d9-46b9-9dc0-8bdd727125b2", "address": "fa:16:3e:b0:f7:a6", "network": {"id": "b9dd5bf0-7dcc-4428-8496-f77a6e0ddbef", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-386192241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba340b1c9b03442ca58b2fef8ec6d60d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9abd882a-72", "ovs_interfaceid": "9abd882a-72d9-46b9-9dc0-8bdd727125b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:06:26 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Converting VIF {"id": "9abd882a-72d9-46b9-9dc0-8bdd727125b2", "address": "fa:16:3e:b0:f7:a6", "network": {"id": "b9dd5bf0-7dcc-4428-8496-f77a6e0ddbef", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-386192241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba340b1c9b03442ca58b2fef8ec6d60d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9abd882a-72", "ovs_interfaceid": "9abd882a-72d9-46b9-9dc0-8bdd727125b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:06:26 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:f7:a6,bridge_name='br-int',has_traffic_filtering=True,id=9abd882a-72d9-46b9-9dc0-8bdd727125b2,network=Network(b9dd5bf0-7dcc-4428-8496-f77a6e0ddbef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9abd882a-72') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:06:26 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:06:26 user nova-compute[74743]:   <uuid>fc4cdeb6-51ff-4090-a29d-d4f6105e15f3</uuid>
Nov 18 17:06:26 user nova-compute[74743]:   <name>instance-00000008</name>
Nov 18 17:06:26 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:06:26 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:06:26 user nova-compute[74743]:   <metadata>
Nov 18 17:06:26 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:06:26 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:06:26 user nova-compute[74743]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1230106308</nova:name>
Nov 18 17:06:26 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:06:23</nova:creationTime>
Nov 18 17:06:26 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:06:26 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:06:26 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:06:26 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:06:26 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:06:26 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:06:26 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:06:26 user nova-compute[74743]:       <nova:owner>
Nov 18 17:06:26 user nova-compute[74743]:         <nova:user uuid="c39539fc6bbd40628ff16ddd50054661">tempest-ServerActionsV293TestJSON-507265829-project-member</nova:user>
Nov 18 17:06:26 user nova-compute[74743]:         <nova:project uuid="ba340b1c9b03442ca58b2fef8ec6d60d">tempest-ServerActionsV293TestJSON-507265829</nova:project>
Nov 18 17:06:26 user nova-compute[74743]:       </nova:owner>
Nov 18 17:06:26 user nova-compute[74743]:       <nova:ports>
Nov 18 17:06:26 user nova-compute[74743]:         <nova:port uuid="9abd882a-72d9-46b9-9dc0-8bdd727125b2">
Nov 18 17:06:26 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 18 17:06:26 user nova-compute[74743]:         </nova:port>
Nov 18 17:06:26 user nova-compute[74743]:       </nova:ports>
Nov 18 17:06:26 user nova-compute[74743]:     </nova:instance>
Nov 18 17:06:26 user nova-compute[74743]:   </metadata>
Nov 18 17:06:26 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:06:26 user nova-compute[74743]:     <system>
Nov 18 17:06:26 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:06:26 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:06:26 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:06:26 user nova-compute[74743]:       <entry name="serial">fc4cdeb6-51ff-4090-a29d-d4f6105e15f3</entry>
Nov 18 17:06:26 user nova-compute[74743]:       <entry name="uuid">fc4cdeb6-51ff-4090-a29d-d4f6105e15f3</entry>
Nov 18 17:06:26 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:06:26 user nova-compute[74743]:     </system>
Nov 18 17:06:26 user nova-compute[74743]:   </sysinfo>
Nov 18 17:06:26 user nova-compute[74743]:   <os>
Nov 18 17:06:26 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:06:26 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:06:26 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:06:26 user nova-compute[74743]:   </os>
Nov 18 17:06:26 user nova-compute[74743]:   <features>
Nov 18 17:06:26 user nova-compute[74743]:     <acpi/>
Nov 18 17:06:26 user nova-compute[74743]:     <apic/>
Nov 18 17:06:26 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:06:26 user nova-compute[74743]:   </features>
Nov 18 17:06:26 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:06:26 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:06:26 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:06:26 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:06:26 user nova-compute[74743]:   </clock>
Nov 18 17:06:26 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:06:26 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:06:26 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:06:26 user nova-compute[74743]:   </cpu>
Nov 18 17:06:26 user nova-compute[74743]:   <devices>
Nov 18 17:06:26 user nova-compute[74743]:     <disk type="block" device="disk">
Nov 18 17:06:26 user nova-compute[74743]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:06:26 user nova-compute[74743]:       <source dev="/dev/sdc"/>
Nov 18 17:06:26 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:06:26 user nova-compute[74743]:       <serial>47861a8d-8eb0-4239-a9b5-962337012ed8</serial>
Nov 18 17:06:26 user nova-compute[74743]:     </disk>
Nov 18 17:06:26 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:06:26 user nova-compute[74743]:       <mac address="fa:16:3e:b0:f7:a6"/>
Nov 18 17:06:26 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:06:26 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:06:26 user nova-compute[74743]:       <target dev="tap9abd882a-72"/>
Nov 18 17:06:26 user nova-compute[74743]:     </interface>
Nov 18 17:06:26 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:06:26 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/fc4cdeb6-51ff-4090-a29d-d4f6105e15f3/console.log" append="off"/>
Nov 18 17:06:26 user nova-compute[74743]:     </serial>
Nov 18 17:06:26 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:06:26 user nova-compute[74743]:     <video>
Nov 18 17:06:26 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:06:26 user nova-compute[74743]:     </video>
Nov 18 17:06:26 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:06:26 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:06:26 user nova-compute[74743]:     </rng>
Nov 18 17:06:26 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:06:26 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:06:26 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:06:26 user nova-compute[74743]:     </memballoon>
Nov 18 17:06:26 user nova-compute[74743]:   </devices>
Nov 18 17:06:26 user nova-compute[74743]: </domain>
Nov 18 17:06:26 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:06:26 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-18T17:03:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1230106308',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-249778714',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM28SzHspmmwqm/7BfauIk9VldwafpsWIykch7gczsKSmKWidDt9xX54sYh31kKA3ijdAH08ekJdERVxFWwJ5PxDpqwRxmcm6s/pJQsbUZ4m6+AK3rHMz90lQEaJaoFkvQ==',key_name='tempest-keypair-2066506709',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:04:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ba340b1c9b03442ca58b2fef8ec6d60d',ramdisk_id='',reservation_id='r-9w700wic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-507265829',owner_user_name='tempest-ServerActionsV293TestJSON-507265829-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:06:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c39539fc6bbd40628ff16ddd50054661',uuid=fc4cdeb6-51ff-4090-a29d-d4f6105e15f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9abd882a-72d9-46b9-9dc0-8bdd727125b2", "address": "fa:16:3e:b0:f7:a6", "network": {"id": "b9dd5bf0-7dcc-4428-8496-f77a6e0ddbef", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-386192241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba340b1c9b03442ca58b2fef8ec6d60d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9abd882a-72", "ovs_interfaceid": "9abd882a-72d9-46b9-9dc0-8bdd727125b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:06:26 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Converting VIF {"id": "9abd882a-72d9-46b9-9dc0-8bdd727125b2", "address": "fa:16:3e:b0:f7:a6", "network": {"id": "b9dd5bf0-7dcc-4428-8496-f77a6e0ddbef", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-386192241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba340b1c9b03442ca58b2fef8ec6d60d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9abd882a-72", "ovs_interfaceid": "9abd882a-72d9-46b9-9dc0-8bdd727125b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:06:26 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:f7:a6,bridge_name='br-int',has_traffic_filtering=True,id=9abd882a-72d9-46b9-9dc0-8bdd727125b2,network=Network(b9dd5bf0-7dcc-4428-8496-f77a6e0ddbef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9abd882a-72') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:06:26 user nova-compute[74743]: DEBUG os_vif [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:f7:a6,bridge_name='br-int',has_traffic_filtering=True,id=9abd882a-72d9-46b9-9dc0-8bdd727125b2,network=Network(b9dd5bf0-7dcc-4428-8496-f77a6e0ddbef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9abd882a-72') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:06:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:06:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:06:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1e598279-caf4-597e-9380-918be1371f08', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:06:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:06:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9abd882a-72, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:06:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9abd882a-72, col_values=(('qos', UUID('0157c652-8f3f-4139-8801-7f5bf02c6972')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:06:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9abd882a-72, col_values=(('external_ids', {'iface-id': '9abd882a-72d9-46b9-9dc0-8bdd727125b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:f7:a6', 'vm-uuid': 'fc4cdeb6-51ff-4090-a29d-d4f6105e15f3'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:06:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:06:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:26 user nova-compute[74743]: INFO os_vif [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:f7:a6,bridge_name='br-int',has_traffic_filtering=True,id=9abd882a-72d9-46b9-9dc0-8bdd727125b2,network=Network(b9dd5bf0-7dcc-4428-8496-f77a6e0ddbef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9abd882a-72')
Nov 18 17:06:26 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] COPY block job progress, current cursor: 265289728 final cursor: 1073741824 {{(pid=74743) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 17:06:26 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:06:26 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] No VIF found with MAC fa:16:3e:b0:f7:a6, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:06:26 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:06:26 user nova-compute[74743]: INFO nova.compute.manager [-] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Took 5.03 seconds to deallocate network for instance.
Nov 18 17:06:27 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] COPY block job progress, current cursor: 404750336 final cursor: 1073741824 {{(pid=74743) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 17:06:27 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:06:27 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:06:27 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Starting heal instance info cache {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 17:06:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "refresh_cache-c006a4ad-a8e2-4108-9af1-dec4dd53fcda" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:06:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquired lock "refresh_cache-c006a4ad-a8e2-4108-9af1-dec4dd53fcda" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:06:27 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Forcefully refreshing network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 17:06:27 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] COPY block job progress, current cursor: 503316480 final cursor: 1073741824 {{(pid=74743) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 17:06:28 user nova-compute[74743]: DEBUG nova.compute.manager [req-3cbe8e26-aa22-448a-ab56-893250ba1e76 req-01be8bbb-54a1-4d6c-b9a4-3c50843c9670 service nova] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Received event network-vif-deleted-c646e401-7317-4e71-9ec5-5720fbc4b449 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:06:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:28 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] COPY block job progress, current cursor: 673185792 final cursor: 1073741824 {{(pid=74743) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 17:06:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:28 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Updating instance_info_cache with network_info: [{"id": "999980cf-efd0-4b78-aa42-f4e80073b5a9", "address": "fa:16:3e:e4:7e:f3", "network": {"id": "fd98f398-6576-449b-a737-887906eb6656", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668610993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb8f5850162c479b8d185e48c03be7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap999980cf-ef", "ovs_interfaceid": "999980cf-efd0-4b78-aa42-f4e80073b5a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:06:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Releasing lock "refresh_cache-c006a4ad-a8e2-4108-9af1-dec4dd53fcda" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:06:28 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Updated the network info_cache for instance {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 17:06:28 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:06:28 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:06:28 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:06:28 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:06:28 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:06:28 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:06:28 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74743) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 17:06:28 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:06:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:28 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Auditing locally available compute resources for user (node: user) {{(pid=74743) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 17:06:28 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] COPY block job progress, current cursor: 787480576 final cursor: 1073741824 {{(pid=74743) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 17:06:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:29 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] COPY block job progress, current cursor: 912261120 final cursor: 1073741824 {{(pid=74743) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 17:06:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39e15045-0a84-4b48-a962-c006b6c747b3/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39e15045-0a84-4b48-a962-c006b6c747b3/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39e15045-0a84-4b48-a962-c006b6c747b3/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:29 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] COPY block job progress, current cursor: 1050673152 final cursor: 1073741824 {{(pid=74743) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 17:06:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39e15045-0a84-4b48-a962-c006b6c747b3/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abf14b55-522e-4497-a799-cdc914072515/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abf14b55-522e-4497-a799-cdc914072515/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abf14b55-522e-4497-a799-cdc914072515/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG nova.compute.manager [req-1ea2314f-d0ca-4d0f-bc9f-1c11b576b695 req-32e04385-dc71-4eb5-bb34-f3c498a67627 service nova] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Received event network-vif-plugged-9abd882a-72d9-46b9-9dc0-8bdd727125b2 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-1ea2314f-d0ca-4d0f-bc9f-1c11b576b695 req-32e04385-dc71-4eb5-bb34-f3c498a67627 service nova] Acquiring lock "fc4cdeb6-51ff-4090-a29d-d4f6105e15f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-1ea2314f-d0ca-4d0f-bc9f-1c11b576b695 req-32e04385-dc71-4eb5-bb34-f3c498a67627 service nova] Lock "fc4cdeb6-51ff-4090-a29d-d4f6105e15f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-1ea2314f-d0ca-4d0f-bc9f-1c11b576b695 req-32e04385-dc71-4eb5-bb34-f3c498a67627 service nova] Lock "fc4cdeb6-51ff-4090-a29d-d4f6105e15f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG nova.compute.manager [req-1ea2314f-d0ca-4d0f-bc9f-1c11b576b695 req-32e04385-dc71-4eb5-bb34-f3c498a67627 service nova] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] No waiting events found dispatching network-vif-plugged-9abd882a-72d9-46b9-9dc0-8bdd727125b2 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:06:30 user nova-compute[74743]: WARNING nova.compute.manager [req-1ea2314f-d0ca-4d0f-bc9f-1c11b576b695 req-32e04385-dc71-4eb5-bb34-f3c498a67627 service nova] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Received unexpected event network-vif-plugged-9abd882a-72d9-46b9-9dc0-8bdd727125b2 for instance with vm_state active and task_state rebuild_spawning.
Nov 18 17:06:30 user nova-compute[74743]: DEBUG nova.compute.manager [req-1ea2314f-d0ca-4d0f-bc9f-1c11b576b695 req-32e04385-dc71-4eb5-bb34-f3c498a67627 service nova] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Received event network-vif-plugged-9abd882a-72d9-46b9-9dc0-8bdd727125b2 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-1ea2314f-d0ca-4d0f-bc9f-1c11b576b695 req-32e04385-dc71-4eb5-bb34-f3c498a67627 service nova] Acquiring lock "fc4cdeb6-51ff-4090-a29d-d4f6105e15f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-1ea2314f-d0ca-4d0f-bc9f-1c11b576b695 req-32e04385-dc71-4eb5-bb34-f3c498a67627 service nova] Lock "fc4cdeb6-51ff-4090-a29d-d4f6105e15f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-1ea2314f-d0ca-4d0f-bc9f-1c11b576b695 req-32e04385-dc71-4eb5-bb34-f3c498a67627 service nova] Lock "fc4cdeb6-51ff-4090-a29d-d4f6105e15f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG nova.compute.manager [req-1ea2314f-d0ca-4d0f-bc9f-1c11b576b695 req-32e04385-dc71-4eb5-bb34-f3c498a67627 service nova] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] No waiting events found dispatching network-vif-plugged-9abd882a-72d9-46b9-9dc0-8bdd727125b2 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:06:30 user nova-compute[74743]: WARNING nova.compute.manager [req-1ea2314f-d0ca-4d0f-bc9f-1c11b576b695 req-32e04385-dc71-4eb5-bb34-f3c498a67627 service nova] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Received unexpected event network-vif-plugged-9abd882a-72d9-46b9-9dc0-8bdd727125b2 for instance with vm_state active and task_state rebuild_spawning.
Nov 18 17:06:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74743) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abf14b55-522e-4497-a799-cdc914072515/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:30 user nova-compute[74743]: INFO nova.compute.manager [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] [instance: 58edd8cc-a455-4922-8de8-c800a61e7b43] Took 5.07 seconds to detach 3 volumes for instance.
Nov 18 17:06:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] [instance: 567feb03-a356-4347-b146-d8930ad60c11] calling os-brick to detach iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, {'target_iqn': 'iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'smbfuYAx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl', 'volume_id': '2a462824-d8b3-4e9a-83f0-803b379cc387'}, None), 'kwargs': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:06:30 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:06:30 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[5472708f-461c-4839-928e-da1e0082de13]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 17:06:30 user nova-compute[74743]: No targets found.
Nov 18 17:06:30 user nova-compute[74743]: iSNS:
Nov 18 17:06:30 user nova-compute[74743]: No targets found.
Nov 18 17:06:30 user nova-compute[74743]: STATIC:
Nov 18 17:06:30 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387
Nov 18 17:06:30 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:30 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:30 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8
Nov 18 17:06:30 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:30 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:30 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83
Nov 18 17:06:30 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:30 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:30 user nova-compute[74743]: FIRMWARE:
Nov 18 17:06:30 user nova-compute[74743]: No targets found.
Nov 18 17:06:30 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 17:06:30 user nova-compute[74743]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 17:06:30 user nova-compute[74743]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74743) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387', 0)] {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[4697404f-2bbb-4e75-bb4f-26085ff07b12]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2747b9-3d89-44c9-b607-3d922148c9ba]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 (non-flash)
Nov 18 17:06:30 user nova-compute[74743]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 (non-flash)
Nov 18 17:06:30 user nova-compute[74743]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:06:30 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 (non-flash)
Nov 18 17:06:30 user nova-compute[74743]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 (non-flash)
Nov 18 17:06:30 user nova-compute[74743]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:06:30 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb084e2ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387'): ({'sdl'}, set())}) {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Removing single pathed devices sdl {{(pid=74743) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.034s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d1718a-c210-4d6c-9887-2a747eaeb797]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdl {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdl" returned: 0 in 0.077s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[8317ed2b-95ad-41c6-8aa7-31c18bb046d4]: (4, ('ok\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Flushing IO for device /dev/sdl {{(pid=74743) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdl {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdl" returned: 0 in 0.014s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e426a1-dc2f-48bb-a155-7e4bafc492bd]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=74743) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdl/device/delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdl/device/delete" returned: 0 in 0.041s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b48e3f-1e11-4674-96af-554ebec0a027]: (4, ('1', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Checking to see if SCSI volumes sdl have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] SCSI volumes sdl have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387')] {{(pid=74743) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.041s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[001b7fa9-fb4c-45e0-877f-b7ff5630eb44]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 -p 172.16.0.220:3260 --logout {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51d987f-1d38-4e84-b050-091dd84b073c]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387, portal: 172.16.0.220,3260]
Nov 18 17:06:30 user nova-compute[74743]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387, portal: 172.16.0.220,3260] successful.
Nov 18 17:06:30 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 -p 172.16.0.220:3260 --op delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a462824-d8b3-4e9a-83f0-803b379cc387 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27da70d-41cc-409c-b544-ab1ed332bfee]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.481s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] <== disconnect_volume: return (483ms) None {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Disconnected iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG nova.compute.manager [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Guest created on hypervisor {{(pid=74743) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 17:06:30 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Instance spawned successfully.
Nov 18 17:06:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Found default for hw_cdrom_bus of ide {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Found default for hw_disk_bus of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Found default for hw_input_bus of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Found default for hw_pointer_model of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Found default for hw_video_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Found default for hw_vif_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG nova.compute.manager [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ClPUfcSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '567feb03-a356-4347-b146-d8930ad60c11', 'attached_at': '', 'detached_at': '', 'volume_id': '03db838c-5e3c-4ff0-a374-b0540da43f83', 'serial'} {{(pid=74743) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG nova.compute.manager [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] [instance: 567feb03-a356-4347-b146-d8930ad60c11] swap_volume: removing Cinder connection for volume 2a462824-d8b3-4e9a-83f0-803b379cc387 {{(pid=74743) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/567feb03-a356-4347-b146-d8930ad60c11/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:31 user nova-compute[74743]: DEBUG nova.compute.manager [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:06:31 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:06:31 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:06:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.476s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.012s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:31 user nova-compute[74743]: DEBUG nova.objects.instance [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74743) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 18 17:06:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/567feb03-a356-4347-b146-d8930ad60c11/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/567feb03-a356-4347-b146-d8930ad60c11/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:31 user nova-compute[74743]: INFO nova.scheduler.client.report [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Deleted allocations for instance 58edd8cc-a455-4922-8de8-c800a61e7b43
Nov 18 17:06:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-69fb090d-880c-434c-bbef-05122dd39e68 tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.099s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-6e604e0d-25c0-4ad5-a9bf-97c355d25e69 tempest-TaggedBootDevicesTest_v242-1747303038 tempest-TaggedBootDevicesTest_v242-1747303038-project-member] Lock "58edd8cc-a455-4922-8de8-c800a61e7b43" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 15.887s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/567feb03-a356-4347-b146-d8930ad60c11/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:31 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:06:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2a7ff40-310e-481f-8459-cde1034a0fbd/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2a7ff40-310e-481f-8459-cde1034a0fbd/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2a7ff40-310e-481f-8459-cde1034a0fbd/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:31 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:31 user nova-compute[74743]: DEBUG nova.compute.manager [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] [instance: 567feb03-a356-4347-b146-d8930ad60c11] swap_volume: Updating volume 2a462824-d8b3-4e9a-83f0-803b379cc387 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "ClPUfcSH", "auth_password": "VpYIl1TN0KF3XJ", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "03db838c-5e3c-4ff0-a374-b0540da43f83"}, "status": "reserved", "instance": "567feb03-a356-4347-b146-d8930ad60c11", "attached_at": "", "detached_at": "", "volume_id": "03db838c-5e3c-4ff0-a374-b0540da43f83", "serial": "03db838c-5e3c-4ff0-a374-b0540da43f83"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '03db838c-5e3c-4ff0-a374-b0540da43f83', 'no_device': None, 'attachment_id': 'd7f15387-7fab-4e50-a237-838ee3c2f0b5'} {{(pid=74743) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 18 17:06:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d1a0d43f-2767-4263-84dd-380444b950bb tempest-TestVolumeSwap-470934295 tempest-TestVolumeSwap-470934295-project-admin] Lock "567feb03-a356-4347-b146-d8930ad60c11" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 21.668s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2a7ff40-310e-481f-8459-cde1034a0fbd/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:32 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:06:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-105e9c51-3c86-4c9e-9fec-8be387f64741 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Acquiring lock "567feb03-a356-4347-b146-d8930ad60c11" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-105e9c51-3c86-4c9e-9fec-8be387f64741 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Lock "567feb03-a356-4347-b146-d8930ad60c11" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:32 user nova-compute[74743]: INFO nova.compute.manager [None req-105e9c51-3c86-4c9e-9fec-8be387f64741 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Detaching volume 03db838c-5e3c-4ff0-a374-b0540da43f83
Nov 18 17:06:32 user nova-compute[74743]: INFO nova.compute.manager [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] [instance: 8ed74254-d845-4810-965f-300a97ce3817] Took 5.54 seconds to detach 3 volumes for instance.
Nov 18 17:06:32 user nova-compute[74743]: INFO nova.virt.block_device [None req-105e9c51-3c86-4c9e-9fec-8be387f64741 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Attempting to driver detach volume 03db838c-5e3c-4ff0-a374-b0540da43f83 from mountpoint /dev/vdb
Nov 18 17:06:32 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-105e9c51-3c86-4c9e-9fec-8be387f64741 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Attempting to detach device vdb from instance 567feb03-a356-4347-b146-d8930ad60c11 from the persistent domain config. {{(pid=74743) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 17:06:32 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-105e9c51-3c86-4c9e-9fec-8be387f64741 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 17:06:32 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:06:32 user nova-compute[74743]:   <source dev="/dev/sdb"/>
Nov 18 17:06:32 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:06:32 user nova-compute[74743]:   <serial>03db838c-5e3c-4ff0-a374-b0540da43f83</serial>
Nov 18 17:06:32 user nova-compute[74743]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 17:06:32 user nova-compute[74743]: </disk>
Nov 18 17:06:32 user nova-compute[74743]:  {{(pid=74743) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 17:06:32 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-105e9c51-3c86-4c9e-9fec-8be387f64741 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Successfully detached device vdb from instance 567feb03-a356-4347-b146-d8930ad60c11 from the persistent domain config.
Nov 18 17:06:32 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-105e9c51-3c86-4c9e-9fec-8be387f64741 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 567feb03-a356-4347-b146-d8930ad60c11 from the live domain config. {{(pid=74743) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 17:06:32 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-105e9c51-3c86-4c9e-9fec-8be387f64741 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 17:06:32 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:06:32 user nova-compute[74743]:   <source dev="/dev/sdb"/>
Nov 18 17:06:32 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:06:32 user nova-compute[74743]:   <serial>03db838c-5e3c-4ff0-a374-b0540da43f83</serial>
Nov 18 17:06:32 user nova-compute[74743]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 17:06:32 user nova-compute[74743]: </disk>
Nov 18 17:06:32 user nova-compute[74743]:  {{(pid=74743) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 17:06:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55192f7b-5aaf-42e6-926a-cf9f43e460ca/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55192f7b-5aaf-42e6-926a-cf9f43e460ca/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55192f7b-5aaf-42e6-926a-cf9f43e460ca/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:32 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:06:32 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:06:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55192f7b-5aaf-42e6-926a-cf9f43e460ca/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.410s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:32 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-105e9c51-3c86-4c9e-9fec-8be387f64741 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 567feb03-a356-4347-b146-d8930ad60c11 {{(pid=74743) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 17:06:33 user nova-compute[74743]: INFO nova.scheduler.client.report [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Deleted allocations for instance 8ed74254-d845-4810-965f-300a97ce3817
Nov 18 17:06:33 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:06:33 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:06:33 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Hypervisor/Node resource view: name=user free_ram=7547MB free_disk=25.637836456298828GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74743) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 17:06:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-9f2c3d5c-ac73-49dd-a3c3-5a92c4ce29e6 tempest-TaggedBootDevicesTest-951253911 tempest-TaggedBootDevicesTest-951253911-project-member] Lock "8ed74254-d845-4810-965f-300a97ce3817" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 17.535s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:33 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 4cce1628-2dcb-40c7-abd4-6a327a432de3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:06:33 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance e9668e1c-1e8d-4dd7-8f58-d453db294557 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:06:33 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance c006a4ad-a8e2-4108-9af1-dec4dd53fcda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:06:33 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 55192f7b-5aaf-42e6-926a-cf9f43e460ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:06:33 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 567feb03-a356-4347-b146-d8930ad60c11 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:06:33 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance fc4cdeb6-51ff-4090-a29d-d4f6105e15f3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:06:33 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance e2a7ff40-310e-481f-8459-cde1034a0fbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:06:33 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 39e15045-0a84-4b48-a962-c006b6c747b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:06:33 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance abf14b55-522e-4497-a799-cdc914072515 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:06:33 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 17:06:33 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 17:06:33 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:06:34 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:06:34 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Compute_service record updated for user:user {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 17:06:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.550s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Acquiring lock "efcddf77-9300-4211-aa2d-31e99a37a180" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Lock "efcddf77-9300-4211-aa2d-31e99a37a180" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:35 user nova-compute[74743]: DEBUG nova.compute.manager [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Starting instance... {{(pid=74743) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 17:06:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:35 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74743) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 17:06:35 user nova-compute[74743]: INFO nova.compute.claims [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Claim successful on node user
Nov 18 17:06:35 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:06:35 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:06:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.407s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:35 user nova-compute[74743]: DEBUG nova.compute.manager [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Start building networks asynchronously for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 17:06:35 user nova-compute[74743]: DEBUG nova.compute.manager [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Allocating IP information in the background. {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 17:06:35 user nova-compute[74743]: DEBUG nova.network.neutron [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] allocate_for_instance() {{(pid=74743) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 17:06:35 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 17:06:35 user nova-compute[74743]: DEBUG nova.compute.manager [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Start building block device mappings for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 17:06:35 user nova-compute[74743]: DEBUG nova.policy [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '99af9f03493348bebcc384eb94d8ea9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c967f66b058543878a89b86b4791d5fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74743) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 17:06:36 user nova-compute[74743]: DEBUG nova.compute.manager [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Start spawning the instance on the hypervisor. {{(pid=74743) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 17:06:36 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Creating instance directory {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 17:06:36 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Creating image(s)
Nov 18 17:06:36 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Acquiring lock "/opt/stack/data/nova/instances/efcddf77-9300-4211-aa2d-31e99a37a180/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:36 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Lock "/opt/stack/data/nova/instances/efcddf77-9300-4211-aa2d-31e99a37a180/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:36 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Lock "/opt/stack/data/nova/instances/efcddf77-9300-4211-aa2d-31e99a37a180/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.180s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:36 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Acquiring lock "c188b3a997bfafa42fa341f9dcc326545681eed9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:36 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.190s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/efcddf77-9300-4211-aa2d-31e99a37a180/disk 1073741824 {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/efcddf77-9300-4211-aa2d-31e99a37a180/disk 1073741824" returned: 0 in 0.052s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:36 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:36 user nova-compute[74743]: DEBUG nova.network.neutron [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Successfully created port: 05e8b2a9-abd7-42e3-b532-af63aed5d299 {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:06:36 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.199s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:36 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Checking if we can resize image /opt/stack/data/nova/instances/efcddf77-9300-4211-aa2d-31e99a37a180/disk. size=1073741824 {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 17:06:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efcddf77-9300-4211-aa2d-31e99a37a180/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efcddf77-9300-4211-aa2d-31e99a37a180/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:36 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Cannot resize image /opt/stack/data/nova/instances/efcddf77-9300-4211-aa2d-31e99a37a180/disk to a smaller size. {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 17:06:36 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Created local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 17:06:36 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Ensure instance console log exists: /opt/stack/data/nova/instances/efcddf77-9300-4211-aa2d-31e99a37a180/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:06:36 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:36 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:36 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:37 user nova-compute[74743]: DEBUG nova.network.neutron [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Successfully updated port: 05e8b2a9-abd7-42e3-b532-af63aed5d299 {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:06:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Acquiring lock "refresh_cache-efcddf77-9300-4211-aa2d-31e99a37a180" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:06:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Acquired lock "refresh_cache-efcddf77-9300-4211-aa2d-31e99a37a180" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:06:37 user nova-compute[74743]: DEBUG nova.network.neutron [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:06:37 user nova-compute[74743]: DEBUG nova.compute.manager [req-84e9e52e-e819-445c-84cf-ca7e73d3372d req-f7838deb-ff51-4d93-973a-256cb303d6ec service nova] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Received event network-changed-05e8b2a9-abd7-42e3-b532-af63aed5d299 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:06:37 user nova-compute[74743]: DEBUG nova.compute.manager [req-84e9e52e-e819-445c-84cf-ca7e73d3372d req-f7838deb-ff51-4d93-973a-256cb303d6ec service nova] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Refreshing instance network info cache due to event network-changed-05e8b2a9-abd7-42e3-b532-af63aed5d299. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:06:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-84e9e52e-e819-445c-84cf-ca7e73d3372d req-f7838deb-ff51-4d93-973a-256cb303d6ec service nova] Acquiring lock "refresh_cache-efcddf77-9300-4211-aa2d-31e99a37a180" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:06:37 user nova-compute[74743]: DEBUG nova.network.neutron [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:06:37 user nova-compute[74743]: DEBUG nova.network.neutron [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Updating instance_info_cache with network_info: [{"id": "05e8b2a9-abd7-42e3-b532-af63aed5d299", "address": "fa:16:3e:f2:ce:73", "network": {"id": "7537df91-4e59-4569-88de-6dbbd9d5a4e4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1983739170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c967f66b058543878a89b86b4791d5fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05e8b2a9-ab", "ovs_interfaceid": "05e8b2a9-abd7-42e3-b532-af63aed5d299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:06:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Releasing lock "refresh_cache-efcddf77-9300-4211-aa2d-31e99a37a180" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:06:37 user nova-compute[74743]: DEBUG nova.compute.manager [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Instance network_info: |[{"id": "05e8b2a9-abd7-42e3-b532-af63aed5d299", "address": "fa:16:3e:f2:ce:73", "network": {"id": "7537df91-4e59-4569-88de-6dbbd9d5a4e4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1983739170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c967f66b058543878a89b86b4791d5fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05e8b2a9-ab", "ovs_interfaceid": "05e8b2a9-abd7-42e3-b532-af63aed5d299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 17:06:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-84e9e52e-e819-445c-84cf-ca7e73d3372d req-f7838deb-ff51-4d93-973a-256cb303d6ec service nova] Acquired lock "refresh_cache-efcddf77-9300-4211-aa2d-31e99a37a180" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:06:37 user nova-compute[74743]: DEBUG nova.network.neutron [req-84e9e52e-e819-445c-84cf-ca7e73d3372d req-f7838deb-ff51-4d93-973a-256cb303d6ec service nova] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Refreshing network info cache for port 05e8b2a9-abd7-42e3-b532-af63aed5d299 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:06:37 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Start _get_guest_xml network_info=[{"id": "05e8b2a9-abd7-42e3-b532-af63aed5d299", "address": "fa:16:3e:f2:ce:73", "network": {"id": "7537df91-4e59-4569-88de-6dbbd9d5a4e4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1983739170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c967f66b058543878a89b86b4791d5fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05e8b2a9-ab", "ovs_interfaceid": "05e8b2a9-abd7-42e3-b532-af63aed5d299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '9536f6cf-95c4-40e2-864a-09a91525678a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:06:37 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:06:37 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:06:37 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:06:37 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:06:37 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:06:37 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:06:37 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:06:37 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:06:37 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:06:37 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:06:37 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:06:37 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:06:37 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:06:37 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:06:37 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:06:37 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:06:37 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:06:37 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:06:37 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:06:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-356026514',display_name='tempest-VolumesAdminNegativeTest-server-356026514',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-356026514',id=14,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c967f66b058543878a89b86b4791d5fc',ramdisk_id='',reservation_id='r-qca1g5we',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-18073692',owner_user_name='tempest-VolumesAdminNegativeTest-18073692-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:06:36Z,user_data=None,user_id='99af9f03493348bebcc384eb94d8ea9a',uuid=efcddf77-9300-4211-aa2d-31e99a37a180,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05e8b2a9-abd7-42e3-b532-af63aed5d299", "address": "fa:16:3e:f2:ce:73", "network": {"id": "7537df91-4e59-4569-88de-6dbbd9d5a4e4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1983739170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c967f66b058543878a89b86b4791d5fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05e8b2a9-ab", "ovs_interfaceid": "05e8b2a9-abd7-42e3-b532-af63aed5d299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:06:37 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Converting VIF {"id": "05e8b2a9-abd7-42e3-b532-af63aed5d299", "address": "fa:16:3e:f2:ce:73", "network": {"id": "7537df91-4e59-4569-88de-6dbbd9d5a4e4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1983739170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c967f66b058543878a89b86b4791d5fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05e8b2a9-ab", "ovs_interfaceid": "05e8b2a9-abd7-42e3-b532-af63aed5d299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:06:37 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:ce:73,bridge_name='br-int',has_traffic_filtering=True,id=05e8b2a9-abd7-42e3-b532-af63aed5d299,network=Network(7537df91-4e59-4569-88de-6dbbd9d5a4e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05e8b2a9-ab') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:06:37 user nova-compute[74743]: DEBUG nova.objects.instance [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Lazy-loading 'pci_devices' on Instance uuid efcddf77-9300-4211-aa2d-31e99a37a180 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:06:37 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:06:37 user nova-compute[74743]:   <uuid>efcddf77-9300-4211-aa2d-31e99a37a180</uuid>
Nov 18 17:06:37 user nova-compute[74743]:   <name>instance-0000000e</name>
Nov 18 17:06:37 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:06:37 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:06:37 user nova-compute[74743]:   <metadata>
Nov 18 17:06:37 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:06:37 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:06:37 user nova-compute[74743]:       <nova:name>tempest-VolumesAdminNegativeTest-server-356026514</nova:name>
Nov 18 17:06:37 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:06:37</nova:creationTime>
Nov 18 17:06:37 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:06:37 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:06:37 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:06:37 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:06:37 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:06:37 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:06:37 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:06:37 user nova-compute[74743]:       <nova:owner>
Nov 18 17:06:37 user nova-compute[74743]:         <nova:user uuid="99af9f03493348bebcc384eb94d8ea9a">tempest-VolumesAdminNegativeTest-18073692-project-member</nova:user>
Nov 18 17:06:37 user nova-compute[74743]:         <nova:project uuid="c967f66b058543878a89b86b4791d5fc">tempest-VolumesAdminNegativeTest-18073692</nova:project>
Nov 18 17:06:37 user nova-compute[74743]:       </nova:owner>
Nov 18 17:06:37 user nova-compute[74743]:       <nova:root type="image" uuid="9536f6cf-95c4-40e2-864a-09a91525678a"/>
Nov 18 17:06:37 user nova-compute[74743]:       <nova:ports>
Nov 18 17:06:37 user nova-compute[74743]:         <nova:port uuid="05e8b2a9-abd7-42e3-b532-af63aed5d299">
Nov 18 17:06:37 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 18 17:06:37 user nova-compute[74743]:         </nova:port>
Nov 18 17:06:37 user nova-compute[74743]:       </nova:ports>
Nov 18 17:06:37 user nova-compute[74743]:     </nova:instance>
Nov 18 17:06:37 user nova-compute[74743]:   </metadata>
Nov 18 17:06:37 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:06:37 user nova-compute[74743]:     <system>
Nov 18 17:06:37 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:06:37 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:06:37 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:06:37 user nova-compute[74743]:       <entry name="serial">efcddf77-9300-4211-aa2d-31e99a37a180</entry>
Nov 18 17:06:37 user nova-compute[74743]:       <entry name="uuid">efcddf77-9300-4211-aa2d-31e99a37a180</entry>
Nov 18 17:06:37 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:06:37 user nova-compute[74743]:     </system>
Nov 18 17:06:37 user nova-compute[74743]:   </sysinfo>
Nov 18 17:06:37 user nova-compute[74743]:   <os>
Nov 18 17:06:37 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:06:37 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:06:37 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:06:37 user nova-compute[74743]:   </os>
Nov 18 17:06:37 user nova-compute[74743]:   <features>
Nov 18 17:06:37 user nova-compute[74743]:     <acpi/>
Nov 18 17:06:37 user nova-compute[74743]:     <apic/>
Nov 18 17:06:37 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:06:37 user nova-compute[74743]:   </features>
Nov 18 17:06:37 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:06:37 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:06:37 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:06:37 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:06:37 user nova-compute[74743]:   </clock>
Nov 18 17:06:37 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:06:37 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:06:37 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:06:37 user nova-compute[74743]:   </cpu>
Nov 18 17:06:37 user nova-compute[74743]:   <devices>
Nov 18 17:06:37 user nova-compute[74743]:     <disk type="file" device="disk">
Nov 18 17:06:37 user nova-compute[74743]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 17:06:37 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/efcddf77-9300-4211-aa2d-31e99a37a180/disk"/>
Nov 18 17:06:37 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:06:37 user nova-compute[74743]:     </disk>
Nov 18 17:06:37 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:06:37 user nova-compute[74743]:       <mac address="fa:16:3e:f2:ce:73"/>
Nov 18 17:06:37 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:06:37 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:06:37 user nova-compute[74743]:       <target dev="tap05e8b2a9-ab"/>
Nov 18 17:06:37 user nova-compute[74743]:     </interface>
Nov 18 17:06:37 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:06:37 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/efcddf77-9300-4211-aa2d-31e99a37a180/console.log" append="off"/>
Nov 18 17:06:37 user nova-compute[74743]:     </serial>
Nov 18 17:06:37 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:06:37 user nova-compute[74743]:     <video>
Nov 18 17:06:37 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:06:37 user nova-compute[74743]:     </video>
Nov 18 17:06:37 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:06:37 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:06:37 user nova-compute[74743]:     </rng>
Nov 18 17:06:37 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:06:37 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:06:37 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:06:37 user nova-compute[74743]:     </memballoon>
Nov 18 17:06:37 user nova-compute[74743]:   </devices>
Nov 18 17:06:37 user nova-compute[74743]: </domain>
Nov 18 17:06:37 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:06:37 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:06:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-356026514',display_name='tempest-VolumesAdminNegativeTest-server-356026514',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-356026514',id=14,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c967f66b058543878a89b86b4791d5fc',ramdisk_id='',reservation_id='r-qca1g5we',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-18073692',owner_user_name='tempest-VolumesAdminNegativeTest-18073692-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:06:36Z,user_data=None,user_id='99af9f03493348bebcc384eb94d8ea9a',uuid=efcddf77-9300-4211-aa2d-31e99a37a180,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05e8b2a9-abd7-42e3-b532-af63aed5d299", "address": "fa:16:3e:f2:ce:73", "network": {"id": "7537df91-4e59-4569-88de-6dbbd9d5a4e4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1983739170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c967f66b058543878a89b86b4791d5fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05e8b2a9-ab", "ovs_interfaceid": "05e8b2a9-abd7-42e3-b532-af63aed5d299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:06:37 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Converting VIF {"id": "05e8b2a9-abd7-42e3-b532-af63aed5d299", "address": "fa:16:3e:f2:ce:73", "network": {"id": "7537df91-4e59-4569-88de-6dbbd9d5a4e4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1983739170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c967f66b058543878a89b86b4791d5fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05e8b2a9-ab", "ovs_interfaceid": "05e8b2a9-abd7-42e3-b532-af63aed5d299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:06:37 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:ce:73,bridge_name='br-int',has_traffic_filtering=True,id=05e8b2a9-abd7-42e3-b532-af63aed5d299,network=Network(7537df91-4e59-4569-88de-6dbbd9d5a4e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05e8b2a9-ab') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:06:37 user nova-compute[74743]: DEBUG os_vif [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:ce:73,bridge_name='br-int',has_traffic_filtering=True,id=05e8b2a9-abd7-42e3-b532-af63aed5d299,network=Network(7537df91-4e59-4569-88de-6dbbd9d5a4e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05e8b2a9-ab') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:06:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:06:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:06:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e67483e6-0bae-55bf-94b4-1bb7f78befe5', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:06:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap05e8b2a9-ab, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:06:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap05e8b2a9-ab, col_values=(('qos', UUID('3a6e6a63-b838-45a8-85b6-3948cf4abfe1')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:06:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap05e8b2a9-ab, col_values=(('external_ids', {'iface-id': '05e8b2a9-abd7-42e3-b532-af63aed5d299', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:ce:73', 'vm-uuid': 'efcddf77-9300-4211-aa2d-31e99a37a180'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:06:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:06:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:37 user nova-compute[74743]: INFO os_vif [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:ce:73,bridge_name='br-int',has_traffic_filtering=True,id=05e8b2a9-abd7-42e3-b532-af63aed5d299,network=Network(7537df91-4e59-4569-88de-6dbbd9d5a4e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05e8b2a9-ab')
Nov 18 17:06:37 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:06:37 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] No VIF found with MAC fa:16:3e:f2:ce:73, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:06:38 user nova-compute[74743]: DEBUG nova.network.neutron [req-84e9e52e-e819-445c-84cf-ca7e73d3372d req-f7838deb-ff51-4d93-973a-256cb303d6ec service nova] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Updated VIF entry in instance network info cache for port 05e8b2a9-abd7-42e3-b532-af63aed5d299. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:06:38 user nova-compute[74743]: DEBUG nova.network.neutron [req-84e9e52e-e819-445c-84cf-ca7e73d3372d req-f7838deb-ff51-4d93-973a-256cb303d6ec service nova] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Updating instance_info_cache with network_info: [{"id": "05e8b2a9-abd7-42e3-b532-af63aed5d299", "address": "fa:16:3e:f2:ce:73", "network": {"id": "7537df91-4e59-4569-88de-6dbbd9d5a4e4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1983739170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c967f66b058543878a89b86b4791d5fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05e8b2a9-ab", "ovs_interfaceid": "05e8b2a9-abd7-42e3-b532-af63aed5d299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:06:38 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-84e9e52e-e819-445c-84cf-ca7e73d3372d req-f7838deb-ff51-4d93-973a-256cb303d6ec service nova] Releasing lock "refresh_cache-efcddf77-9300-4211-aa2d-31e99a37a180" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:06:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:39 user nova-compute[74743]: DEBUG nova.compute.manager [req-9e05ebca-6067-4c41-8861-0f7111a1e306 req-3d50968d-f308-4b2e-9b77-02e54786d993 service nova] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Received event network-vif-plugged-05e8b2a9-abd7-42e3-b532-af63aed5d299 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:06:39 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-9e05ebca-6067-4c41-8861-0f7111a1e306 req-3d50968d-f308-4b2e-9b77-02e54786d993 service nova] Acquiring lock "efcddf77-9300-4211-aa2d-31e99a37a180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:39 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-9e05ebca-6067-4c41-8861-0f7111a1e306 req-3d50968d-f308-4b2e-9b77-02e54786d993 service nova] Lock "efcddf77-9300-4211-aa2d-31e99a37a180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:39 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-9e05ebca-6067-4c41-8861-0f7111a1e306 req-3d50968d-f308-4b2e-9b77-02e54786d993 service nova] Lock "efcddf77-9300-4211-aa2d-31e99a37a180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:39 user nova-compute[74743]: DEBUG nova.compute.manager [req-9e05ebca-6067-4c41-8861-0f7111a1e306 req-3d50968d-f308-4b2e-9b77-02e54786d993 service nova] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] No waiting events found dispatching network-vif-plugged-05e8b2a9-abd7-42e3-b532-af63aed5d299 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:06:39 user nova-compute[74743]: WARNING nova.compute.manager [req-9e05ebca-6067-4c41-8861-0f7111a1e306 req-3d50968d-f308-4b2e-9b77-02e54786d993 service nova] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Received unexpected event network-vif-plugged-05e8b2a9-abd7-42e3-b532-af63aed5d299 for instance with vm_state building and task_state spawning.
Nov 18 17:06:41 user nova-compute[74743]: DEBUG nova.compute.manager [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:06:41 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Guest created on hypervisor {{(pid=74743) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 17:06:41 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Instance spawned successfully.
Nov 18 17:06:41 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 17:06:41 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Found default for hw_cdrom_bus of ide {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:06:41 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Found default for hw_disk_bus of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:06:41 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Found default for hw_input_bus of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:06:41 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Found default for hw_pointer_model of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:06:41 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Found default for hw_video_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:06:41 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Found default for hw_vif_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:06:41 user nova-compute[74743]: INFO nova.compute.manager [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Took 5.37 seconds to spawn the instance on the hypervisor.
Nov 18 17:06:41 user nova-compute[74743]: DEBUG nova.compute.manager [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:06:41 user nova-compute[74743]: INFO nova.compute.manager [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Took 6.11 seconds to build instance.
Nov 18 17:06:41 user nova-compute[74743]: DEBUG nova.compute.manager [req-4c12b9cb-666a-4c2c-93d6-3e501c805aeb req-3bc35bd0-e867-489a-bfef-0e0e9592f439 service nova] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Received event network-vif-plugged-05e8b2a9-abd7-42e3-b532-af63aed5d299 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:06:41 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4c12b9cb-666a-4c2c-93d6-3e501c805aeb req-3bc35bd0-e867-489a-bfef-0e0e9592f439 service nova] Acquiring lock "efcddf77-9300-4211-aa2d-31e99a37a180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:41 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4c12b9cb-666a-4c2c-93d6-3e501c805aeb req-3bc35bd0-e867-489a-bfef-0e0e9592f439 service nova] Lock "efcddf77-9300-4211-aa2d-31e99a37a180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:41 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4c12b9cb-666a-4c2c-93d6-3e501c805aeb req-3bc35bd0-e867-489a-bfef-0e0e9592f439 service nova] Lock "efcddf77-9300-4211-aa2d-31e99a37a180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:41 user nova-compute[74743]: DEBUG nova.compute.manager [req-4c12b9cb-666a-4c2c-93d6-3e501c805aeb req-3bc35bd0-e867-489a-bfef-0e0e9592f439 service nova] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] No waiting events found dispatching network-vif-plugged-05e8b2a9-abd7-42e3-b532-af63aed5d299 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:06:41 user nova-compute[74743]: WARNING nova.compute.manager [req-4c12b9cb-666a-4c2c-93d6-3e501c805aeb req-3bc35bd0-e867-489a-bfef-0e0e9592f439 service nova] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Received unexpected event network-vif-plugged-05e8b2a9-abd7-42e3-b532-af63aed5d299 for instance with vm_state active and task_state None.
Nov 18 17:06:41 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e3b3f88a-1919-4a46-b3f9-25962363ebb4 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Lock "efcddf77-9300-4211-aa2d-31e99a37a180" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.230s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:42 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:44 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:52 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-105e9c51-3c86-4c9e-9fec-8be387f64741 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 567feb03-a356-4347-b146-d8930ad60c11 is timed out.
Nov 18 17:06:52 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-105e9c51-3c86-4c9e-9fec-8be387f64741 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Successfully detached device vdb from instance 567feb03-a356-4347-b146-d8930ad60c11 from the live domain config.
Nov 18 17:06:52 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-105e9c51-3c86-4c9e-9fec-8be387f64741 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] [instance: 567feb03-a356-4347-b146-d8930ad60c11] calling os-brick to detach iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 17:06:52 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-105e9c51-3c86-4c9e-9fec-8be387f64741 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, {'target_iqn': 'iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ClPUfcSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '03db838c-5e3c-4ff0-a374-b0540da43f83'}, None), 'kwargs': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:06:52 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-105e9c51-3c86-4c9e-9fec-8be387f64741 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:06:52 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-105e9c51-3c86-4c9e-9fec-8be387f64741 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:06:52 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-105e9c51-3c86-4c9e-9fec-8be387f64741 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:06:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:52 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[119bfe6e-63b7-4059-9c63-ab551e9115a2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:52 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-105e9c51-3c86-4c9e-9fec-8be387f64741 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 17:06:52 user nova-compute[74743]: No targets found.
Nov 18 17:06:52 user nova-compute[74743]: iSNS:
Nov 18 17:06:52 user nova-compute[74743]: No targets found.
Nov 18 17:06:52 user nova-compute[74743]: STATIC:
Nov 18 17:06:52 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8
Nov 18 17:06:52 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:52 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:52 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83
Nov 18 17:06:52 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:06:52 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:06:52 user nova-compute[74743]: FIRMWARE:
Nov 18 17:06:52 user nova-compute[74743]: No targets found.
Nov 18 17:06:52 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:06:52 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-105e9c51-3c86-4c9e-9fec-8be387f64741 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 17:06:52 user nova-compute[74743]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 17:06:52 user nova-compute[74743]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74743) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 17:06:52 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-105e9c51-3c86-4c9e-9fec-8be387f64741 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83', 0)] {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 17:06:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:52 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c207a2-8abb-4df9-948b-c11db666e778]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:53 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[61cf725f-835d-4861-85fc-8fa82b4140bf]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:53 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-105e9c51-3c86-4c9e-9fec-8be387f64741 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 (non-flash)
Nov 18 17:06:53 user nova-compute[74743]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:06:53 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:06:53 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-105e9c51-3c86-4c9e-9fec-8be387f64741 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 (non-flash)
Nov 18 17:06:53 user nova-compute[74743]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:06:53 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:06:53 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-105e9c51-3c86-4c9e-9fec-8be387f64741 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb08342cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83'): ({'sdb'}, set())}) {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 17:06:53 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-105e9c51-3c86-4c9e-9fec-8be387f64741 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Removing single pathed devices sdb {{(pid=74743) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 17:06:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:53 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[4908834f-694c-4ad9-9644-e426c6c372dc]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:53 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c71a87-ef77-48f0-b653-64fc60049861]: (4, ('ok\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:53 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-105e9c51-3c86-4c9e-9fec-8be387f64741 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Flushing IO for device /dev/sdb {{(pid=74743) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 17:06:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:53 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ce81d3-6178-4136-ac2f-f2d90a84be2b]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:53 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-105e9c51-3c86-4c9e-9fec-8be387f64741 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74743) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 17:06:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:53 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d03167b-8d70-4b43-92d2-18f6e3c3ba13]: (4, ('1', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:53 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-105e9c51-3c86-4c9e-9fec-8be387f64741 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 17:06:53 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-105e9c51-3c86-4c9e-9fec-8be387f64741 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] SCSI volumes sdb have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 17:06:53 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-105e9c51-3c86-4c9e-9fec-8be387f64741 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83')] {{(pid=74743) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 17:06:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:53 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad16f5cb-742e-4ce0-b1eb-358bbe8c7fce]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:53 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-105e9c51-3c86-4c9e-9fec-8be387f64741 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 -p 172.16.0.220:3260 --logout {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:53 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[101c9364-258f-4c5d-b560-5591cc780577]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:53 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-105e9c51-3c86-4c9e-9fec-8be387f64741 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83, portal: 172.16.0.220,3260]
Nov 18 17:06:53 user nova-compute[74743]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83, portal: 172.16.0.220,3260] successful.
Nov 18 17:06:53 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 -p 172.16.0.220:3260 --op delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:06:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03db838c-5e3c-4ff0-a374-b0540da43f83 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:06:53 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc0642f-a898-4b5c-bd12-fb7c31d14b54]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:06:53 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-105e9c51-3c86-4c9e-9fec-8be387f64741 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:06:53 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-105e9c51-3c86-4c9e-9fec-8be387f64741 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:06:53 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-105e9c51-3c86-4c9e-9fec-8be387f64741 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] <== disconnect_volume: return (311ms) None {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:06:53 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-105e9c51-3c86-4c9e-9fec-8be387f64741 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Disconnected iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 17:06:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-df69db2d-ec9b-4f6e-91c3-04f618b3ca76 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Acquiring lock "e2a7ff40-310e-481f-8459-cde1034a0fbd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-df69db2d-ec9b-4f6e-91c3-04f618b3ca76 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Lock "e2a7ff40-310e-481f-8459-cde1034a0fbd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-df69db2d-ec9b-4f6e-91c3-04f618b3ca76 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Acquiring lock "e2a7ff40-310e-481f-8459-cde1034a0fbd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-df69db2d-ec9b-4f6e-91c3-04f618b3ca76 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Lock "e2a7ff40-310e-481f-8459-cde1034a0fbd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-df69db2d-ec9b-4f6e-91c3-04f618b3ca76 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Lock "e2a7ff40-310e-481f-8459-cde1034a0fbd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:55 user nova-compute[74743]: INFO nova.compute.manager [None req-df69db2d-ec9b-4f6e-91c3-04f618b3ca76 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Terminating instance
Nov 18 17:06:55 user nova-compute[74743]: DEBUG nova.compute.manager [None req-df69db2d-ec9b-4f6e-91c3-04f618b3ca76 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Start destroying the instance on the hypervisor. {{(pid=74743) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 17:06:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:55 user nova-compute[74743]: DEBUG nova.objects.instance [None req-105e9c51-3c86-4c9e-9fec-8be387f64741 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Lazy-loading 'flavor' on Instance uuid 567feb03-a356-4347-b146-d8930ad60c11 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:06:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-105e9c51-3c86-4c9e-9fec-8be387f64741 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Lock "567feb03-a356-4347-b146-d8930ad60c11" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.429s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:55 user nova-compute[74743]: DEBUG nova.compute.manager [req-238afa5f-6077-4c81-a061-ae491efb3411 req-1e791492-9009-4415-b397-e3ccedb3c2f9 service nova] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Received event network-vif-unplugged-9c7850d5-314e-4854-bbc1-b4e08037abd1 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:06:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-238afa5f-6077-4c81-a061-ae491efb3411 req-1e791492-9009-4415-b397-e3ccedb3c2f9 service nova] Acquiring lock "e2a7ff40-310e-481f-8459-cde1034a0fbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-238afa5f-6077-4c81-a061-ae491efb3411 req-1e791492-9009-4415-b397-e3ccedb3c2f9 service nova] Lock "e2a7ff40-310e-481f-8459-cde1034a0fbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-238afa5f-6077-4c81-a061-ae491efb3411 req-1e791492-9009-4415-b397-e3ccedb3c2f9 service nova] Lock "e2a7ff40-310e-481f-8459-cde1034a0fbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:55 user nova-compute[74743]: DEBUG nova.compute.manager [req-238afa5f-6077-4c81-a061-ae491efb3411 req-1e791492-9009-4415-b397-e3ccedb3c2f9 service nova] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] No waiting events found dispatching network-vif-unplugged-9c7850d5-314e-4854-bbc1-b4e08037abd1 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:06:55 user nova-compute[74743]: DEBUG nova.compute.manager [req-238afa5f-6077-4c81-a061-ae491efb3411 req-1e791492-9009-4415-b397-e3ccedb3c2f9 service nova] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Received event network-vif-unplugged-9c7850d5-314e-4854-bbc1-b4e08037abd1 for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:06:56 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Instance destroyed successfully.
Nov 18 17:06:56 user nova-compute[74743]: DEBUG nova.objects.instance [None req-df69db2d-ec9b-4f6e-91c3-04f618b3ca76 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Lazy-loading 'resources' on Instance uuid e2a7ff40-310e-481f-8459-cde1034a0fbd {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:06:56 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-df69db2d-ec9b-4f6e-91c3-04f618b3ca76 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:03:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-339350780',display_name='tempest-VolumesAssistedSnapshotsTest-server-339350780',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-339350780',id=9,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPsKCzfUQWQXQ3/HK5Qqi9cFLmOjsEFKKg3Yt3iiY12xnfyRZ2/rFHMjTrP6mdiHsSuJltDbJQNayteqXWXOlImKAn5pi6TVuSSERYWV2Ta9KlxuVOYV5igWs/Mh+GxYkQ==',key_name='tempest-keypair-743524350',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:04:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7771c1adef144c06bc2635a551bf1c50',ramdisk_id='',reservation_id='r-ikw9ji6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-318796158',owner_user_name='tempest-VolumesAssistedSnapshotsTest-318796158-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:04:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c3fd257809b44b9ba4e8c60e1d988a9',uuid=e2a7ff40-310e-481f-8459-cde1034a0fbd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c7850d5-314e-4854-bbc1-b4e08037abd1", "address": "fa:16:3e:05:50:5c", "network": {"id": "55694218-7eff-4083-b98f-0604e4ac3c20", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-34716983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7771c1adef144c06bc2635a551bf1c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c7850d5-31", "ovs_interfaceid": "9c7850d5-314e-4854-bbc1-b4e08037abd1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:06:56 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-df69db2d-ec9b-4f6e-91c3-04f618b3ca76 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Converting VIF {"id": "9c7850d5-314e-4854-bbc1-b4e08037abd1", "address": "fa:16:3e:05:50:5c", "network": {"id": "55694218-7eff-4083-b98f-0604e4ac3c20", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-34716983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7771c1adef144c06bc2635a551bf1c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c7850d5-31", "ovs_interfaceid": "9c7850d5-314e-4854-bbc1-b4e08037abd1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:06:56 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-df69db2d-ec9b-4f6e-91c3-04f618b3ca76 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:50:5c,bridge_name='br-int',has_traffic_filtering=True,id=9c7850d5-314e-4854-bbc1-b4e08037abd1,network=Network(55694218-7eff-4083-b98f-0604e4ac3c20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c7850d5-31') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:06:56 user nova-compute[74743]: DEBUG os_vif [None req-df69db2d-ec9b-4f6e-91c3-04f618b3ca76 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:50:5c,bridge_name='br-int',has_traffic_filtering=True,id=9c7850d5-314e-4854-bbc1-b4e08037abd1,network=Network(55694218-7eff-4083-b98f-0604e4ac3c20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c7850d5-31') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:06:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c7850d5-31, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:06:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:06:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2fa8b5fa-5538-44da-b966-9dded8180f3b) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:06:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:06:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:06:56 user nova-compute[74743]: INFO os_vif [None req-df69db2d-ec9b-4f6e-91c3-04f618b3ca76 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:50:5c,bridge_name='br-int',has_traffic_filtering=True,id=9c7850d5-314e-4854-bbc1-b4e08037abd1,network=Network(55694218-7eff-4083-b98f-0604e4ac3c20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c7850d5-31')
Nov 18 17:06:56 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-df69db2d-ec9b-4f6e-91c3-04f618b3ca76 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Deleting instance files /opt/stack/data/nova/instances/e2a7ff40-310e-481f-8459-cde1034a0fbd_del
Nov 18 17:06:56 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-df69db2d-ec9b-4f6e-91c3-04f618b3ca76 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Deletion of /opt/stack/data/nova/instances/e2a7ff40-310e-481f-8459-cde1034a0fbd_del complete
Nov 18 17:06:56 user nova-compute[74743]: INFO nova.compute.manager [None req-df69db2d-ec9b-4f6e-91c3-04f618b3ca76 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 18 17:06:56 user nova-compute[74743]: DEBUG oslo.service.loopingcall [None req-df69db2d-ec9b-4f6e-91c3-04f618b3ca76 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74743) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 17:06:56 user nova-compute[74743]: DEBUG nova.compute.manager [-] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Deallocating network for instance {{(pid=74743) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 17:06:56 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] deallocate_for_instance() {{(pid=74743) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 17:06:57 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:06:57 user nova-compute[74743]: INFO nova.compute.manager [-] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Took 0.79 seconds to deallocate network for instance.
Nov 18 17:06:57 user nova-compute[74743]: DEBUG nova.compute.manager [req-984bd771-a81a-4f7b-8661-ea1d55ea95e1 req-5ff74406-9a81-429d-a29f-2a2832cca036 service nova] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Received event network-vif-deleted-9c7850d5-314e-4854-bbc1-b4e08037abd1 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:06:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-df69db2d-ec9b-4f6e-91c3-04f618b3ca76 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-df69db2d-ec9b-4f6e-91c3-04f618b3ca76 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:57 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-df69db2d-ec9b-4f6e-91c3-04f618b3ca76 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:06:57 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-df69db2d-ec9b-4f6e-91c3-04f618b3ca76 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:06:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-df69db2d-ec9b-4f6e-91c3-04f618b3ca76 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.358s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:57 user nova-compute[74743]: INFO nova.scheduler.client.report [None req-df69db2d-ec9b-4f6e-91c3-04f618b3ca76 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Deleted allocations for instance e2a7ff40-310e-481f-8459-cde1034a0fbd
Nov 18 17:06:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-df69db2d-ec9b-4f6e-91c3-04f618b3ca76 tempest-VolumesAssistedSnapshotsTest-318796158 tempest-VolumesAssistedSnapshotsTest-318796158-project-member] Lock "e2a7ff40-310e-481f-8459-cde1034a0fbd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.241s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:57 user nova-compute[74743]: DEBUG nova.compute.manager [req-ab2f8fc2-dbd8-427c-862a-c7a8993df1bc req-620f03f5-f26c-4c10-ba12-6bf8b5e2a3c8 service nova] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Received event network-vif-plugged-9c7850d5-314e-4854-bbc1-b4e08037abd1 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:06:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ab2f8fc2-dbd8-427c-862a-c7a8993df1bc req-620f03f5-f26c-4c10-ba12-6bf8b5e2a3c8 service nova] Acquiring lock "e2a7ff40-310e-481f-8459-cde1034a0fbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:06:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ab2f8fc2-dbd8-427c-862a-c7a8993df1bc req-620f03f5-f26c-4c10-ba12-6bf8b5e2a3c8 service nova] Lock "e2a7ff40-310e-481f-8459-cde1034a0fbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:06:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ab2f8fc2-dbd8-427c-862a-c7a8993df1bc req-620f03f5-f26c-4c10-ba12-6bf8b5e2a3c8 service nova] Lock "e2a7ff40-310e-481f-8459-cde1034a0fbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:06:57 user nova-compute[74743]: DEBUG nova.compute.manager [req-ab2f8fc2-dbd8-427c-862a-c7a8993df1bc req-620f03f5-f26c-4c10-ba12-6bf8b5e2a3c8 service nova] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] No waiting events found dispatching network-vif-plugged-9c7850d5-314e-4854-bbc1-b4e08037abd1 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:06:57 user nova-compute[74743]: WARNING nova.compute.manager [req-ab2f8fc2-dbd8-427c-862a-c7a8993df1bc req-620f03f5-f26c-4c10-ba12-6bf8b5e2a3c8 service nova] [instance: e2a7ff40-310e-481f-8459-cde1034a0fbd] Received unexpected event network-vif-plugged-9c7850d5-314e-4854-bbc1-b4e08037abd1 for instance with vm_state deleted and task_state None.
Nov 18 17:06:59 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:01 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:04 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:09 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:10 user nova-compute[74743]: DEBUG nova.compute.manager [req-148959a4-32f0-4508-b992-610ab2d333e2 req-50498b40-8b8f-4ad7-8e4b-f1128848d196 service nova] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Received event network-changed-eec59f5d-4379-4f07-b4cb-f56b388fca0a {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:07:10 user nova-compute[74743]: DEBUG nova.compute.manager [req-148959a4-32f0-4508-b992-610ab2d333e2 req-50498b40-8b8f-4ad7-8e4b-f1128848d196 service nova] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Refreshing instance network info cache due to event network-changed-eec59f5d-4379-4f07-b4cb-f56b388fca0a. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:07:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-148959a4-32f0-4508-b992-610ab2d333e2 req-50498b40-8b8f-4ad7-8e4b-f1128848d196 service nova] Acquiring lock "refresh_cache-39e15045-0a84-4b48-a962-c006b6c747b3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:07:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-148959a4-32f0-4508-b992-610ab2d333e2 req-50498b40-8b8f-4ad7-8e4b-f1128848d196 service nova] Acquired lock "refresh_cache-39e15045-0a84-4b48-a962-c006b6c747b3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:07:10 user nova-compute[74743]: DEBUG nova.network.neutron [req-148959a4-32f0-4508-b992-610ab2d333e2 req-50498b40-8b8f-4ad7-8e4b-f1128848d196 service nova] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Refreshing network info cache for port eec59f5d-4379-4f07-b4cb-f56b388fca0a {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:07:11 user nova-compute[74743]: DEBUG nova.network.neutron [req-148959a4-32f0-4508-b992-610ab2d333e2 req-50498b40-8b8f-4ad7-8e4b-f1128848d196 service nova] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Updated VIF entry in instance network info cache for port eec59f5d-4379-4f07-b4cb-f56b388fca0a. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:07:11 user nova-compute[74743]: DEBUG nova.network.neutron [req-148959a4-32f0-4508-b992-610ab2d333e2 req-50498b40-8b8f-4ad7-8e4b-f1128848d196 service nova] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Updating instance_info_cache with network_info: [{"id": "eec59f5d-4379-4f07-b4cb-f56b388fca0a", "address": "fa:16:3e:1e:8b:be", "network": {"id": "0aaa14d8-7754-499d-8438-fd1229fddc6a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-589739381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b814ffb2501544a6a5c669df102db2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeec59f5d-43", "ovs_interfaceid": "eec59f5d-4379-4f07-b4cb-f56b388fca0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:07:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-148959a4-32f0-4508-b992-610ab2d333e2 req-50498b40-8b8f-4ad7-8e4b-f1128848d196 service nova] Releasing lock "refresh_cache-39e15045-0a84-4b48-a962-c006b6c747b3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:07:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:12 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-2c77e3c9-2655-40f2-95fa-81b6ba6e8351 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Acquiring lock "39e15045-0a84-4b48-a962-c006b6c747b3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:07:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-2c77e3c9-2655-40f2-95fa-81b6ba6e8351 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Lock "39e15045-0a84-4b48-a962-c006b6c747b3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:07:14 user nova-compute[74743]: DEBUG nova.objects.instance [None req-2c77e3c9-2655-40f2-95fa-81b6ba6e8351 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Lazy-loading 'flavor' on Instance uuid 39e15045-0a84-4b48-a962-c006b6c747b3 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:07:14 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-2c77e3c9-2655-40f2-95fa-81b6ba6e8351 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Lock "39e15045-0a84-4b48-a962-c006b6c747b3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:07:14 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-2c77e3c9-2655-40f2-95fa-81b6ba6e8351 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Acquiring lock "39e15045-0a84-4b48-a962-c006b6c747b3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:07:14 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-2c77e3c9-2655-40f2-95fa-81b6ba6e8351 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Lock "39e15045-0a84-4b48-a962-c006b6c747b3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:07:14 user nova-compute[74743]: INFO nova.compute.manager [None req-2c77e3c9-2655-40f2-95fa-81b6ba6e8351 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Attaching volume 039844c6-8136-4bb5-9026-010fa035e2af to /dev/vdb
Nov 18 17:07:14 user nova-compute[74743]: DEBUG os_brick.utils [None req-2c77e3c9-2655-40f2-95fa-81b6ba6e8351 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:07:14 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:14 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:14 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fcc5c30-4bc0-45d8-b74b-2eee8a2442eb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1116acd8874d\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:07:14 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:14 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:14 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c391df6-245f-4bdf-abdb-289d80f49141]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:07:14 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:14 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:14 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0832de12-5317-4d62-8392-d080985ba9fe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:07:14 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[000f17e8-7be0-4f16-9d5b-2a398cfddd5f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:07:14 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-2c77e3c9-2655-40f2-95fa-81b6ba6e8351 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Running cmd (subprocess): nvme version {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:14 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-2c77e3c9-2655-40f2-95fa-81b6ba6e8351 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] 'nvme version' failed. Not Retrying. {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:07:14 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2c77e3c9-2655-40f2-95fa-81b6ba6e8351 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] nvme not present on system {{(pid=74743) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 17:07:14 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:14 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:07:14 user nova-compute[74743]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 17:07:14 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a655dfd2-98e2-4639-86b2-df8a607233aa]: (4, '') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:07:14 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-2c77e3c9-2655-40f2-95fa-81b6ba6e8351 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74743) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 17:07:14 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-2c77e3c9-2655-40f2-95fa-81b6ba6e8351 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 17:07:14 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-2c77e3c9-2655-40f2-95fa-81b6ba6e8351 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] LIGHTOS: no hostnqn found. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 17:07:14 user nova-compute[74743]: DEBUG os_brick.utils [None req-2c77e3c9-2655-40f2-95fa-81b6ba6e8351 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1116acd8874d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:07:14 user nova-compute[74743]: DEBUG nova.virt.block_device [None req-2c77e3c9-2655-40f2-95fa-81b6ba6e8351 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Updating existing volume attachment record: 962f7732-d234-45b0-93fa-b12f842eae74 {{(pid=74743) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 17:07:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-1b00234f-b474-4d1c-8d6d-d6e4d934d6ad tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Acquiring lock "abf14b55-522e-4497-a799-cdc914072515" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:07:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-1b00234f-b474-4d1c-8d6d-d6e4d934d6ad tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Lock "abf14b55-522e-4497-a799-cdc914072515" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:07:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-1b00234f-b474-4d1c-8d6d-d6e4d934d6ad tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Acquiring lock "abf14b55-522e-4497-a799-cdc914072515-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:07:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-1b00234f-b474-4d1c-8d6d-d6e4d934d6ad tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Lock "abf14b55-522e-4497-a799-cdc914072515-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:07:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-1b00234f-b474-4d1c-8d6d-d6e4d934d6ad tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Lock "abf14b55-522e-4497-a799-cdc914072515-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:07:15 user nova-compute[74743]: INFO nova.compute.manager [None req-1b00234f-b474-4d1c-8d6d-d6e4d934d6ad tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] [instance: abf14b55-522e-4497-a799-cdc914072515] Terminating instance
Nov 18 17:07:15 user nova-compute[74743]: DEBUG nova.compute.manager [None req-1b00234f-b474-4d1c-8d6d-d6e4d934d6ad tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] [instance: abf14b55-522e-4497-a799-cdc914072515] Start destroying the instance on the hypervisor. {{(pid=74743) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 17:07:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:16 user nova-compute[74743]: DEBUG nova.compute.manager [req-ea7da87a-384a-4027-bf14-dfe30686ecb1 req-14873c6b-484d-4b2a-bbdf-3883b0b5a6f8 service nova] [instance: abf14b55-522e-4497-a799-cdc914072515] Received event network-vif-unplugged-b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:07:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ea7da87a-384a-4027-bf14-dfe30686ecb1 req-14873c6b-484d-4b2a-bbdf-3883b0b5a6f8 service nova] Acquiring lock "abf14b55-522e-4497-a799-cdc914072515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:07:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ea7da87a-384a-4027-bf14-dfe30686ecb1 req-14873c6b-484d-4b2a-bbdf-3883b0b5a6f8 service nova] Lock "abf14b55-522e-4497-a799-cdc914072515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:07:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ea7da87a-384a-4027-bf14-dfe30686ecb1 req-14873c6b-484d-4b2a-bbdf-3883b0b5a6f8 service nova] Lock "abf14b55-522e-4497-a799-cdc914072515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:07:16 user nova-compute[74743]: DEBUG nova.compute.manager [req-ea7da87a-384a-4027-bf14-dfe30686ecb1 req-14873c6b-484d-4b2a-bbdf-3883b0b5a6f8 service nova] [instance: abf14b55-522e-4497-a799-cdc914072515] No waiting events found dispatching network-vif-unplugged-b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:07:16 user nova-compute[74743]: DEBUG nova.compute.manager [req-ea7da87a-384a-4027-bf14-dfe30686ecb1 req-14873c6b-484d-4b2a-bbdf-3883b0b5a6f8 service nova] [instance: abf14b55-522e-4497-a799-cdc914072515] Received event network-vif-unplugged-b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:07:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:16 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: abf14b55-522e-4497-a799-cdc914072515] Instance destroyed successfully.
Nov 18 17:07:16 user nova-compute[74743]: DEBUG nova.objects.instance [None req-1b00234f-b474-4d1c-8d6d-d6e4d934d6ad tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Lazy-loading 'resources' on Instance uuid abf14b55-522e-4497-a799-cdc914072515 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:07:16 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-1b00234f-b474-4d1c-8d6d-d6e4d934d6ad tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:05:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1511794040',display_name='tempest-VolumesNegativeTest-instance-1511794040',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1511794040',id=13,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:05:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='de5e099a27494eabb547f8d5203cb0e5',ramdisk_id='',reservation_id='r-n6l3qldv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-450589239',owner_user_name='tempest-VolumesNegativeTest-450589239-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:05:34Z,user_data=None,user_id='fd7084ff003c425fa79affcde8a547ee',uuid=abf14b55-522e-4497-a799-cdc914072515,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e", "address": "fa:16:3e:0a:90:a3", "network": {"id": "a5153a19-cb61-4511-9fd6-d4a48226e4cc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e135c3aa00df41149fab95db3d88532f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d0dbbe-3d", "ovs_interfaceid": "b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:07:16 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-1b00234f-b474-4d1c-8d6d-d6e4d934d6ad tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Converting VIF {"id": "b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e", "address": "fa:16:3e:0a:90:a3", "network": {"id": "a5153a19-cb61-4511-9fd6-d4a48226e4cc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e135c3aa00df41149fab95db3d88532f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d0dbbe-3d", "ovs_interfaceid": "b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:07:16 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-1b00234f-b474-4d1c-8d6d-d6e4d934d6ad tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:90:a3,bridge_name='br-int',has_traffic_filtering=True,id=b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e,network=Network(a5153a19-cb61-4511-9fd6-d4a48226e4cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0d0dbbe-3d') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:07:16 user nova-compute[74743]: DEBUG os_vif [None req-1b00234f-b474-4d1c-8d6d-d6e4d934d6ad tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:90:a3,bridge_name='br-int',has_traffic_filtering=True,id=b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e,network=Network(a5153a19-cb61-4511-9fd6-d4a48226e4cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0d0dbbe-3d') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:07:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb0d0dbbe-3d, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:07:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:07:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0c403a38-74b7-42d4-8078-7f71d6746955) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:07:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:07:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:16 user nova-compute[74743]: INFO os_vif [None req-1b00234f-b474-4d1c-8d6d-d6e4d934d6ad tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:90:a3,bridge_name='br-int',has_traffic_filtering=True,id=b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e,network=Network(a5153a19-cb61-4511-9fd6-d4a48226e4cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0d0dbbe-3d')
Nov 18 17:07:16 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-1b00234f-b474-4d1c-8d6d-d6e4d934d6ad tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] [instance: abf14b55-522e-4497-a799-cdc914072515] Deleting instance files /opt/stack/data/nova/instances/abf14b55-522e-4497-a799-cdc914072515_del
Nov 18 17:07:16 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-1b00234f-b474-4d1c-8d6d-d6e4d934d6ad tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] [instance: abf14b55-522e-4497-a799-cdc914072515] Deletion of /opt/stack/data/nova/instances/abf14b55-522e-4497-a799-cdc914072515_del complete
Nov 18 17:07:16 user nova-compute[74743]: INFO nova.compute.manager [None req-1b00234f-b474-4d1c-8d6d-d6e4d934d6ad tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] [instance: abf14b55-522e-4497-a799-cdc914072515] Took 1.10 seconds to destroy the instance on the hypervisor.
Nov 18 17:07:16 user nova-compute[74743]: DEBUG oslo.service.loopingcall [None req-1b00234f-b474-4d1c-8d6d-d6e4d934d6ad tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74743) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 17:07:16 user nova-compute[74743]: DEBUG nova.compute.manager [-] [instance: abf14b55-522e-4497-a799-cdc914072515] Deallocating network for instance {{(pid=74743) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 17:07:16 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: abf14b55-522e-4497-a799-cdc914072515] deallocate_for_instance() {{(pid=74743) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 17:07:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:17 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: abf14b55-522e-4497-a799-cdc914072515] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:07:17 user nova-compute[74743]: DEBUG nova.compute.manager [req-96877e4f-2779-47bd-b61f-da802d35c916 req-ca7bba30-507d-4c1a-9c44-451b0801ccc2 service nova] [instance: abf14b55-522e-4497-a799-cdc914072515] Received event network-vif-deleted-b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:07:17 user nova-compute[74743]: INFO nova.compute.manager [req-96877e4f-2779-47bd-b61f-da802d35c916 req-ca7bba30-507d-4c1a-9c44-451b0801ccc2 service nova] [instance: abf14b55-522e-4497-a799-cdc914072515] Neutron deleted interface b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e; detaching it from the instance and deleting it from the info cache
Nov 18 17:07:17 user nova-compute[74743]: DEBUG nova.network.neutron [req-96877e4f-2779-47bd-b61f-da802d35c916 req-ca7bba30-507d-4c1a-9c44-451b0801ccc2 service nova] [instance: abf14b55-522e-4497-a799-cdc914072515] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:07:17 user nova-compute[74743]: INFO nova.compute.manager [-] [instance: abf14b55-522e-4497-a799-cdc914072515] Took 0.94 seconds to deallocate network for instance.
Nov 18 17:07:17 user nova-compute[74743]: DEBUG nova.compute.manager [req-96877e4f-2779-47bd-b61f-da802d35c916 req-ca7bba30-507d-4c1a-9c44-451b0801ccc2 service nova] [instance: abf14b55-522e-4497-a799-cdc914072515] Detach interface failed, port_id=b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e, reason: Instance abf14b55-522e-4497-a799-cdc914072515 could not be found. {{(pid=74743) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 17:07:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-7762c43f-9b07-4302-831e-787848e9bf6a req-314a4b62-d523-4829-bd75-dadfdd92c576 service nova] [instance: abf14b55-522e-4497-a799-cdc914072515] Received event network-vif-plugged-b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:07:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-7762c43f-9b07-4302-831e-787848e9bf6a req-314a4b62-d523-4829-bd75-dadfdd92c576 service nova] Acquiring lock "abf14b55-522e-4497-a799-cdc914072515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:07:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-7762c43f-9b07-4302-831e-787848e9bf6a req-314a4b62-d523-4829-bd75-dadfdd92c576 service nova] Lock "abf14b55-522e-4497-a799-cdc914072515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:07:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-7762c43f-9b07-4302-831e-787848e9bf6a req-314a4b62-d523-4829-bd75-dadfdd92c576 service nova] Lock "abf14b55-522e-4497-a799-cdc914072515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:07:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-7762c43f-9b07-4302-831e-787848e9bf6a req-314a4b62-d523-4829-bd75-dadfdd92c576 service nova] [instance: abf14b55-522e-4497-a799-cdc914072515] No waiting events found dispatching network-vif-plugged-b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:07:18 user nova-compute[74743]: WARNING nova.compute.manager [req-7762c43f-9b07-4302-831e-787848e9bf6a req-314a4b62-d523-4829-bd75-dadfdd92c576 service nova] [instance: abf14b55-522e-4497-a799-cdc914072515] Received unexpected event network-vif-plugged-b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e for instance with vm_state active and task_state deleting.
Nov 18 17:07:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-7762c43f-9b07-4302-831e-787848e9bf6a req-314a4b62-d523-4829-bd75-dadfdd92c576 service nova] [instance: abf14b55-522e-4497-a799-cdc914072515] Received event network-vif-plugged-b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:07:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-7762c43f-9b07-4302-831e-787848e9bf6a req-314a4b62-d523-4829-bd75-dadfdd92c576 service nova] Acquiring lock "abf14b55-522e-4497-a799-cdc914072515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:07:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-7762c43f-9b07-4302-831e-787848e9bf6a req-314a4b62-d523-4829-bd75-dadfdd92c576 service nova] Lock "abf14b55-522e-4497-a799-cdc914072515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:07:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-7762c43f-9b07-4302-831e-787848e9bf6a req-314a4b62-d523-4829-bd75-dadfdd92c576 service nova] Lock "abf14b55-522e-4497-a799-cdc914072515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:07:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-7762c43f-9b07-4302-831e-787848e9bf6a req-314a4b62-d523-4829-bd75-dadfdd92c576 service nova] [instance: abf14b55-522e-4497-a799-cdc914072515] No waiting events found dispatching network-vif-plugged-b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:07:18 user nova-compute[74743]: WARNING nova.compute.manager [req-7762c43f-9b07-4302-831e-787848e9bf6a req-314a4b62-d523-4829-bd75-dadfdd92c576 service nova] [instance: abf14b55-522e-4497-a799-cdc914072515] Received unexpected event network-vif-plugged-b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e for instance with vm_state active and task_state deleting.
Nov 18 17:07:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-7762c43f-9b07-4302-831e-787848e9bf6a req-314a4b62-d523-4829-bd75-dadfdd92c576 service nova] [instance: abf14b55-522e-4497-a799-cdc914072515] Received event network-vif-plugged-b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:07:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-7762c43f-9b07-4302-831e-787848e9bf6a req-314a4b62-d523-4829-bd75-dadfdd92c576 service nova] Acquiring lock "abf14b55-522e-4497-a799-cdc914072515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:07:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-7762c43f-9b07-4302-831e-787848e9bf6a req-314a4b62-d523-4829-bd75-dadfdd92c576 service nova] Lock "abf14b55-522e-4497-a799-cdc914072515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:07:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-7762c43f-9b07-4302-831e-787848e9bf6a req-314a4b62-d523-4829-bd75-dadfdd92c576 service nova] Lock "abf14b55-522e-4497-a799-cdc914072515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:07:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-7762c43f-9b07-4302-831e-787848e9bf6a req-314a4b62-d523-4829-bd75-dadfdd92c576 service nova] [instance: abf14b55-522e-4497-a799-cdc914072515] No waiting events found dispatching network-vif-plugged-b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:07:18 user nova-compute[74743]: WARNING nova.compute.manager [req-7762c43f-9b07-4302-831e-787848e9bf6a req-314a4b62-d523-4829-bd75-dadfdd92c576 service nova] [instance: abf14b55-522e-4497-a799-cdc914072515] Received unexpected event network-vif-plugged-b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e for instance with vm_state active and task_state deleting.
Nov 18 17:07:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-7762c43f-9b07-4302-831e-787848e9bf6a req-314a4b62-d523-4829-bd75-dadfdd92c576 service nova] [instance: abf14b55-522e-4497-a799-cdc914072515] Received event network-vif-unplugged-b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:07:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-7762c43f-9b07-4302-831e-787848e9bf6a req-314a4b62-d523-4829-bd75-dadfdd92c576 service nova] Acquiring lock "abf14b55-522e-4497-a799-cdc914072515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:07:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-7762c43f-9b07-4302-831e-787848e9bf6a req-314a4b62-d523-4829-bd75-dadfdd92c576 service nova] Lock "abf14b55-522e-4497-a799-cdc914072515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:07:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-7762c43f-9b07-4302-831e-787848e9bf6a req-314a4b62-d523-4829-bd75-dadfdd92c576 service nova] Lock "abf14b55-522e-4497-a799-cdc914072515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:07:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-7762c43f-9b07-4302-831e-787848e9bf6a req-314a4b62-d523-4829-bd75-dadfdd92c576 service nova] [instance: abf14b55-522e-4497-a799-cdc914072515] No waiting events found dispatching network-vif-unplugged-b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:07:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-7762c43f-9b07-4302-831e-787848e9bf6a req-314a4b62-d523-4829-bd75-dadfdd92c576 service nova] [instance: abf14b55-522e-4497-a799-cdc914072515] Received event network-vif-unplugged-b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:07:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-7762c43f-9b07-4302-831e-787848e9bf6a req-314a4b62-d523-4829-bd75-dadfdd92c576 service nova] [instance: abf14b55-522e-4497-a799-cdc914072515] Received event network-vif-plugged-b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:07:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-7762c43f-9b07-4302-831e-787848e9bf6a req-314a4b62-d523-4829-bd75-dadfdd92c576 service nova] Acquiring lock "abf14b55-522e-4497-a799-cdc914072515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:07:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-7762c43f-9b07-4302-831e-787848e9bf6a req-314a4b62-d523-4829-bd75-dadfdd92c576 service nova] Lock "abf14b55-522e-4497-a799-cdc914072515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:07:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-7762c43f-9b07-4302-831e-787848e9bf6a req-314a4b62-d523-4829-bd75-dadfdd92c576 service nova] Lock "abf14b55-522e-4497-a799-cdc914072515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:07:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-7762c43f-9b07-4302-831e-787848e9bf6a req-314a4b62-d523-4829-bd75-dadfdd92c576 service nova] [instance: abf14b55-522e-4497-a799-cdc914072515] No waiting events found dispatching network-vif-plugged-b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:07:18 user nova-compute[74743]: WARNING nova.compute.manager [req-7762c43f-9b07-4302-831e-787848e9bf6a req-314a4b62-d523-4829-bd75-dadfdd92c576 service nova] [instance: abf14b55-522e-4497-a799-cdc914072515] Received unexpected event network-vif-plugged-b0d0dbbe-3d3e-4520-92ca-49d6a3582c2e for instance with vm_state active and task_state deleting.
Nov 18 17:07:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-1b00234f-b474-4d1c-8d6d-d6e4d934d6ad tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:07:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-1b00234f-b474-4d1c-8d6d-d6e4d934d6ad tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:07:18 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-1b00234f-b474-4d1c-8d6d-d6e4d934d6ad tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:07:18 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-1b00234f-b474-4d1c-8d6d-d6e4d934d6ad tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:07:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-1b00234f-b474-4d1c-8d6d-d6e4d934d6ad tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.483s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:07:18 user nova-compute[74743]: INFO nova.scheduler.client.report [None req-1b00234f-b474-4d1c-8d6d-d6e4d934d6ad tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Deleted allocations for instance abf14b55-522e-4497-a799-cdc914072515
Nov 18 17:07:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquiring lock "a77117a2-748d-4a39-8db7-8b965a1725fc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:07:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "a77117a2-748d-4a39-8db7-8b965a1725fc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:07:18 user nova-compute[74743]: DEBUG nova.compute.manager [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Starting instance... {{(pid=74743) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 17:07:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-1b00234f-b474-4d1c-8d6d-d6e4d934d6ad tempest-VolumesNegativeTest-450589239 tempest-VolumesNegativeTest-450589239-project-member] Lock "abf14b55-522e-4497-a799-cdc914072515" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.242s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:07:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:07:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:07:19 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74743) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 17:07:19 user nova-compute[74743]: INFO nova.compute.claims [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Claim successful on node user
Nov 18 17:07:19 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:07:19 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:07:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.449s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:07:19 user nova-compute[74743]: DEBUG nova.compute.manager [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Start building networks asynchronously for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 17:07:19 user nova-compute[74743]: DEBUG nova.compute.manager [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Allocating IP information in the background. {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 17:07:19 user nova-compute[74743]: DEBUG nova.network.neutron [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] allocate_for_instance() {{(pid=74743) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 17:07:19 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 17:07:19 user nova-compute[74743]: DEBUG nova.compute.manager [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Start building block device mappings for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 17:07:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:19 user nova-compute[74743]: DEBUG nova.policy [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ce3e4cef47114a7c9327db639460d923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8f5850162c479b8d185e48c03be7d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74743) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 17:07:19 user nova-compute[74743]: DEBUG nova.compute.manager [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Start spawning the instance on the hypervisor. {{(pid=74743) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 17:07:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Creating instance directory {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 17:07:19 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Creating image(s)
Nov 18 17:07:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquiring lock "/opt/stack/data/nova/instances/a77117a2-748d-4a39-8db7-8b965a1725fc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:07:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "/opt/stack/data/nova/instances/a77117a2-748d-4a39-8db7-8b965a1725fc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:07:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "/opt/stack/data/nova/instances/a77117a2-748d-4a39-8db7-8b965a1725fc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:07:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.181s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquiring lock "c188b3a997bfafa42fa341f9dcc326545681eed9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:07:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:07:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.175s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/a77117a2-748d-4a39-8db7-8b965a1725fc/disk 1073741824 {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/a77117a2-748d-4a39-8db7-8b965a1725fc/disk 1073741824" returned: 0 in 0.047s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:07:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.211s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:20 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a77117a2-748d-4a39-8db7-8b965a1725fc/disk. size=1073741824 {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 17:07:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77117a2-748d-4a39-8db7-8b965a1725fc/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:20 user nova-compute[74743]: DEBUG nova.network.neutron [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Successfully created port: 22eb23ff-0df1-42e9-92c0-458497610ff9 {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:07:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77117a2-748d-4a39-8db7-8b965a1725fc/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:20 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Cannot resize image /opt/stack/data/nova/instances/a77117a2-748d-4a39-8db7-8b965a1725fc/disk to a smaller size. {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 17:07:20 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Created local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 17:07:20 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Ensure instance console log exists: /opt/stack/data/nova/instances/a77117a2-748d-4a39-8db7-8b965a1725fc/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:07:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:07:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:07:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:07:21 user nova-compute[74743]: DEBUG nova.network.neutron [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Successfully updated port: 22eb23ff-0df1-42e9-92c0-458497610ff9 {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:07:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquiring lock "refresh_cache-a77117a2-748d-4a39-8db7-8b965a1725fc" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:07:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquired lock "refresh_cache-a77117a2-748d-4a39-8db7-8b965a1725fc" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:07:21 user nova-compute[74743]: DEBUG nova.network.neutron [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:07:21 user nova-compute[74743]: DEBUG nova.compute.manager [req-b8c95149-69ee-4d4d-96bc-b2d559a8444d req-68d65ee6-767f-4681-be06-ca307073ac5a service nova] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Received event network-changed-22eb23ff-0df1-42e9-92c0-458497610ff9 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:07:21 user nova-compute[74743]: DEBUG nova.compute.manager [req-b8c95149-69ee-4d4d-96bc-b2d559a8444d req-68d65ee6-767f-4681-be06-ca307073ac5a service nova] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Refreshing instance network info cache due to event network-changed-22eb23ff-0df1-42e9-92c0-458497610ff9. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:07:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b8c95149-69ee-4d4d-96bc-b2d559a8444d req-68d65ee6-767f-4681-be06-ca307073ac5a service nova] Acquiring lock "refresh_cache-a77117a2-748d-4a39-8db7-8b965a1725fc" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:07:21 user nova-compute[74743]: DEBUG nova.network.neutron [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:07:21 user nova-compute[74743]: DEBUG nova.network.neutron [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Updating instance_info_cache with network_info: [{"id": "22eb23ff-0df1-42e9-92c0-458497610ff9", "address": "fa:16:3e:b3:91:01", "network": {"id": "fd98f398-6576-449b-a737-887906eb6656", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668610993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb8f5850162c479b8d185e48c03be7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22eb23ff-0d", "ovs_interfaceid": "22eb23ff-0df1-42e9-92c0-458497610ff9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:07:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Releasing lock "refresh_cache-a77117a2-748d-4a39-8db7-8b965a1725fc" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:07:21 user nova-compute[74743]: DEBUG nova.compute.manager [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Instance network_info: |[{"id": "22eb23ff-0df1-42e9-92c0-458497610ff9", "address": "fa:16:3e:b3:91:01", "network": {"id": "fd98f398-6576-449b-a737-887906eb6656", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668610993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb8f5850162c479b8d185e48c03be7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22eb23ff-0d", "ovs_interfaceid": "22eb23ff-0df1-42e9-92c0-458497610ff9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 17:07:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b8c95149-69ee-4d4d-96bc-b2d559a8444d req-68d65ee6-767f-4681-be06-ca307073ac5a service nova] Acquired lock "refresh_cache-a77117a2-748d-4a39-8db7-8b965a1725fc" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:07:21 user nova-compute[74743]: DEBUG nova.network.neutron [req-b8c95149-69ee-4d4d-96bc-b2d559a8444d req-68d65ee6-767f-4681-be06-ca307073ac5a service nova] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Refreshing network info cache for port 22eb23ff-0df1-42e9-92c0-458497610ff9 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:07:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Start _get_guest_xml network_info=[{"id": "22eb23ff-0df1-42e9-92c0-458497610ff9", "address": "fa:16:3e:b3:91:01", "network": {"id": "fd98f398-6576-449b-a737-887906eb6656", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668610993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb8f5850162c479b8d185e48c03be7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22eb23ff-0d", "ovs_interfaceid": "22eb23ff-0df1-42e9-92c0-458497610ff9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '9536f6cf-95c4-40e2-864a-09a91525678a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:07:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:21 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:07:21 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:07:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:07:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:07:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:07:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:07:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:07:21 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:07:21 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:07:21 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:07:21 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:07:21 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:07:21 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:07:21 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:07:21 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:07:21 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:07:21 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:07:21 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:07:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:07:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-196576409',display_name='tempest-tempest.common.compute-instance-196576409',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-196576409',id=15,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJ9kBQV92QaO3NUQbsdxDa+z/O1R04nUATEUKPjnEHL9HBfHVAhzij3/MW2rTF8MFDQnt9uJ84+7PkWlYtClUm5BR319p/vhy/LOgQaMQorogb0O8y32fF069JI6jSm2g==',key_name='tempest-keypair-524527226',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb8f5850162c479b8d185e48c03be7d3',ramdisk_id='',reservation_id='r-hahsjukq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-128885625',owner_user_name='tempest-ServerActionsTestOtherA-128885625-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:07:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce3e4cef47114a7c9327db639460d923',uuid=a77117a2-748d-4a39-8db7-8b965a1725fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22eb23ff-0df1-42e9-92c0-458497610ff9", "address": "fa:16:3e:b3:91:01", "network": {"id": "fd98f398-6576-449b-a737-887906eb6656", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668610993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb8f5850162c479b8d185e48c03be7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22eb23ff-0d", "ovs_interfaceid": "22eb23ff-0df1-42e9-92c0-458497610ff9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:07:21 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Converting VIF {"id": "22eb23ff-0df1-42e9-92c0-458497610ff9", "address": "fa:16:3e:b3:91:01", "network": {"id": "fd98f398-6576-449b-a737-887906eb6656", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668610993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb8f5850162c479b8d185e48c03be7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22eb23ff-0d", "ovs_interfaceid": "22eb23ff-0df1-42e9-92c0-458497610ff9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:07:21 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:91:01,bridge_name='br-int',has_traffic_filtering=True,id=22eb23ff-0df1-42e9-92c0-458497610ff9,network=Network(fd98f398-6576-449b-a737-887906eb6656),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22eb23ff-0d') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:07:21 user nova-compute[74743]: DEBUG nova.objects.instance [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lazy-loading 'pci_devices' on Instance uuid a77117a2-748d-4a39-8db7-8b965a1725fc {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:07:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:07:21 user nova-compute[74743]:   <uuid>a77117a2-748d-4a39-8db7-8b965a1725fc</uuid>
Nov 18 17:07:21 user nova-compute[74743]:   <name>instance-0000000f</name>
Nov 18 17:07:21 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:07:21 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:07:21 user nova-compute[74743]:   <metadata>
Nov 18 17:07:21 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:07:21 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:07:21 user nova-compute[74743]:       <nova:name>tempest-tempest.common.compute-instance-196576409</nova:name>
Nov 18 17:07:21 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:07:21</nova:creationTime>
Nov 18 17:07:21 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:07:21 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:07:21 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:07:21 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:07:21 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:07:21 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:07:21 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:07:21 user nova-compute[74743]:       <nova:owner>
Nov 18 17:07:21 user nova-compute[74743]:         <nova:user uuid="ce3e4cef47114a7c9327db639460d923">tempest-ServerActionsTestOtherA-128885625-project-member</nova:user>
Nov 18 17:07:21 user nova-compute[74743]:         <nova:project uuid="fb8f5850162c479b8d185e48c03be7d3">tempest-ServerActionsTestOtherA-128885625</nova:project>
Nov 18 17:07:21 user nova-compute[74743]:       </nova:owner>
Nov 18 17:07:21 user nova-compute[74743]:       <nova:root type="image" uuid="9536f6cf-95c4-40e2-864a-09a91525678a"/>
Nov 18 17:07:21 user nova-compute[74743]:       <nova:ports>
Nov 18 17:07:21 user nova-compute[74743]:         <nova:port uuid="22eb23ff-0df1-42e9-92c0-458497610ff9">
Nov 18 17:07:21 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 18 17:07:21 user nova-compute[74743]:         </nova:port>
Nov 18 17:07:21 user nova-compute[74743]:       </nova:ports>
Nov 18 17:07:21 user nova-compute[74743]:     </nova:instance>
Nov 18 17:07:21 user nova-compute[74743]:   </metadata>
Nov 18 17:07:21 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:07:21 user nova-compute[74743]:     <system>
Nov 18 17:07:21 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:07:21 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:07:21 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:07:21 user nova-compute[74743]:       <entry name="serial">a77117a2-748d-4a39-8db7-8b965a1725fc</entry>
Nov 18 17:07:21 user nova-compute[74743]:       <entry name="uuid">a77117a2-748d-4a39-8db7-8b965a1725fc</entry>
Nov 18 17:07:21 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:07:21 user nova-compute[74743]:     </system>
Nov 18 17:07:21 user nova-compute[74743]:   </sysinfo>
Nov 18 17:07:21 user nova-compute[74743]:   <os>
Nov 18 17:07:21 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:07:21 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:07:21 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:07:21 user nova-compute[74743]:   </os>
Nov 18 17:07:21 user nova-compute[74743]:   <features>
Nov 18 17:07:21 user nova-compute[74743]:     <acpi/>
Nov 18 17:07:21 user nova-compute[74743]:     <apic/>
Nov 18 17:07:21 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:07:21 user nova-compute[74743]:   </features>
Nov 18 17:07:21 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:07:21 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:07:21 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:07:21 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:07:21 user nova-compute[74743]:   </clock>
Nov 18 17:07:21 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:07:21 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:07:21 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:07:21 user nova-compute[74743]:   </cpu>
Nov 18 17:07:21 user nova-compute[74743]:   <devices>
Nov 18 17:07:21 user nova-compute[74743]:     <disk type="file" device="disk">
Nov 18 17:07:21 user nova-compute[74743]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 17:07:21 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/a77117a2-748d-4a39-8db7-8b965a1725fc/disk"/>
Nov 18 17:07:21 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:07:21 user nova-compute[74743]:     </disk>
Nov 18 17:07:21 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:07:21 user nova-compute[74743]:       <mac address="fa:16:3e:b3:91:01"/>
Nov 18 17:07:21 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:07:21 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:07:21 user nova-compute[74743]:       <target dev="tap22eb23ff-0d"/>
Nov 18 17:07:21 user nova-compute[74743]:     </interface>
Nov 18 17:07:21 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:07:21 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/a77117a2-748d-4a39-8db7-8b965a1725fc/console.log" append="off"/>
Nov 18 17:07:21 user nova-compute[74743]:     </serial>
Nov 18 17:07:21 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:07:21 user nova-compute[74743]:     <video>
Nov 18 17:07:21 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:07:21 user nova-compute[74743]:     </video>
Nov 18 17:07:21 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:07:21 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:07:21 user nova-compute[74743]:     </rng>
Nov 18 17:07:21 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:07:21 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:07:21 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:07:21 user nova-compute[74743]:     </memballoon>
Nov 18 17:07:21 user nova-compute[74743]:   </devices>
Nov 18 17:07:21 user nova-compute[74743]: </domain>
Nov 18 17:07:21 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:07:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:07:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-196576409',display_name='tempest-tempest.common.compute-instance-196576409',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-196576409',id=15,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJ9kBQV92QaO3NUQbsdxDa+z/O1R04nUATEUKPjnEHL9HBfHVAhzij3/MW2rTF8MFDQnt9uJ84+7PkWlYtClUm5BR319p/vhy/LOgQaMQorogb0O8y32fF069JI6jSm2g==',key_name='tempest-keypair-524527226',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb8f5850162c479b8d185e48c03be7d3',ramdisk_id='',reservation_id='r-hahsjukq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-128885625',owner_user_name='tempest-ServerActionsTestOtherA-128885625-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:07:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce3e4cef47114a7c9327db639460d923',uuid=a77117a2-748d-4a39-8db7-8b965a1725fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22eb23ff-0df1-42e9-92c0-458497610ff9", "address": "fa:16:3e:b3:91:01", "network": {"id": "fd98f398-6576-449b-a737-887906eb6656", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668610993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb8f5850162c479b8d185e48c03be7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22eb23ff-0d", "ovs_interfaceid": "22eb23ff-0df1-42e9-92c0-458497610ff9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:07:21 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Converting VIF {"id": "22eb23ff-0df1-42e9-92c0-458497610ff9", "address": "fa:16:3e:b3:91:01", "network": {"id": "fd98f398-6576-449b-a737-887906eb6656", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668610993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb8f5850162c479b8d185e48c03be7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22eb23ff-0d", "ovs_interfaceid": "22eb23ff-0df1-42e9-92c0-458497610ff9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:07:21 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:91:01,bridge_name='br-int',has_traffic_filtering=True,id=22eb23ff-0df1-42e9-92c0-458497610ff9,network=Network(fd98f398-6576-449b-a737-887906eb6656),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22eb23ff-0d') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:07:21 user nova-compute[74743]: DEBUG os_vif [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:91:01,bridge_name='br-int',has_traffic_filtering=True,id=22eb23ff-0df1-42e9-92c0-458497610ff9,network=Network(fd98f398-6576-449b-a737-887906eb6656),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22eb23ff-0d') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:07:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:07:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:07:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd5415b49-4860-5bc9-a3c1-b037a9abfd6f', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:07:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22eb23ff-0d, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:07:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap22eb23ff-0d, col_values=(('qos', UUID('a33bfd3b-4425-4cdc-9e62-08fa18ef0f55')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:07:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap22eb23ff-0d, col_values=(('external_ids', {'iface-id': '22eb23ff-0df1-42e9-92c0-458497610ff9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:91:01', 'vm-uuid': 'a77117a2-748d-4a39-8db7-8b965a1725fc'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:07:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:07:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:21 user nova-compute[74743]: INFO os_vif [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:91:01,bridge_name='br-int',has_traffic_filtering=True,id=22eb23ff-0df1-42e9-92c0-458497610ff9,network=Network(fd98f398-6576-449b-a737-887906eb6656),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22eb23ff-0d')
Nov 18 17:07:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:07:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] No VIF found with MAC fa:16:3e:b3:91:01, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:07:22 user nova-compute[74743]: DEBUG nova.network.neutron [req-b8c95149-69ee-4d4d-96bc-b2d559a8444d req-68d65ee6-767f-4681-be06-ca307073ac5a service nova] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Updated VIF entry in instance network info cache for port 22eb23ff-0df1-42e9-92c0-458497610ff9. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:07:22 user nova-compute[74743]: DEBUG nova.network.neutron [req-b8c95149-69ee-4d4d-96bc-b2d559a8444d req-68d65ee6-767f-4681-be06-ca307073ac5a service nova] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Updating instance_info_cache with network_info: [{"id": "22eb23ff-0df1-42e9-92c0-458497610ff9", "address": "fa:16:3e:b3:91:01", "network": {"id": "fd98f398-6576-449b-a737-887906eb6656", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668610993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb8f5850162c479b8d185e48c03be7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22eb23ff-0d", "ovs_interfaceid": "22eb23ff-0df1-42e9-92c0-458497610ff9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:07:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b8c95149-69ee-4d4d-96bc-b2d559a8444d req-68d65ee6-767f-4681-be06-ca307073ac5a service nova] Releasing lock "refresh_cache-a77117a2-748d-4a39-8db7-8b965a1725fc" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:07:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-6c61ccc6-7db7-4ea5-9ee4-08100d998d87 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Acquiring lock "567feb03-a356-4347-b146-d8930ad60c11" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:07:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-6c61ccc6-7db7-4ea5-9ee4-08100d998d87 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Lock "567feb03-a356-4347-b146-d8930ad60c11" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:07:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-6c61ccc6-7db7-4ea5-9ee4-08100d998d87 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Acquiring lock "567feb03-a356-4347-b146-d8930ad60c11-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:07:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-6c61ccc6-7db7-4ea5-9ee4-08100d998d87 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Lock "567feb03-a356-4347-b146-d8930ad60c11-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:07:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-6c61ccc6-7db7-4ea5-9ee4-08100d998d87 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Lock "567feb03-a356-4347-b146-d8930ad60c11-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:07:22 user nova-compute[74743]: INFO nova.compute.manager [None req-6c61ccc6-7db7-4ea5-9ee4-08100d998d87 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Terminating instance
Nov 18 17:07:22 user nova-compute[74743]: DEBUG nova.compute.manager [None req-6c61ccc6-7db7-4ea5-9ee4-08100d998d87 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Start destroying the instance on the hypervisor. {{(pid=74743) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 17:07:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:23 user nova-compute[74743]: DEBUG nova.compute.manager [req-d39267ff-14e4-4334-bb71-dc64bd5dbe35 req-3684248a-1173-4c47-b1be-25e7f87e0916 service nova] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Received event network-vif-unplugged-8b4ff8a1-a6e9-45bc-bea0-ea343801011d {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:07:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d39267ff-14e4-4334-bb71-dc64bd5dbe35 req-3684248a-1173-4c47-b1be-25e7f87e0916 service nova] Acquiring lock "567feb03-a356-4347-b146-d8930ad60c11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:07:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d39267ff-14e4-4334-bb71-dc64bd5dbe35 req-3684248a-1173-4c47-b1be-25e7f87e0916 service nova] Lock "567feb03-a356-4347-b146-d8930ad60c11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:07:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d39267ff-14e4-4334-bb71-dc64bd5dbe35 req-3684248a-1173-4c47-b1be-25e7f87e0916 service nova] Lock "567feb03-a356-4347-b146-d8930ad60c11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:07:23 user nova-compute[74743]: DEBUG nova.compute.manager [req-d39267ff-14e4-4334-bb71-dc64bd5dbe35 req-3684248a-1173-4c47-b1be-25e7f87e0916 service nova] [instance: 567feb03-a356-4347-b146-d8930ad60c11] No waiting events found dispatching network-vif-unplugged-8b4ff8a1-a6e9-45bc-bea0-ea343801011d {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:07:23 user nova-compute[74743]: DEBUG nova.compute.manager [req-d39267ff-14e4-4334-bb71-dc64bd5dbe35 req-3684248a-1173-4c47-b1be-25e7f87e0916 service nova] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Received event network-vif-unplugged-8b4ff8a1-a6e9-45bc-bea0-ea343801011d for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:07:23 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:23 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:23 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:23 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:23 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:23 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:23 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Instance destroyed successfully.
Nov 18 17:07:23 user nova-compute[74743]: DEBUG nova.objects.instance [None req-6c61ccc6-7db7-4ea5-9ee4-08100d998d87 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Lazy-loading 'resources' on Instance uuid 567feb03-a356-4347-b146-d8930ad60c11 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:07:23 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-6c61ccc6-7db7-4ea5-9ee4-08100d998d87 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:03:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1875844160',display_name='tempest-TestVolumeSwap-server-1875844160',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1875844160',id=7,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCg1YXN0TzaTnpbw2dwzzWU5+kovzT7JAIHs2x8cRM/vhH290LjElIv66tJ3Kom4/c/xOainrd1BBPd+eYRZMWQT02xLZGQejkg3iaRCe+Idi8tlr/r8D4zZ3LmKvfcEPA==',key_name='tempest-keypair-524493985',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:04:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='944d66befe2a46dc85d3c3aded3495f9',ramdisk_id='',reservation_id='r-2ex2nqqb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1246113169',owner_user_name='tempest-TestVolumeSwap-1246113169-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:04:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2898fbfb804d4710a2cab8cd943f0c53',uuid=567feb03-a356-4347-b146-d8930ad60c11,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b4ff8a1-a6e9-45bc-bea0-ea343801011d", "address": "fa:16:3e:b3:b4:6a", "network": {"id": "0db4e9a5-ebe1-4af2-a7a4-25ae3a070a1a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-868857269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "944d66befe2a46dc85d3c3aded3495f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4ff8a1-a6", "ovs_interfaceid": "8b4ff8a1-a6e9-45bc-bea0-ea343801011d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:07:23 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-6c61ccc6-7db7-4ea5-9ee4-08100d998d87 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Converting VIF {"id": "8b4ff8a1-a6e9-45bc-bea0-ea343801011d", "address": "fa:16:3e:b3:b4:6a", "network": {"id": "0db4e9a5-ebe1-4af2-a7a4-25ae3a070a1a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-868857269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "944d66befe2a46dc85d3c3aded3495f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4ff8a1-a6", "ovs_interfaceid": "8b4ff8a1-a6e9-45bc-bea0-ea343801011d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:07:23 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-6c61ccc6-7db7-4ea5-9ee4-08100d998d87 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:b4:6a,bridge_name='br-int',has_traffic_filtering=True,id=8b4ff8a1-a6e9-45bc-bea0-ea343801011d,network=Network(0db4e9a5-ebe1-4af2-a7a4-25ae3a070a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4ff8a1-a6') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:07:24 user nova-compute[74743]: DEBUG os_vif [None req-6c61ccc6-7db7-4ea5-9ee4-08100d998d87 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:b4:6a,bridge_name='br-int',has_traffic_filtering=True,id=8b4ff8a1-a6e9-45bc-bea0-ea343801011d,network=Network(0db4e9a5-ebe1-4af2-a7a4-25ae3a070a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4ff8a1-a6') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:07:24 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:24 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b4ff8a1-a6, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:07:24 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:24 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:07:24 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:24 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:24 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8c931e45-b7dd-47fa-87a0-c97424998156) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:07:24 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:24 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:07:24 user nova-compute[74743]: INFO os_vif [None req-6c61ccc6-7db7-4ea5-9ee4-08100d998d87 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:b4:6a,bridge_name='br-int',has_traffic_filtering=True,id=8b4ff8a1-a6e9-45bc-bea0-ea343801011d,network=Network(0db4e9a5-ebe1-4af2-a7a4-25ae3a070a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4ff8a1-a6')
Nov 18 17:07:24 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-6c61ccc6-7db7-4ea5-9ee4-08100d998d87 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Deleting instance files /opt/stack/data/nova/instances/567feb03-a356-4347-b146-d8930ad60c11_del
Nov 18 17:07:24 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-6c61ccc6-7db7-4ea5-9ee4-08100d998d87 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Deletion of /opt/stack/data/nova/instances/567feb03-a356-4347-b146-d8930ad60c11_del complete
Nov 18 17:07:24 user nova-compute[74743]: INFO nova.compute.manager [None req-6c61ccc6-7db7-4ea5-9ee4-08100d998d87 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Took 1.33 seconds to destroy the instance on the hypervisor.
Nov 18 17:07:24 user nova-compute[74743]: DEBUG oslo.service.loopingcall [None req-6c61ccc6-7db7-4ea5-9ee4-08100d998d87 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74743) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 17:07:24 user nova-compute[74743]: DEBUG nova.compute.manager [-] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Deallocating network for instance {{(pid=74743) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 17:07:24 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 567feb03-a356-4347-b146-d8930ad60c11] deallocate_for_instance() {{(pid=74743) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 17:07:24 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:07:24 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:07:24 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:07:24 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Starting heal instance info cache {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 17:07:24 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "refresh_cache-55192f7b-5aaf-42e6-926a-cf9f43e460ca" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:07:24 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquired lock "refresh_cache-55192f7b-5aaf-42e6-926a-cf9f43e460ca" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:07:24 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Forcefully refreshing network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 17:07:24 user nova-compute[74743]: DEBUG nova.compute.manager [req-36e49687-4b2d-45d0-8d36-1da4a9845c1b req-9a434f62-f93c-4953-a128-0bd5369e2008 service nova] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Received event network-vif-plugged-22eb23ff-0df1-42e9-92c0-458497610ff9 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:07:24 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-36e49687-4b2d-45d0-8d36-1da4a9845c1b req-9a434f62-f93c-4953-a128-0bd5369e2008 service nova] Acquiring lock "a77117a2-748d-4a39-8db7-8b965a1725fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:07:24 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-36e49687-4b2d-45d0-8d36-1da4a9845c1b req-9a434f62-f93c-4953-a128-0bd5369e2008 service nova] Lock "a77117a2-748d-4a39-8db7-8b965a1725fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:07:24 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-36e49687-4b2d-45d0-8d36-1da4a9845c1b req-9a434f62-f93c-4953-a128-0bd5369e2008 service nova] Lock "a77117a2-748d-4a39-8db7-8b965a1725fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.008s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:07:24 user nova-compute[74743]: DEBUG nova.compute.manager [req-36e49687-4b2d-45d0-8d36-1da4a9845c1b req-9a434f62-f93c-4953-a128-0bd5369e2008 service nova] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] No waiting events found dispatching network-vif-plugged-22eb23ff-0df1-42e9-92c0-458497610ff9 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:07:24 user nova-compute[74743]: WARNING nova.compute.manager [req-36e49687-4b2d-45d0-8d36-1da4a9845c1b req-9a434f62-f93c-4953-a128-0bd5369e2008 service nova] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Received unexpected event network-vif-plugged-22eb23ff-0df1-42e9-92c0-458497610ff9 for instance with vm_state building and task_state spawning.
Nov 18 17:07:24 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:25 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:07:25 user nova-compute[74743]: DEBUG nova.compute.manager [req-db160571-4f26-452e-8615-a2fd2557ff8f req-1d1d7c36-4d3c-4f40-9aea-fbbbcc60de98 service nova] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Received event network-vif-plugged-8b4ff8a1-a6e9-45bc-bea0-ea343801011d {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:07:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-db160571-4f26-452e-8615-a2fd2557ff8f req-1d1d7c36-4d3c-4f40-9aea-fbbbcc60de98 service nova] Acquiring lock "567feb03-a356-4347-b146-d8930ad60c11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:07:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-db160571-4f26-452e-8615-a2fd2557ff8f req-1d1d7c36-4d3c-4f40-9aea-fbbbcc60de98 service nova] Lock "567feb03-a356-4347-b146-d8930ad60c11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:07:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-db160571-4f26-452e-8615-a2fd2557ff8f req-1d1d7c36-4d3c-4f40-9aea-fbbbcc60de98 service nova] Lock "567feb03-a356-4347-b146-d8930ad60c11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:07:25 user nova-compute[74743]: DEBUG nova.compute.manager [req-db160571-4f26-452e-8615-a2fd2557ff8f req-1d1d7c36-4d3c-4f40-9aea-fbbbcc60de98 service nova] [instance: 567feb03-a356-4347-b146-d8930ad60c11] No waiting events found dispatching network-vif-plugged-8b4ff8a1-a6e9-45bc-bea0-ea343801011d {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:07:25 user nova-compute[74743]: WARNING nova.compute.manager [req-db160571-4f26-452e-8615-a2fd2557ff8f req-1d1d7c36-4d3c-4f40-9aea-fbbbcc60de98 service nova] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Received unexpected event network-vif-plugged-8b4ff8a1-a6e9-45bc-bea0-ea343801011d for instance with vm_state active and task_state deleting.
Nov 18 17:07:25 user nova-compute[74743]: DEBUG nova.compute.manager [req-f3626406-899f-4765-8d7d-e39ae3aabdd4 req-0284eaf6-5fa8-4875-a2af-98e3c73ffecc service nova] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Received event network-vif-deleted-8b4ff8a1-a6e9-45bc-bea0-ea343801011d {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:07:25 user nova-compute[74743]: INFO nova.compute.manager [req-f3626406-899f-4765-8d7d-e39ae3aabdd4 req-0284eaf6-5fa8-4875-a2af-98e3c73ffecc service nova] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Neutron deleted interface 8b4ff8a1-a6e9-45bc-bea0-ea343801011d; detaching it from the instance and deleting it from the info cache
Nov 18 17:07:25 user nova-compute[74743]: DEBUG nova.network.neutron [req-f3626406-899f-4765-8d7d-e39ae3aabdd4 req-0284eaf6-5fa8-4875-a2af-98e3c73ffecc service nova] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:07:25 user nova-compute[74743]: INFO nova.compute.manager [-] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Took 1.20 seconds to deallocate network for instance.
Nov 18 17:07:25 user nova-compute[74743]: DEBUG nova.compute.manager [req-f3626406-899f-4765-8d7d-e39ae3aabdd4 req-0284eaf6-5fa8-4875-a2af-98e3c73ffecc service nova] [instance: 567feb03-a356-4347-b146-d8930ad60c11] Detach interface failed, port_id=8b4ff8a1-a6e9-45bc-bea0-ea343801011d, reason: Instance 567feb03-a356-4347-b146-d8930ad60c11 could not be found. {{(pid=74743) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 17:07:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-6c61ccc6-7db7-4ea5-9ee4-08100d998d87 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:07:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-6c61ccc6-7db7-4ea5-9ee4-08100d998d87 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:07:25 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Updating instance_info_cache with network_info: [{"id": "3fecf596-29c4-44af-bbe1-25589e8aa794", "address": "fa:16:3e:1c:10:2b", "network": {"id": "7537df91-4e59-4569-88de-6dbbd9d5a4e4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1983739170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c967f66b058543878a89b86b4791d5fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fecf596-29", "ovs_interfaceid": "3fecf596-29c4-44af-bbe1-25589e8aa794", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:07:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Releasing lock "refresh_cache-55192f7b-5aaf-42e6-926a-cf9f43e460ca" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:07:25 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Updated the network info_cache for instance {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 17:07:25 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:07:25 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:07:25 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:07:25 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:07:25 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:07:25 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:07:25 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74743) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 17:07:25 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:07:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:07:25 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-6c61ccc6-7db7-4ea5-9ee4-08100d998d87 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:07:25 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-6c61ccc6-7db7-4ea5-9ee4-08100d998d87 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:07:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-6c61ccc6-7db7-4ea5-9ee4-08100d998d87 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.399s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:07:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.309s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:07:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:07:25 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Auditing locally available compute resources for user (node: user) {{(pid=74743) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 17:07:25 user nova-compute[74743]: INFO nova.scheduler.client.report [None req-6c61ccc6-7db7-4ea5-9ee4-08100d998d87 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Deleted allocations for instance 567feb03-a356-4347-b146-d8930ad60c11
Nov 18 17:07:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-6c61ccc6-7db7-4ea5-9ee4-08100d998d87 tempest-TestVolumeSwap-1246113169 tempest-TestVolumeSwap-1246113169-project-member] Lock "567feb03-a356-4347-b146-d8930ad60c11" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.236s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39e15045-0a84-4b48-a962-c006b6c747b3/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG nova.compute.manager [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Guest created on hypervisor {{(pid=74743) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 17:07:26 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Instance spawned successfully.
Nov 18 17:07:26 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Found default for hw_cdrom_bus of ide {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Found default for hw_disk_bus of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Found default for hw_input_bus of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Found default for hw_pointer_model of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Found default for hw_video_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Found default for hw_vif_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39e15045-0a84-4b48-a962-c006b6c747b3/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39e15045-0a84-4b48-a962-c006b6c747b3/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:26 user nova-compute[74743]: INFO nova.compute.manager [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Took 6.55 seconds to spawn the instance on the hypervisor.
Nov 18 17:07:26 user nova-compute[74743]: DEBUG nova.compute.manager [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39e15045-0a84-4b48-a962-c006b6c747b3/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:26 user nova-compute[74743]: INFO nova.compute.manager [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Took 7.44 seconds to build instance.
Nov 18 17:07:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4b21e4f3-52da-4b24-b4bd-b0604e737046 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "a77117a2-748d-4a39-8db7-8b965a1725fc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.579s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG nova.compute.manager [req-be257d57-2228-4864-a9ab-db4a6ac55cff req-f1225e44-ef76-4329-8152-1d83865355e2 service nova] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Received event network-vif-plugged-22eb23ff-0df1-42e9-92c0-458497610ff9 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-be257d57-2228-4864-a9ab-db4a6ac55cff req-f1225e44-ef76-4329-8152-1d83865355e2 service nova] Acquiring lock "a77117a2-748d-4a39-8db7-8b965a1725fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-be257d57-2228-4864-a9ab-db4a6ac55cff req-f1225e44-ef76-4329-8152-1d83865355e2 service nova] Lock "a77117a2-748d-4a39-8db7-8b965a1725fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-be257d57-2228-4864-a9ab-db4a6ac55cff req-f1225e44-ef76-4329-8152-1d83865355e2 service nova] Lock "a77117a2-748d-4a39-8db7-8b965a1725fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG nova.compute.manager [req-be257d57-2228-4864-a9ab-db4a6ac55cff req-f1225e44-ef76-4329-8152-1d83865355e2 service nova] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] No waiting events found dispatching network-vif-plugged-22eb23ff-0df1-42e9-92c0-458497610ff9 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:07:26 user nova-compute[74743]: WARNING nova.compute.manager [req-be257d57-2228-4864-a9ab-db4a6ac55cff req-f1225e44-ef76-4329-8152-1d83865355e2 service nova] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Received unexpected event network-vif-plugged-22eb23ff-0df1-42e9-92c0-458497610ff9 for instance with vm_state active and task_state None.
Nov 18 17:07:26 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c77e3c9-2655-40f2-95fa-81b6ba6e8351 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Calling os-brick to attach iSCSI Volume {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c77e3c9-2655-40f2-95fa-81b6ba6e8351 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:039844c6-8136-4bb5-9026-010fa035e2af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ewTJaUim', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:07:26 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-2c77e3c9-2655-40f2-95fa-81b6ba6e8351 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:07:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-2c77e3c9-2655-40f2-95fa-81b6ba6e8351 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-2c77e3c9-2655-40f2-95fa-81b6ba6e8351 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:07:26 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-2c77e3c9-2655-40f2-95fa-81b6ba6e8351 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:07:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-2c77e3c9-2655-40f2-95fa-81b6ba6e8351 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:039844c6-8136-4bb5-9026-010fa035e2af" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-2c77e3c9-2655-40f2-95fa-81b6ba6e8351 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:039844c6-8136-4bb5-9026-010fa035e2af" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:07:26 user nova-compute[74743]: INFO os_brick.initiator.connectors.iscsi [None req-2c77e3c9-2655-40f2-95fa-81b6ba6e8351 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 17:07:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:039844c6-8136-4bb5-9026-010fa035e2af -p 172.16.0.220:3260 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:039844c6-8136-4bb5-9026-010fa035e2af -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda3ef47-d0d1-43d9-8154-0525271e4acb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c77e3c9-2655-40f2-95fa-81b6ba6e8351 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 17:07:26 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:039844c6-8136-4bb5-9026-010fa035e2af -p 172.16.0.220:3260 --interface default --op new {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:039844c6-8136-4bb5-9026-010fa035e2af -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0562eb3-5a4d-44b5-b055-3802f3e524ee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:039844c6-8136-4bb5-9026-010fa035e2af] added\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c77e3c9-2655-40f2-95fa-81b6ba6e8351 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:039844c6-8136-4bb5-9026-010fa035e2af] added
Nov 18 17:07:26 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:039844c6-8136-4bb5-9026-010fa035e2af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:039844c6-8136-4bb5-9026-010fa035e2af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a392ddd-68bf-4060-897b-f22ca0dcefd3]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c77e3c9-2655-40f2-95fa-81b6ba6e8351 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:039844c6-8136-4bb5-9026-010fa035e2af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:039844c6-8136-4bb5-9026-010fa035e2af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4df281-5850-4119-ba8d-ca6c44ddb1f1]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c77e3c9-2655-40f2-95fa-81b6ba6e8351 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:039844c6-8136-4bb5-9026-010fa035e2af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ewTJaUim {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:039844c6-8136-4bb5-9026-010fa035e2af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ewTJaUim" returned: 0 in 0.032s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[138fe2ec-740b-4d33-b2df-f9bd3c638373]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c77e3c9-2655-40f2-95fa-81b6ba6e8351 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ewTJaUim'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:039844c6-8136-4bb5-9026-010fa035e2af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:039844c6-8136-4bb5-9026-010fa035e2af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b979ae-f109-4fff-9d81-809e24a85d4e]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c77e3c9-2655-40f2-95fa-81b6ba6e8351 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a9fb79-334a-4cd4-b881-5e89625ab780]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c77e3c9-2655-40f2-95fa-81b6ba6e8351 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:07:26 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c77e3c9-2655-40f2-95fa-81b6ba6e8351 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:07:26 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:039844c6-8136-4bb5-9026-010fa035e2af -p 172.16.0.220:3260 --login {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:039844c6-8136-4bb5-9026-010fa035e2af -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2cfe4f-9ece-44d0-af35-ec5e975c3f28]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:039844c6-8136-4bb5-9026-010fa035e2af, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:039844c6-8136-4bb5-9026-010fa035e2af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c77e3c9-2655-40f2-95fa-81b6ba6e8351 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:039844c6-8136-4bb5-9026-010fa035e2af, portal: 172.16.0.220,3260]
Nov 18 17:07:26 user nova-compute[74743]: Login to [iface: default, target: iqn.2010-10.org.openstack:039844c6-8136-4bb5-9026-010fa035e2af, portal: 172.16.0.220,3260] successful.
Nov 18 17:07:26 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:039844c6-8136-4bb5-9026-010fa035e2af -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:039844c6-8136-4bb5-9026-010fa035e2af -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a63c19-fa5e-42f1-ab28-98ce53742b0d]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c77e3c9-2655-40f2-95fa-81b6ba6e8351 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[55895d6c-9312-4269-8f2b-ee8442b13f6b]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039844c6-8136-4bb5-9026-010fa035e2af (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c77e3c9-2655-40f2-95fa-81b6ba6e8351 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:07:26 user nova-compute[74743]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039844c6-8136-4bb5-9026-010fa035e2af (non-flash)
Nov 18 17:07:26 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c77e3c9-2655-40f2-95fa-81b6ba6e8351 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:07:26 user nova-compute[74743]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039844c6-8136-4bb5-9026-010fa035e2af (non-flash)
Nov 18 17:07:26 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-2c77e3c9-2655-40f2-95fa-81b6ba6e8351 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:039844c6-8136-4bb5-9026-010fa035e2af" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c77e3c9-2655-40f2-95fa-81b6ba6e8351 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Connected to 172.16.0.220:3260 {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-2c77e3c9-2655-40f2-95fa-81b6ba6e8351 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=74743) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-2c77e3c9-2655-40f2-95fa-81b6ba6e8351 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74743) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f17e0c7-f2e5-4388-ac33-5705587a008e]: (4, ('- - 0', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:07:26 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-2c77e3c9-2655-40f2-95fa-81b6ba6e8351 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: None {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:07:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efcddf77-9300-4211-aa2d-31e99a37a180/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efcddf77-9300-4211-aa2d-31e99a37a180/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efcddf77-9300-4211-aa2d-31e99a37a180/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efcddf77-9300-4211-aa2d-31e99a37a180/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:27 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-2c77e3c9-2655-40f2-95fa-81b6ba6e8351 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:07:27 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c77e3c9-2655-40f2-95fa-81b6ba6e8351 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:039844c6-8136-4bb5-9026-010fa035e2af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ewTJaUim', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 17:07:27 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-2c77e3c9-2655-40f2-95fa-81b6ba6e8351 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.403s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:07:27 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c77e3c9-2655-40f2-95fa-81b6ba6e8351 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] <== connect_volume: return (1406ms) {'type': 'block', 'scsi_wwn': '23336633963633034', 'path': '/dev/sdb'} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:07:27 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c77e3c9-2655-40f2-95fa-81b6ba6e8351 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336633963633034', 'path': '/dev/sdb'} {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 17:07:28 user nova-compute[74743]: DEBUG nova.objects.instance [None req-2c77e3c9-2655-40f2-95fa-81b6ba6e8351 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Lazy-loading 'flavor' on Instance uuid 39e15045-0a84-4b48-a962-c006b6c747b3 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:07:28 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-2c77e3c9-2655-40f2-95fa-81b6ba6e8351 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 17:07:28 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:07:28 user nova-compute[74743]:   <source dev="/dev/sdb"/>
Nov 18 17:07:28 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:07:28 user nova-compute[74743]:   <serial>039844c6-8136-4bb5-9026-010fa035e2af</serial>
Nov 18 17:07:28 user nova-compute[74743]: </disk>
Nov 18 17:07:28 user nova-compute[74743]:  {{(pid=74743) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 17:07:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:28 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:07:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77117a2-748d-4a39-8db7-8b965a1725fc/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77117a2-748d-4a39-8db7-8b965a1725fc/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77117a2-748d-4a39-8db7-8b965a1725fc/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77117a2-748d-4a39-8db7-8b965a1725fc/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:28 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-2c77e3c9-2655-40f2-95fa-81b6ba6e8351 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:07:28 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-2c77e3c9-2655-40f2-95fa-81b6ba6e8351 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:07:28 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-2c77e3c9-2655-40f2-95fa-81b6ba6e8351 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] No VIF found with MAC fa:16:3e:1e:8b:be, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:07:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-2c77e3c9-2655-40f2-95fa-81b6ba6e8351 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Lock "39e15045-0a84-4b48-a962-c006b6c747b3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.594s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:07:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55192f7b-5aaf-42e6-926a-cf9f43e460ca/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55192f7b-5aaf-42e6-926a-cf9f43e460ca/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55192f7b-5aaf-42e6-926a-cf9f43e460ca/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55192f7b-5aaf-42e6-926a-cf9f43e460ca/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:29 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:07:29 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:07:29 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Hypervisor/Node resource view: name=user free_ram=7704MB free_disk=25.717266082763672GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74743) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 17:07:29 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:07:29 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:07:30 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 4cce1628-2dcb-40c7-abd4-6a327a432de3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:07:30 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance e9668e1c-1e8d-4dd7-8f58-d453db294557 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:07:30 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance c006a4ad-a8e2-4108-9af1-dec4dd53fcda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:07:30 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 55192f7b-5aaf-42e6-926a-cf9f43e460ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:07:30 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance fc4cdeb6-51ff-4090-a29d-d4f6105e15f3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:07:30 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 39e15045-0a84-4b48-a962-c006b6c747b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:07:30 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance efcddf77-9300-4211-aa2d-31e99a37a180 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:07:30 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance a77117a2-748d-4a39-8db7-8b965a1725fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:07:30 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 17:07:30 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 17:07:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:30 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:07:30 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:07:30 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Compute_service record updated for user:user {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 17:07:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.603s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:07:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-97532696-8626-450f-94e7-597130dde934 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Acquiring lock "39e15045-0a84-4b48-a962-c006b6c747b3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:07:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-97532696-8626-450f-94e7-597130dde934 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Lock "39e15045-0a84-4b48-a962-c006b6c747b3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:07:30 user nova-compute[74743]: INFO nova.compute.manager [None req-97532696-8626-450f-94e7-597130dde934 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Detaching volume 039844c6-8136-4bb5-9026-010fa035e2af
Nov 18 17:07:31 user nova-compute[74743]: INFO nova.virt.block_device [None req-97532696-8626-450f-94e7-597130dde934 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Attempting to driver detach volume 039844c6-8136-4bb5-9026-010fa035e2af from mountpoint /dev/vdb
Nov 18 17:07:31 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-97532696-8626-450f-94e7-597130dde934 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Attempting to detach device vdb from instance 39e15045-0a84-4b48-a962-c006b6c747b3 from the persistent domain config. {{(pid=74743) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 17:07:31 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-97532696-8626-450f-94e7-597130dde934 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 17:07:31 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:07:31 user nova-compute[74743]:   <source dev="/dev/sdb"/>
Nov 18 17:07:31 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:07:31 user nova-compute[74743]:   <serial>039844c6-8136-4bb5-9026-010fa035e2af</serial>
Nov 18 17:07:31 user nova-compute[74743]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 17:07:31 user nova-compute[74743]: </disk>
Nov 18 17:07:31 user nova-compute[74743]:  {{(pid=74743) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 17:07:31 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-97532696-8626-450f-94e7-597130dde934 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Successfully detached device vdb from instance 39e15045-0a84-4b48-a962-c006b6c747b3 from the persistent domain config.
Nov 18 17:07:31 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-97532696-8626-450f-94e7-597130dde934 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 39e15045-0a84-4b48-a962-c006b6c747b3 from the live domain config. {{(pid=74743) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 17:07:31 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-97532696-8626-450f-94e7-597130dde934 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 17:07:31 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:07:31 user nova-compute[74743]:   <source dev="/dev/sdb"/>
Nov 18 17:07:31 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:07:31 user nova-compute[74743]:   <serial>039844c6-8136-4bb5-9026-010fa035e2af</serial>
Nov 18 17:07:31 user nova-compute[74743]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 17:07:31 user nova-compute[74743]: </disk>
Nov 18 17:07:31 user nova-compute[74743]:  {{(pid=74743) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 17:07:31 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-97532696-8626-450f-94e7-597130dde934 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 39e15045-0a84-4b48-a962-c006b6c747b3 {{(pid=74743) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 17:07:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:36 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:42 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a155e472-2260-4de4-be14-889e26f50d0d tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Acquiring lock "fc4cdeb6-51ff-4090-a29d-d4f6105e15f3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:07:42 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a155e472-2260-4de4-be14-889e26f50d0d tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Lock "fc4cdeb6-51ff-4090-a29d-d4f6105e15f3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:07:42 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a155e472-2260-4de4-be14-889e26f50d0d tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Acquiring lock "fc4cdeb6-51ff-4090-a29d-d4f6105e15f3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:07:42 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a155e472-2260-4de4-be14-889e26f50d0d tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Lock "fc4cdeb6-51ff-4090-a29d-d4f6105e15f3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:07:42 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a155e472-2260-4de4-be14-889e26f50d0d tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Lock "fc4cdeb6-51ff-4090-a29d-d4f6105e15f3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:07:42 user nova-compute[74743]: INFO nova.compute.manager [None req-a155e472-2260-4de4-be14-889e26f50d0d tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Terminating instance
Nov 18 17:07:42 user nova-compute[74743]: DEBUG nova.compute.manager [None req-a155e472-2260-4de4-be14-889e26f50d0d tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Start destroying the instance on the hypervisor. {{(pid=74743) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 17:07:42 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:42 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:42 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Acquiring lock "49ebdd5a-824d-476a-bd10-3b891bbfe9e2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:07:42 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Lock "49ebdd5a-824d-476a-bd10-3b891bbfe9e2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:07:42 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:42 user nova-compute[74743]: DEBUG nova.compute.manager [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Starting instance... {{(pid=74743) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 17:07:42 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:07:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:07:43 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74743) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 17:07:43 user nova-compute[74743]: INFO nova.compute.claims [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Claim successful on node user
Nov 18 17:07:43 user nova-compute[74743]: DEBUG nova.compute.manager [req-45c92696-5e97-40cf-9c70-44239e01334d req-7393fe63-d430-453c-a1cc-593e24a0ce01 service nova] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Received event network-vif-unplugged-9abd882a-72d9-46b9-9dc0-8bdd727125b2 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:07:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-45c92696-5e97-40cf-9c70-44239e01334d req-7393fe63-d430-453c-a1cc-593e24a0ce01 service nova] Acquiring lock "fc4cdeb6-51ff-4090-a29d-d4f6105e15f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:07:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-45c92696-5e97-40cf-9c70-44239e01334d req-7393fe63-d430-453c-a1cc-593e24a0ce01 service nova] Lock "fc4cdeb6-51ff-4090-a29d-d4f6105e15f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:07:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-45c92696-5e97-40cf-9c70-44239e01334d req-7393fe63-d430-453c-a1cc-593e24a0ce01 service nova] Lock "fc4cdeb6-51ff-4090-a29d-d4f6105e15f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:07:43 user nova-compute[74743]: DEBUG nova.compute.manager [req-45c92696-5e97-40cf-9c70-44239e01334d req-7393fe63-d430-453c-a1cc-593e24a0ce01 service nova] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] No waiting events found dispatching network-vif-unplugged-9abd882a-72d9-46b9-9dc0-8bdd727125b2 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:07:43 user nova-compute[74743]: DEBUG nova.compute.manager [req-45c92696-5e97-40cf-9c70-44239e01334d req-7393fe63-d430-453c-a1cc-593e24a0ce01 service nova] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Received event network-vif-unplugged-9abd882a-72d9-46b9-9dc0-8bdd727125b2 for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:07:43 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:07:43 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:07:43 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:43 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Instance destroyed successfully.
Nov 18 17:07:43 user nova-compute[74743]: DEBUG nova.objects.instance [None req-a155e472-2260-4de4-be14-889e26f50d0d tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Lazy-loading 'resources' on Instance uuid fc4cdeb6-51ff-4090-a29d-d4f6105e15f3 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:07:43 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.680s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:07:43 user nova-compute[74743]: DEBUG nova.compute.manager [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Start building networks asynchronously for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 17:07:43 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:43 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-a155e472-2260-4de4-be14-889e26f50d0d tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-18T17:03:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1230106308',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-249778714',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM28SzHspmmwqm/7BfauIk9VldwafpsWIykch7gczsKSmKWidDt9xX54sYh31kKA3ijdAH08ekJdERVxFWwJ5PxDpqwRxmcm6s/pJQsbUZ4m6+AK3rHMz90lQEaJaoFkvQ==',key_name='tempest-keypair-2066506709',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:06:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba340b1c9b03442ca58b2fef8ec6d60d',ramdisk_id='',reservation_id='r-9w700wic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-507265829',owner_user_name='tempest-ServerActionsV293TestJSON-507265829-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:06:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c39539fc6bbd40628ff16ddd50054661',uuid=fc4cdeb6-51ff-4090-a29d-d4f6105e15f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9abd882a-72d9-46b9-9dc0-8bdd727125b2", "address": "fa:16:3e:b0:f7:a6", "network": {"id": "b9dd5bf0-7dcc-4428-8496-f77a6e0ddbef", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-386192241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba340b1c9b03442ca58b2fef8ec6d60d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9abd882a-72", "ovs_interfaceid": "9abd882a-72d9-46b9-9dc0-8bdd727125b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:07:43 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-a155e472-2260-4de4-be14-889e26f50d0d tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Converting VIF {"id": "9abd882a-72d9-46b9-9dc0-8bdd727125b2", "address": "fa:16:3e:b0:f7:a6", "network": {"id": "b9dd5bf0-7dcc-4428-8496-f77a6e0ddbef", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-386192241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba340b1c9b03442ca58b2fef8ec6d60d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9abd882a-72", "ovs_interfaceid": "9abd882a-72d9-46b9-9dc0-8bdd727125b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:07:43 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-a155e472-2260-4de4-be14-889e26f50d0d tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:f7:a6,bridge_name='br-int',has_traffic_filtering=True,id=9abd882a-72d9-46b9-9dc0-8bdd727125b2,network=Network(b9dd5bf0-7dcc-4428-8496-f77a6e0ddbef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9abd882a-72') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:07:43 user nova-compute[74743]: DEBUG os_vif [None req-a155e472-2260-4de4-be14-889e26f50d0d tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:f7:a6,bridge_name='br-int',has_traffic_filtering=True,id=9abd882a-72d9-46b9-9dc0-8bdd727125b2,network=Network(b9dd5bf0-7dcc-4428-8496-f77a6e0ddbef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9abd882a-72') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:07:43 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:43 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9abd882a-72, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:07:43 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:43 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:07:43 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:43 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0157c652-8f3f-4139-8801-7f5bf02c6972) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:07:43 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:43 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:07:43 user nova-compute[74743]: INFO os_vif [None req-a155e472-2260-4de4-be14-889e26f50d0d tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:f7:a6,bridge_name='br-int',has_traffic_filtering=True,id=9abd882a-72d9-46b9-9dc0-8bdd727125b2,network=Network(b9dd5bf0-7dcc-4428-8496-f77a6e0ddbef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9abd882a-72')
Nov 18 17:07:43 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a155e472-2260-4de4-be14-889e26f50d0d tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] calling os-brick to detach iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 17:07:43 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-a155e472-2260-4de4-be14-889e26f50d0d tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, {'target_iqn': 'iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KPiubrlw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:07:43 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-a155e472-2260-4de4-be14-889e26f50d0d tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:07:43 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-a155e472-2260-4de4-be14-889e26f50d0d tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:07:43 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-a155e472-2260-4de4-be14-889e26f50d0d tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:07:43 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:43 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:43 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dcd9ee5-3f64-4e6f-9802-4180394123f2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:039844c6-8136-4bb5-9026-010fa035e2af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:07:43 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-a155e472-2260-4de4-be14-889e26f50d0d tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 17:07:43 user nova-compute[74743]: No targets found.
Nov 18 17:07:43 user nova-compute[74743]: iSNS:
Nov 18 17:07:43 user nova-compute[74743]: No targets found.
Nov 18 17:07:43 user nova-compute[74743]: STATIC:
Nov 18 17:07:43 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8
Nov 18 17:07:43 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:07:43 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:07:43 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:039844c6-8136-4bb5-9026-010fa035e2af
Nov 18 17:07:43 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:07:43 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:07:43 user nova-compute[74743]: FIRMWARE:
Nov 18 17:07:43 user nova-compute[74743]: No targets found.
Nov 18 17:07:43 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:07:43 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-a155e472-2260-4de4-be14-889e26f50d0d tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 17:07:43 user nova-compute[74743]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 17:07:43 user nova-compute[74743]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74743) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 17:07:43 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-a155e472-2260-4de4-be14-889e26f50d0d tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8', 0)] {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 17:07:43 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:43 user nova-compute[74743]: DEBUG nova.compute.manager [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Allocating IP information in the background. {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 17:07:43 user nova-compute[74743]: DEBUG nova.network.neutron [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] allocate_for_instance() {{(pid=74743) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 17:07:43 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:43 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:43 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b659a84b-d9c3-466c-863b-79c230b9ffa0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:039844c6-8136-4bb5-9026-010fa035e2af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:07:43 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:43 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 17:07:43 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:43 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66a1631-9b5e-4b21-9107-f55f17b50efc]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039844c6-8136-4bb5-9026-010fa035e2af (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:07:43 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-a155e472-2260-4de4-be14-889e26f50d0d tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:07:43 user nova-compute[74743]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039844c6-8136-4bb5-9026-010fa035e2af (non-flash)
Nov 18 17:07:43 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:07:43 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-a155e472-2260-4de4-be14-889e26f50d0d tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 (non-flash)
Nov 18 17:07:43 user nova-compute[74743]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039844c6-8136-4bb5-9026-010fa035e2af (non-flash)
Nov 18 17:07:43 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:07:43 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-a155e472-2260-4de4-be14-889e26f50d0d tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb0833d510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8'): ({'sdc'}, set())}) {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 17:07:43 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-a155e472-2260-4de4-be14-889e26f50d0d tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Removing single pathed devices sdc {{(pid=74743) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 17:07:43 user nova-compute[74743]: DEBUG nova.compute.manager [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Start building block device mappings for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 17:07:43 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:43 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.039s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:43 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e29be27-0ade-4c33-bfcd-f008860e27cc]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:07:43 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.041s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:44 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e915fdc-eb33-41b4-9f1f-6bd847608ce8]: (4, ('ok\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:07:44 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-a155e472-2260-4de4-be14-889e26f50d0d tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Flushing IO for device /dev/sdc {{(pid=74743) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 17:07:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:44 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b255d4cf-2886-462b-aa7f-4bea17628a32]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:07:44 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-a155e472-2260-4de4-be14-889e26f50d0d tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74743) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 17:07:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:44 user nova-compute[74743]: DEBUG nova.policy [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c37b5fe2f7d74cab894eef0f41c6a5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8955c5a052b34bde997f9db74d302edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74743) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 17:07:44 user nova-compute[74743]: DEBUG nova.compute.manager [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Start spawning the instance on the hypervisor. {{(pid=74743) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 17:07:44 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Creating instance directory {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 17:07:44 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Creating image(s)
Nov 18 17:07:44 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Acquiring lock "/opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:07:44 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Lock "/opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:07:44 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Lock "/opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:07:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.068s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:44 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[9157f39c-08ed-4d06-b08d-0dd4de88f8c4]: (4, ('1', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:07:44 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-a155e472-2260-4de4-be14-889e26f50d0d tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 17:07:44 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-a155e472-2260-4de4-be14-889e26f50d0d tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] SCSI volumes sdc have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 17:07:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:44 user nova-compute[74743]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_8c4b6acb', '/dev/disk/by-id/scsi-1SCST_BIO8c4b6acb-bb9b375c4377f89e', '/dev/disk/by-id/scsi-26262396233373563') {{(pid=85244) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 18 17:07:44 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f165404-2d6f-4d1b-9fc5-2d284bb394c8]: (4, None) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:07:44 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-a155e472-2260-4de4-be14-889e26f50d0d tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8')] {{(pid=74743) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 17:07:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:44 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[54bf87bf-661f-4ab5-8953-0857b3b04524]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:07:44 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-a155e472-2260-4de4-be14-889e26f50d0d tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:07:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 -p 172.16.0.220:3260 --logout {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:44 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a03400-7944-4719-9010-0c326e028d82]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:07:44 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-a155e472-2260-4de4-be14-889e26f50d0d tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8, portal: 172.16.0.220,3260]
Nov 18 17:07:44 user nova-compute[74743]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8, portal: 172.16.0.220,3260] successful.
Nov 18 17:07:44 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:07:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 -p 172.16.0.220:3260 --op delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47861a8d-8eb0-4239-a9b5-962337012ed8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:44 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a297132-7cc7-4707-9a40-9cd62bf35b4f]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:07:44 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-a155e472-2260-4de4-be14-889e26f50d0d tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:07:44 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-a155e472-2260-4de4-be14-889e26f50d0d tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.593s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:07:44 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-a155e472-2260-4de4-be14-889e26f50d0d tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] <== disconnect_volume: return (597ms) None {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:07:44 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a155e472-2260-4de4-be14-889e26f50d0d tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Disconnected iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 17:07:44 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-a155e472-2260-4de4-be14-889e26f50d0d tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Deleting instance files /opt/stack/data/nova/instances/fc4cdeb6-51ff-4090-a29d-d4f6105e15f3_del
Nov 18 17:07:44 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-a155e472-2260-4de4-be14-889e26f50d0d tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Deletion of /opt/stack/data/nova/instances/fc4cdeb6-51ff-4090-a29d-d4f6105e15f3_del complete
Nov 18 17:07:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.272s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:44 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Acquiring lock "c188b3a997bfafa42fa341f9dcc326545681eed9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:07:44 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:07:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:44 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:44 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:44 user nova-compute[74743]: INFO nova.compute.manager [None req-a155e472-2260-4de4-be14-889e26f50d0d tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Took 1.77 seconds to destroy the instance on the hypervisor.
Nov 18 17:07:44 user nova-compute[74743]: DEBUG oslo.service.loopingcall [None req-a155e472-2260-4de4-be14-889e26f50d0d tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74743) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 17:07:44 user nova-compute[74743]: DEBUG nova.compute.manager [-] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Deallocating network for instance {{(pid=74743) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 17:07:44 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] deallocate_for_instance() {{(pid=74743) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 17:07:44 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:44 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.222s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/disk 1073741824 {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:44 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:44 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/disk 1073741824" returned: 0 in 0.070s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:44 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.296s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:07:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.224s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:44 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Checking if we can resize image /opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/disk. size=1073741824 {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 17:07:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:44 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:45 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Cannot resize image /opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/disk to a smaller size. {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 17:07:45 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Created local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 17:07:45 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Ensure instance console log exists: /opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:07:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:07:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:07:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:07:45 user nova-compute[74743]: DEBUG nova.compute.manager [req-543748ae-18e9-4029-81cc-d91f85cf0533 req-f5238274-a7b5-48f2-aed5-f2ffc17f0c08 service nova] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Received event network-vif-plugged-9abd882a-72d9-46b9-9dc0-8bdd727125b2 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:07:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-543748ae-18e9-4029-81cc-d91f85cf0533 req-f5238274-a7b5-48f2-aed5-f2ffc17f0c08 service nova] Acquiring lock "fc4cdeb6-51ff-4090-a29d-d4f6105e15f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:07:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-543748ae-18e9-4029-81cc-d91f85cf0533 req-f5238274-a7b5-48f2-aed5-f2ffc17f0c08 service nova] Lock "fc4cdeb6-51ff-4090-a29d-d4f6105e15f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:07:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-543748ae-18e9-4029-81cc-d91f85cf0533 req-f5238274-a7b5-48f2-aed5-f2ffc17f0c08 service nova] Lock "fc4cdeb6-51ff-4090-a29d-d4f6105e15f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:07:45 user nova-compute[74743]: DEBUG nova.compute.manager [req-543748ae-18e9-4029-81cc-d91f85cf0533 req-f5238274-a7b5-48f2-aed5-f2ffc17f0c08 service nova] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] No waiting events found dispatching network-vif-plugged-9abd882a-72d9-46b9-9dc0-8bdd727125b2 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:07:45 user nova-compute[74743]: WARNING nova.compute.manager [req-543748ae-18e9-4029-81cc-d91f85cf0533 req-f5238274-a7b5-48f2-aed5-f2ffc17f0c08 service nova] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Received unexpected event network-vif-plugged-9abd882a-72d9-46b9-9dc0-8bdd727125b2 for instance with vm_state active and task_state deleting.
Nov 18 17:07:45 user nova-compute[74743]: DEBUG nova.compute.manager [req-543748ae-18e9-4029-81cc-d91f85cf0533 req-f5238274-a7b5-48f2-aed5-f2ffc17f0c08 service nova] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Received event network-vif-plugged-9abd882a-72d9-46b9-9dc0-8bdd727125b2 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:07:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-543748ae-18e9-4029-81cc-d91f85cf0533 req-f5238274-a7b5-48f2-aed5-f2ffc17f0c08 service nova] Acquiring lock "fc4cdeb6-51ff-4090-a29d-d4f6105e15f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:07:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-543748ae-18e9-4029-81cc-d91f85cf0533 req-f5238274-a7b5-48f2-aed5-f2ffc17f0c08 service nova] Lock "fc4cdeb6-51ff-4090-a29d-d4f6105e15f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:07:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-543748ae-18e9-4029-81cc-d91f85cf0533 req-f5238274-a7b5-48f2-aed5-f2ffc17f0c08 service nova] Lock "fc4cdeb6-51ff-4090-a29d-d4f6105e15f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:07:45 user nova-compute[74743]: DEBUG nova.compute.manager [req-543748ae-18e9-4029-81cc-d91f85cf0533 req-f5238274-a7b5-48f2-aed5-f2ffc17f0c08 service nova] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] No waiting events found dispatching network-vif-plugged-9abd882a-72d9-46b9-9dc0-8bdd727125b2 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:07:45 user nova-compute[74743]: WARNING nova.compute.manager [req-543748ae-18e9-4029-81cc-d91f85cf0533 req-f5238274-a7b5-48f2-aed5-f2ffc17f0c08 service nova] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Received unexpected event network-vif-plugged-9abd882a-72d9-46b9-9dc0-8bdd727125b2 for instance with vm_state active and task_state deleting.
Nov 18 17:07:45 user nova-compute[74743]: DEBUG nova.compute.manager [req-543748ae-18e9-4029-81cc-d91f85cf0533 req-f5238274-a7b5-48f2-aed5-f2ffc17f0c08 service nova] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Received event network-vif-plugged-9abd882a-72d9-46b9-9dc0-8bdd727125b2 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:07:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-543748ae-18e9-4029-81cc-d91f85cf0533 req-f5238274-a7b5-48f2-aed5-f2ffc17f0c08 service nova] Acquiring lock "fc4cdeb6-51ff-4090-a29d-d4f6105e15f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:07:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-543748ae-18e9-4029-81cc-d91f85cf0533 req-f5238274-a7b5-48f2-aed5-f2ffc17f0c08 service nova] Lock "fc4cdeb6-51ff-4090-a29d-d4f6105e15f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:07:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-543748ae-18e9-4029-81cc-d91f85cf0533 req-f5238274-a7b5-48f2-aed5-f2ffc17f0c08 service nova] Lock "fc4cdeb6-51ff-4090-a29d-d4f6105e15f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:07:45 user nova-compute[74743]: DEBUG nova.compute.manager [req-543748ae-18e9-4029-81cc-d91f85cf0533 req-f5238274-a7b5-48f2-aed5-f2ffc17f0c08 service nova] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] No waiting events found dispatching network-vif-plugged-9abd882a-72d9-46b9-9dc0-8bdd727125b2 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:07:45 user nova-compute[74743]: WARNING nova.compute.manager [req-543748ae-18e9-4029-81cc-d91f85cf0533 req-f5238274-a7b5-48f2-aed5-f2ffc17f0c08 service nova] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Received unexpected event network-vif-plugged-9abd882a-72d9-46b9-9dc0-8bdd727125b2 for instance with vm_state active and task_state deleting.
Nov 18 17:07:45 user nova-compute[74743]: DEBUG nova.compute.manager [req-543748ae-18e9-4029-81cc-d91f85cf0533 req-f5238274-a7b5-48f2-aed5-f2ffc17f0c08 service nova] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Received event network-vif-unplugged-9abd882a-72d9-46b9-9dc0-8bdd727125b2 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:07:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-543748ae-18e9-4029-81cc-d91f85cf0533 req-f5238274-a7b5-48f2-aed5-f2ffc17f0c08 service nova] Acquiring lock "fc4cdeb6-51ff-4090-a29d-d4f6105e15f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:07:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-543748ae-18e9-4029-81cc-d91f85cf0533 req-f5238274-a7b5-48f2-aed5-f2ffc17f0c08 service nova] Lock "fc4cdeb6-51ff-4090-a29d-d4f6105e15f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:07:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-543748ae-18e9-4029-81cc-d91f85cf0533 req-f5238274-a7b5-48f2-aed5-f2ffc17f0c08 service nova] Lock "fc4cdeb6-51ff-4090-a29d-d4f6105e15f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:07:45 user nova-compute[74743]: DEBUG nova.compute.manager [req-543748ae-18e9-4029-81cc-d91f85cf0533 req-f5238274-a7b5-48f2-aed5-f2ffc17f0c08 service nova] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] No waiting events found dispatching network-vif-unplugged-9abd882a-72d9-46b9-9dc0-8bdd727125b2 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:07:45 user nova-compute[74743]: DEBUG nova.compute.manager [req-543748ae-18e9-4029-81cc-d91f85cf0533 req-f5238274-a7b5-48f2-aed5-f2ffc17f0c08 service nova] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Received event network-vif-unplugged-9abd882a-72d9-46b9-9dc0-8bdd727125b2 for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:07:45 user nova-compute[74743]: DEBUG nova.compute.manager [req-543748ae-18e9-4029-81cc-d91f85cf0533 req-f5238274-a7b5-48f2-aed5-f2ffc17f0c08 service nova] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Received event network-vif-plugged-9abd882a-72d9-46b9-9dc0-8bdd727125b2 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:07:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-543748ae-18e9-4029-81cc-d91f85cf0533 req-f5238274-a7b5-48f2-aed5-f2ffc17f0c08 service nova] Acquiring lock "fc4cdeb6-51ff-4090-a29d-d4f6105e15f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:07:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-543748ae-18e9-4029-81cc-d91f85cf0533 req-f5238274-a7b5-48f2-aed5-f2ffc17f0c08 service nova] Lock "fc4cdeb6-51ff-4090-a29d-d4f6105e15f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:07:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-543748ae-18e9-4029-81cc-d91f85cf0533 req-f5238274-a7b5-48f2-aed5-f2ffc17f0c08 service nova] Lock "fc4cdeb6-51ff-4090-a29d-d4f6105e15f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:07:45 user nova-compute[74743]: DEBUG nova.compute.manager [req-543748ae-18e9-4029-81cc-d91f85cf0533 req-f5238274-a7b5-48f2-aed5-f2ffc17f0c08 service nova] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] No waiting events found dispatching network-vif-plugged-9abd882a-72d9-46b9-9dc0-8bdd727125b2 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:07:45 user nova-compute[74743]: WARNING nova.compute.manager [req-543748ae-18e9-4029-81cc-d91f85cf0533 req-f5238274-a7b5-48f2-aed5-f2ffc17f0c08 service nova] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Received unexpected event network-vif-plugged-9abd882a-72d9-46b9-9dc0-8bdd727125b2 for instance with vm_state active and task_state deleting.
Nov 18 17:07:46 user nova-compute[74743]: DEBUG nova.network.neutron [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Successfully created port: c66ef239-8068-4eff-807a-830d5f3d0dba {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:07:46 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:07:46 user nova-compute[74743]: INFO nova.compute.manager [-] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Took 1.53 seconds to deallocate network for instance.
Nov 18 17:07:46 user nova-compute[74743]: INFO nova.compute.manager [None req-a155e472-2260-4de4-be14-889e26f50d0d tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Took 0.88 seconds to detach 1 volumes for instance.
Nov 18 17:07:46 user nova-compute[74743]: DEBUG nova.compute.manager [None req-a155e472-2260-4de4-be14-889e26f50d0d tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Deleting volume: 47861a8d-8eb0-4239-a9b5-962337012ed8 {{(pid=74743) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 18 17:07:47 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a155e472-2260-4de4-be14-889e26f50d0d tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:07:47 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a155e472-2260-4de4-be14-889e26f50d0d tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:07:47 user nova-compute[74743]: DEBUG nova.network.neutron [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Successfully updated port: c66ef239-8068-4eff-807a-830d5f3d0dba {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:07:47 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Acquiring lock "refresh_cache-49ebdd5a-824d-476a-bd10-3b891bbfe9e2" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:07:47 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Acquired lock "refresh_cache-49ebdd5a-824d-476a-bd10-3b891bbfe9e2" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:07:47 user nova-compute[74743]: DEBUG nova.network.neutron [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:07:47 user nova-compute[74743]: DEBUG nova.compute.manager [req-0759f97d-1d30-46e3-a07b-77fcbd6dbce1 req-b2fc8398-978c-435b-8ecc-0cd28b11371e service nova] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Received event network-changed-c66ef239-8068-4eff-807a-830d5f3d0dba {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:07:47 user nova-compute[74743]: DEBUG nova.compute.manager [req-0759f97d-1d30-46e3-a07b-77fcbd6dbce1 req-b2fc8398-978c-435b-8ecc-0cd28b11371e service nova] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Refreshing instance network info cache due to event network-changed-c66ef239-8068-4eff-807a-830d5f3d0dba. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:07:47 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-0759f97d-1d30-46e3-a07b-77fcbd6dbce1 req-b2fc8398-978c-435b-8ecc-0cd28b11371e service nova] Acquiring lock "refresh_cache-49ebdd5a-824d-476a-bd10-3b891bbfe9e2" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:07:47 user nova-compute[74743]: DEBUG nova.compute.manager [req-439520ff-a4e4-4296-9a13-450dba5a8874 req-02b402ad-a793-467f-8e28-7e68d84905ce service nova] [instance: fc4cdeb6-51ff-4090-a29d-d4f6105e15f3] Received event network-vif-deleted-9abd882a-72d9-46b9-9dc0-8bdd727125b2 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:07:47 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-a155e472-2260-4de4-be14-889e26f50d0d tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:07:47 user nova-compute[74743]: DEBUG nova.network.neutron [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:07:47 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-a155e472-2260-4de4-be14-889e26f50d0d tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:07:47 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a155e472-2260-4de4-be14-889e26f50d0d tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.400s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:07:47 user nova-compute[74743]: INFO nova.scheduler.client.report [None req-a155e472-2260-4de4-be14-889e26f50d0d tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Deleted allocations for instance fc4cdeb6-51ff-4090-a29d-d4f6105e15f3
Nov 18 17:07:47 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a155e472-2260-4de4-be14-889e26f50d0d tempest-ServerActionsV293TestJSON-507265829 tempest-ServerActionsV293TestJSON-507265829-project-member] Lock "fc4cdeb6-51ff-4090-a29d-d4f6105e15f3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.894s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:07:47 user nova-compute[74743]: DEBUG nova.network.neutron [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Updating instance_info_cache with network_info: [{"id": "c66ef239-8068-4eff-807a-830d5f3d0dba", "address": "fa:16:3e:f3:3d:ca", "network": {"id": "79046ec4-e7a8-4b7d-8607-3205067366b6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1734449136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8955c5a052b34bde997f9db74d302edb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66ef239-80", "ovs_interfaceid": "c66ef239-8068-4eff-807a-830d5f3d0dba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:07:47 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Releasing lock "refresh_cache-49ebdd5a-824d-476a-bd10-3b891bbfe9e2" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:07:47 user nova-compute[74743]: DEBUG nova.compute.manager [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Instance network_info: |[{"id": "c66ef239-8068-4eff-807a-830d5f3d0dba", "address": "fa:16:3e:f3:3d:ca", "network": {"id": "79046ec4-e7a8-4b7d-8607-3205067366b6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1734449136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8955c5a052b34bde997f9db74d302edb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66ef239-80", "ovs_interfaceid": "c66ef239-8068-4eff-807a-830d5f3d0dba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 17:07:47 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-0759f97d-1d30-46e3-a07b-77fcbd6dbce1 req-b2fc8398-978c-435b-8ecc-0cd28b11371e service nova] Acquired lock "refresh_cache-49ebdd5a-824d-476a-bd10-3b891bbfe9e2" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:07:47 user nova-compute[74743]: DEBUG nova.network.neutron [req-0759f97d-1d30-46e3-a07b-77fcbd6dbce1 req-b2fc8398-978c-435b-8ecc-0cd28b11371e service nova] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Refreshing network info cache for port c66ef239-8068-4eff-807a-830d5f3d0dba {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:07:47 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Start _get_guest_xml network_info=[{"id": "c66ef239-8068-4eff-807a-830d5f3d0dba", "address": "fa:16:3e:f3:3d:ca", "network": {"id": "79046ec4-e7a8-4b7d-8607-3205067366b6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1734449136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8955c5a052b34bde997f9db74d302edb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66ef239-80", "ovs_interfaceid": "c66ef239-8068-4eff-807a-830d5f3d0dba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '9536f6cf-95c4-40e2-864a-09a91525678a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:07:47 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:07:47 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:07:47 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:07:47 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:07:47 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:07:47 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:07:47 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:07:47 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:07:47 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:07:47 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:07:47 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:07:47 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:07:47 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:07:47 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:07:47 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:07:47 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:07:47 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:07:47 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:07:48 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:07:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-761441758',display_name='tempest-ServerActionsTestOtherB-server-761441758',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-761441758',id=16,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHSxRrGlHxDyqlCOq0hy6p31kUDSaQIxafGDavUpZ/Ka4RS6tIfzT5avp8Ymkenpc8OEHVquoqpPuZPk62jn4N2SagQ88JWrrx/6+VzSF8w9eq7GAvBHe/3/xNVOBksa4g==',key_name='tempest-keypair-1267949685',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8955c5a052b34bde997f9db74d302edb',ramdisk_id='',reservation_id='r-ewenialm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-2984948',owner_user_name='tempest-ServerActionsTestOtherB-2984948-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:07:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c37b5fe2f7d74cab894eef0f41c6a5ed',uuid=49ebdd5a-824d-476a-bd10-3b891bbfe9e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c66ef239-8068-4eff-807a-830d5f3d0dba", "address": "fa:16:3e:f3:3d:ca", "network": {"id": "79046ec4-e7a8-4b7d-8607-3205067366b6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1734449136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8955c5a052b34bde997f9db74d302edb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66ef239-80", "ovs_interfaceid": "c66ef239-8068-4eff-807a-830d5f3d0dba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:07:48 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Converting VIF {"id": "c66ef239-8068-4eff-807a-830d5f3d0dba", "address": "fa:16:3e:f3:3d:ca", "network": {"id": "79046ec4-e7a8-4b7d-8607-3205067366b6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1734449136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8955c5a052b34bde997f9db74d302edb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66ef239-80", "ovs_interfaceid": "c66ef239-8068-4eff-807a-830d5f3d0dba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:07:48 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:3d:ca,bridge_name='br-int',has_traffic_filtering=True,id=c66ef239-8068-4eff-807a-830d5f3d0dba,network=Network(79046ec4-e7a8-4b7d-8607-3205067366b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66ef239-80') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:07:48 user nova-compute[74743]: DEBUG nova.objects.instance [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Lazy-loading 'pci_devices' on Instance uuid 49ebdd5a-824d-476a-bd10-3b891bbfe9e2 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:07:48 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:07:48 user nova-compute[74743]:   <uuid>49ebdd5a-824d-476a-bd10-3b891bbfe9e2</uuid>
Nov 18 17:07:48 user nova-compute[74743]:   <name>instance-00000010</name>
Nov 18 17:07:48 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:07:48 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:07:48 user nova-compute[74743]:   <metadata>
Nov 18 17:07:48 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:07:48 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:07:48 user nova-compute[74743]:       <nova:name>tempest-ServerActionsTestOtherB-server-761441758</nova:name>
Nov 18 17:07:48 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:07:47</nova:creationTime>
Nov 18 17:07:48 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:07:48 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:07:48 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:07:48 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:07:48 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:07:48 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:07:48 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:07:48 user nova-compute[74743]:       <nova:owner>
Nov 18 17:07:48 user nova-compute[74743]:         <nova:user uuid="c37b5fe2f7d74cab894eef0f41c6a5ed">tempest-ServerActionsTestOtherB-2984948-project-member</nova:user>
Nov 18 17:07:48 user nova-compute[74743]:         <nova:project uuid="8955c5a052b34bde997f9db74d302edb">tempest-ServerActionsTestOtherB-2984948</nova:project>
Nov 18 17:07:48 user nova-compute[74743]:       </nova:owner>
Nov 18 17:07:48 user nova-compute[74743]:       <nova:root type="image" uuid="9536f6cf-95c4-40e2-864a-09a91525678a"/>
Nov 18 17:07:48 user nova-compute[74743]:       <nova:ports>
Nov 18 17:07:48 user nova-compute[74743]:         <nova:port uuid="c66ef239-8068-4eff-807a-830d5f3d0dba">
Nov 18 17:07:48 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 18 17:07:48 user nova-compute[74743]:         </nova:port>
Nov 18 17:07:48 user nova-compute[74743]:       </nova:ports>
Nov 18 17:07:48 user nova-compute[74743]:     </nova:instance>
Nov 18 17:07:48 user nova-compute[74743]:   </metadata>
Nov 18 17:07:48 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:07:48 user nova-compute[74743]:     <system>
Nov 18 17:07:48 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:07:48 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:07:48 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:07:48 user nova-compute[74743]:       <entry name="serial">49ebdd5a-824d-476a-bd10-3b891bbfe9e2</entry>
Nov 18 17:07:48 user nova-compute[74743]:       <entry name="uuid">49ebdd5a-824d-476a-bd10-3b891bbfe9e2</entry>
Nov 18 17:07:48 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:07:48 user nova-compute[74743]:     </system>
Nov 18 17:07:48 user nova-compute[74743]:   </sysinfo>
Nov 18 17:07:48 user nova-compute[74743]:   <os>
Nov 18 17:07:48 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:07:48 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:07:48 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:07:48 user nova-compute[74743]:   </os>
Nov 18 17:07:48 user nova-compute[74743]:   <features>
Nov 18 17:07:48 user nova-compute[74743]:     <acpi/>
Nov 18 17:07:48 user nova-compute[74743]:     <apic/>
Nov 18 17:07:48 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:07:48 user nova-compute[74743]:   </features>
Nov 18 17:07:48 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:07:48 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:07:48 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:07:48 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:07:48 user nova-compute[74743]:   </clock>
Nov 18 17:07:48 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:07:48 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:07:48 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:07:48 user nova-compute[74743]:   </cpu>
Nov 18 17:07:48 user nova-compute[74743]:   <devices>
Nov 18 17:07:48 user nova-compute[74743]:     <disk type="file" device="disk">
Nov 18 17:07:48 user nova-compute[74743]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 17:07:48 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/disk"/>
Nov 18 17:07:48 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:07:48 user nova-compute[74743]:     </disk>
Nov 18 17:07:48 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:07:48 user nova-compute[74743]:       <mac address="fa:16:3e:f3:3d:ca"/>
Nov 18 17:07:48 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:07:48 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:07:48 user nova-compute[74743]:       <target dev="tapc66ef239-80"/>
Nov 18 17:07:48 user nova-compute[74743]:     </interface>
Nov 18 17:07:48 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:07:48 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/console.log" append="off"/>
Nov 18 17:07:48 user nova-compute[74743]:     </serial>
Nov 18 17:07:48 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:07:48 user nova-compute[74743]:     <video>
Nov 18 17:07:48 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:07:48 user nova-compute[74743]:     </video>
Nov 18 17:07:48 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:07:48 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:07:48 user nova-compute[74743]:     </rng>
Nov 18 17:07:48 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:07:48 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:07:48 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:07:48 user nova-compute[74743]:     </memballoon>
Nov 18 17:07:48 user nova-compute[74743]:   </devices>
Nov 18 17:07:48 user nova-compute[74743]: </domain>
Nov 18 17:07:48 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:07:48 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:07:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-761441758',display_name='tempest-ServerActionsTestOtherB-server-761441758',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-761441758',id=16,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHSxRrGlHxDyqlCOq0hy6p31kUDSaQIxafGDavUpZ/Ka4RS6tIfzT5avp8Ymkenpc8OEHVquoqpPuZPk62jn4N2SagQ88JWrrx/6+VzSF8w9eq7GAvBHe/3/xNVOBksa4g==',key_name='tempest-keypair-1267949685',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8955c5a052b34bde997f9db74d302edb',ramdisk_id='',reservation_id='r-ewenialm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-2984948',owner_user_name='tempest-ServerActionsTestOtherB-2984948-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:07:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c37b5fe2f7d74cab894eef0f41c6a5ed',uuid=49ebdd5a-824d-476a-bd10-3b891bbfe9e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c66ef239-8068-4eff-807a-830d5f3d0dba", "address": "fa:16:3e:f3:3d:ca", "network": {"id": "79046ec4-e7a8-4b7d-8607-3205067366b6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1734449136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8955c5a052b34bde997f9db74d302edb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66ef239-80", "ovs_interfaceid": "c66ef239-8068-4eff-807a-830d5f3d0dba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:07:48 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Converting VIF {"id": "c66ef239-8068-4eff-807a-830d5f3d0dba", "address": "fa:16:3e:f3:3d:ca", "network": {"id": "79046ec4-e7a8-4b7d-8607-3205067366b6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1734449136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8955c5a052b34bde997f9db74d302edb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66ef239-80", "ovs_interfaceid": "c66ef239-8068-4eff-807a-830d5f3d0dba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:07:48 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:3d:ca,bridge_name='br-int',has_traffic_filtering=True,id=c66ef239-8068-4eff-807a-830d5f3d0dba,network=Network(79046ec4-e7a8-4b7d-8607-3205067366b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66ef239-80') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:07:48 user nova-compute[74743]: DEBUG os_vif [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:3d:ca,bridge_name='br-int',has_traffic_filtering=True,id=c66ef239-8068-4eff-807a-830d5f3d0dba,network=Network(79046ec4-e7a8-4b7d-8607-3205067366b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66ef239-80') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:07:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:07:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:07:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd9453b78-1231-55b7-b004-020385db604d', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:07:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc66ef239-80, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:07:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc66ef239-80, col_values=(('qos', UUID('5411aab5-6c45-437d-af75-c5370f2de59a')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:07:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc66ef239-80, col_values=(('external_ids', {'iface-id': 'c66ef239-8068-4eff-807a-830d5f3d0dba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:3d:ca', 'vm-uuid': '49ebdd5a-824d-476a-bd10-3b891bbfe9e2'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:07:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:07:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:48 user nova-compute[74743]: INFO os_vif [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:3d:ca,bridge_name='br-int',has_traffic_filtering=True,id=c66ef239-8068-4eff-807a-830d5f3d0dba,network=Network(79046ec4-e7a8-4b7d-8607-3205067366b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66ef239-80')
Nov 18 17:07:48 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:07:48 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] No VIF found with MAC fa:16:3e:f3:3d:ca, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:07:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:48 user nova-compute[74743]: DEBUG nova.network.neutron [req-0759f97d-1d30-46e3-a07b-77fcbd6dbce1 req-b2fc8398-978c-435b-8ecc-0cd28b11371e service nova] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Updated VIF entry in instance network info cache for port c66ef239-8068-4eff-807a-830d5f3d0dba. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:07:48 user nova-compute[74743]: DEBUG nova.network.neutron [req-0759f97d-1d30-46e3-a07b-77fcbd6dbce1 req-b2fc8398-978c-435b-8ecc-0cd28b11371e service nova] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Updating instance_info_cache with network_info: [{"id": "c66ef239-8068-4eff-807a-830d5f3d0dba", "address": "fa:16:3e:f3:3d:ca", "network": {"id": "79046ec4-e7a8-4b7d-8607-3205067366b6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1734449136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8955c5a052b34bde997f9db74d302edb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66ef239-80", "ovs_interfaceid": "c66ef239-8068-4eff-807a-830d5f3d0dba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:07:48 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-0759f97d-1d30-46e3-a07b-77fcbd6dbce1 req-b2fc8398-978c-435b-8ecc-0cd28b11371e service nova] Releasing lock "refresh_cache-49ebdd5a-824d-476a-bd10-3b891bbfe9e2" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:07:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:50 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:50 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:50 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:51 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-97532696-8626-450f-94e7-597130dde934 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 39e15045-0a84-4b48-a962-c006b6c747b3 is timed out.
Nov 18 17:07:51 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-97532696-8626-450f-94e7-597130dde934 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Successfully detached device vdb from instance 39e15045-0a84-4b48-a962-c006b6c747b3 from the live domain config.
Nov 18 17:07:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97532696-8626-450f-94e7-597130dde934 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] calling os-brick to detach iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 17:07:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-97532696-8626-450f-94e7-597130dde934 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, {'target_iqn': 'iqn.2010-10.org.openstack:039844c6-8136-4bb5-9026-010fa035e2af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ewTJaUim', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:07:51 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-97532696-8626-450f-94e7-597130dde934 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:07:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-97532696-8626-450f-94e7-597130dde934 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:07:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-97532696-8626-450f-94e7-597130dde934 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:07:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:51 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ca8895-a9b9-481b-a3e4-e3bdc8297e30]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:039844c6-8136-4bb5-9026-010fa035e2af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:07:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-97532696-8626-450f-94e7-597130dde934 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 17:07:51 user nova-compute[74743]: No targets found.
Nov 18 17:07:51 user nova-compute[74743]: iSNS:
Nov 18 17:07:51 user nova-compute[74743]: No targets found.
Nov 18 17:07:51 user nova-compute[74743]: STATIC:
Nov 18 17:07:51 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:039844c6-8136-4bb5-9026-010fa035e2af
Nov 18 17:07:51 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:07:51 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:07:51 user nova-compute[74743]: FIRMWARE:
Nov 18 17:07:51 user nova-compute[74743]: No targets found.
Nov 18 17:07:51 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:07:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-97532696-8626-450f-94e7-597130dde934 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 17:07:51 user nova-compute[74743]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 17:07:51 user nova-compute[74743]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74743) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 17:07:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-97532696-8626-450f-94e7-597130dde934 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:039844c6-8136-4bb5-9026-010fa035e2af', 0)] {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 17:07:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:51 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8e702f-88b8-4d83-81e5-6b7cda29019b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:039844c6-8136-4bb5-9026-010fa035e2af\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:07:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:51 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[6332a8c2-5980-4b06-98dc-44c8c8a1f203]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039844c6-8136-4bb5-9026-010fa035e2af (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:07:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-97532696-8626-450f-94e7-597130dde934 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039844c6-8136-4bb5-9026-010fa035e2af (non-flash)
Nov 18 17:07:51 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:07:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-97532696-8626-450f-94e7-597130dde934 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039844c6-8136-4bb5-9026-010fa035e2af (non-flash)
Nov 18 17:07:51 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:07:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-97532696-8626-450f-94e7-597130dde934 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb087cd090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:039844c6-8136-4bb5-9026-010fa035e2af'): ({'sdb'}, set())}) {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 17:07:51 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-97532696-8626-450f-94e7-597130dde934 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Removing single pathed devices sdb {{(pid=74743) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 17:07:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:51 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1a1984-539a-486c-aa07-6a883a7dbfa9]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:07:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:51 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[911324a8-3e51-451c-94a5-1e8b5673d12c]: (4, ('ok\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:07:51 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-97532696-8626-450f-94e7-597130dde934 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Flushing IO for device /dev/sdb {{(pid=74743) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 17:07:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:51 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[7441e4d2-4786-43f9-a283-b0a0cf4be3fc]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:07:51 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-97532696-8626-450f-94e7-597130dde934 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74743) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 17:07:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:51 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[da83624b-17a7-49d2-8a1b-90872280f487]: (4, ('1', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:07:51 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-97532696-8626-450f-94e7-597130dde934 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 17:07:51 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-97532696-8626-450f-94e7-597130dde934 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] SCSI volumes sdb have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 17:07:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-97532696-8626-450f-94e7-597130dde934 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:039844c6-8136-4bb5-9026-010fa035e2af')] {{(pid=74743) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 17:07:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:039844c6-8136-4bb5-9026-010fa035e2af -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:039844c6-8136-4bb5-9026-010fa035e2af -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:51 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c4ab6f-05e0-4880-8639-a175ce81d304]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:07:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-97532696-8626-450f-94e7-597130dde934 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:07:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:039844c6-8136-4bb5-9026-010fa035e2af -p 172.16.0.220:3260 --logout {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:039844c6-8136-4bb5-9026-010fa035e2af -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:51 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d025b026-1d87-4960-a274-b5ef867d6764]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:039844c6-8136-4bb5-9026-010fa035e2af, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:039844c6-8136-4bb5-9026-010fa035e2af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:07:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-97532696-8626-450f-94e7-597130dde934 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:039844c6-8136-4bb5-9026-010fa035e2af, portal: 172.16.0.220,3260]
Nov 18 17:07:51 user nova-compute[74743]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:039844c6-8136-4bb5-9026-010fa035e2af, portal: 172.16.0.220,3260] successful.
Nov 18 17:07:51 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:07:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:039844c6-8136-4bb5-9026-010fa035e2af -p 172.16.0.220:3260 --op delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:039844c6-8136-4bb5-9026-010fa035e2af -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:52 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[44250c03-abf5-4e9a-8ae2-a78279493a55]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:07:52 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-97532696-8626-450f-94e7-597130dde934 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:07:52 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-97532696-8626-450f-94e7-597130dde934 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:07:52 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-97532696-8626-450f-94e7-597130dde934 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] <== disconnect_volume: return (353ms) None {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:07:52 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97532696-8626-450f-94e7-597130dde934 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Disconnected iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 17:07:52 user nova-compute[74743]: DEBUG nova.compute.manager [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:07:52 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Guest created on hypervisor {{(pid=74743) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 17:07:52 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Instance spawned successfully.
Nov 18 17:07:52 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 17:07:52 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Found default for hw_cdrom_bus of ide {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:07:52 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Found default for hw_disk_bus of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:07:52 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Found default for hw_input_bus of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:07:52 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Found default for hw_pointer_model of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:07:52 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Found default for hw_video_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:07:52 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Found default for hw_vif_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:07:52 user nova-compute[74743]: INFO nova.compute.manager [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Took 8.23 seconds to spawn the instance on the hypervisor.
Nov 18 17:07:52 user nova-compute[74743]: DEBUG nova.compute.manager [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:07:52 user nova-compute[74743]: INFO nova.compute.manager [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Took 9.47 seconds to build instance.
Nov 18 17:07:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-6ce9bf5c-f9d3-4106-a1ad-c25384b02fcf tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Lock "49ebdd5a-824d-476a-bd10-3b891bbfe9e2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.592s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:07:52 user nova-compute[74743]: DEBUG nova.objects.instance [None req-97532696-8626-450f-94e7-597130dde934 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Lazy-loading 'flavor' on Instance uuid 39e15045-0a84-4b48-a962-c006b6c747b3 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:07:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-97532696-8626-450f-94e7-597130dde934 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Lock "39e15045-0a84-4b48-a962-c006b6c747b3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.835s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:07:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:53 user nova-compute[74743]: DEBUG nova.compute.manager [req-2bddfb72-67a2-4619-a937-36ffcaa1c6e2 req-c3e8d00a-715d-4ae0-8cff-8db1d03a080d service nova] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Received event network-vif-plugged-c66ef239-8068-4eff-807a-830d5f3d0dba {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:07:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-2bddfb72-67a2-4619-a937-36ffcaa1c6e2 req-c3e8d00a-715d-4ae0-8cff-8db1d03a080d service nova] Acquiring lock "49ebdd5a-824d-476a-bd10-3b891bbfe9e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:07:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-2bddfb72-67a2-4619-a937-36ffcaa1c6e2 req-c3e8d00a-715d-4ae0-8cff-8db1d03a080d service nova] Lock "49ebdd5a-824d-476a-bd10-3b891bbfe9e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:07:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-2bddfb72-67a2-4619-a937-36ffcaa1c6e2 req-c3e8d00a-715d-4ae0-8cff-8db1d03a080d service nova] Lock "49ebdd5a-824d-476a-bd10-3b891bbfe9e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:07:53 user nova-compute[74743]: DEBUG nova.compute.manager [req-2bddfb72-67a2-4619-a937-36ffcaa1c6e2 req-c3e8d00a-715d-4ae0-8cff-8db1d03a080d service nova] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] No waiting events found dispatching network-vif-plugged-c66ef239-8068-4eff-807a-830d5f3d0dba {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:07:53 user nova-compute[74743]: WARNING nova.compute.manager [req-2bddfb72-67a2-4619-a937-36ffcaa1c6e2 req-c3e8d00a-715d-4ae0-8cff-8db1d03a080d service nova] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Received unexpected event network-vif-plugged-c66ef239-8068-4eff-807a-830d5f3d0dba for instance with vm_state active and task_state None.
Nov 18 17:07:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:55 user nova-compute[74743]: DEBUG nova.compute.manager [req-eb9ade92-edf7-4889-a53b-de2a82eb5575 req-ee602d52-4229-4454-ade2-4325814d4828 service nova] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Received event network-vif-plugged-c66ef239-8068-4eff-807a-830d5f3d0dba {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:07:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-eb9ade92-edf7-4889-a53b-de2a82eb5575 req-ee602d52-4229-4454-ade2-4325814d4828 service nova] Acquiring lock "49ebdd5a-824d-476a-bd10-3b891bbfe9e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:07:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-eb9ade92-edf7-4889-a53b-de2a82eb5575 req-ee602d52-4229-4454-ade2-4325814d4828 service nova] Lock "49ebdd5a-824d-476a-bd10-3b891bbfe9e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:07:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-eb9ade92-edf7-4889-a53b-de2a82eb5575 req-ee602d52-4229-4454-ade2-4325814d4828 service nova] Lock "49ebdd5a-824d-476a-bd10-3b891bbfe9e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:07:55 user nova-compute[74743]: DEBUG nova.compute.manager [req-eb9ade92-edf7-4889-a53b-de2a82eb5575 req-ee602d52-4229-4454-ade2-4325814d4828 service nova] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] No waiting events found dispatching network-vif-plugged-c66ef239-8068-4eff-807a-830d5f3d0dba {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:07:55 user nova-compute[74743]: WARNING nova.compute.manager [req-eb9ade92-edf7-4889-a53b-de2a82eb5575 req-ee602d52-4229-4454-ade2-4325814d4828 service nova] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Received unexpected event network-vif-plugged-c66ef239-8068-4eff-807a-830d5f3d0dba for instance with vm_state active and task_state None.
Nov 18 17:07:55 user nova-compute[74743]: INFO nova.compute.manager [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Rescuing
Nov 18 17:07:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Acquiring lock "refresh_cache-4cce1628-2dcb-40c7-abd4-6a327a432de3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:07:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Acquired lock "refresh_cache-4cce1628-2dcb-40c7-abd4-6a327a432de3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:07:55 user nova-compute[74743]: DEBUG nova.network.neutron [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:07:56 user nova-compute[74743]: DEBUG nova.network.neutron [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Updating instance_info_cache with network_info: [{"id": "28f81291-34bb-4a6f-890b-faea6ef8a385", "address": "fa:16:3e:47:f5:86", "network": {"id": "252343cc-f379-471d-a2c9-99b9a60ebcb4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25c06dc8e7be46229750b8e283622c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28f81291-34", "ovs_interfaceid": "28f81291-34bb-4a6f-890b-faea6ef8a385", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:07:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Releasing lock "refresh_cache-4cce1628-2dcb-40c7-abd4-6a327a432de3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:07:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:57 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Instance destroyed successfully.
Nov 18 17:07:57 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Attempting rescue
Nov 18 17:07:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74743) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 18 17:07:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Instance directory exists: not creating {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 18 17:07:57 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Creating image(s)
Nov 18 17:07:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Acquiring lock "/opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:07:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "/opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:07:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "/opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:07:57 user nova-compute[74743]: DEBUG nova.objects.instance [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4cce1628-2dcb-40c7-abd4-6a327a432de3 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:07:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Acquiring lock "c188b3a997bfafa42fa341f9dcc326545681eed9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:07:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:07:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.198s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk.rescue {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:07:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk.rescue" returned: 0 in 0.049s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:07:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:07:57 user nova-compute[74743]: DEBUG nova.objects.instance [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lazy-loading 'migration_context' on Instance uuid 4cce1628-2dcb-40c7-abd4-6a327a432de3 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:07:57 user nova-compute[74743]: DEBUG nova.objects.base [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Object Instance<4cce1628-2dcb-40c7-abd4-6a327a432de3> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:07:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Created local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 17:07:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Start _get_guest_xml network_info=[{"id": "28f81291-34bb-4a6f-890b-faea6ef8a385", "address": "fa:16:3e:47:f5:86", "network": {"id": "252343cc-f379-471d-a2c9-99b9a60ebcb4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "vif_mac": "fa:16:3e:47:f5:86"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25c06dc8e7be46229750b8e283622c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28f81291-34", "ovs_interfaceid": "28f81291-34bb-4a6f-890b-faea6ef8a385", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '9536f6cf-95c4-40e2-864a-09a91525678a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:07:57 user nova-compute[74743]: DEBUG nova.objects.instance [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lazy-loading 'resources' on Instance uuid 4cce1628-2dcb-40c7-abd4-6a327a432de3 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:07:57 user nova-compute[74743]: DEBUG nova.objects.base [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Object Instance<4cce1628-2dcb-40c7-abd4-6a327a432de3> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:07:57 user nova-compute[74743]: DEBUG nova.objects.instance [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lazy-loading 'numa_topology' on Instance uuid 4cce1628-2dcb-40c7-abd4-6a327a432de3 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:07:57 user nova-compute[74743]: DEBUG nova.objects.base [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Object Instance<4cce1628-2dcb-40c7-abd4-6a327a432de3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:07:57 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:07:57 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:07:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:07:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:07:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:07:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:07:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:07:57 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:07:57 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:07:57 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:07:57 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:07:57 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:07:57 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:07:57 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:07:57 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:07:57 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:07:57 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:07:57 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:07:57 user nova-compute[74743]: DEBUG nova.objects.instance [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4cce1628-2dcb-40c7-abd4-6a327a432de3 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:07:57 user nova-compute[74743]: DEBUG nova.objects.base [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Object Instance<4cce1628-2dcb-40c7-abd4-6a327a432de3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:07:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:03:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1591726463',display_name='tempest-ServerRescueNegativeTestJSON-server-1591726463',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1591726463',id=1,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:03:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='25c06dc8e7be46229750b8e283622c9b',ramdisk_id='',reservation_id='r-x3cybepq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-732707405',owner_user_name='tempest-ServerRescueNegativeTestJSON-732707405-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:03:25Z,user_data=None,user_id='1470478a455242f9ad92eaf95dc6a2f4',uuid=4cce1628-2dcb-40c7-abd4-6a327a432de3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28f81291-34bb-4a6f-890b-faea6ef8a385", "address": "fa:16:3e:47:f5:86", "network": {"id": "252343cc-f379-471d-a2c9-99b9a60ebcb4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "vif_mac": "fa:16:3e:47:f5:86"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25c06dc8e7be46229750b8e283622c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28f81291-34", "ovs_interfaceid": "28f81291-34bb-4a6f-890b-faea6ef8a385", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:07:57 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Converting VIF {"id": "28f81291-34bb-4a6f-890b-faea6ef8a385", "address": "fa:16:3e:47:f5:86", "network": {"id": "252343cc-f379-471d-a2c9-99b9a60ebcb4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "vif_mac": "fa:16:3e:47:f5:86"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25c06dc8e7be46229750b8e283622c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28f81291-34", "ovs_interfaceid": "28f81291-34bb-4a6f-890b-faea6ef8a385", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:07:57 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:f5:86,bridge_name='br-int',has_traffic_filtering=True,id=28f81291-34bb-4a6f-890b-faea6ef8a385,network=Network(252343cc-f379-471d-a2c9-99b9a60ebcb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28f81291-34') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:07:57 user nova-compute[74743]: DEBUG nova.objects.instance [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lazy-loading 'pci_devices' on Instance uuid 4cce1628-2dcb-40c7-abd4-6a327a432de3 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:07:57 user nova-compute[74743]: DEBUG nova.objects.base [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Object Instance<4cce1628-2dcb-40c7-abd4-6a327a432de3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:07:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:07:57 user nova-compute[74743]:   <uuid>4cce1628-2dcb-40c7-abd4-6a327a432de3</uuid>
Nov 18 17:07:57 user nova-compute[74743]:   <name>instance-00000001</name>
Nov 18 17:07:57 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:07:57 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:07:57 user nova-compute[74743]:   <metadata>
Nov 18 17:07:57 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:07:57 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:07:57 user nova-compute[74743]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1591726463</nova:name>
Nov 18 17:07:57 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:07:57</nova:creationTime>
Nov 18 17:07:57 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:07:57 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:07:57 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:07:57 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:07:57 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:07:57 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:07:57 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:07:57 user nova-compute[74743]:       <nova:owner>
Nov 18 17:07:57 user nova-compute[74743]:         <nova:user uuid="1470478a455242f9ad92eaf95dc6a2f4">tempest-ServerRescueNegativeTestJSON-732707405-project-member</nova:user>
Nov 18 17:07:57 user nova-compute[74743]:         <nova:project uuid="25c06dc8e7be46229750b8e283622c9b">tempest-ServerRescueNegativeTestJSON-732707405</nova:project>
Nov 18 17:07:57 user nova-compute[74743]:       </nova:owner>
Nov 18 17:07:57 user nova-compute[74743]:       <nova:root type="image" uuid="9536f6cf-95c4-40e2-864a-09a91525678a"/>
Nov 18 17:07:57 user nova-compute[74743]:       <nova:ports>
Nov 18 17:07:57 user nova-compute[74743]:         <nova:port uuid="28f81291-34bb-4a6f-890b-faea6ef8a385">
Nov 18 17:07:57 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 18 17:07:57 user nova-compute[74743]:         </nova:port>
Nov 18 17:07:57 user nova-compute[74743]:       </nova:ports>
Nov 18 17:07:57 user nova-compute[74743]:     </nova:instance>
Nov 18 17:07:57 user nova-compute[74743]:   </metadata>
Nov 18 17:07:57 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:07:57 user nova-compute[74743]:     <system>
Nov 18 17:07:57 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:07:57 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:07:57 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:07:57 user nova-compute[74743]:       <entry name="serial">4cce1628-2dcb-40c7-abd4-6a327a432de3</entry>
Nov 18 17:07:57 user nova-compute[74743]:       <entry name="uuid">4cce1628-2dcb-40c7-abd4-6a327a432de3</entry>
Nov 18 17:07:57 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:07:57 user nova-compute[74743]:     </system>
Nov 18 17:07:57 user nova-compute[74743]:   </sysinfo>
Nov 18 17:07:57 user nova-compute[74743]:   <os>
Nov 18 17:07:57 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:07:57 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:07:57 user nova-compute[74743]:   </os>
Nov 18 17:07:57 user nova-compute[74743]:   <features>
Nov 18 17:07:57 user nova-compute[74743]:     <acpi/>
Nov 18 17:07:57 user nova-compute[74743]:     <apic/>
Nov 18 17:07:57 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:07:57 user nova-compute[74743]:   </features>
Nov 18 17:07:57 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:07:57 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:07:57 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:07:57 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:07:57 user nova-compute[74743]:   </clock>
Nov 18 17:07:57 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:07:57 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:07:57 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:07:57 user nova-compute[74743]:   </cpu>
Nov 18 17:07:57 user nova-compute[74743]:   <devices>
Nov 18 17:07:57 user nova-compute[74743]:     <disk type="file" device="disk">
Nov 18 17:07:57 user nova-compute[74743]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 17:07:57 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk.rescue"/>
Nov 18 17:07:57 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:07:57 user nova-compute[74743]:     </disk>
Nov 18 17:07:57 user nova-compute[74743]:     <disk type="file" device="disk">
Nov 18 17:07:57 user nova-compute[74743]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 17:07:57 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk"/>
Nov 18 17:07:57 user nova-compute[74743]:       <target dev="vdb" bus="virtio"/>
Nov 18 17:07:57 user nova-compute[74743]:     </disk>
Nov 18 17:07:57 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:07:57 user nova-compute[74743]:       <mac address="fa:16:3e:47:f5:86"/>
Nov 18 17:07:57 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:07:57 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:07:57 user nova-compute[74743]:       <target dev="tap28f81291-34"/>
Nov 18 17:07:57 user nova-compute[74743]:     </interface>
Nov 18 17:07:57 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:07:57 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/console.log" append="off"/>
Nov 18 17:07:57 user nova-compute[74743]:     </serial>
Nov 18 17:07:57 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:07:57 user nova-compute[74743]:     <video>
Nov 18 17:07:57 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:07:57 user nova-compute[74743]:     </video>
Nov 18 17:07:57 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:07:57 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:07:57 user nova-compute[74743]:     </rng>
Nov 18 17:07:57 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:07:57 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:07:57 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:07:57 user nova-compute[74743]:     </memballoon>
Nov 18 17:07:57 user nova-compute[74743]:   </devices>
Nov 18 17:07:57 user nova-compute[74743]: </domain>
Nov 18 17:07:57 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:07:57 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Instance destroyed successfully.
Nov 18 17:07:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:07:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:07:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] No VIF found with MAC fa:16:3e:47:f5:86, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:07:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:59 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:59 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:59 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:59 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:59 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:07:59 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:01 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Acquiring lock "c5c74497-1d1c-48a0-9b0a-e7df2a41361c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:08:01 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Lock "c5c74497-1d1c-48a0-9b0a-e7df2a41361c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:08:01 user nova-compute[74743]: DEBUG nova.compute.manager [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Starting instance... {{(pid=74743) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 17:08:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:08:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:08:02 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74743) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 17:08:02 user nova-compute[74743]: INFO nova.compute.claims [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Claim successful on node user
Nov 18 17:08:02 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:02 user nova-compute[74743]: DEBUG nova.compute.manager [None req-41af09a2-2e9f-40cb-a0f6-cc412b04cb3e tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:08:02 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:08:02 user nova-compute[74743]: DEBUG nova.compute.manager [req-13e411db-fb90-4c58-b5ba-8d188e49f157 req-7259ef79-a8ca-4cc6-b1e6-4ddc9e1d7a54 service nova] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Received event network-vif-unplugged-28f81291-34bb-4a6f-890b-faea6ef8a385 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:08:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-13e411db-fb90-4c58-b5ba-8d188e49f157 req-7259ef79-a8ca-4cc6-b1e6-4ddc9e1d7a54 service nova] Acquiring lock "4cce1628-2dcb-40c7-abd4-6a327a432de3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:08:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-13e411db-fb90-4c58-b5ba-8d188e49f157 req-7259ef79-a8ca-4cc6-b1e6-4ddc9e1d7a54 service nova] Lock "4cce1628-2dcb-40c7-abd4-6a327a432de3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:08:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-13e411db-fb90-4c58-b5ba-8d188e49f157 req-7259ef79-a8ca-4cc6-b1e6-4ddc9e1d7a54 service nova] Lock "4cce1628-2dcb-40c7-abd4-6a327a432de3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:08:02 user nova-compute[74743]: DEBUG nova.compute.manager [req-13e411db-fb90-4c58-b5ba-8d188e49f157 req-7259ef79-a8ca-4cc6-b1e6-4ddc9e1d7a54 service nova] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] No waiting events found dispatching network-vif-unplugged-28f81291-34bb-4a6f-890b-faea6ef8a385 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:08:02 user nova-compute[74743]: WARNING nova.compute.manager [req-13e411db-fb90-4c58-b5ba-8d188e49f157 req-7259ef79-a8ca-4cc6-b1e6-4ddc9e1d7a54 service nova] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Received unexpected event network-vif-unplugged-28f81291-34bb-4a6f-890b-faea6ef8a385 for instance with vm_state active and task_state rescuing.
Nov 18 17:08:02 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:08:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.638s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:08:02 user nova-compute[74743]: DEBUG nova.compute.manager [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Start building networks asynchronously for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 17:08:02 user nova-compute[74743]: DEBUG nova.compute.manager [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Allocating IP information in the background. {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 17:08:02 user nova-compute[74743]: DEBUG nova.network.neutron [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] allocate_for_instance() {{(pid=74743) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 17:08:02 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 17:08:02 user nova-compute[74743]: DEBUG nova.compute.manager [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Start building block device mappings for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 17:08:03 user nova-compute[74743]: DEBUG nova.compute.manager [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Start spawning the instance on the hypervisor. {{(pid=74743) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 17:08:03 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Creating instance directory {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 17:08:03 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Creating image(s)
Nov 18 17:08:03 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Acquiring lock "/opt/stack/data/nova/instances/c5c74497-1d1c-48a0-9b0a-e7df2a41361c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:08:03 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Lock "/opt/stack/data/nova/instances/c5c74497-1d1c-48a0-9b0a-e7df2a41361c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:08:03 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Lock "/opt/stack/data/nova/instances/c5c74497-1d1c-48a0-9b0a-e7df2a41361c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:08:03 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:08:03 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:03 user nova-compute[74743]: DEBUG nova.policy [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e5fa5e5c1b2548b5bb3b6edc4f8d6139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c1b4501efb42a482d0faf10fa1ff2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74743) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 17:08:03 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.250s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:08:03 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Acquiring lock "c188b3a997bfafa42fa341f9dcc326545681eed9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:08:03 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:08:03 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:08:03 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.228s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:08:03 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/c5c74497-1d1c-48a0-9b0a-e7df2a41361c/disk 1073741824 {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:08:03 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/c5c74497-1d1c-48a0-9b0a-e7df2a41361c/disk 1073741824" returned: 0 in 0.054s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:08:03 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:08:03 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:08:03 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.251s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:08:03 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c5c74497-1d1c-48a0-9b0a-e7df2a41361c/disk. size=1073741824 {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 17:08:03 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5c74497-1d1c-48a0-9b0a-e7df2a41361c/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:08:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5c74497-1d1c-48a0-9b0a-e7df2a41361c/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:08:04 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Cannot resize image /opt/stack/data/nova/instances/c5c74497-1d1c-48a0-9b0a-e7df2a41361c/disk to a smaller size. {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 17:08:04 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Created local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 17:08:04 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Ensure instance console log exists: /opt/stack/data/nova/instances/c5c74497-1d1c-48a0-9b0a-e7df2a41361c/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:08:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:08:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:08:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:08:04 user nova-compute[74743]: DEBUG nova.network.neutron [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Successfully created port: e5de62fd-2d58-469b-b981-e7519bb831b6 {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:08:04 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:04 user nova-compute[74743]: DEBUG nova.compute.manager [req-d6306cb3-e5cd-43dd-9f5f-04c6fa17dbb0 req-0ba6050e-7ce9-493b-8282-30e4d1121e52 service nova] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Received event network-vif-plugged-28f81291-34bb-4a6f-890b-faea6ef8a385 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:08:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d6306cb3-e5cd-43dd-9f5f-04c6fa17dbb0 req-0ba6050e-7ce9-493b-8282-30e4d1121e52 service nova] Acquiring lock "4cce1628-2dcb-40c7-abd4-6a327a432de3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:08:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d6306cb3-e5cd-43dd-9f5f-04c6fa17dbb0 req-0ba6050e-7ce9-493b-8282-30e4d1121e52 service nova] Lock "4cce1628-2dcb-40c7-abd4-6a327a432de3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:08:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d6306cb3-e5cd-43dd-9f5f-04c6fa17dbb0 req-0ba6050e-7ce9-493b-8282-30e4d1121e52 service nova] Lock "4cce1628-2dcb-40c7-abd4-6a327a432de3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:08:04 user nova-compute[74743]: DEBUG nova.compute.manager [req-d6306cb3-e5cd-43dd-9f5f-04c6fa17dbb0 req-0ba6050e-7ce9-493b-8282-30e4d1121e52 service nova] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] No waiting events found dispatching network-vif-plugged-28f81291-34bb-4a6f-890b-faea6ef8a385 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:08:04 user nova-compute[74743]: WARNING nova.compute.manager [req-d6306cb3-e5cd-43dd-9f5f-04c6fa17dbb0 req-0ba6050e-7ce9-493b-8282-30e4d1121e52 service nova] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Received unexpected event network-vif-plugged-28f81291-34bb-4a6f-890b-faea6ef8a385 for instance with vm_state rescued and task_state None.
Nov 18 17:08:04 user nova-compute[74743]: DEBUG nova.compute.manager [req-d6306cb3-e5cd-43dd-9f5f-04c6fa17dbb0 req-0ba6050e-7ce9-493b-8282-30e4d1121e52 service nova] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Received event network-vif-plugged-28f81291-34bb-4a6f-890b-faea6ef8a385 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:08:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d6306cb3-e5cd-43dd-9f5f-04c6fa17dbb0 req-0ba6050e-7ce9-493b-8282-30e4d1121e52 service nova] Acquiring lock "4cce1628-2dcb-40c7-abd4-6a327a432de3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:08:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d6306cb3-e5cd-43dd-9f5f-04c6fa17dbb0 req-0ba6050e-7ce9-493b-8282-30e4d1121e52 service nova] Lock "4cce1628-2dcb-40c7-abd4-6a327a432de3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:08:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d6306cb3-e5cd-43dd-9f5f-04c6fa17dbb0 req-0ba6050e-7ce9-493b-8282-30e4d1121e52 service nova] Lock "4cce1628-2dcb-40c7-abd4-6a327a432de3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:08:04 user nova-compute[74743]: DEBUG nova.compute.manager [req-d6306cb3-e5cd-43dd-9f5f-04c6fa17dbb0 req-0ba6050e-7ce9-493b-8282-30e4d1121e52 service nova] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] No waiting events found dispatching network-vif-plugged-28f81291-34bb-4a6f-890b-faea6ef8a385 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:08:04 user nova-compute[74743]: WARNING nova.compute.manager [req-d6306cb3-e5cd-43dd-9f5f-04c6fa17dbb0 req-0ba6050e-7ce9-493b-8282-30e4d1121e52 service nova] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Received unexpected event network-vif-plugged-28f81291-34bb-4a6f-890b-faea6ef8a385 for instance with vm_state rescued and task_state None.
Nov 18 17:08:04 user nova-compute[74743]: DEBUG nova.compute.manager [req-d6306cb3-e5cd-43dd-9f5f-04c6fa17dbb0 req-0ba6050e-7ce9-493b-8282-30e4d1121e52 service nova] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Received event network-vif-plugged-28f81291-34bb-4a6f-890b-faea6ef8a385 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:08:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d6306cb3-e5cd-43dd-9f5f-04c6fa17dbb0 req-0ba6050e-7ce9-493b-8282-30e4d1121e52 service nova] Acquiring lock "4cce1628-2dcb-40c7-abd4-6a327a432de3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:08:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d6306cb3-e5cd-43dd-9f5f-04c6fa17dbb0 req-0ba6050e-7ce9-493b-8282-30e4d1121e52 service nova] Lock "4cce1628-2dcb-40c7-abd4-6a327a432de3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:08:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d6306cb3-e5cd-43dd-9f5f-04c6fa17dbb0 req-0ba6050e-7ce9-493b-8282-30e4d1121e52 service nova] Lock "4cce1628-2dcb-40c7-abd4-6a327a432de3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:08:04 user nova-compute[74743]: DEBUG nova.compute.manager [req-d6306cb3-e5cd-43dd-9f5f-04c6fa17dbb0 req-0ba6050e-7ce9-493b-8282-30e4d1121e52 service nova] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] No waiting events found dispatching network-vif-plugged-28f81291-34bb-4a6f-890b-faea6ef8a385 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:08:04 user nova-compute[74743]: WARNING nova.compute.manager [req-d6306cb3-e5cd-43dd-9f5f-04c6fa17dbb0 req-0ba6050e-7ce9-493b-8282-30e4d1121e52 service nova] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Received unexpected event network-vif-plugged-28f81291-34bb-4a6f-890b-faea6ef8a385 for instance with vm_state rescued and task_state None.
Nov 18 17:08:05 user nova-compute[74743]: DEBUG nova.network.neutron [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Successfully updated port: e5de62fd-2d58-469b-b981-e7519bb831b6 {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:08:05 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Acquiring lock "refresh_cache-c5c74497-1d1c-48a0-9b0a-e7df2a41361c" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:08:05 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Acquired lock "refresh_cache-c5c74497-1d1c-48a0-9b0a-e7df2a41361c" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:08:05 user nova-compute[74743]: DEBUG nova.network.neutron [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:08:05 user nova-compute[74743]: DEBUG nova.compute.manager [req-1ca624ec-4580-47c3-ac17-69edadadc20b req-0621cade-5f8f-46b1-b42a-2f1f791f9acc service nova] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Received event network-changed-e5de62fd-2d58-469b-b981-e7519bb831b6 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:08:05 user nova-compute[74743]: DEBUG nova.compute.manager [req-1ca624ec-4580-47c3-ac17-69edadadc20b req-0621cade-5f8f-46b1-b42a-2f1f791f9acc service nova] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Refreshing instance network info cache due to event network-changed-e5de62fd-2d58-469b-b981-e7519bb831b6. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:08:05 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-1ca624ec-4580-47c3-ac17-69edadadc20b req-0621cade-5f8f-46b1-b42a-2f1f791f9acc service nova] Acquiring lock "refresh_cache-c5c74497-1d1c-48a0-9b0a-e7df2a41361c" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:08:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:05 user nova-compute[74743]: DEBUG nova.network.neutron [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:08:06 user nova-compute[74743]: DEBUG nova.network.neutron [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Updating instance_info_cache with network_info: [{"id": "e5de62fd-2d58-469b-b981-e7519bb831b6", "address": "fa:16:3e:45:6a:b6", "network": {"id": "878a81f7-c3ef-4b3b-8074-52d119d989b4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1839718683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c1b4501efb42a482d0faf10fa1ff2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5de62fd-2d", "ovs_interfaceid": "e5de62fd-2d58-469b-b981-e7519bb831b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:08:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Releasing lock "refresh_cache-c5c74497-1d1c-48a0-9b0a-e7df2a41361c" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:08:06 user nova-compute[74743]: DEBUG nova.compute.manager [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Instance network_info: |[{"id": "e5de62fd-2d58-469b-b981-e7519bb831b6", "address": "fa:16:3e:45:6a:b6", "network": {"id": "878a81f7-c3ef-4b3b-8074-52d119d989b4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1839718683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c1b4501efb42a482d0faf10fa1ff2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5de62fd-2d", "ovs_interfaceid": "e5de62fd-2d58-469b-b981-e7519bb831b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 17:08:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-1ca624ec-4580-47c3-ac17-69edadadc20b req-0621cade-5f8f-46b1-b42a-2f1f791f9acc service nova] Acquired lock "refresh_cache-c5c74497-1d1c-48a0-9b0a-e7df2a41361c" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:08:06 user nova-compute[74743]: DEBUG nova.network.neutron [req-1ca624ec-4580-47c3-ac17-69edadadc20b req-0621cade-5f8f-46b1-b42a-2f1f791f9acc service nova] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Refreshing network info cache for port e5de62fd-2d58-469b-b981-e7519bb831b6 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:08:06 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Start _get_guest_xml network_info=[{"id": "e5de62fd-2d58-469b-b981-e7519bb831b6", "address": "fa:16:3e:45:6a:b6", "network": {"id": "878a81f7-c3ef-4b3b-8074-52d119d989b4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1839718683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c1b4501efb42a482d0faf10fa1ff2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5de62fd-2d", "ovs_interfaceid": "e5de62fd-2d58-469b-b981-e7519bb831b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '9536f6cf-95c4-40e2-864a-09a91525678a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:08:06 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:08:06 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:08:06 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:08:06 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:08:06 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:08:06 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:08:06 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:08:06 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:08:06 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:08:06 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:08:06 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:08:06 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:08:06 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:08:06 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:08:06 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:08:06 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:08:06 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:08:06 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:08:06 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:08:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-615708399',display_name='tempest-TestServerVolumeAttachmentScenario-server-615708399',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-615708399',id=17,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRn/q/1K03eVQo/nKnZ9mXzuizMJEKNhpl/MCWvBkLc+qgNJuFktUTYI6Jm4ZALbuPl09Fhvt7ENy/pbfjHmtWKL+ZIoWQqU76dMhjBJ4P4evdsovtzZfcG35cL4ZWCfA==',key_name='tempest-keypair-1928572282',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72c1b4501efb42a482d0faf10fa1ff2b',ramdisk_id='',reservation_id='r-zm4acbdi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-155768243',owner_user_name='tempest-TestServerVolumeAttachmentScenario-155768243-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:08:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5fa5e5c1b2548b5bb3b6edc4f8d6139',uuid=c5c74497-1d1c-48a0-9b0a-e7df2a41361c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5de62fd-2d58-469b-b981-e7519bb831b6", "address": "fa:16:3e:45:6a:b6", "network": {"id": "878a81f7-c3ef-4b3b-8074-52d119d989b4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1839718683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c1b4501efb42a482d0faf10fa1ff2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5de62fd-2d", "ovs_interfaceid": "e5de62fd-2d58-469b-b981-e7519bb831b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:08:06 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Converting VIF {"id": "e5de62fd-2d58-469b-b981-e7519bb831b6", "address": "fa:16:3e:45:6a:b6", "network": {"id": "878a81f7-c3ef-4b3b-8074-52d119d989b4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1839718683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c1b4501efb42a482d0faf10fa1ff2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5de62fd-2d", "ovs_interfaceid": "e5de62fd-2d58-469b-b981-e7519bb831b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:08:06 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:6a:b6,bridge_name='br-int',has_traffic_filtering=True,id=e5de62fd-2d58-469b-b981-e7519bb831b6,network=Network(878a81f7-c3ef-4b3b-8074-52d119d989b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5de62fd-2d') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:08:06 user nova-compute[74743]: DEBUG nova.objects.instance [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Lazy-loading 'pci_devices' on Instance uuid c5c74497-1d1c-48a0-9b0a-e7df2a41361c {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:08:06 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:08:06 user nova-compute[74743]:   <uuid>c5c74497-1d1c-48a0-9b0a-e7df2a41361c</uuid>
Nov 18 17:08:06 user nova-compute[74743]:   <name>instance-00000011</name>
Nov 18 17:08:06 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:08:06 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:08:06 user nova-compute[74743]:   <metadata>
Nov 18 17:08:06 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:08:06 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:08:06 user nova-compute[74743]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-615708399</nova:name>
Nov 18 17:08:06 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:08:06</nova:creationTime>
Nov 18 17:08:06 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:08:06 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:08:06 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:08:06 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:08:06 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:08:06 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:08:06 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:08:06 user nova-compute[74743]:       <nova:owner>
Nov 18 17:08:06 user nova-compute[74743]:         <nova:user uuid="e5fa5e5c1b2548b5bb3b6edc4f8d6139">tempest-TestServerVolumeAttachmentScenario-155768243-project-member</nova:user>
Nov 18 17:08:06 user nova-compute[74743]:         <nova:project uuid="72c1b4501efb42a482d0faf10fa1ff2b">tempest-TestServerVolumeAttachmentScenario-155768243</nova:project>
Nov 18 17:08:06 user nova-compute[74743]:       </nova:owner>
Nov 18 17:08:06 user nova-compute[74743]:       <nova:root type="image" uuid="9536f6cf-95c4-40e2-864a-09a91525678a"/>
Nov 18 17:08:06 user nova-compute[74743]:       <nova:ports>
Nov 18 17:08:06 user nova-compute[74743]:         <nova:port uuid="e5de62fd-2d58-469b-b981-e7519bb831b6">
Nov 18 17:08:06 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 18 17:08:06 user nova-compute[74743]:         </nova:port>
Nov 18 17:08:06 user nova-compute[74743]:       </nova:ports>
Nov 18 17:08:06 user nova-compute[74743]:     </nova:instance>
Nov 18 17:08:06 user nova-compute[74743]:   </metadata>
Nov 18 17:08:06 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:08:06 user nova-compute[74743]:     <system>
Nov 18 17:08:06 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:08:06 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:08:06 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:08:06 user nova-compute[74743]:       <entry name="serial">c5c74497-1d1c-48a0-9b0a-e7df2a41361c</entry>
Nov 18 17:08:06 user nova-compute[74743]:       <entry name="uuid">c5c74497-1d1c-48a0-9b0a-e7df2a41361c</entry>
Nov 18 17:08:06 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:08:06 user nova-compute[74743]:     </system>
Nov 18 17:08:06 user nova-compute[74743]:   </sysinfo>
Nov 18 17:08:06 user nova-compute[74743]:   <os>
Nov 18 17:08:06 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:08:06 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:08:06 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:08:06 user nova-compute[74743]:   </os>
Nov 18 17:08:06 user nova-compute[74743]:   <features>
Nov 18 17:08:06 user nova-compute[74743]:     <acpi/>
Nov 18 17:08:06 user nova-compute[74743]:     <apic/>
Nov 18 17:08:06 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:08:06 user nova-compute[74743]:   </features>
Nov 18 17:08:06 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:08:06 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:08:06 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:08:06 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:08:06 user nova-compute[74743]:   </clock>
Nov 18 17:08:06 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:08:06 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:08:06 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:08:06 user nova-compute[74743]:   </cpu>
Nov 18 17:08:06 user nova-compute[74743]:   <devices>
Nov 18 17:08:06 user nova-compute[74743]:     <disk type="file" device="disk">
Nov 18 17:08:06 user nova-compute[74743]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 17:08:06 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/c5c74497-1d1c-48a0-9b0a-e7df2a41361c/disk"/>
Nov 18 17:08:06 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:08:06 user nova-compute[74743]:     </disk>
Nov 18 17:08:06 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:08:06 user nova-compute[74743]:       <mac address="fa:16:3e:45:6a:b6"/>
Nov 18 17:08:06 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:08:06 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:08:06 user nova-compute[74743]:       <target dev="tape5de62fd-2d"/>
Nov 18 17:08:06 user nova-compute[74743]:     </interface>
Nov 18 17:08:06 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:08:06 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/c5c74497-1d1c-48a0-9b0a-e7df2a41361c/console.log" append="off"/>
Nov 18 17:08:06 user nova-compute[74743]:     </serial>
Nov 18 17:08:06 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:08:06 user nova-compute[74743]:     <video>
Nov 18 17:08:06 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:08:06 user nova-compute[74743]:     </video>
Nov 18 17:08:06 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:08:06 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:08:06 user nova-compute[74743]:     </rng>
Nov 18 17:08:06 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:08:06 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:08:06 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:08:06 user nova-compute[74743]:     </memballoon>
Nov 18 17:08:06 user nova-compute[74743]:   </devices>
Nov 18 17:08:06 user nova-compute[74743]: </domain>
Nov 18 17:08:06 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:08:06 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:08:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-615708399',display_name='tempest-TestServerVolumeAttachmentScenario-server-615708399',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-615708399',id=17,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRn/q/1K03eVQo/nKnZ9mXzuizMJEKNhpl/MCWvBkLc+qgNJuFktUTYI6Jm4ZALbuPl09Fhvt7ENy/pbfjHmtWKL+ZIoWQqU76dMhjBJ4P4evdsovtzZfcG35cL4ZWCfA==',key_name='tempest-keypair-1928572282',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72c1b4501efb42a482d0faf10fa1ff2b',ramdisk_id='',reservation_id='r-zm4acbdi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-155768243',owner_user_name='tempest-TestServerVolumeAttachmentScenario-155768243-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:08:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5fa5e5c1b2548b5bb3b6edc4f8d6139',uuid=c5c74497-1d1c-48a0-9b0a-e7df2a41361c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5de62fd-2d58-469b-b981-e7519bb831b6", "address": "fa:16:3e:45:6a:b6", "network": {"id": "878a81f7-c3ef-4b3b-8074-52d119d989b4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1839718683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c1b4501efb42a482d0faf10fa1ff2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5de62fd-2d", "ovs_interfaceid": "e5de62fd-2d58-469b-b981-e7519bb831b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:08:06 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Converting VIF {"id": "e5de62fd-2d58-469b-b981-e7519bb831b6", "address": "fa:16:3e:45:6a:b6", "network": {"id": "878a81f7-c3ef-4b3b-8074-52d119d989b4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1839718683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c1b4501efb42a482d0faf10fa1ff2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5de62fd-2d", "ovs_interfaceid": "e5de62fd-2d58-469b-b981-e7519bb831b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:08:06 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:6a:b6,bridge_name='br-int',has_traffic_filtering=True,id=e5de62fd-2d58-469b-b981-e7519bb831b6,network=Network(878a81f7-c3ef-4b3b-8074-52d119d989b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5de62fd-2d') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:08:06 user nova-compute[74743]: DEBUG os_vif [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:6a:b6,bridge_name='br-int',has_traffic_filtering=True,id=e5de62fd-2d58-469b-b981-e7519bb831b6,network=Network(878a81f7-c3ef-4b3b-8074-52d119d989b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5de62fd-2d') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:08:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:08:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:08:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5d683145-57f2-5754-957c-75aa1fe3d43d', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:08:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape5de62fd-2d, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:08:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape5de62fd-2d, col_values=(('qos', UUID('09fcfabc-d195-4cc6-b217-66c23f98660e')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:08:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape5de62fd-2d, col_values=(('external_ids', {'iface-id': 'e5de62fd-2d58-469b-b981-e7519bb831b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:6a:b6', 'vm-uuid': 'c5c74497-1d1c-48a0-9b0a-e7df2a41361c'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:08:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:08:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:06 user nova-compute[74743]: INFO os_vif [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:6a:b6,bridge_name='br-int',has_traffic_filtering=True,id=e5de62fd-2d58-469b-b981-e7519bb831b6,network=Network(878a81f7-c3ef-4b3b-8074-52d119d989b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5de62fd-2d')
Nov 18 17:08:06 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:08:06 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] No VIF found with MAC fa:16:3e:45:6a:b6, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:08:06 user nova-compute[74743]: DEBUG nova.network.neutron [req-1ca624ec-4580-47c3-ac17-69edadadc20b req-0621cade-5f8f-46b1-b42a-2f1f791f9acc service nova] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Updated VIF entry in instance network info cache for port e5de62fd-2d58-469b-b981-e7519bb831b6. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:08:06 user nova-compute[74743]: DEBUG nova.network.neutron [req-1ca624ec-4580-47c3-ac17-69edadadc20b req-0621cade-5f8f-46b1-b42a-2f1f791f9acc service nova] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Updating instance_info_cache with network_info: [{"id": "e5de62fd-2d58-469b-b981-e7519bb831b6", "address": "fa:16:3e:45:6a:b6", "network": {"id": "878a81f7-c3ef-4b3b-8074-52d119d989b4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1839718683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c1b4501efb42a482d0faf10fa1ff2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5de62fd-2d", "ovs_interfaceid": "e5de62fd-2d58-469b-b981-e7519bb831b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:08:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-1ca624ec-4580-47c3-ac17-69edadadc20b req-0621cade-5f8f-46b1-b42a-2f1f791f9acc service nova] Releasing lock "refresh_cache-c5c74497-1d1c-48a0-9b0a-e7df2a41361c" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:08:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:08 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:08 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:08 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:08 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:08 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:09 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:10 user nova-compute[74743]: DEBUG nova.compute.manager [req-77ab0e1e-3df4-44c6-be47-17f0804f15fb req-1e3be3ad-eb78-4745-ad77-45aa5d34197a service nova] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Received event network-vif-plugged-e5de62fd-2d58-469b-b981-e7519bb831b6 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:08:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-77ab0e1e-3df4-44c6-be47-17f0804f15fb req-1e3be3ad-eb78-4745-ad77-45aa5d34197a service nova] Acquiring lock "c5c74497-1d1c-48a0-9b0a-e7df2a41361c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:08:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-77ab0e1e-3df4-44c6-be47-17f0804f15fb req-1e3be3ad-eb78-4745-ad77-45aa5d34197a service nova] Lock "c5c74497-1d1c-48a0-9b0a-e7df2a41361c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:08:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-77ab0e1e-3df4-44c6-be47-17f0804f15fb req-1e3be3ad-eb78-4745-ad77-45aa5d34197a service nova] Lock "c5c74497-1d1c-48a0-9b0a-e7df2a41361c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:08:10 user nova-compute[74743]: DEBUG nova.compute.manager [req-77ab0e1e-3df4-44c6-be47-17f0804f15fb req-1e3be3ad-eb78-4745-ad77-45aa5d34197a service nova] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] No waiting events found dispatching network-vif-plugged-e5de62fd-2d58-469b-b981-e7519bb831b6 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:08:10 user nova-compute[74743]: WARNING nova.compute.manager [req-77ab0e1e-3df4-44c6-be47-17f0804f15fb req-1e3be3ad-eb78-4745-ad77-45aa5d34197a service nova] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Received unexpected event network-vif-plugged-e5de62fd-2d58-469b-b981-e7519bb831b6 for instance with vm_state building and task_state spawning.
Nov 18 17:08:10 user nova-compute[74743]: DEBUG nova.compute.manager [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:08:10 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Guest created on hypervisor {{(pid=74743) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 17:08:10 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Instance spawned successfully.
Nov 18 17:08:10 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 17:08:10 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Found default for hw_cdrom_bus of ide {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:08:10 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Found default for hw_disk_bus of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:08:10 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Found default for hw_input_bus of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:08:10 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Found default for hw_pointer_model of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:08:10 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Found default for hw_video_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:08:10 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Found default for hw_vif_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:08:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:10 user nova-compute[74743]: INFO nova.compute.manager [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Took 7.58 seconds to spawn the instance on the hypervisor.
Nov 18 17:08:10 user nova-compute[74743]: DEBUG nova.compute.manager [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:08:10 user nova-compute[74743]: INFO nova.compute.manager [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Took 8.68 seconds to build instance.
Nov 18 17:08:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-10e9d495-9b29-474c-b500-7a063d36b7e3 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Lock "c5c74497-1d1c-48a0-9b0a-e7df2a41361c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.804s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:08:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:12 user nova-compute[74743]: DEBUG nova.compute.manager [req-07ffe6d4-6c38-4c69-9886-bf53415286fc req-a7c70e1c-055f-4a1e-8a4a-3c7d1a7d93aa service nova] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Received event network-vif-plugged-e5de62fd-2d58-469b-b981-e7519bb831b6 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:08:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-07ffe6d4-6c38-4c69-9886-bf53415286fc req-a7c70e1c-055f-4a1e-8a4a-3c7d1a7d93aa service nova] Acquiring lock "c5c74497-1d1c-48a0-9b0a-e7df2a41361c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:08:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-07ffe6d4-6c38-4c69-9886-bf53415286fc req-a7c70e1c-055f-4a1e-8a4a-3c7d1a7d93aa service nova] Lock "c5c74497-1d1c-48a0-9b0a-e7df2a41361c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:08:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-07ffe6d4-6c38-4c69-9886-bf53415286fc req-a7c70e1c-055f-4a1e-8a4a-3c7d1a7d93aa service nova] Lock "c5c74497-1d1c-48a0-9b0a-e7df2a41361c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:08:12 user nova-compute[74743]: DEBUG nova.compute.manager [req-07ffe6d4-6c38-4c69-9886-bf53415286fc req-a7c70e1c-055f-4a1e-8a4a-3c7d1a7d93aa service nova] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] No waiting events found dispatching network-vif-plugged-e5de62fd-2d58-469b-b981-e7519bb831b6 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:08:12 user nova-compute[74743]: WARNING nova.compute.manager [req-07ffe6d4-6c38-4c69-9886-bf53415286fc req-a7c70e1c-055f-4a1e-8a4a-3c7d1a7d93aa service nova] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Received unexpected event network-vif-plugged-e5de62fd-2d58-469b-b981-e7519bb831b6 for instance with vm_state active and task_state None.
Nov 18 17:08:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:17 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Acquiring lock "8a9b12da-02c5-42ba-b215-a20df0e3ea4f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:08:17 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "8a9b12da-02c5-42ba-b215-a20df0e3ea4f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:08:17 user nova-compute[74743]: DEBUG nova.compute.manager [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Starting instance... {{(pid=74743) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 17:08:17 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:08:17 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:08:17 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74743) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 17:08:17 user nova-compute[74743]: INFO nova.compute.claims [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Claim successful on node user
Nov 18 17:08:19 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:08:19 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:08:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.683s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:08:19 user nova-compute[74743]: DEBUG nova.compute.manager [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Start building networks asynchronously for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 17:08:19 user nova-compute[74743]: DEBUG nova.compute.manager [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Allocating IP information in the background. {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 17:08:19 user nova-compute[74743]: DEBUG nova.network.neutron [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] allocate_for_instance() {{(pid=74743) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 17:08:19 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 17:08:19 user nova-compute[74743]: DEBUG nova.compute.manager [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Start building block device mappings for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 17:08:19 user nova-compute[74743]: DEBUG nova.policy [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '351aa457efdc463b95a4c837d26cd23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4468d0e7ff32423091ecc55d82deba1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74743) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 17:08:19 user nova-compute[74743]: DEBUG nova.compute.manager [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Start spawning the instance on the hypervisor. {{(pid=74743) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 17:08:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Creating instance directory {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 17:08:19 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Creating image(s)
Nov 18 17:08:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Acquiring lock "/opt/stack/data/nova/instances/8a9b12da-02c5-42ba-b215-a20df0e3ea4f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:08:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "/opt/stack/data/nova/instances/8a9b12da-02c5-42ba-b215-a20df0e3ea4f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:08:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "/opt/stack/data/nova/instances/8a9b12da-02c5-42ba-b215-a20df0e3ea4f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:08:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:08:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.217s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:08:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Acquiring lock "c188b3a997bfafa42fa341f9dcc326545681eed9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:08:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:08:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:08:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.190s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:08:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/8a9b12da-02c5-42ba-b215-a20df0e3ea4f/disk 1073741824 {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:08:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/8a9b12da-02c5-42ba-b215-a20df0e3ea4f/disk 1073741824" returned: 0 in 0.067s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:08:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:08:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:08:19 user nova-compute[74743]: DEBUG nova.network.neutron [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Successfully created port: 6e3b96b3-1a83-4b25-ad28-cf77e11ff137 {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:08:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.211s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:08:20 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8a9b12da-02c5-42ba-b215-a20df0e3ea4f/disk. size=1073741824 {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 17:08:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a9b12da-02c5-42ba-b215-a20df0e3ea4f/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:08:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a9b12da-02c5-42ba-b215-a20df0e3ea4f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:08:20 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Cannot resize image /opt/stack/data/nova/instances/8a9b12da-02c5-42ba-b215-a20df0e3ea4f/disk to a smaller size. {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 17:08:20 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Created local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 17:08:20 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Ensure instance console log exists: /opt/stack/data/nova/instances/8a9b12da-02c5-42ba-b215-a20df0e3ea4f/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:08:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:08:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:08:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:08:20 user nova-compute[74743]: DEBUG nova.network.neutron [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Successfully updated port: 6e3b96b3-1a83-4b25-ad28-cf77e11ff137 {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:08:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Acquiring lock "refresh_cache-8a9b12da-02c5-42ba-b215-a20df0e3ea4f" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:08:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Acquired lock "refresh_cache-8a9b12da-02c5-42ba-b215-a20df0e3ea4f" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:08:20 user nova-compute[74743]: DEBUG nova.network.neutron [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:08:20 user nova-compute[74743]: DEBUG nova.compute.manager [req-c5b9a2b5-d392-4068-a438-5176c07ee486 req-45e0c691-3030-4509-a4ad-c7df5ddd3fa0 service nova] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Received event network-changed-6e3b96b3-1a83-4b25-ad28-cf77e11ff137 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:08:20 user nova-compute[74743]: DEBUG nova.compute.manager [req-c5b9a2b5-d392-4068-a438-5176c07ee486 req-45e0c691-3030-4509-a4ad-c7df5ddd3fa0 service nova] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Refreshing instance network info cache due to event network-changed-6e3b96b3-1a83-4b25-ad28-cf77e11ff137. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:08:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-c5b9a2b5-d392-4068-a438-5176c07ee486 req-45e0c691-3030-4509-a4ad-c7df5ddd3fa0 service nova] Acquiring lock "refresh_cache-8a9b12da-02c5-42ba-b215-a20df0e3ea4f" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:08:20 user nova-compute[74743]: DEBUG nova.network.neutron [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:08:21 user nova-compute[74743]: DEBUG nova.network.neutron [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Updating instance_info_cache with network_info: [{"id": "6e3b96b3-1a83-4b25-ad28-cf77e11ff137", "address": "fa:16:3e:34:83:d5", "network": {"id": "2588909e-8504-407d-bc7b-5d1f3d978395", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1712970821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468d0e7ff32423091ecc55d82deba1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e3b96b3-1a", "ovs_interfaceid": "6e3b96b3-1a83-4b25-ad28-cf77e11ff137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:08:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Releasing lock "refresh_cache-8a9b12da-02c5-42ba-b215-a20df0e3ea4f" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:08:21 user nova-compute[74743]: DEBUG nova.compute.manager [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Instance network_info: |[{"id": "6e3b96b3-1a83-4b25-ad28-cf77e11ff137", "address": "fa:16:3e:34:83:d5", "network": {"id": "2588909e-8504-407d-bc7b-5d1f3d978395", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1712970821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468d0e7ff32423091ecc55d82deba1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e3b96b3-1a", "ovs_interfaceid": "6e3b96b3-1a83-4b25-ad28-cf77e11ff137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 17:08:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-c5b9a2b5-d392-4068-a438-5176c07ee486 req-45e0c691-3030-4509-a4ad-c7df5ddd3fa0 service nova] Acquired lock "refresh_cache-8a9b12da-02c5-42ba-b215-a20df0e3ea4f" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:08:21 user nova-compute[74743]: DEBUG nova.network.neutron [req-c5b9a2b5-d392-4068-a438-5176c07ee486 req-45e0c691-3030-4509-a4ad-c7df5ddd3fa0 service nova] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Refreshing network info cache for port 6e3b96b3-1a83-4b25-ad28-cf77e11ff137 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:08:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Start _get_guest_xml network_info=[{"id": "6e3b96b3-1a83-4b25-ad28-cf77e11ff137", "address": "fa:16:3e:34:83:d5", "network": {"id": "2588909e-8504-407d-bc7b-5d1f3d978395", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1712970821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468d0e7ff32423091ecc55d82deba1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e3b96b3-1a", "ovs_interfaceid": "6e3b96b3-1a83-4b25-ad28-cf77e11ff137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '9536f6cf-95c4-40e2-864a-09a91525678a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:08:21 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:08:21 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:08:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:08:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:08:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:08:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:08:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:08:21 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:08:21 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:08:21 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:08:21 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:08:21 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:08:21 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:08:21 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:08:21 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:08:21 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:08:21 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:08:21 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:08:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:08:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2117608811',display_name='tempest-VolumesSnapshotTestJSON-instance-2117608811',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2117608811',id=18,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+4EMOOsj8T3vRtmB2AXIxIcp4Bo39KkS2gbtxNjS+u3t5pu+ScTjKs6BJP2HZkZ3GpO2xYUc/hqLzSCTgFK2yYWdaa9XRP7MT8+JmYdBTsGOv0BwzXiPunFpprImiuyw==',key_name='tempest-keypair-38298062',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4468d0e7ff32423091ecc55d82deba1c',ramdisk_id='',reservation_id='r-u8wvs0d3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1394839673',owner_user_name='tempest-VolumesSnapshotTestJSON-1394839673-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:08:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='351aa457efdc463b95a4c837d26cd23f',uuid=8a9b12da-02c5-42ba-b215-a20df0e3ea4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e3b96b3-1a83-4b25-ad28-cf77e11ff137", "address": "fa:16:3e:34:83:d5", "network": {"id": "2588909e-8504-407d-bc7b-5d1f3d978395", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1712970821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468d0e7ff32423091ecc55d82deba1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e3b96b3-1a", "ovs_interfaceid": "6e3b96b3-1a83-4b25-ad28-cf77e11ff137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:08:21 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Converting VIF {"id": "6e3b96b3-1a83-4b25-ad28-cf77e11ff137", "address": "fa:16:3e:34:83:d5", "network": {"id": "2588909e-8504-407d-bc7b-5d1f3d978395", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1712970821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468d0e7ff32423091ecc55d82deba1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e3b96b3-1a", "ovs_interfaceid": "6e3b96b3-1a83-4b25-ad28-cf77e11ff137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:08:21 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:83:d5,bridge_name='br-int',has_traffic_filtering=True,id=6e3b96b3-1a83-4b25-ad28-cf77e11ff137,network=Network(2588909e-8504-407d-bc7b-5d1f3d978395),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e3b96b3-1a') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:08:21 user nova-compute[74743]: DEBUG nova.objects.instance [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lazy-loading 'pci_devices' on Instance uuid 8a9b12da-02c5-42ba-b215-a20df0e3ea4f {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:08:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:08:21 user nova-compute[74743]:   <uuid>8a9b12da-02c5-42ba-b215-a20df0e3ea4f</uuid>
Nov 18 17:08:21 user nova-compute[74743]:   <name>instance-00000012</name>
Nov 18 17:08:21 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:08:21 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:08:21 user nova-compute[74743]:   <metadata>
Nov 18 17:08:21 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:08:21 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:08:21 user nova-compute[74743]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-2117608811</nova:name>
Nov 18 17:08:21 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:08:21</nova:creationTime>
Nov 18 17:08:21 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:08:21 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:08:21 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:08:21 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:08:21 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:08:21 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:08:21 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:08:21 user nova-compute[74743]:       <nova:owner>
Nov 18 17:08:21 user nova-compute[74743]:         <nova:user uuid="351aa457efdc463b95a4c837d26cd23f">tempest-VolumesSnapshotTestJSON-1394839673-project-member</nova:user>
Nov 18 17:08:21 user nova-compute[74743]:         <nova:project uuid="4468d0e7ff32423091ecc55d82deba1c">tempest-VolumesSnapshotTestJSON-1394839673</nova:project>
Nov 18 17:08:21 user nova-compute[74743]:       </nova:owner>
Nov 18 17:08:21 user nova-compute[74743]:       <nova:root type="image" uuid="9536f6cf-95c4-40e2-864a-09a91525678a"/>
Nov 18 17:08:21 user nova-compute[74743]:       <nova:ports>
Nov 18 17:08:21 user nova-compute[74743]:         <nova:port uuid="6e3b96b3-1a83-4b25-ad28-cf77e11ff137">
Nov 18 17:08:21 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 18 17:08:21 user nova-compute[74743]:         </nova:port>
Nov 18 17:08:21 user nova-compute[74743]:       </nova:ports>
Nov 18 17:08:21 user nova-compute[74743]:     </nova:instance>
Nov 18 17:08:21 user nova-compute[74743]:   </metadata>
Nov 18 17:08:21 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:08:21 user nova-compute[74743]:     <system>
Nov 18 17:08:21 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:08:21 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:08:21 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:08:21 user nova-compute[74743]:       <entry name="serial">8a9b12da-02c5-42ba-b215-a20df0e3ea4f</entry>
Nov 18 17:08:21 user nova-compute[74743]:       <entry name="uuid">8a9b12da-02c5-42ba-b215-a20df0e3ea4f</entry>
Nov 18 17:08:21 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:08:21 user nova-compute[74743]:     </system>
Nov 18 17:08:21 user nova-compute[74743]:   </sysinfo>
Nov 18 17:08:21 user nova-compute[74743]:   <os>
Nov 18 17:08:21 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:08:21 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:08:21 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:08:21 user nova-compute[74743]:   </os>
Nov 18 17:08:21 user nova-compute[74743]:   <features>
Nov 18 17:08:21 user nova-compute[74743]:     <acpi/>
Nov 18 17:08:21 user nova-compute[74743]:     <apic/>
Nov 18 17:08:21 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:08:21 user nova-compute[74743]:   </features>
Nov 18 17:08:21 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:08:21 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:08:21 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:08:21 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:08:21 user nova-compute[74743]:   </clock>
Nov 18 17:08:21 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:08:21 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:08:21 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:08:21 user nova-compute[74743]:   </cpu>
Nov 18 17:08:21 user nova-compute[74743]:   <devices>
Nov 18 17:08:21 user nova-compute[74743]:     <disk type="file" device="disk">
Nov 18 17:08:21 user nova-compute[74743]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 17:08:21 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/8a9b12da-02c5-42ba-b215-a20df0e3ea4f/disk"/>
Nov 18 17:08:21 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:08:21 user nova-compute[74743]:     </disk>
Nov 18 17:08:21 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:08:21 user nova-compute[74743]:       <mac address="fa:16:3e:34:83:d5"/>
Nov 18 17:08:21 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:08:21 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:08:21 user nova-compute[74743]:       <target dev="tap6e3b96b3-1a"/>
Nov 18 17:08:21 user nova-compute[74743]:     </interface>
Nov 18 17:08:21 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:08:21 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/8a9b12da-02c5-42ba-b215-a20df0e3ea4f/console.log" append="off"/>
Nov 18 17:08:21 user nova-compute[74743]:     </serial>
Nov 18 17:08:21 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:08:21 user nova-compute[74743]:     <video>
Nov 18 17:08:21 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:08:21 user nova-compute[74743]:     </video>
Nov 18 17:08:21 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:08:21 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:08:21 user nova-compute[74743]:     </rng>
Nov 18 17:08:21 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:08:21 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:08:21 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:08:21 user nova-compute[74743]:     </memballoon>
Nov 18 17:08:21 user nova-compute[74743]:   </devices>
Nov 18 17:08:21 user nova-compute[74743]: </domain>
Nov 18 17:08:21 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:08:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:08:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2117608811',display_name='tempest-VolumesSnapshotTestJSON-instance-2117608811',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2117608811',id=18,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+4EMOOsj8T3vRtmB2AXIxIcp4Bo39KkS2gbtxNjS+u3t5pu+ScTjKs6BJP2HZkZ3GpO2xYUc/hqLzSCTgFK2yYWdaa9XRP7MT8+JmYdBTsGOv0BwzXiPunFpprImiuyw==',key_name='tempest-keypair-38298062',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4468d0e7ff32423091ecc55d82deba1c',ramdisk_id='',reservation_id='r-u8wvs0d3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1394839673',owner_user_name='tempest-VolumesSnapshotTestJSON-1394839673-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:08:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='351aa457efdc463b95a4c837d26cd23f',uuid=8a9b12da-02c5-42ba-b215-a20df0e3ea4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e3b96b3-1a83-4b25-ad28-cf77e11ff137", "address": "fa:16:3e:34:83:d5", "network": {"id": "2588909e-8504-407d-bc7b-5d1f3d978395", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1712970821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468d0e7ff32423091ecc55d82deba1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e3b96b3-1a", "ovs_interfaceid": "6e3b96b3-1a83-4b25-ad28-cf77e11ff137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:08:21 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Converting VIF {"id": "6e3b96b3-1a83-4b25-ad28-cf77e11ff137", "address": "fa:16:3e:34:83:d5", "network": {"id": "2588909e-8504-407d-bc7b-5d1f3d978395", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1712970821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468d0e7ff32423091ecc55d82deba1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e3b96b3-1a", "ovs_interfaceid": "6e3b96b3-1a83-4b25-ad28-cf77e11ff137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:08:21 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:83:d5,bridge_name='br-int',has_traffic_filtering=True,id=6e3b96b3-1a83-4b25-ad28-cf77e11ff137,network=Network(2588909e-8504-407d-bc7b-5d1f3d978395),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e3b96b3-1a') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:08:21 user nova-compute[74743]: DEBUG os_vif [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:83:d5,bridge_name='br-int',has_traffic_filtering=True,id=6e3b96b3-1a83-4b25-ad28-cf77e11ff137,network=Network(2588909e-8504-407d-bc7b-5d1f3d978395),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e3b96b3-1a') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:08:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:08:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:08:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3be0f407-de98-5f7f-b688-8a67afe6dbe9', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:08:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:08:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e3b96b3-1a, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:08:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6e3b96b3-1a, col_values=(('qos', UUID('d895cb37-48d6-44a1-892d-a87fefced3c5')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:08:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6e3b96b3-1a, col_values=(('external_ids', {'iface-id': '6e3b96b3-1a83-4b25-ad28-cf77e11ff137', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:83:d5', 'vm-uuid': '8a9b12da-02c5-42ba-b215-a20df0e3ea4f'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:08:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:08:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:21 user nova-compute[74743]: INFO os_vif [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:83:d5,bridge_name='br-int',has_traffic_filtering=True,id=6e3b96b3-1a83-4b25-ad28-cf77e11ff137,network=Network(2588909e-8504-407d-bc7b-5d1f3d978395),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e3b96b3-1a')
Nov 18 17:08:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:08:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] No VIF found with MAC fa:16:3e:34:83:d5, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:08:21 user nova-compute[74743]: DEBUG nova.network.neutron [req-c5b9a2b5-d392-4068-a438-5176c07ee486 req-45e0c691-3030-4509-a4ad-c7df5ddd3fa0 service nova] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Updated VIF entry in instance network info cache for port 6e3b96b3-1a83-4b25-ad28-cf77e11ff137. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:08:21 user nova-compute[74743]: DEBUG nova.network.neutron [req-c5b9a2b5-d392-4068-a438-5176c07ee486 req-45e0c691-3030-4509-a4ad-c7df5ddd3fa0 service nova] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Updating instance_info_cache with network_info: [{"id": "6e3b96b3-1a83-4b25-ad28-cf77e11ff137", "address": "fa:16:3e:34:83:d5", "network": {"id": "2588909e-8504-407d-bc7b-5d1f3d978395", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1712970821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468d0e7ff32423091ecc55d82deba1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e3b96b3-1a", "ovs_interfaceid": "6e3b96b3-1a83-4b25-ad28-cf77e11ff137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:08:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-c5b9a2b5-d392-4068-a438-5176c07ee486 req-45e0c691-3030-4509-a4ad-c7df5ddd3fa0 service nova] Releasing lock "refresh_cache-8a9b12da-02c5-42ba-b215-a20df0e3ea4f" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:08:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:23 user nova-compute[74743]: DEBUG nova.compute.manager [req-37caa0b0-5d33-4841-bbee-f9c0cf2d9860 req-c228a0d1-7f7c-41e9-852e-a57f6c76197c service nova] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Received event network-vif-plugged-6e3b96b3-1a83-4b25-ad28-cf77e11ff137 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:08:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-37caa0b0-5d33-4841-bbee-f9c0cf2d9860 req-c228a0d1-7f7c-41e9-852e-a57f6c76197c service nova] Acquiring lock "8a9b12da-02c5-42ba-b215-a20df0e3ea4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:08:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-37caa0b0-5d33-4841-bbee-f9c0cf2d9860 req-c228a0d1-7f7c-41e9-852e-a57f6c76197c service nova] Lock "8a9b12da-02c5-42ba-b215-a20df0e3ea4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:08:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-37caa0b0-5d33-4841-bbee-f9c0cf2d9860 req-c228a0d1-7f7c-41e9-852e-a57f6c76197c service nova] Lock "8a9b12da-02c5-42ba-b215-a20df0e3ea4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:08:23 user nova-compute[74743]: DEBUG nova.compute.manager [req-37caa0b0-5d33-4841-bbee-f9c0cf2d9860 req-c228a0d1-7f7c-41e9-852e-a57f6c76197c service nova] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] No waiting events found dispatching network-vif-plugged-6e3b96b3-1a83-4b25-ad28-cf77e11ff137 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:08:23 user nova-compute[74743]: WARNING nova.compute.manager [req-37caa0b0-5d33-4841-bbee-f9c0cf2d9860 req-c228a0d1-7f7c-41e9-852e-a57f6c76197c service nova] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Received unexpected event network-vif-plugged-6e3b96b3-1a83-4b25-ad28-cf77e11ff137 for instance with vm_state building and task_state spawning.
Nov 18 17:08:23 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:24 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:24 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:24 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:24 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-6d8f2949-7b7f-48da-a320-a7c772c5ea63 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Acquiring lock "39e15045-0a84-4b48-a962-c006b6c747b3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:08:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-6d8f2949-7b7f-48da-a320-a7c772c5ea63 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Lock "39e15045-0a84-4b48-a962-c006b6c747b3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:08:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-6d8f2949-7b7f-48da-a320-a7c772c5ea63 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Acquiring lock "39e15045-0a84-4b48-a962-c006b6c747b3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:08:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-6d8f2949-7b7f-48da-a320-a7c772c5ea63 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Lock "39e15045-0a84-4b48-a962-c006b6c747b3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:08:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-6d8f2949-7b7f-48da-a320-a7c772c5ea63 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Lock "39e15045-0a84-4b48-a962-c006b6c747b3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:08:25 user nova-compute[74743]: INFO nova.compute.manager [None req-6d8f2949-7b7f-48da-a320-a7c772c5ea63 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Terminating instance
Nov 18 17:08:25 user nova-compute[74743]: DEBUG nova.compute.manager [None req-6d8f2949-7b7f-48da-a320-a7c772c5ea63 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Start destroying the instance on the hypervisor. {{(pid=74743) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 17:08:25 user nova-compute[74743]: DEBUG nova.compute.manager [req-258e4788-0758-420d-b48d-fb37c4c1fa27 req-fe0dce42-4094-41d0-81b0-3c9f77eee97d service nova] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Received event network-vif-plugged-6e3b96b3-1a83-4b25-ad28-cf77e11ff137 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:08:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-258e4788-0758-420d-b48d-fb37c4c1fa27 req-fe0dce42-4094-41d0-81b0-3c9f77eee97d service nova] Acquiring lock "8a9b12da-02c5-42ba-b215-a20df0e3ea4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:08:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-258e4788-0758-420d-b48d-fb37c4c1fa27 req-fe0dce42-4094-41d0-81b0-3c9f77eee97d service nova] Lock "8a9b12da-02c5-42ba-b215-a20df0e3ea4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:08:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-258e4788-0758-420d-b48d-fb37c4c1fa27 req-fe0dce42-4094-41d0-81b0-3c9f77eee97d service nova] Lock "8a9b12da-02c5-42ba-b215-a20df0e3ea4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:08:25 user nova-compute[74743]: DEBUG nova.compute.manager [req-258e4788-0758-420d-b48d-fb37c4c1fa27 req-fe0dce42-4094-41d0-81b0-3c9f77eee97d service nova] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] No waiting events found dispatching network-vif-plugged-6e3b96b3-1a83-4b25-ad28-cf77e11ff137 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:08:25 user nova-compute[74743]: WARNING nova.compute.manager [req-258e4788-0758-420d-b48d-fb37c4c1fa27 req-fe0dce42-4094-41d0-81b0-3c9f77eee97d service nova] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Received unexpected event network-vif-plugged-6e3b96b3-1a83-4b25-ad28-cf77e11ff137 for instance with vm_state building and task_state spawning.
Nov 18 17:08:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:25 user nova-compute[74743]: DEBUG nova.compute.manager [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:08:25 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Guest created on hypervisor {{(pid=74743) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 17:08:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:25 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Instance spawned successfully.
Nov 18 17:08:25 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 17:08:25 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Found default for hw_cdrom_bus of ide {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:08:25 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Found default for hw_disk_bus of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:08:25 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Found default for hw_input_bus of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:08:25 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Found default for hw_pointer_model of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:08:25 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Found default for hw_video_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:08:25 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Found default for hw_vif_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:08:25 user nova-compute[74743]: INFO nova.compute.manager [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Took 6.30 seconds to spawn the instance on the hypervisor.
Nov 18 17:08:25 user nova-compute[74743]: DEBUG nova.compute.manager [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:08:25 user nova-compute[74743]: INFO nova.compute.manager [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Took 8.21 seconds to build instance.
Nov 18 17:08:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-5097a366-6dee-472b-83d1-cb15dab6d3d2 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "8a9b12da-02c5-42ba-b215-a20df0e3ea4f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.361s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:08:25 user nova-compute[74743]: DEBUG nova.compute.manager [req-1ff38f91-0e8f-45ee-8bdf-e5c419c104c9 req-9bf0755c-5285-4e25-85ee-7bfcf6dfa7d0 service nova] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Received event network-vif-unplugged-eec59f5d-4379-4f07-b4cb-f56b388fca0a {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:08:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-1ff38f91-0e8f-45ee-8bdf-e5c419c104c9 req-9bf0755c-5285-4e25-85ee-7bfcf6dfa7d0 service nova] Acquiring lock "39e15045-0a84-4b48-a962-c006b6c747b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:08:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-1ff38f91-0e8f-45ee-8bdf-e5c419c104c9 req-9bf0755c-5285-4e25-85ee-7bfcf6dfa7d0 service nova] Lock "39e15045-0a84-4b48-a962-c006b6c747b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:08:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-1ff38f91-0e8f-45ee-8bdf-e5c419c104c9 req-9bf0755c-5285-4e25-85ee-7bfcf6dfa7d0 service nova] Lock "39e15045-0a84-4b48-a962-c006b6c747b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:08:25 user nova-compute[74743]: DEBUG nova.compute.manager [req-1ff38f91-0e8f-45ee-8bdf-e5c419c104c9 req-9bf0755c-5285-4e25-85ee-7bfcf6dfa7d0 service nova] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] No waiting events found dispatching network-vif-unplugged-eec59f5d-4379-4f07-b4cb-f56b388fca0a {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:08:25 user nova-compute[74743]: DEBUG nova.compute.manager [req-1ff38f91-0e8f-45ee-8bdf-e5c419c104c9 req-9bf0755c-5285-4e25-85ee-7bfcf6dfa7d0 service nova] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Received event network-vif-unplugged-eec59f5d-4379-4f07-b4cb-f56b388fca0a for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:08:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:26 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Instance destroyed successfully.
Nov 18 17:08:26 user nova-compute[74743]: DEBUG nova.objects.instance [None req-6d8f2949-7b7f-48da-a320-a7c772c5ea63 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Lazy-loading 'resources' on Instance uuid 39e15045-0a84-4b48-a962-c006b6c747b3 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:08:26 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-6d8f2949-7b7f-48da-a320-a7c772c5ea63 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:05:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-136508521',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-136508521',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1365085',id=12,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCY9v376v12iHPTn5Jtyl4n1foaPCisWGmqHQBpFJ6SNiXM2qGq2yc0TuZ+fOvMFYq8onwGKyqOghMBII2zwzVUbwRaBy+CSo/wQfbKk4gGo14xOqlcPyO+UpVFA9zibTA==',key_name='tempest-keypair-1893785406',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:05:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b814ffb2501544a6a5c669df102db2d4',ramdisk_id='',reservation_id='r-n0bec0hg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-204264382',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:05:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c20e517153644747a9284535f032c3cb',uuid=39e15045-0a84-4b48-a962-c006b6c747b3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eec59f5d-4379-4f07-b4cb-f56b388fca0a", "address": "fa:16:3e:1e:8b:be", "network": {"id": "0aaa14d8-7754-499d-8438-fd1229fddc6a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-589739381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b814ffb2501544a6a5c669df102db2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeec59f5d-43", "ovs_interfaceid": "eec59f5d-4379-4f07-b4cb-f56b388fca0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:08:26 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-6d8f2949-7b7f-48da-a320-a7c772c5ea63 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Converting VIF {"id": "eec59f5d-4379-4f07-b4cb-f56b388fca0a", "address": "fa:16:3e:1e:8b:be", "network": {"id": "0aaa14d8-7754-499d-8438-fd1229fddc6a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-589739381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b814ffb2501544a6a5c669df102db2d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeec59f5d-43", "ovs_interfaceid": "eec59f5d-4379-4f07-b4cb-f56b388fca0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:08:26 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-6d8f2949-7b7f-48da-a320-a7c772c5ea63 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:8b:be,bridge_name='br-int',has_traffic_filtering=True,id=eec59f5d-4379-4f07-b4cb-f56b388fca0a,network=Network(0aaa14d8-7754-499d-8438-fd1229fddc6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeec59f5d-43') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:08:26 user nova-compute[74743]: DEBUG os_vif [None req-6d8f2949-7b7f-48da-a320-a7c772c5ea63 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:8b:be,bridge_name='br-int',has_traffic_filtering=True,id=eec59f5d-4379-4f07-b4cb-f56b388fca0a,network=Network(0aaa14d8-7754-499d-8438-fd1229fddc6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeec59f5d-43') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:08:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeec59f5d-43, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:08:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:08:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=043af2a4-9ac7-4ba0-946d-90b7c85875f2) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:08:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:08:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:26 user nova-compute[74743]: INFO os_vif [None req-6d8f2949-7b7f-48da-a320-a7c772c5ea63 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:8b:be,bridge_name='br-int',has_traffic_filtering=True,id=eec59f5d-4379-4f07-b4cb-f56b388fca0a,network=Network(0aaa14d8-7754-499d-8438-fd1229fddc6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeec59f5d-43')
Nov 18 17:08:26 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-6d8f2949-7b7f-48da-a320-a7c772c5ea63 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Deleting instance files /opt/stack/data/nova/instances/39e15045-0a84-4b48-a962-c006b6c747b3_del
Nov 18 17:08:26 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-6d8f2949-7b7f-48da-a320-a7c772c5ea63 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Deletion of /opt/stack/data/nova/instances/39e15045-0a84-4b48-a962-c006b6c747b3_del complete
Nov 18 17:08:26 user nova-compute[74743]: INFO nova.compute.manager [None req-6d8f2949-7b7f-48da-a320-a7c772c5ea63 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 18 17:08:26 user nova-compute[74743]: DEBUG oslo.service.loopingcall [None req-6d8f2949-7b7f-48da-a320-a7c772c5ea63 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74743) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 17:08:26 user nova-compute[74743]: DEBUG nova.compute.manager [-] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Deallocating network for instance {{(pid=74743) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 17:08:26 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] deallocate_for_instance() {{(pid=74743) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 17:08:27 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:08:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Acquiring lock "e2b51739-7900-47bd-a01e-2e83e2f13ae1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:08:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Lock "e2b51739-7900-47bd-a01e-2e83e2f13ae1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:08:27 user nova-compute[74743]: INFO nova.compute.manager [-] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Took 1.02 seconds to deallocate network for instance.
Nov 18 17:08:27 user nova-compute[74743]: DEBUG nova.compute.manager [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Starting instance... {{(pid=74743) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 17:08:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-6d8f2949-7b7f-48da-a320-a7c772c5ea63 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:08:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-6d8f2949-7b7f-48da-a320-a7c772c5ea63 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:08:27 user nova-compute[74743]: DEBUG nova.compute.manager [req-a2e7eb9c-c92f-43d0-83b6-52930f48127c req-4ff3cfbf-78c9-4e78-b2d8-eb775a4473c9 service nova] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Received event network-vif-deleted-eec59f5d-4379-4f07-b4cb-f56b388fca0a {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:08:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:08:27 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-6d8f2949-7b7f-48da-a320-a7c772c5ea63 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:08:27 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-6d8f2949-7b7f-48da-a320-a7c772c5ea63 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:08:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-6d8f2949-7b7f-48da-a320-a7c772c5ea63 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.451s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:08:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.366s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:08:27 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74743) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 17:08:27 user nova-compute[74743]: INFO nova.compute.claims [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Claim successful on node user
Nov 18 17:08:27 user nova-compute[74743]: INFO nova.scheduler.client.report [None req-6d8f2949-7b7f-48da-a320-a7c772c5ea63 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Deleted allocations for instance 39e15045-0a84-4b48-a962-c006b6c747b3
Nov 18 17:08:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-6d8f2949-7b7f-48da-a320-a7c772c5ea63 tempest-TestServerVolumeAttachScenarioOldVersion-204264382 tempest-TestServerVolumeAttachScenarioOldVersion-204264382-project-member] Lock "39e15045-0a84-4b48-a962-c006b6c747b3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.853s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:08:28 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:08:28 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:08:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.447s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:08:28 user nova-compute[74743]: DEBUG nova.compute.manager [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Start building networks asynchronously for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 17:08:28 user nova-compute[74743]: DEBUG nova.compute.manager [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Allocating IP information in the background. {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 17:08:28 user nova-compute[74743]: DEBUG nova.network.neutron [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] allocate_for_instance() {{(pid=74743) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 17:08:28 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 17:08:28 user nova-compute[74743]: DEBUG nova.compute.manager [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Start building block device mappings for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 17:08:28 user nova-compute[74743]: DEBUG nova.policy [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eb774fdb80ef465187caf4ffd2422e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15d7007a99745f1a308b64514566129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74743) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 17:08:28 user nova-compute[74743]: DEBUG nova.compute.manager [req-484b8639-47e5-4695-8d49-46734999d853 req-a2315629-e092-41f3-8044-b18c7569d85c service nova] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Received event network-vif-plugged-eec59f5d-4379-4f07-b4cb-f56b388fca0a {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:08:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-484b8639-47e5-4695-8d49-46734999d853 req-a2315629-e092-41f3-8044-b18c7569d85c service nova] Acquiring lock "39e15045-0a84-4b48-a962-c006b6c747b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:08:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-484b8639-47e5-4695-8d49-46734999d853 req-a2315629-e092-41f3-8044-b18c7569d85c service nova] Lock "39e15045-0a84-4b48-a962-c006b6c747b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:08:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-484b8639-47e5-4695-8d49-46734999d853 req-a2315629-e092-41f3-8044-b18c7569d85c service nova] Lock "39e15045-0a84-4b48-a962-c006b6c747b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:08:28 user nova-compute[74743]: DEBUG nova.compute.manager [req-484b8639-47e5-4695-8d49-46734999d853 req-a2315629-e092-41f3-8044-b18c7569d85c service nova] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] No waiting events found dispatching network-vif-plugged-eec59f5d-4379-4f07-b4cb-f56b388fca0a {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:08:28 user nova-compute[74743]: WARNING nova.compute.manager [req-484b8639-47e5-4695-8d49-46734999d853 req-a2315629-e092-41f3-8044-b18c7569d85c service nova] [instance: 39e15045-0a84-4b48-a962-c006b6c747b3] Received unexpected event network-vif-plugged-eec59f5d-4379-4f07-b4cb-f56b388fca0a for instance with vm_state deleted and task_state None.
Nov 18 17:08:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:28 user nova-compute[74743]: DEBUG nova.compute.manager [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Start spawning the instance on the hypervisor. {{(pid=74743) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 17:08:28 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Creating instance directory {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 17:08:28 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Creating image(s)
Nov 18 17:08:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Acquiring lock "/opt/stack/data/nova/instances/e2b51739-7900-47bd-a01e-2e83e2f13ae1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:08:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Lock "/opt/stack/data/nova/instances/e2b51739-7900-47bd-a01e-2e83e2f13ae1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:08:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Lock "/opt/stack/data/nova/instances/e2b51739-7900-47bd-a01e-2e83e2f13ae1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:08:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:08:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.244s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:08:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Acquiring lock "c188b3a997bfafa42fa341f9dcc326545681eed9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:08:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:08:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:08:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.231s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:08:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/e2b51739-7900-47bd-a01e-2e83e2f13ae1/disk 1073741824 {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:08:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/e2b51739-7900-47bd-a01e-2e83e2f13ae1/disk 1073741824" returned: 0 in 0.077s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:08:29 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.316s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:08:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:08:29 user nova-compute[74743]: DEBUG nova.network.neutron [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Successfully created port: 14c7e1ef-5997-4e7f-aebf-baa01bec87a6 {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:08:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.201s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:08:29 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e2b51739-7900-47bd-a01e-2e83e2f13ae1/disk. size=1073741824 {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 17:08:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b51739-7900-47bd-a01e-2e83e2f13ae1/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:08:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b51739-7900-47bd-a01e-2e83e2f13ae1/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:08:29 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Cannot resize image /opt/stack/data/nova/instances/e2b51739-7900-47bd-a01e-2e83e2f13ae1/disk to a smaller size. {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 17:08:29 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Created local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 17:08:29 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Ensure instance console log exists: /opt/stack/data/nova/instances/e2b51739-7900-47bd-a01e-2e83e2f13ae1/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:08:29 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:08:29 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:08:29 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:08:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG nova.network.neutron [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Successfully updated port: 14c7e1ef-5997-4e7f-aebf-baa01bec87a6 {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Acquiring lock "refresh_cache-e2b51739-7900-47bd-a01e-2e83e2f13ae1" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Acquired lock "refresh_cache-e2b51739-7900-47bd-a01e-2e83e2f13ae1" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG nova.network.neutron [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG nova.compute.manager [req-6d43a60f-942e-444b-8602-5846f753a69c req-f35def9c-45de-4e6b-b24f-546ca376bb6f service nova] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Received event network-changed-14c7e1ef-5997-4e7f-aebf-baa01bec87a6 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG nova.compute.manager [req-6d43a60f-942e-444b-8602-5846f753a69c req-f35def9c-45de-4e6b-b24f-546ca376bb6f service nova] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Refreshing instance network info cache due to event network-changed-14c7e1ef-5997-4e7f-aebf-baa01bec87a6. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-6d43a60f-942e-444b-8602-5846f753a69c req-f35def9c-45de-4e6b-b24f-546ca376bb6f service nova] Acquiring lock "refresh_cache-e2b51739-7900-47bd-a01e-2e83e2f13ae1" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG nova.network.neutron [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Starting heal instance info cache {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG nova.network.neutron [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Updating instance_info_cache with network_info: [{"id": "14c7e1ef-5997-4e7f-aebf-baa01bec87a6", "address": "fa:16:3e:2d:fd:f9", "network": {"id": "f6455510-3862-45cf-b6d7-7d92905b0554", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-6755490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c15d7007a99745f1a308b64514566129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c7e1ef-59", "ovs_interfaceid": "14c7e1ef-5997-4e7f-aebf-baa01bec87a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Didn't find any instances for network info cache update. {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74743) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Releasing lock "refresh_cache-e2b51739-7900-47bd-a01e-2e83e2f13ae1" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG nova.compute.manager [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Instance network_info: |[{"id": "14c7e1ef-5997-4e7f-aebf-baa01bec87a6", "address": "fa:16:3e:2d:fd:f9", "network": {"id": "f6455510-3862-45cf-b6d7-7d92905b0554", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-6755490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c15d7007a99745f1a308b64514566129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c7e1ef-59", "ovs_interfaceid": "14c7e1ef-5997-4e7f-aebf-baa01bec87a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-6d43a60f-942e-444b-8602-5846f753a69c req-f35def9c-45de-4e6b-b24f-546ca376bb6f service nova] Acquired lock "refresh_cache-e2b51739-7900-47bd-a01e-2e83e2f13ae1" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG nova.network.neutron [req-6d43a60f-942e-444b-8602-5846f753a69c req-f35def9c-45de-4e6b-b24f-546ca376bb6f service nova] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Refreshing network info cache for port 14c7e1ef-5997-4e7f-aebf-baa01bec87a6 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Start _get_guest_xml network_info=[{"id": "14c7e1ef-5997-4e7f-aebf-baa01bec87a6", "address": "fa:16:3e:2d:fd:f9", "network": {"id": "f6455510-3862-45cf-b6d7-7d92905b0554", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-6755490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c15d7007a99745f1a308b64514566129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c7e1ef-59", "ovs_interfaceid": "14c7e1ef-5997-4e7f-aebf-baa01bec87a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '9536f6cf-95c4-40e2-864a-09a91525678a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Auditing locally available compute resources for user (node: user) {{(pid=74743) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 17:08:30 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:08:30 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:08:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T17:08:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-411956172',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-411956172',id=19,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIsbQN9tS0qcOOC8WPSSYsTCVNWYWYH/K8oXwrg2jt5ZqyybStsLpAIghGB8s0OC3gX9C23pdQMdiUELbHV4Nj+tyYgRoCwRrAGlWKX/+zFnGGmym65cFn63wRBKph/3bw==',key_name='tempest-keypair-1379891500',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c15d7007a99745f1a308b64514566129',ramdisk_id='',reservation_id='r-xbgsfk5e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1465741228',owner_user_name='tempest-TaggedAttachmentsTest-1465741228-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:08:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb774fdb80ef465187caf4ffd2422e83',uuid=e2b51739-7900-47bd-a01e-2e83e2f13ae1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14c7e1ef-5997-4e7f-aebf-baa01bec87a6", "address": "fa:16:3e:2d:fd:f9", "network": {"id": "f6455510-3862-45cf-b6d7-7d92905b0554", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-6755490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c15d7007a99745f1a308b64514566129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c7e1ef-59", "ovs_interfaceid": "14c7e1ef-5997-4e7f-aebf-baa01bec87a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Converting VIF {"id": "14c7e1ef-5997-4e7f-aebf-baa01bec87a6", "address": "fa:16:3e:2d:fd:f9", "network": {"id": "f6455510-3862-45cf-b6d7-7d92905b0554", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-6755490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c15d7007a99745f1a308b64514566129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c7e1ef-59", "ovs_interfaceid": "14c7e1ef-5997-4e7f-aebf-baa01bec87a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:fd:f9,bridge_name='br-int',has_traffic_filtering=True,id=14c7e1ef-5997-4e7f-aebf-baa01bec87a6,network=Network(f6455510-3862-45cf-b6d7-7d92905b0554),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14c7e1ef-59') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG nova.objects.instance [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Lazy-loading 'pci_devices' on Instance uuid e2b51739-7900-47bd-a01e-2e83e2f13ae1 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:08:30 user nova-compute[74743]:   <uuid>e2b51739-7900-47bd-a01e-2e83e2f13ae1</uuid>
Nov 18 17:08:30 user nova-compute[74743]:   <name>instance-00000013</name>
Nov 18 17:08:30 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:08:30 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:08:30 user nova-compute[74743]:   <metadata>
Nov 18 17:08:30 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:08:30 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:08:30 user nova-compute[74743]:       <nova:name>tempest-device-tagging-server-411956172</nova:name>
Nov 18 17:08:30 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:08:30</nova:creationTime>
Nov 18 17:08:30 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:08:30 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:08:30 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:08:30 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:08:30 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:08:30 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:08:30 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:08:30 user nova-compute[74743]:       <nova:owner>
Nov 18 17:08:30 user nova-compute[74743]:         <nova:user uuid="eb774fdb80ef465187caf4ffd2422e83">tempest-TaggedAttachmentsTest-1465741228-project-member</nova:user>
Nov 18 17:08:30 user nova-compute[74743]:         <nova:project uuid="c15d7007a99745f1a308b64514566129">tempest-TaggedAttachmentsTest-1465741228</nova:project>
Nov 18 17:08:30 user nova-compute[74743]:       </nova:owner>
Nov 18 17:08:30 user nova-compute[74743]:       <nova:root type="image" uuid="9536f6cf-95c4-40e2-864a-09a91525678a"/>
Nov 18 17:08:30 user nova-compute[74743]:       <nova:ports>
Nov 18 17:08:30 user nova-compute[74743]:         <nova:port uuid="14c7e1ef-5997-4e7f-aebf-baa01bec87a6">
Nov 18 17:08:30 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 18 17:08:30 user nova-compute[74743]:         </nova:port>
Nov 18 17:08:30 user nova-compute[74743]:       </nova:ports>
Nov 18 17:08:30 user nova-compute[74743]:     </nova:instance>
Nov 18 17:08:30 user nova-compute[74743]:   </metadata>
Nov 18 17:08:30 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:08:30 user nova-compute[74743]:     <system>
Nov 18 17:08:30 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:08:30 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:08:30 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:08:30 user nova-compute[74743]:       <entry name="serial">e2b51739-7900-47bd-a01e-2e83e2f13ae1</entry>
Nov 18 17:08:30 user nova-compute[74743]:       <entry name="uuid">e2b51739-7900-47bd-a01e-2e83e2f13ae1</entry>
Nov 18 17:08:30 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:08:30 user nova-compute[74743]:     </system>
Nov 18 17:08:30 user nova-compute[74743]:   </sysinfo>
Nov 18 17:08:30 user nova-compute[74743]:   <os>
Nov 18 17:08:30 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:08:30 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:08:30 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:08:30 user nova-compute[74743]:   </os>
Nov 18 17:08:30 user nova-compute[74743]:   <features>
Nov 18 17:08:30 user nova-compute[74743]:     <acpi/>
Nov 18 17:08:30 user nova-compute[74743]:     <apic/>
Nov 18 17:08:30 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:08:30 user nova-compute[74743]:   </features>
Nov 18 17:08:30 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:08:30 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:08:30 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:08:30 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:08:30 user nova-compute[74743]:   </clock>
Nov 18 17:08:30 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:08:30 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:08:30 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:08:30 user nova-compute[74743]:   </cpu>
Nov 18 17:08:30 user nova-compute[74743]:   <devices>
Nov 18 17:08:30 user nova-compute[74743]:     <disk type="file" device="disk">
Nov 18 17:08:30 user nova-compute[74743]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 17:08:30 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/e2b51739-7900-47bd-a01e-2e83e2f13ae1/disk"/>
Nov 18 17:08:30 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:08:30 user nova-compute[74743]:     </disk>
Nov 18 17:08:30 user nova-compute[74743]:     <disk type="file" device="cdrom">
Nov 18 17:08:30 user nova-compute[74743]:       <driver name="qemu" type="raw" cache="none"/>
Nov 18 17:08:30 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/e2b51739-7900-47bd-a01e-2e83e2f13ae1/disk.config"/>
Nov 18 17:08:30 user nova-compute[74743]:       <target dev="hda" bus="ide"/>
Nov 18 17:08:30 user nova-compute[74743]:     </disk>
Nov 18 17:08:30 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:08:30 user nova-compute[74743]:       <mac address="fa:16:3e:2d:fd:f9"/>
Nov 18 17:08:30 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:08:30 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:08:30 user nova-compute[74743]:       <target dev="tap14c7e1ef-59"/>
Nov 18 17:08:30 user nova-compute[74743]:     </interface>
Nov 18 17:08:30 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:08:30 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/e2b51739-7900-47bd-a01e-2e83e2f13ae1/console.log" append="off"/>
Nov 18 17:08:30 user nova-compute[74743]:     </serial>
Nov 18 17:08:30 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:08:30 user nova-compute[74743]:     <video>
Nov 18 17:08:30 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:08:30 user nova-compute[74743]:     </video>
Nov 18 17:08:30 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:08:30 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:08:30 user nova-compute[74743]:     </rng>
Nov 18 17:08:30 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:08:30 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:08:30 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:08:30 user nova-compute[74743]:     </memballoon>
Nov 18 17:08:30 user nova-compute[74743]:   </devices>
Nov 18 17:08:30 user nova-compute[74743]: </domain>
Nov 18 17:08:30 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T17:08:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-411956172',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-411956172',id=19,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIsbQN9tS0qcOOC8WPSSYsTCVNWYWYH/K8oXwrg2jt5ZqyybStsLpAIghGB8s0OC3gX9C23pdQMdiUELbHV4Nj+tyYgRoCwRrAGlWKX/+zFnGGmym65cFn63wRBKph/3bw==',key_name='tempest-keypair-1379891500',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c15d7007a99745f1a308b64514566129',ramdisk_id='',reservation_id='r-xbgsfk5e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1465741228',owner_user_name='tempest-TaggedAttachmentsTest-1465741228-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:08:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb774fdb80ef465187caf4ffd2422e83',uuid=e2b51739-7900-47bd-a01e-2e83e2f13ae1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14c7e1ef-5997-4e7f-aebf-baa01bec87a6", "address": "fa:16:3e:2d:fd:f9", "network": {"id": "f6455510-3862-45cf-b6d7-7d92905b0554", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-6755490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c15d7007a99745f1a308b64514566129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c7e1ef-59", "ovs_interfaceid": "14c7e1ef-5997-4e7f-aebf-baa01bec87a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Converting VIF {"id": "14c7e1ef-5997-4e7f-aebf-baa01bec87a6", "address": "fa:16:3e:2d:fd:f9", "network": {"id": "f6455510-3862-45cf-b6d7-7d92905b0554", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-6755490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c15d7007a99745f1a308b64514566129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c7e1ef-59", "ovs_interfaceid": "14c7e1ef-5997-4e7f-aebf-baa01bec87a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:fd:f9,bridge_name='br-int',has_traffic_filtering=True,id=14c7e1ef-5997-4e7f-aebf-baa01bec87a6,network=Network(f6455510-3862-45cf-b6d7-7d92905b0554),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14c7e1ef-59') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG os_vif [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:fd:f9,bridge_name='br-int',has_traffic_filtering=True,id=14c7e1ef-5997-4e7f-aebf-baa01bec87a6,network=Network(f6455510-3862-45cf-b6d7-7d92905b0554),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14c7e1ef-59') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a4532c2a-c52a-5df6-9553-26bb23915202', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap14c7e1ef-59, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap14c7e1ef-59, col_values=(('qos', UUID('15d92045-ab42-41b5-9cca-c19b7f2b1b7e')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap14c7e1ef-59, col_values=(('external_ids', {'iface-id': '14c7e1ef-5997-4e7f-aebf-baa01bec87a6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:fd:f9', 'vm-uuid': 'e2b51739-7900-47bd-a01e-2e83e2f13ae1'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:30 user nova-compute[74743]: INFO os_vif [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:fd:f9,bridge_name='br-int',has_traffic_filtering=True,id=14c7e1ef-5997-4e7f-aebf-baa01bec87a6,network=Network(f6455510-3862-45cf-b6d7-7d92905b0554),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14c7e1ef-59')
Nov 18 17:08:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] No BDM found with device name hda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:08:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] No VIF found with MAC fa:16:3e:2d:fd:f9, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:08:30 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Using config drive
Nov 18 17:08:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:08:31 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Creating config drive at /opt/stack/data/nova/instances/e2b51739-7900-47bd-a01e-2e83e2f13ae1/disk.config
Nov 18 17:08:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e2b51739-7900-47bd-a01e-2e83e2f13ae1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp0trqi680 {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:08:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:08:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:08:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e2b51739-7900-47bd-a01e-2e83e2f13ae1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp0trqi680" returned: 0 in 0.096s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:08:31 user nova-compute[74743]: DEBUG nova.network.neutron [req-6d43a60f-942e-444b-8602-5846f753a69c req-f35def9c-45de-4e6b-b24f-546ca376bb6f service nova] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Updated VIF entry in instance network info cache for port 14c7e1ef-5997-4e7f-aebf-baa01bec87a6. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:08:31 user nova-compute[74743]: DEBUG nova.network.neutron [req-6d43a60f-942e-444b-8602-5846f753a69c req-f35def9c-45de-4e6b-b24f-546ca376bb6f service nova] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Updating instance_info_cache with network_info: [{"id": "14c7e1ef-5997-4e7f-aebf-baa01bec87a6", "address": "fa:16:3e:2d:fd:f9", "network": {"id": "f6455510-3862-45cf-b6d7-7d92905b0554", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-6755490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c15d7007a99745f1a308b64514566129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c7e1ef-59", "ovs_interfaceid": "14c7e1ef-5997-4e7f-aebf-baa01bec87a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:08:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-6d43a60f-942e-444b-8602-5846f753a69c req-f35def9c-45de-4e6b-b24f-546ca376bb6f service nova] Releasing lock "refresh_cache-e2b51739-7900-47bd-a01e-2e83e2f13ae1" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:08:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:08:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:08:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:08:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:08:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:08:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:08:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:08:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:08:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:08:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efcddf77-9300-4211-aa2d-31e99a37a180/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:08:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efcddf77-9300-4211-aa2d-31e99a37a180/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:08:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efcddf77-9300-4211-aa2d-31e99a37a180/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:08:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4836037d-cb75-4b85-a9cb-fddabc5d08bf tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Acquiring lock "efcddf77-9300-4211-aa2d-31e99a37a180" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:08:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4836037d-cb75-4b85-a9cb-fddabc5d08bf tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Lock "efcddf77-9300-4211-aa2d-31e99a37a180" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:08:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4836037d-cb75-4b85-a9cb-fddabc5d08bf tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Acquiring lock "efcddf77-9300-4211-aa2d-31e99a37a180-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:08:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4836037d-cb75-4b85-a9cb-fddabc5d08bf tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Lock "efcddf77-9300-4211-aa2d-31e99a37a180-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:08:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4836037d-cb75-4b85-a9cb-fddabc5d08bf tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Lock "efcddf77-9300-4211-aa2d-31e99a37a180-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:08:32 user nova-compute[74743]: INFO nova.compute.manager [None req-4836037d-cb75-4b85-a9cb-fddabc5d08bf tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Terminating instance
Nov 18 17:08:32 user nova-compute[74743]: DEBUG nova.compute.manager [None req-4836037d-cb75-4b85-a9cb-fddabc5d08bf tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Start destroying the instance on the hypervisor. {{(pid=74743) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 17:08:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efcddf77-9300-4211-aa2d-31e99a37a180/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:08:32 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:08:32 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:08:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:08:32 user nova-compute[74743]: DEBUG nova.compute.manager [req-36420175-69a4-4283-958e-f2b0f62c1b76 req-1c6e4e90-7c13-4b00-afc2-167571e05c47 service nova] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Received event network-vif-unplugged-05e8b2a9-abd7-42e3-b532-af63aed5d299 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:08:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-36420175-69a4-4283-958e-f2b0f62c1b76 req-1c6e4e90-7c13-4b00-afc2-167571e05c47 service nova] Acquiring lock "efcddf77-9300-4211-aa2d-31e99a37a180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:08:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-36420175-69a4-4283-958e-f2b0f62c1b76 req-1c6e4e90-7c13-4b00-afc2-167571e05c47 service nova] Lock "efcddf77-9300-4211-aa2d-31e99a37a180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:08:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-36420175-69a4-4283-958e-f2b0f62c1b76 req-1c6e4e90-7c13-4b00-afc2-167571e05c47 service nova] Lock "efcddf77-9300-4211-aa2d-31e99a37a180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:08:32 user nova-compute[74743]: DEBUG nova.compute.manager [req-36420175-69a4-4283-958e-f2b0f62c1b76 req-1c6e4e90-7c13-4b00-afc2-167571e05c47 service nova] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] No waiting events found dispatching network-vif-unplugged-05e8b2a9-abd7-42e3-b532-af63aed5d299 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:08:32 user nova-compute[74743]: DEBUG nova.compute.manager [req-36420175-69a4-4283-958e-f2b0f62c1b76 req-1c6e4e90-7c13-4b00-afc2-167571e05c47 service nova] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Received event network-vif-unplugged-05e8b2a9-abd7-42e3-b532-af63aed5d299 for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:08:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:08:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77117a2-748d-4a39-8db7-8b965a1725fc/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:08:33 user nova-compute[74743]: DEBUG nova.compute.manager [req-6d373c9c-aa1d-4114-baa7-efb096897541 req-4e259deb-0e1f-4bb3-8f42-5eca05cc9f36 service nova] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Received event network-vif-plugged-14c7e1ef-5997-4e7f-aebf-baa01bec87a6 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:08:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-6d373c9c-aa1d-4114-baa7-efb096897541 req-4e259deb-0e1f-4bb3-8f42-5eca05cc9f36 service nova] Acquiring lock "e2b51739-7900-47bd-a01e-2e83e2f13ae1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:08:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-6d373c9c-aa1d-4114-baa7-efb096897541 req-4e259deb-0e1f-4bb3-8f42-5eca05cc9f36 service nova] Lock "e2b51739-7900-47bd-a01e-2e83e2f13ae1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:08:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-6d373c9c-aa1d-4114-baa7-efb096897541 req-4e259deb-0e1f-4bb3-8f42-5eca05cc9f36 service nova] Lock "e2b51739-7900-47bd-a01e-2e83e2f13ae1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:08:33 user nova-compute[74743]: DEBUG nova.compute.manager [req-6d373c9c-aa1d-4114-baa7-efb096897541 req-4e259deb-0e1f-4bb3-8f42-5eca05cc9f36 service nova] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] No waiting events found dispatching network-vif-plugged-14c7e1ef-5997-4e7f-aebf-baa01bec87a6 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:08:33 user nova-compute[74743]: WARNING nova.compute.manager [req-6d373c9c-aa1d-4114-baa7-efb096897541 req-4e259deb-0e1f-4bb3-8f42-5eca05cc9f36 service nova] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Received unexpected event network-vif-plugged-14c7e1ef-5997-4e7f-aebf-baa01bec87a6 for instance with vm_state building and task_state spawning.
Nov 18 17:08:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77117a2-748d-4a39-8db7-8b965a1725fc/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:08:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77117a2-748d-4a39-8db7-8b965a1725fc/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:08:33 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:33 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:33 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:33 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Instance destroyed successfully.
Nov 18 17:08:33 user nova-compute[74743]: DEBUG nova.objects.instance [None req-4836037d-cb75-4b85-a9cb-fddabc5d08bf tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Lazy-loading 'resources' on Instance uuid efcddf77-9300-4211-aa2d-31e99a37a180 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:08:33 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-4836037d-cb75-4b85-a9cb-fddabc5d08bf tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:06:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-356026514',display_name='tempest-VolumesAdminNegativeTest-server-356026514',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-356026514',id=14,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:06:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c967f66b058543878a89b86b4791d5fc',ramdisk_id='',reservation_id='r-qca1g5we',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-18073692',owner_user_name='tempest-VolumesAdminNegativeTest-18073692-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:06:41Z,user_data=None,user_id='99af9f03493348bebcc384eb94d8ea9a',uuid=efcddf77-9300-4211-aa2d-31e99a37a180,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "05e8b2a9-abd7-42e3-b532-af63aed5d299", "address": "fa:16:3e:f2:ce:73", "network": {"id": "7537df91-4e59-4569-88de-6dbbd9d5a4e4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1983739170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c967f66b058543878a89b86b4791d5fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05e8b2a9-ab", "ovs_interfaceid": "05e8b2a9-abd7-42e3-b532-af63aed5d299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:08:33 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-4836037d-cb75-4b85-a9cb-fddabc5d08bf tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Converting VIF {"id": "05e8b2a9-abd7-42e3-b532-af63aed5d299", "address": "fa:16:3e:f2:ce:73", "network": {"id": "7537df91-4e59-4569-88de-6dbbd9d5a4e4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1983739170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c967f66b058543878a89b86b4791d5fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05e8b2a9-ab", "ovs_interfaceid": "05e8b2a9-abd7-42e3-b532-af63aed5d299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:08:33 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-4836037d-cb75-4b85-a9cb-fddabc5d08bf tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:ce:73,bridge_name='br-int',has_traffic_filtering=True,id=05e8b2a9-abd7-42e3-b532-af63aed5d299,network=Network(7537df91-4e59-4569-88de-6dbbd9d5a4e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05e8b2a9-ab') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:08:33 user nova-compute[74743]: DEBUG os_vif [None req-4836037d-cb75-4b85-a9cb-fddabc5d08bf tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:ce:73,bridge_name='br-int',has_traffic_filtering=True,id=05e8b2a9-abd7-42e3-b532-af63aed5d299,network=Network(7537df91-4e59-4569-88de-6dbbd9d5a4e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05e8b2a9-ab') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:08:33 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:33 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap05e8b2a9-ab, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:08:33 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:08:33 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:33 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:33 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3a6e6a63-b838-45a8-85b6-3948cf4abfe1) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:08:33 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77117a2-748d-4a39-8db7-8b965a1725fc/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:08:33 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:08:33 user nova-compute[74743]: INFO os_vif [None req-4836037d-cb75-4b85-a9cb-fddabc5d08bf tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:ce:73,bridge_name='br-int',has_traffic_filtering=True,id=05e8b2a9-abd7-42e3-b532-af63aed5d299,network=Network(7537df91-4e59-4569-88de-6dbbd9d5a4e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05e8b2a9-ab')
Nov 18 17:08:33 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-4836037d-cb75-4b85-a9cb-fddabc5d08bf tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Deleting instance files /opt/stack/data/nova/instances/efcddf77-9300-4211-aa2d-31e99a37a180_del
Nov 18 17:08:33 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-4836037d-cb75-4b85-a9cb-fddabc5d08bf tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Deletion of /opt/stack/data/nova/instances/efcddf77-9300-4211-aa2d-31e99a37a180_del complete
Nov 18 17:08:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk.rescue --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:08:33 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:33 user nova-compute[74743]: INFO nova.compute.manager [None req-4836037d-cb75-4b85-a9cb-fddabc5d08bf tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 18 17:08:33 user nova-compute[74743]: DEBUG oslo.service.loopingcall [None req-4836037d-cb75-4b85-a9cb-fddabc5d08bf tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74743) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 17:08:33 user nova-compute[74743]: DEBUG nova.compute.manager [-] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Deallocating network for instance {{(pid=74743) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 17:08:33 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] deallocate_for_instance() {{(pid=74743) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 17:08:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:08:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk.rescue --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:08:33 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:08:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:08:34 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:08:34 user nova-compute[74743]: DEBUG nova.compute.manager [req-cbb11618-870f-4808-8558-4edb4370c9a5 req-29f735f9-5893-4879-9809-9c385f98e54a service nova] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Received event network-vif-deleted-05e8b2a9-abd7-42e3-b532-af63aed5d299 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:08:34 user nova-compute[74743]: INFO nova.compute.manager [req-cbb11618-870f-4808-8558-4edb4370c9a5 req-29f735f9-5893-4879-9809-9c385f98e54a service nova] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Neutron deleted interface 05e8b2a9-abd7-42e3-b532-af63aed5d299; detaching it from the instance and deleting it from the info cache
Nov 18 17:08:34 user nova-compute[74743]: DEBUG nova.network.neutron [req-cbb11618-870f-4808-8558-4edb4370c9a5 req-29f735f9-5893-4879-9809-9c385f98e54a service nova] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:08:34 user nova-compute[74743]: INFO nova.compute.manager [-] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Took 0.57 seconds to deallocate network for instance.
Nov 18 17:08:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json" returned: 0 in 0.297s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:08:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:08:34 user nova-compute[74743]: DEBUG nova.compute.manager [req-cbb11618-870f-4808-8558-4edb4370c9a5 req-29f735f9-5893-4879-9809-9c385f98e54a service nova] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Detach interface failed, port_id=05e8b2a9-abd7-42e3-b532-af63aed5d299, reason: Instance efcddf77-9300-4211-aa2d-31e99a37a180 could not be found. {{(pid=74743) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 17:08:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4836037d-cb75-4b85-a9cb-fddabc5d08bf tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:08:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4836037d-cb75-4b85-a9cb-fddabc5d08bf tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:08:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:08:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b51739-7900-47bd-a01e-2e83e2f13ae1/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:08:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b51739-7900-47bd-a01e-2e83e2f13ae1/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:08:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b51739-7900-47bd-a01e-2e83e2f13ae1/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:08:34 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-4836037d-cb75-4b85-a9cb-fddabc5d08bf tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:08:34 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-4836037d-cb75-4b85-a9cb-fddabc5d08bf tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:08:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4836037d-cb75-4b85-a9cb-fddabc5d08bf tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.626s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:08:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b51739-7900-47bd-a01e-2e83e2f13ae1/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:08:35 user nova-compute[74743]: INFO nova.scheduler.client.report [None req-4836037d-cb75-4b85-a9cb-fddabc5d08bf tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Deleted allocations for instance efcddf77-9300-4211-aa2d-31e99a37a180
Nov 18 17:08:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a9b12da-02c5-42ba-b215-a20df0e3ea4f/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:08:35 user nova-compute[74743]: DEBUG nova.compute.manager [req-85d51ba4-331e-4e88-9dae-e3facea5d7f2 req-84505b31-5fe0-44cf-ae80-632011bb0d72 service nova] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Received event network-vif-plugged-05e8b2a9-abd7-42e3-b532-af63aed5d299 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:08:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-85d51ba4-331e-4e88-9dae-e3facea5d7f2 req-84505b31-5fe0-44cf-ae80-632011bb0d72 service nova] Acquiring lock "efcddf77-9300-4211-aa2d-31e99a37a180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:08:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-85d51ba4-331e-4e88-9dae-e3facea5d7f2 req-84505b31-5fe0-44cf-ae80-632011bb0d72 service nova] Lock "efcddf77-9300-4211-aa2d-31e99a37a180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:08:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-85d51ba4-331e-4e88-9dae-e3facea5d7f2 req-84505b31-5fe0-44cf-ae80-632011bb0d72 service nova] Lock "efcddf77-9300-4211-aa2d-31e99a37a180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:08:35 user nova-compute[74743]: DEBUG nova.compute.manager [req-85d51ba4-331e-4e88-9dae-e3facea5d7f2 req-84505b31-5fe0-44cf-ae80-632011bb0d72 service nova] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] No waiting events found dispatching network-vif-plugged-05e8b2a9-abd7-42e3-b532-af63aed5d299 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:08:35 user nova-compute[74743]: WARNING nova.compute.manager [req-85d51ba4-331e-4e88-9dae-e3facea5d7f2 req-84505b31-5fe0-44cf-ae80-632011bb0d72 service nova] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Received unexpected event network-vif-plugged-05e8b2a9-abd7-42e3-b532-af63aed5d299 for instance with vm_state deleted and task_state None.
Nov 18 17:08:35 user nova-compute[74743]: DEBUG nova.compute.manager [req-85d51ba4-331e-4e88-9dae-e3facea5d7f2 req-84505b31-5fe0-44cf-ae80-632011bb0d72 service nova] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Received event network-vif-plugged-05e8b2a9-abd7-42e3-b532-af63aed5d299 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:08:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-85d51ba4-331e-4e88-9dae-e3facea5d7f2 req-84505b31-5fe0-44cf-ae80-632011bb0d72 service nova] Acquiring lock "efcddf77-9300-4211-aa2d-31e99a37a180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:08:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-85d51ba4-331e-4e88-9dae-e3facea5d7f2 req-84505b31-5fe0-44cf-ae80-632011bb0d72 service nova] Lock "efcddf77-9300-4211-aa2d-31e99a37a180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:08:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-85d51ba4-331e-4e88-9dae-e3facea5d7f2 req-84505b31-5fe0-44cf-ae80-632011bb0d72 service nova] Lock "efcddf77-9300-4211-aa2d-31e99a37a180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:08:35 user nova-compute[74743]: DEBUG nova.compute.manager [req-85d51ba4-331e-4e88-9dae-e3facea5d7f2 req-84505b31-5fe0-44cf-ae80-632011bb0d72 service nova] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] No waiting events found dispatching network-vif-plugged-05e8b2a9-abd7-42e3-b532-af63aed5d299 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:08:35 user nova-compute[74743]: WARNING nova.compute.manager [req-85d51ba4-331e-4e88-9dae-e3facea5d7f2 req-84505b31-5fe0-44cf-ae80-632011bb0d72 service nova] [instance: efcddf77-9300-4211-aa2d-31e99a37a180] Received unexpected event network-vif-plugged-05e8b2a9-abd7-42e3-b532-af63aed5d299 for instance with vm_state deleted and task_state None.
Nov 18 17:08:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4836037d-cb75-4b85-a9cb-fddabc5d08bf tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Lock "efcddf77-9300-4211-aa2d-31e99a37a180" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.719s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:08:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a9b12da-02c5-42ba-b215-a20df0e3ea4f/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:08:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a9b12da-02c5-42ba-b215-a20df0e3ea4f/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:08:35 user nova-compute[74743]: DEBUG nova.compute.manager [req-73ef7962-e85c-4268-ba45-6f9507948085 req-244ccc81-ba97-4cdd-8368-04fa00c4d06e service nova] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Received event network-vif-plugged-14c7e1ef-5997-4e7f-aebf-baa01bec87a6 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:08:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-73ef7962-e85c-4268-ba45-6f9507948085 req-244ccc81-ba97-4cdd-8368-04fa00c4d06e service nova] Acquiring lock "e2b51739-7900-47bd-a01e-2e83e2f13ae1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:08:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-73ef7962-e85c-4268-ba45-6f9507948085 req-244ccc81-ba97-4cdd-8368-04fa00c4d06e service nova] Lock "e2b51739-7900-47bd-a01e-2e83e2f13ae1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:08:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-73ef7962-e85c-4268-ba45-6f9507948085 req-244ccc81-ba97-4cdd-8368-04fa00c4d06e service nova] Lock "e2b51739-7900-47bd-a01e-2e83e2f13ae1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:08:35 user nova-compute[74743]: DEBUG nova.compute.manager [req-73ef7962-e85c-4268-ba45-6f9507948085 req-244ccc81-ba97-4cdd-8368-04fa00c4d06e service nova] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] No waiting events found dispatching network-vif-plugged-14c7e1ef-5997-4e7f-aebf-baa01bec87a6 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:08:35 user nova-compute[74743]: WARNING nova.compute.manager [req-73ef7962-e85c-4268-ba45-6f9507948085 req-244ccc81-ba97-4cdd-8368-04fa00c4d06e service nova] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Received unexpected event network-vif-plugged-14c7e1ef-5997-4e7f-aebf-baa01bec87a6 for instance with vm_state building and task_state spawning.
Nov 18 17:08:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a9b12da-02c5-42ba-b215-a20df0e3ea4f/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:08:35 user nova-compute[74743]: DEBUG nova.compute.manager [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:08:35 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Guest created on hypervisor {{(pid=74743) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 17:08:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55192f7b-5aaf-42e6-926a-cf9f43e460ca/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:08:35 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Instance spawned successfully.
Nov 18 17:08:35 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 17:08:35 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Found default for hw_cdrom_bus of ide {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:08:35 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Found default for hw_disk_bus of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:08:35 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Found default for hw_input_bus of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:08:35 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Found default for hw_pointer_model of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:08:35 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Found default for hw_video_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:08:35 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Found default for hw_vif_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:08:35 user nova-compute[74743]: INFO nova.compute.manager [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Took 7.18 seconds to spawn the instance on the hypervisor.
Nov 18 17:08:35 user nova-compute[74743]: DEBUG nova.compute.manager [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:08:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55192f7b-5aaf-42e6-926a-cf9f43e460ca/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:08:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55192f7b-5aaf-42e6-926a-cf9f43e460ca/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:08:35 user nova-compute[74743]: INFO nova.compute.manager [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Took 8.53 seconds to build instance.
Nov 18 17:08:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f73e776f-b55a-4f5d-9956-b0824538e5bd tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Lock "e2b51739-7900-47bd-a01e-2e83e2f13ae1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.677s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:08:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55192f7b-5aaf-42e6-926a-cf9f43e460ca/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:08:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5c74497-1d1c-48a0-9b0a-e7df2a41361c/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:08:36 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5c74497-1d1c-48a0-9b0a-e7df2a41361c/disk --force-share --output=json" returned: 0 in 0.320s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:08:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5c74497-1d1c-48a0-9b0a-e7df2a41361c/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:08:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5c74497-1d1c-48a0-9b0a-e7df2a41361c/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:08:37 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:08:37 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:08:37 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Hypervisor/Node resource view: name=user free_ram=7455MB free_disk=25.624744415283203GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74743) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 17:08:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:08:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:08:37 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 4cce1628-2dcb-40c7-abd4-6a327a432de3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:08:37 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance e9668e1c-1e8d-4dd7-8f58-d453db294557 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:08:37 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance c006a4ad-a8e2-4108-9af1-dec4dd53fcda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:08:37 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 55192f7b-5aaf-42e6-926a-cf9f43e460ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:08:37 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance a77117a2-748d-4a39-8db7-8b965a1725fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:08:37 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 49ebdd5a-824d-476a-bd10-3b891bbfe9e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:08:37 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance c5c74497-1d1c-48a0-9b0a-e7df2a41361c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:08:37 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 8a9b12da-02c5-42ba-b215-a20df0e3ea4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:08:37 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance e2b51739-7900-47bd-a01e-2e83e2f13ae1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:08:37 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 17:08:37 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 17:08:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:37 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:08:38 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:08:38 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Compute_service record updated for user:user {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 17:08:38 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.865s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:08:38 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:38 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:40 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Acquiring lock "0ad8aa2d-663c-4829-87f9-07959105ca68" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:08:40 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Lock "0ad8aa2d-663c-4829-87f9-07959105ca68" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:08:40 user nova-compute[74743]: DEBUG nova.compute.manager [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] Starting instance... {{(pid=74743) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 17:08:40 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:08:40 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:08:40 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74743) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 17:08:40 user nova-compute[74743]: INFO nova.compute.claims [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] Claim successful on node user
Nov 18 17:08:41 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:08:41 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:08:41 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.444s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:08:41 user nova-compute[74743]: DEBUG nova.compute.manager [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] Start building networks asynchronously for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 17:08:41 user nova-compute[74743]: DEBUG nova.compute.manager [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] Allocating IP information in the background. {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 17:08:41 user nova-compute[74743]: DEBUG nova.network.neutron [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] allocate_for_instance() {{(pid=74743) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 17:08:41 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 17:08:41 user nova-compute[74743]: DEBUG nova.compute.manager [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] Start building block device mappings for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 17:08:41 user nova-compute[74743]: DEBUG nova.policy [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '357f81ed0cae4dda9721d5ce81d23be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ac6e8f2384c6fb2bb4cbdeee429c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74743) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 17:08:41 user nova-compute[74743]: DEBUG nova.compute.manager [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] Start spawning the instance on the hypervisor. {{(pid=74743) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 17:08:41 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] Creating instance directory {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 17:08:41 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] Creating image(s)
Nov 18 17:08:41 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Acquiring lock "/opt/stack/data/nova/instances/0ad8aa2d-663c-4829-87f9-07959105ca68/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:08:41 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Lock "/opt/stack/data/nova/instances/0ad8aa2d-663c-4829-87f9-07959105ca68/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:08:41 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Lock "/opt/stack/data/nova/instances/0ad8aa2d-663c-4829-87f9-07959105ca68/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:08:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:08:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.198s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:08:41 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Acquiring lock "c188b3a997bfafa42fa341f9dcc326545681eed9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:08:41 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:08:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:08:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.213s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:08:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/0ad8aa2d-663c-4829-87f9-07959105ca68/disk 1073741824 {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:08:42 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/0ad8aa2d-663c-4829-87f9-07959105ca68/disk 1073741824" returned: 0 in 0.083s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:08:42 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.306s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:08:42 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:08:42 user nova-compute[74743]: DEBUG nova.network.neutron [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] Successfully created port: f8b70f64-c72b-4d3b-be6a-6e401ce15011 {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:08:42 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.190s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:08:42 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0ad8aa2d-663c-4829-87f9-07959105ca68/disk. size=1073741824 {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 17:08:42 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad8aa2d-663c-4829-87f9-07959105ca68/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:08:42 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad8aa2d-663c-4829-87f9-07959105ca68/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:08:42 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Cannot resize image /opt/stack/data/nova/instances/0ad8aa2d-663c-4829-87f9-07959105ca68/disk to a smaller size. {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 17:08:42 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] Created local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 17:08:42 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] Ensure instance console log exists: /opt/stack/data/nova/instances/0ad8aa2d-663c-4829-87f9-07959105ca68/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:08:42 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:08:42 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:08:42 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:08:42 user nova-compute[74743]: DEBUG nova.network.neutron [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] Successfully updated port: f8b70f64-c72b-4d3b-be6a-6e401ce15011 {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:08:42 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Acquiring lock "refresh_cache-0ad8aa2d-663c-4829-87f9-07959105ca68" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:08:42 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Acquired lock "refresh_cache-0ad8aa2d-663c-4829-87f9-07959105ca68" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:08:42 user nova-compute[74743]: DEBUG nova.network.neutron [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:08:42 user nova-compute[74743]: DEBUG nova.compute.manager [req-ac3bf8c1-daea-4320-b5f3-3e0d6f4e9c0f req-9a709864-f8ca-4e89-a4b0-39ce2af73b88 service nova] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] Received event network-changed-f8b70f64-c72b-4d3b-be6a-6e401ce15011 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:08:42 user nova-compute[74743]: DEBUG nova.compute.manager [req-ac3bf8c1-daea-4320-b5f3-3e0d6f4e9c0f req-9a709864-f8ca-4e89-a4b0-39ce2af73b88 service nova] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] Refreshing instance network info cache due to event network-changed-f8b70f64-c72b-4d3b-be6a-6e401ce15011. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:08:42 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ac3bf8c1-daea-4320-b5f3-3e0d6f4e9c0f req-9a709864-f8ca-4e89-a4b0-39ce2af73b88 service nova] Acquiring lock "refresh_cache-0ad8aa2d-663c-4829-87f9-07959105ca68" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:08:43 user nova-compute[74743]: DEBUG nova.network.neutron [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:08:43 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:43 user nova-compute[74743]: DEBUG nova.network.neutron [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] Updating instance_info_cache with network_info: [{"id": "f8b70f64-c72b-4d3b-be6a-6e401ce15011", "address": "fa:16:3e:30:37:84", "network": {"id": "13e0d3be-e4a3-4f20-8aac-1cf64be1e1b2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-853497736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b57ac6e8f2384c6fb2bb4cbdeee429c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8b70f64-c7", "ovs_interfaceid": "f8b70f64-c72b-4d3b-be6a-6e401ce15011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:08:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Releasing lock "refresh_cache-0ad8aa2d-663c-4829-87f9-07959105ca68" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:08:43 user nova-compute[74743]: DEBUG nova.compute.manager [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] Instance network_info: |[{"id": "f8b70f64-c72b-4d3b-be6a-6e401ce15011", "address": "fa:16:3e:30:37:84", "network": {"id": "13e0d3be-e4a3-4f20-8aac-1cf64be1e1b2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-853497736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b57ac6e8f2384c6fb2bb4cbdeee429c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8b70f64-c7", "ovs_interfaceid": "f8b70f64-c72b-4d3b-be6a-6e401ce15011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 17:08:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ac3bf8c1-daea-4320-b5f3-3e0d6f4e9c0f req-9a709864-f8ca-4e89-a4b0-39ce2af73b88 service nova] Acquired lock "refresh_cache-0ad8aa2d-663c-4829-87f9-07959105ca68" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:08:43 user nova-compute[74743]: DEBUG nova.network.neutron [req-ac3bf8c1-daea-4320-b5f3-3e0d6f4e9c0f req-9a709864-f8ca-4e89-a4b0-39ce2af73b88 service nova] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] Refreshing network info cache for port f8b70f64-c72b-4d3b-be6a-6e401ce15011 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:08:43 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] Start _get_guest_xml network_info=[{"id": "f8b70f64-c72b-4d3b-be6a-6e401ce15011", "address": "fa:16:3e:30:37:84", "network": {"id": "13e0d3be-e4a3-4f20-8aac-1cf64be1e1b2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-853497736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b57ac6e8f2384c6fb2bb4cbdeee429c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8b70f64-c7", "ovs_interfaceid": "f8b70f64-c72b-4d3b-be6a-6e401ce15011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '9536f6cf-95c4-40e2-864a-09a91525678a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:08:43 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:08:43 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:08:43 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:08:43 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:08:43 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:08:43 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:08:43 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:08:43 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:08:43 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:08:43 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:08:43 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:08:43 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:08:43 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:08:43 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:08:43 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:08:43 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:08:43 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:08:43 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:08:43 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:08:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1150764694',display_name='tempest-ServersNegativeTestJSON-server-1150764694',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1150764694',id=20,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b57ac6e8f2384c6fb2bb4cbdeee429c0',ramdisk_id='',reservation_id='r-9epp743l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-840944804',owner_user_name='tempest-ServersNegativeTestJSON-840944804-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:08:41Z,user_data=None,user_id='357f81ed0cae4dda9721d5ce81d23be5',uuid=0ad8aa2d-663c-4829-87f9-07959105ca68,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8b70f64-c72b-4d3b-be6a-6e401ce15011", "address": "fa:16:3e:30:37:84", "network": {"id": "13e0d3be-e4a3-4f20-8aac-1cf64be1e1b2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-853497736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b57ac6e8f2384c6fb2bb4cbdeee429c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8b70f64-c7", "ovs_interfaceid": "f8b70f64-c72b-4d3b-be6a-6e401ce15011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:08:43 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Converting VIF {"id": "f8b70f64-c72b-4d3b-be6a-6e401ce15011", "address": "fa:16:3e:30:37:84", "network": {"id": "13e0d3be-e4a3-4f20-8aac-1cf64be1e1b2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-853497736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b57ac6e8f2384c6fb2bb4cbdeee429c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8b70f64-c7", "ovs_interfaceid": "f8b70f64-c72b-4d3b-be6a-6e401ce15011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:08:43 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:37:84,bridge_name='br-int',has_traffic_filtering=True,id=f8b70f64-c72b-4d3b-be6a-6e401ce15011,network=Network(13e0d3be-e4a3-4f20-8aac-1cf64be1e1b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8b70f64-c7') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:08:43 user nova-compute[74743]: DEBUG nova.objects.instance [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ad8aa2d-663c-4829-87f9-07959105ca68 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:08:43 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:08:43 user nova-compute[74743]:   <uuid>0ad8aa2d-663c-4829-87f9-07959105ca68</uuid>
Nov 18 17:08:43 user nova-compute[74743]:   <name>instance-00000014</name>
Nov 18 17:08:43 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:08:43 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:08:43 user nova-compute[74743]:   <metadata>
Nov 18 17:08:43 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:08:43 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:08:43 user nova-compute[74743]:       <nova:name>tempest-ServersNegativeTestJSON-server-1150764694</nova:name>
Nov 18 17:08:43 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:08:43</nova:creationTime>
Nov 18 17:08:43 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:08:43 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:08:43 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:08:43 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:08:43 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:08:43 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:08:43 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:08:43 user nova-compute[74743]:       <nova:owner>
Nov 18 17:08:43 user nova-compute[74743]:         <nova:user uuid="357f81ed0cae4dda9721d5ce81d23be5">tempest-ServersNegativeTestJSON-840944804-project-member</nova:user>
Nov 18 17:08:43 user nova-compute[74743]:         <nova:project uuid="b57ac6e8f2384c6fb2bb4cbdeee429c0">tempest-ServersNegativeTestJSON-840944804</nova:project>
Nov 18 17:08:43 user nova-compute[74743]:       </nova:owner>
Nov 18 17:08:43 user nova-compute[74743]:       <nova:root type="image" uuid="9536f6cf-95c4-40e2-864a-09a91525678a"/>
Nov 18 17:08:43 user nova-compute[74743]:       <nova:ports>
Nov 18 17:08:43 user nova-compute[74743]:         <nova:port uuid="f8b70f64-c72b-4d3b-be6a-6e401ce15011">
Nov 18 17:08:43 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 18 17:08:43 user nova-compute[74743]:         </nova:port>
Nov 18 17:08:43 user nova-compute[74743]:       </nova:ports>
Nov 18 17:08:43 user nova-compute[74743]:     </nova:instance>
Nov 18 17:08:43 user nova-compute[74743]:   </metadata>
Nov 18 17:08:43 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:08:43 user nova-compute[74743]:     <system>
Nov 18 17:08:43 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:08:43 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:08:43 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:08:43 user nova-compute[74743]:       <entry name="serial">0ad8aa2d-663c-4829-87f9-07959105ca68</entry>
Nov 18 17:08:43 user nova-compute[74743]:       <entry name="uuid">0ad8aa2d-663c-4829-87f9-07959105ca68</entry>
Nov 18 17:08:43 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:08:43 user nova-compute[74743]:     </system>
Nov 18 17:08:43 user nova-compute[74743]:   </sysinfo>
Nov 18 17:08:43 user nova-compute[74743]:   <os>
Nov 18 17:08:43 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:08:43 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:08:43 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:08:43 user nova-compute[74743]:   </os>
Nov 18 17:08:43 user nova-compute[74743]:   <features>
Nov 18 17:08:43 user nova-compute[74743]:     <acpi/>
Nov 18 17:08:43 user nova-compute[74743]:     <apic/>
Nov 18 17:08:43 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:08:43 user nova-compute[74743]:   </features>
Nov 18 17:08:43 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:08:43 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:08:43 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:08:43 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:08:43 user nova-compute[74743]:   </clock>
Nov 18 17:08:43 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:08:43 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:08:43 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:08:43 user nova-compute[74743]:   </cpu>
Nov 18 17:08:43 user nova-compute[74743]:   <devices>
Nov 18 17:08:43 user nova-compute[74743]:     <disk type="file" device="disk">
Nov 18 17:08:43 user nova-compute[74743]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 17:08:43 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/0ad8aa2d-663c-4829-87f9-07959105ca68/disk"/>
Nov 18 17:08:43 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:08:43 user nova-compute[74743]:     </disk>
Nov 18 17:08:43 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:08:43 user nova-compute[74743]:       <mac address="fa:16:3e:30:37:84"/>
Nov 18 17:08:43 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:08:43 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:08:43 user nova-compute[74743]:       <target dev="tapf8b70f64-c7"/>
Nov 18 17:08:43 user nova-compute[74743]:     </interface>
Nov 18 17:08:43 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:08:43 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/0ad8aa2d-663c-4829-87f9-07959105ca68/console.log" append="off"/>
Nov 18 17:08:43 user nova-compute[74743]:     </serial>
Nov 18 17:08:43 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:08:43 user nova-compute[74743]:     <video>
Nov 18 17:08:43 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:08:43 user nova-compute[74743]:     </video>
Nov 18 17:08:43 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:08:43 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:08:43 user nova-compute[74743]:     </rng>
Nov 18 17:08:43 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:08:43 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:08:43 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:08:43 user nova-compute[74743]:     </memballoon>
Nov 18 17:08:43 user nova-compute[74743]:   </devices>
Nov 18 17:08:43 user nova-compute[74743]: </domain>
Nov 18 17:08:43 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:08:43 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:08:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1150764694',display_name='tempest-ServersNegativeTestJSON-server-1150764694',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1150764694',id=20,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b57ac6e8f2384c6fb2bb4cbdeee429c0',ramdisk_id='',reservation_id='r-9epp743l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-840944804',owner_user_name='tempest-ServersNegativeTestJSON-840944804-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:08:41Z,user_data=None,user_id='357f81ed0cae4dda9721d5ce81d23be5',uuid=0ad8aa2d-663c-4829-87f9-07959105ca68,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8b70f64-c72b-4d3b-be6a-6e401ce15011", "address": "fa:16:3e:30:37:84", "network": {"id": "13e0d3be-e4a3-4f20-8aac-1cf64be1e1b2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-853497736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b57ac6e8f2384c6fb2bb4cbdeee429c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8b70f64-c7", "ovs_interfaceid": "f8b70f64-c72b-4d3b-be6a-6e401ce15011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:08:43 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Converting VIF {"id": "f8b70f64-c72b-4d3b-be6a-6e401ce15011", "address": "fa:16:3e:30:37:84", "network": {"id": "13e0d3be-e4a3-4f20-8aac-1cf64be1e1b2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-853497736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b57ac6e8f2384c6fb2bb4cbdeee429c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8b70f64-c7", "ovs_interfaceid": "f8b70f64-c72b-4d3b-be6a-6e401ce15011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:08:43 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:37:84,bridge_name='br-int',has_traffic_filtering=True,id=f8b70f64-c72b-4d3b-be6a-6e401ce15011,network=Network(13e0d3be-e4a3-4f20-8aac-1cf64be1e1b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8b70f64-c7') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:08:43 user nova-compute[74743]: DEBUG os_vif [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:37:84,bridge_name='br-int',has_traffic_filtering=True,id=f8b70f64-c72b-4d3b-be6a-6e401ce15011,network=Network(13e0d3be-e4a3-4f20-8aac-1cf64be1e1b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8b70f64-c7') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:08:43 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:43 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:08:43 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:08:43 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:43 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a27b74a6-8440-5f31-bd45-c66db20f83c2', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:08:43 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:43 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:08:43 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:43 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf8b70f64-c7, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:08:43 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf8b70f64-c7, col_values=(('qos', UUID('42d81abe-2bec-4350-968d-edd88048cef7')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:08:43 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf8b70f64-c7, col_values=(('external_ids', {'iface-id': 'f8b70f64-c72b-4d3b-be6a-6e401ce15011', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:37:84', 'vm-uuid': '0ad8aa2d-663c-4829-87f9-07959105ca68'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:08:43 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:43 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:08:43 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:43 user nova-compute[74743]: INFO os_vif [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:37:84,bridge_name='br-int',has_traffic_filtering=True,id=f8b70f64-c72b-4d3b-be6a-6e401ce15011,network=Network(13e0d3be-e4a3-4f20-8aac-1cf64be1e1b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8b70f64-c7')
Nov 18 17:08:43 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:08:43 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] No VIF found with MAC fa:16:3e:30:37:84, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:08:44 user nova-compute[74743]: DEBUG nova.network.neutron [req-ac3bf8c1-daea-4320-b5f3-3e0d6f4e9c0f req-9a709864-f8ca-4e89-a4b0-39ce2af73b88 service nova] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] Updated VIF entry in instance network info cache for port f8b70f64-c72b-4d3b-be6a-6e401ce15011. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:08:44 user nova-compute[74743]: DEBUG nova.network.neutron [req-ac3bf8c1-daea-4320-b5f3-3e0d6f4e9c0f req-9a709864-f8ca-4e89-a4b0-39ce2af73b88 service nova] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] Updating instance_info_cache with network_info: [{"id": "f8b70f64-c72b-4d3b-be6a-6e401ce15011", "address": "fa:16:3e:30:37:84", "network": {"id": "13e0d3be-e4a3-4f20-8aac-1cf64be1e1b2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-853497736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b57ac6e8f2384c6fb2bb4cbdeee429c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8b70f64-c7", "ovs_interfaceid": "f8b70f64-c72b-4d3b-be6a-6e401ce15011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:08:44 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ac3bf8c1-daea-4320-b5f3-3e0d6f4e9c0f req-9a709864-f8ca-4e89-a4b0-39ce2af73b88 service nova] Releasing lock "refresh_cache-0ad8aa2d-663c-4829-87f9-07959105ca68" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:08:44 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:45 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:45 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:45 user nova-compute[74743]: DEBUG nova.compute.manager [req-f2b56c59-8779-442c-a51a-2c9c7f9de116 req-6c3feb33-160e-4010-88f2-a5ff4325bd56 service nova] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] Received event network-vif-plugged-f8b70f64-c72b-4d3b-be6a-6e401ce15011 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:08:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f2b56c59-8779-442c-a51a-2c9c7f9de116 req-6c3feb33-160e-4010-88f2-a5ff4325bd56 service nova] Acquiring lock "0ad8aa2d-663c-4829-87f9-07959105ca68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:08:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f2b56c59-8779-442c-a51a-2c9c7f9de116 req-6c3feb33-160e-4010-88f2-a5ff4325bd56 service nova] Lock "0ad8aa2d-663c-4829-87f9-07959105ca68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:08:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f2b56c59-8779-442c-a51a-2c9c7f9de116 req-6c3feb33-160e-4010-88f2-a5ff4325bd56 service nova] Lock "0ad8aa2d-663c-4829-87f9-07959105ca68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:08:45 user nova-compute[74743]: DEBUG nova.compute.manager [req-f2b56c59-8779-442c-a51a-2c9c7f9de116 req-6c3feb33-160e-4010-88f2-a5ff4325bd56 service nova] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] No waiting events found dispatching network-vif-plugged-f8b70f64-c72b-4d3b-be6a-6e401ce15011 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:08:45 user nova-compute[74743]: WARNING nova.compute.manager [req-f2b56c59-8779-442c-a51a-2c9c7f9de116 req-6c3feb33-160e-4010-88f2-a5ff4325bd56 service nova] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] Received unexpected event network-vif-plugged-f8b70f64-c72b-4d3b-be6a-6e401ce15011 for instance with vm_state building and task_state spawning.
Nov 18 17:08:45 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:47 user nova-compute[74743]: DEBUG nova.compute.manager [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:08:47 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] Guest created on hypervisor {{(pid=74743) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 17:08:47 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] Instance spawned successfully.
Nov 18 17:08:47 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 17:08:47 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] Found default for hw_cdrom_bus of ide {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:08:47 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] Found default for hw_disk_bus of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:08:47 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] Found default for hw_input_bus of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:08:47 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] Found default for hw_pointer_model of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:08:47 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] Found default for hw_video_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:08:47 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] Found default for hw_vif_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:08:47 user nova-compute[74743]: DEBUG nova.compute.manager [req-0152949c-b023-4c7e-98a7-dfea180e0ccc req-5f88b88d-3237-435f-b81b-d853af9052e9 service nova] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] Received event network-vif-plugged-f8b70f64-c72b-4d3b-be6a-6e401ce15011 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:08:47 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-0152949c-b023-4c7e-98a7-dfea180e0ccc req-5f88b88d-3237-435f-b81b-d853af9052e9 service nova] Acquiring lock "0ad8aa2d-663c-4829-87f9-07959105ca68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:08:47 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-0152949c-b023-4c7e-98a7-dfea180e0ccc req-5f88b88d-3237-435f-b81b-d853af9052e9 service nova] Lock "0ad8aa2d-663c-4829-87f9-07959105ca68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:08:47 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-0152949c-b023-4c7e-98a7-dfea180e0ccc req-5f88b88d-3237-435f-b81b-d853af9052e9 service nova] Lock "0ad8aa2d-663c-4829-87f9-07959105ca68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:08:47 user nova-compute[74743]: DEBUG nova.compute.manager [req-0152949c-b023-4c7e-98a7-dfea180e0ccc req-5f88b88d-3237-435f-b81b-d853af9052e9 service nova] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] No waiting events found dispatching network-vif-plugged-f8b70f64-c72b-4d3b-be6a-6e401ce15011 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:08:47 user nova-compute[74743]: WARNING nova.compute.manager [req-0152949c-b023-4c7e-98a7-dfea180e0ccc req-5f88b88d-3237-435f-b81b-d853af9052e9 service nova] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] Received unexpected event network-vif-plugged-f8b70f64-c72b-4d3b-be6a-6e401ce15011 for instance with vm_state building and task_state spawning.
Nov 18 17:08:47 user nova-compute[74743]: INFO nova.compute.manager [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] Took 6.24 seconds to spawn the instance on the hypervisor.
Nov 18 17:08:47 user nova-compute[74743]: DEBUG nova.compute.manager [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:08:47 user nova-compute[74743]: INFO nova.compute.manager [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] Took 7.15 seconds to build instance.
Nov 18 17:08:47 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-37cde2c9-b16b-4d5d-b4cd-d12afc47fc93 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Lock "0ad8aa2d-663c-4829-87f9-07959105ca68" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.264s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:08:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:08:59 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:03 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:04 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:04 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:08 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:09 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:10 user nova-compute[74743]: DEBUG nova.compute.manager [req-5adc34b4-b465-4e8f-8b2e-1da25813b87b req-66a0d924-2c5a-4c24-afc3-c7830ab1329a service nova] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Received event network-changed-22eb23ff-0df1-42e9-92c0-458497610ff9 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:09:10 user nova-compute[74743]: DEBUG nova.compute.manager [req-5adc34b4-b465-4e8f-8b2e-1da25813b87b req-66a0d924-2c5a-4c24-afc3-c7830ab1329a service nova] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Refreshing instance network info cache due to event network-changed-22eb23ff-0df1-42e9-92c0-458497610ff9. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:09:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-5adc34b4-b465-4e8f-8b2e-1da25813b87b req-66a0d924-2c5a-4c24-afc3-c7830ab1329a service nova] Acquiring lock "refresh_cache-a77117a2-748d-4a39-8db7-8b965a1725fc" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:09:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-5adc34b4-b465-4e8f-8b2e-1da25813b87b req-66a0d924-2c5a-4c24-afc3-c7830ab1329a service nova] Acquired lock "refresh_cache-a77117a2-748d-4a39-8db7-8b965a1725fc" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:09:10 user nova-compute[74743]: DEBUG nova.network.neutron [req-5adc34b4-b465-4e8f-8b2e-1da25813b87b req-66a0d924-2c5a-4c24-afc3-c7830ab1329a service nova] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Refreshing network info cache for port 22eb23ff-0df1-42e9-92c0-458497610ff9 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:09:10 user nova-compute[74743]: DEBUG nova.network.neutron [req-5adc34b4-b465-4e8f-8b2e-1da25813b87b req-66a0d924-2c5a-4c24-afc3-c7830ab1329a service nova] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Updated VIF entry in instance network info cache for port 22eb23ff-0df1-42e9-92c0-458497610ff9. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:09:10 user nova-compute[74743]: DEBUG nova.network.neutron [req-5adc34b4-b465-4e8f-8b2e-1da25813b87b req-66a0d924-2c5a-4c24-afc3-c7830ab1329a service nova] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Updating instance_info_cache with network_info: [{"id": "22eb23ff-0df1-42e9-92c0-458497610ff9", "address": "fa:16:3e:b3:91:01", "network": {"id": "fd98f398-6576-449b-a737-887906eb6656", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668610993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb8f5850162c479b8d185e48c03be7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22eb23ff-0d", "ovs_interfaceid": "22eb23ff-0df1-42e9-92c0-458497610ff9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:09:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-5adc34b4-b465-4e8f-8b2e-1da25813b87b req-66a0d924-2c5a-4c24-afc3-c7830ab1329a service nova] Releasing lock "refresh_cache-a77117a2-748d-4a39-8db7-8b965a1725fc" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:09:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-56ea5fb3-b754-4581-88a5-50d802bd2fab tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquiring lock "a77117a2-748d-4a39-8db7-8b965a1725fc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:09:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-56ea5fb3-b754-4581-88a5-50d802bd2fab tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "a77117a2-748d-4a39-8db7-8b965a1725fc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:09:11 user nova-compute[74743]: DEBUG nova.objects.instance [None req-56ea5fb3-b754-4581-88a5-50d802bd2fab tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lazy-loading 'flavor' on Instance uuid a77117a2-748d-4a39-8db7-8b965a1725fc {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:09:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-56ea5fb3-b754-4581-88a5-50d802bd2fab tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "a77117a2-748d-4a39-8db7-8b965a1725fc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:09:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-56ea5fb3-b754-4581-88a5-50d802bd2fab tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquiring lock "a77117a2-748d-4a39-8db7-8b965a1725fc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:09:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-56ea5fb3-b754-4581-88a5-50d802bd2fab tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "a77117a2-748d-4a39-8db7-8b965a1725fc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:09:11 user nova-compute[74743]: INFO nova.compute.manager [None req-56ea5fb3-b754-4581-88a5-50d802bd2fab tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Attaching volume ec4a2b65-8e33-4a44-8961-7c0570cde14e to /dev/vdb
Nov 18 17:09:11 user nova-compute[74743]: DEBUG os_brick.utils [None req-56ea5fb3-b754-4581-88a5-50d802bd2fab tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:09:11 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:11 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:11 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a767ccd8-e6c2-406d-a82e-382a98e4533c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1116acd8874d\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:11 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:11 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:11 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[567b2393-38ca-47fb-a50f-213a7cd57653]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:11 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:11 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:11 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d899815c-eba7-4e01-91ef-0b25f98757ae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:11 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[86965375-cf04-4b3b-9a79-1d158d64be77]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:11 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-56ea5fb3-b754-4581-88a5-50d802bd2fab tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Running cmd (subprocess): nvme version {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:11 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-56ea5fb3-b754-4581-88a5-50d802bd2fab tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] 'nvme version' failed. Not Retrying. {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:09:11 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.nvmeof [None req-56ea5fb3-b754-4581-88a5-50d802bd2fab tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] nvme not present on system {{(pid=74743) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 17:09:11 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:11 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:09:11 user nova-compute[74743]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 17:09:11 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaeed9c3-9ef5-4a72-abac-c26290d99d42]: (4, '') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:11 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-56ea5fb3-b754-4581-88a5-50d802bd2fab tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74743) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 17:09:11 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-56ea5fb3-b754-4581-88a5-50d802bd2fab tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 17:09:11 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-56ea5fb3-b754-4581-88a5-50d802bd2fab tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] LIGHTOS: no hostnqn found. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 17:09:11 user nova-compute[74743]: DEBUG os_brick.utils [None req-56ea5fb3-b754-4581-88a5-50d802bd2fab tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1116acd8874d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:09:11 user nova-compute[74743]: DEBUG nova.virt.block_device [None req-56ea5fb3-b754-4581-88a5-50d802bd2fab tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Updating existing volume attachment record: 404cc796-53a8-4b82-af18-83ebe44d20b9 {{(pid=74743) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 17:09:11 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:09:11 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Cleaning up deleted instances {{(pid=74743) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 18 17:09:11 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] There are 0 instances to clean {{(pid=74743) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 18 17:09:11 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:09:13 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "7764af08-2214-4a2f-84c4-cab1366e198d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:09:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "7764af08-2214-4a2f-84c4-cab1366e198d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:09:15 user nova-compute[74743]: DEBUG nova.compute.manager [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Starting instance... {{(pid=74743) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 17:09:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:09:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:09:15 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74743) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 17:09:15 user nova-compute[74743]: INFO nova.compute.claims [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Claim successful on node user
Nov 18 17:09:15 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:09:15 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:09:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.489s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:09:15 user nova-compute[74743]: DEBUG nova.compute.manager [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Start building networks asynchronously for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 17:09:15 user nova-compute[74743]: DEBUG nova.compute.manager [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Allocating IP information in the background. {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 17:09:15 user nova-compute[74743]: DEBUG nova.network.neutron [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] allocate_for_instance() {{(pid=74743) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 17:09:15 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 17:09:15 user nova-compute[74743]: DEBUG nova.compute.manager [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Start building block device mappings for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 17:09:15 user nova-compute[74743]: DEBUG nova.policy [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '89ce0d4bf7234c348b9b1a8979609c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a956c4d6e4304d34872ecf989279c886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74743) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 17:09:15 user nova-compute[74743]: INFO nova.virt.block_device [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Booting with volume snapshot 08a5ec02-0d52-4cc8-a784-2aba4729fe9a at /dev/vda
Nov 18 17:09:16 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:09:16 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74743) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 17:09:16 user nova-compute[74743]: DEBUG nova.network.neutron [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Successfully created port: b8787812-1f2e-4f67-8a5c-9eede06d1506 {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:09:16 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56ea5fb3-b754-4581-88a5-50d802bd2fab tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Calling os-brick to attach iSCSI Volume {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 17:09:16 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ea5fb3-b754-4581-88a5-50d802bd2fab tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ziSgfLDh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:09:16 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-56ea5fb3-b754-4581-88a5-50d802bd2fab tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:09:16 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-56ea5fb3-b754-4581-88a5-50d802bd2fab tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:09:16 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-56ea5fb3-b754-4581-88a5-50d802bd2fab tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:09:16 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-56ea5fb3-b754-4581-88a5-50d802bd2fab tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:09:16 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-56ea5fb3-b754-4581-88a5-50d802bd2fab tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:09:16 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-56ea5fb3-b754-4581-88a5-50d802bd2fab tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:09:16 user nova-compute[74743]: INFO os_brick.initiator.connectors.iscsi [None req-56ea5fb3-b754-4581-88a5-50d802bd2fab tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 17:09:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e -p 172.16.0.220:3260 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e734e1-b1df-4336-8d0b-0628c7557cb9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ea5fb3-b754-4581-88a5-50d802bd2fab tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 17:09:17 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e -p 172.16.0.220:3260 --interface default --op new {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a09ec03-9413-4c2b-9819-212bda359a4e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e] added\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ea5fb3-b754-4581-88a5-50d802bd2fab tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e] added
Nov 18 17:09:17 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5ba29d-9ec6-465d-894a-e05be668bcd9]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ea5fb3-b754-4581-88a5-50d802bd2fab tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a13ba34-4d4c-41bd-8886-7229efb45513]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ea5fb3-b754-4581-88a5-50d802bd2fab tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ziSgfLDh {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ziSgfLDh" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[4553fcd9-d292-45bb-b086-6c56a391a74d]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ea5fb3-b754-4581-88a5-50d802bd2fab tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ziSgfLDh'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[5669a2c6-f480-4a0a-b820-6fced8dfe9a7]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ea5fb3-b754-4581-88a5-50d802bd2fab tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[4caf121e-cb35-48a3-a41b-3450a2bc63df]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ea5fb3-b754-4581-88a5-50d802bd2fab tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 18 17:09:17 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ea5fb3-b754-4581-88a5-50d802bd2fab tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 18 17:09:17 user nova-compute[74743]:  {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:09:17 user nova-compute[74743]: WARNING os_brick.initiator.connectors.iscsi [None req-56ea5fb3-b754-4581-88a5-50d802bd2fab tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 18 17:09:17 user nova-compute[74743]: 
Nov 18 17:09:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e -p 172.16.0.220:3260 --login {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[be00ee0f-2a29-4f11-99c4-92b748cbbb5e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ea5fb3-b754-4581-88a5-50d802bd2fab tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e, portal: 172.16.0.220,3260]
Nov 18 17:09:17 user nova-compute[74743]: Login to [iface: default, target: iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e, portal: 172.16.0.220,3260] successful.
Nov 18 17:09:17 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7de674f-c0e6-4944-93c4-e3528ad7f9e1]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ea5fb3-b754-4581-88a5-50d802bd2fab tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e83eef-72b0-4ea5-9cdd-c21e0688994f]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ea5fb3-b754-4581-88a5-50d802bd2fab tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)
Nov 18 17:09:17 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ea5fb3-b754-4581-88a5-50d802bd2fab tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)
Nov 18 17:09:17 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-56ea5fb3-b754-4581-88a5-50d802bd2fab tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ea5fb3-b754-4581-88a5-50d802bd2fab tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Connected to 172.16.0.220:3260 {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-56ea5fb3-b754-4581-88a5-50d802bd2fab tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=74743) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-56ea5fb3-b754-4581-88a5-50d802bd2fab tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74743) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG nova.network.neutron [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Successfully updated port: b8787812-1f2e-4f67-8a5c-9eede06d1506 {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c86eb9-04b2-4636-81d8-b960ca496b3b]: (4, ('- - 0', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-56ea5fb3-b754-4581-88a5-50d802bd2fab tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ea5fb3-b754-4581-88a5-50d802bd2fab tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ziSgfLDh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "refresh_cache-7764af08-2214-4a2f-84c4-cab1366e198d" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquired lock "refresh_cache-7764af08-2214-4a2f-84c4-cab1366e198d" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG nova.network.neutron [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG nova.network.neutron [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Starting heal instance info cache {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Rebuilding the list of instances to heal {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG nova.compute.manager [req-cc8c9744-79d5-4dbe-aef7-9ba6e6ddf183 req-f4e5d189-1438-4b76-b91c-5ca0cf9aee1f service nova] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Received event network-changed-b8787812-1f2e-4f67-8a5c-9eede06d1506 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG nova.compute.manager [req-cc8c9744-79d5-4dbe-aef7-9ba6e6ddf183 req-f4e5d189-1438-4b76-b91c-5ca0cf9aee1f service nova] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Refreshing instance network info cache due to event network-changed-b8787812-1f2e-4f67-8a5c-9eede06d1506. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-cc8c9744-79d5-4dbe-aef7-9ba6e6ddf183 req-f4e5d189-1438-4b76-b91c-5ca0cf9aee1f service nova] Acquiring lock "refresh_cache-7764af08-2214-4a2f-84c4-cab1366e198d" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Skipping network cache update for instance because it is Building. {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "refresh_cache-4cce1628-2dcb-40c7-abd4-6a327a432de3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquired lock "refresh_cache-4cce1628-2dcb-40c7-abd4-6a327a432de3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Forcefully refreshing network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG nova.objects.instance [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lazy-loading 'info_cache' on Instance uuid 4cce1628-2dcb-40c7-abd4-6a327a432de3 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG nova.network.neutron [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Updating instance_info_cache with network_info: [{"id": "b8787812-1f2e-4f67-8a5c-9eede06d1506", "address": "fa:16:3e:bd:2f:d7", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8787812-1f", "ovs_interfaceid": "b8787812-1f2e-4f67-8a5c-9eede06d1506", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Releasing lock "refresh_cache-7764af08-2214-4a2f-84c4-cab1366e198d" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG nova.compute.manager [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Instance network_info: |[{"id": "b8787812-1f2e-4f67-8a5c-9eede06d1506", "address": "fa:16:3e:bd:2f:d7", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8787812-1f", "ovs_interfaceid": "b8787812-1f2e-4f67-8a5c-9eede06d1506", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-cc8c9744-79d5-4dbe-aef7-9ba6e6ddf183 req-f4e5d189-1438-4b76-b91c-5ca0cf9aee1f service nova] Acquired lock "refresh_cache-7764af08-2214-4a2f-84c4-cab1366e198d" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:09:17 user nova-compute[74743]: DEBUG nova.network.neutron [req-cc8c9744-79d5-4dbe-aef7-9ba6e6ddf183 req-f4e5d189-1438-4b76-b91c-5ca0cf9aee1f service nova] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Refreshing network info cache for port b8787812-1f2e-4f67-8a5c-9eede06d1506 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:09:18 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Updating instance_info_cache with network_info: [{"id": "28f81291-34bb-4a6f-890b-faea6ef8a385", "address": "fa:16:3e:47:f5:86", "network": {"id": "252343cc-f379-471d-a2c9-99b9a60ebcb4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25c06dc8e7be46229750b8e283622c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28f81291-34", "ovs_interfaceid": "28f81291-34bb-4a6f-890b-faea6ef8a385", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:09:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Releasing lock "refresh_cache-4cce1628-2dcb-40c7-abd4-6a327a432de3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:09:18 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Updated the network info_cache for instance {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 17:09:18 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:09:18 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:09:18 user nova-compute[74743]: DEBUG nova.network.neutron [req-cc8c9744-79d5-4dbe-aef7-9ba6e6ddf183 req-f4e5d189-1438-4b76-b91c-5ca0cf9aee1f service nova] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Updated VIF entry in instance network info cache for port b8787812-1f2e-4f67-8a5c-9eede06d1506. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:09:18 user nova-compute[74743]: DEBUG nova.network.neutron [req-cc8c9744-79d5-4dbe-aef7-9ba6e6ddf183 req-f4e5d189-1438-4b76-b91c-5ca0cf9aee1f service nova] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Updating instance_info_cache with network_info: [{"id": "b8787812-1f2e-4f67-8a5c-9eede06d1506", "address": "fa:16:3e:bd:2f:d7", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8787812-1f", "ovs_interfaceid": "b8787812-1f2e-4f67-8a5c-9eede06d1506", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:09:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-cc8c9744-79d5-4dbe-aef7-9ba6e6ddf183 req-f4e5d189-1438-4b76-b91c-5ca0cf9aee1f service nova] Releasing lock "refresh_cache-7764af08-2214-4a2f-84c4-cab1366e198d" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:09:18 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-56ea5fb3-b754-4581-88a5-50d802bd2fab tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:09:18 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ea5fb3-b754-4581-88a5-50d802bd2fab tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '26466353433383230', 'path': '/dev/sdb'} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:09:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56ea5fb3-b754-4581-88a5-50d802bd2fab tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26466353433383230', 'path': '/dev/sdb'} {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 17:09:18 user nova-compute[74743]: DEBUG nova.objects.instance [None req-56ea5fb3-b754-4581-88a5-50d802bd2fab tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lazy-loading 'flavor' on Instance uuid a77117a2-748d-4a39-8db7-8b965a1725fc {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:09:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-56ea5fb3-b754-4581-88a5-50d802bd2fab tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 17:09:18 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:09:18 user nova-compute[74743]:   <source dev="/dev/sdb"/>
Nov 18 17:09:18 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:09:18 user nova-compute[74743]:   <serial>ec4a2b65-8e33-4a44-8961-7c0570cde14e</serial>
Nov 18 17:09:18 user nova-compute[74743]: </disk>
Nov 18 17:09:18 user nova-compute[74743]:  {{(pid=74743) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 17:09:18 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:09:18 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Cleaning up deleted instances with incomplete migration  {{(pid=74743) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 18 17:09:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-56ea5fb3-b754-4581-88a5-50d802bd2fab tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:09:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-56ea5fb3-b754-4581-88a5-50d802bd2fab tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:09:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-56ea5fb3-b754-4581-88a5-50d802bd2fab tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] No VIF found with MAC fa:16:3e:b3:91:01, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:09:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-56ea5fb3-b754-4581-88a5-50d802bd2fab tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "a77117a2-748d-4a39-8db7-8b965a1725fc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.648s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:09:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:20 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:09:20 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:09:20 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:09:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:09:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:09:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:09:20 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Auditing locally available compute resources for user (node: user) {{(pid=74743) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 17:09:20 user nova-compute[74743]: INFO nova.compute.manager [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Rebuilding instance
Nov 18 17:09:20 user nova-compute[74743]: DEBUG nova.compute.manager [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:09:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:20 user nova-compute[74743]: DEBUG nova.compute.manager [req-4acffe82-b495-490b-91f0-91c79af89144 req-5d30052a-b01a-4174-98eb-59ad31ad2ac5 service nova] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Received event network-vif-unplugged-22eb23ff-0df1-42e9-92c0-458497610ff9 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:09:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4acffe82-b495-490b-91f0-91c79af89144 req-5d30052a-b01a-4174-98eb-59ad31ad2ac5 service nova] Acquiring lock "a77117a2-748d-4a39-8db7-8b965a1725fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:09:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4acffe82-b495-490b-91f0-91c79af89144 req-5d30052a-b01a-4174-98eb-59ad31ad2ac5 service nova] Lock "a77117a2-748d-4a39-8db7-8b965a1725fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:09:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4acffe82-b495-490b-91f0-91c79af89144 req-5d30052a-b01a-4174-98eb-59ad31ad2ac5 service nova] Lock "a77117a2-748d-4a39-8db7-8b965a1725fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:09:20 user nova-compute[74743]: DEBUG nova.compute.manager [req-4acffe82-b495-490b-91f0-91c79af89144 req-5d30052a-b01a-4174-98eb-59ad31ad2ac5 service nova] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] No waiting events found dispatching network-vif-unplugged-22eb23ff-0df1-42e9-92c0-458497610ff9 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:09:20 user nova-compute[74743]: WARNING nova.compute.manager [req-4acffe82-b495-490b-91f0-91c79af89144 req-5d30052a-b01a-4174-98eb-59ad31ad2ac5 service nova] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Received unexpected event network-vif-unplugged-22eb23ff-0df1-42e9-92c0-458497610ff9 for instance with vm_state active and task_state rebuilding.
Nov 18 17:09:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:21 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Instance destroyed successfully.
Nov 18 17:09:21 user nova-compute[74743]: INFO nova.compute.manager [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Detaching volume ec4a2b65-8e33-4a44-8961-7c0570cde14e
Nov 18 17:09:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:21 user nova-compute[74743]: INFO nova.virt.block_device [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Attempting to driver detach volume ec4a2b65-8e33-4a44-8961-7c0570cde14e from mountpoint /dev/vdb
Nov 18 17:09:21 user nova-compute[74743]: DEBUG os_brick.utils [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Attempting to detach device vdb from instance a77117a2-748d-4a39-8db7-8b965a1725fc from the persistent domain config. {{(pid=74743) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 17:09:21 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:09:21 user nova-compute[74743]:   <source dev="/dev/sdb"/>
Nov 18 17:09:21 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:09:21 user nova-compute[74743]:   <serial>ec4a2b65-8e33-4a44-8961-7c0570cde14e</serial>
Nov 18 17:09:21 user nova-compute[74743]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 17:09:21 user nova-compute[74743]: </disk>
Nov 18 17:09:21 user nova-compute[74743]:  {{(pid=74743) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17dcc28-27e1-4377-86c6-4c90c69d2b77]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1116acd8874d\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:21 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Successfully detached device vdb from instance a77117a2-748d-4a39-8db7-8b965a1725fc from the persistent domain config.
Nov 18 17:09:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] calling os-brick to detach iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, {'target_iqn': 'iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ziSgfLDh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:09:21 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 18 17:09:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8478f91-78d3-4841-86d9-f08fb904821a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[85bf04ab-60b6-4267-b333-b27d75715511]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 17:09:21 user nova-compute[74743]: No targets found.
Nov 18 17:09:21 user nova-compute[74743]: iSNS:
Nov 18 17:09:21 user nova-compute[74743]: No targets found.
Nov 18 17:09:21 user nova-compute[74743]: STATIC:
Nov 18 17:09:21 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e
Nov 18 17:09:21 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:09:21 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:09:21 user nova-compute[74743]: FIRMWARE:
Nov 18 17:09:21 user nova-compute[74743]: No targets found.
Nov 18 17:09:21 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 17:09:21 user nova-compute[74743]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 17:09:21 user nova-compute[74743]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74743) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e', 0)] {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b402b69-0465-4188-a130-247472d267b5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[377d4341-f730-44e0-b152-7e8b57990610]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Running cmd (subprocess): nvme version {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] 'nvme version' failed. Not Retrying. {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38f766b-00de-4708-abee-6f193072222d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.nvmeof [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] nvme not present on system {{(pid=74743) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:09:21 user nova-compute[74743]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 17:09:21 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[df408c6c-4355-403b-8040-50ac20c2aa13]: (4, '') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[93dc94f6-cc54-492d-85ec-5885c7677b0b]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)
Nov 18 17:09:21 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)
Nov 18 17:09:21 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb08335e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e'): ({'sdb'}, set())}) {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Removing single pathed devices sdb {{(pid=74743) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74743) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] LIGHTOS: no hostnqn found. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG os_brick.utils [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] <== get_connector_properties: return (176ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1116acd8874d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG nova.virt.block_device [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Updating existing volume attachment record: b66df61d-2bab-4f45-8375-d3b414111fae {{(pid=74743) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5af9b22-8371-41e7-895f-adf0fbf71859]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c079836-4928-412f-891b-f58653afd035]: (4, ('ok\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Flushing IO for device /dev/sdb {{(pid=74743) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4487a1a-b5f8-46c5-b20d-ca1a76a1f16c]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74743) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 17:09:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:22 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[03cf2c86-c829-428f-9d22-3a3789f1b70e]: (4, ('1', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:22 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 17:09:22 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] SCSI volumes sdb have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 17:09:22 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e')] {{(pid=74743) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 17:09:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:22 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[275135b1-82d3-4ae4-af8d-653bf2b37759]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:22 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:09:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e -p 172.16.0.220:3260 --logout {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:22 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b167e75-c493-4b38-a3e4-ce30d3f0592b]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:22 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e, portal: 172.16.0.220,3260]
Nov 18 17:09:22 user nova-compute[74743]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e, portal: 172.16.0.220,3260] successful.
Nov 18 17:09:22 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:09:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e -p 172.16.0.220:3260 --op delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:22 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5bee374-3806-469d-b27b-49d5c698db7f]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:22 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:09:22 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:09:22 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] <== disconnect_volume: return (367ms) None {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:09:22 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Disconnected iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 17:09:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad8aa2d-663c-4829-87f9-07959105ca68/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad8aa2d-663c-4829-87f9-07959105ca68/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad8aa2d-663c-4829-87f9-07959105ca68/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad8aa2d-663c-4829-87f9-07959105ca68/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77117a2-748d-4a39-8db7-8b965a1725fc/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77117a2-748d-4a39-8db7-8b965a1725fc/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77117a2-748d-4a39-8db7-8b965a1725fc/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:23 user nova-compute[74743]: DEBUG nova.compute.manager [req-232881a7-1b8a-4083-ac99-9bcb5a35f741 req-ae158aca-3ca1-4f14-a028-72a4cb043d5d service nova] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Received event network-vif-plugged-22eb23ff-0df1-42e9-92c0-458497610ff9 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:09:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-232881a7-1b8a-4083-ac99-9bcb5a35f741 req-ae158aca-3ca1-4f14-a028-72a4cb043d5d service nova] Acquiring lock "a77117a2-748d-4a39-8db7-8b965a1725fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:09:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-232881a7-1b8a-4083-ac99-9bcb5a35f741 req-ae158aca-3ca1-4f14-a028-72a4cb043d5d service nova] Lock "a77117a2-748d-4a39-8db7-8b965a1725fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:09:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-232881a7-1b8a-4083-ac99-9bcb5a35f741 req-ae158aca-3ca1-4f14-a028-72a4cb043d5d service nova] Lock "a77117a2-748d-4a39-8db7-8b965a1725fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:09:23 user nova-compute[74743]: DEBUG nova.compute.manager [req-232881a7-1b8a-4083-ac99-9bcb5a35f741 req-ae158aca-3ca1-4f14-a028-72a4cb043d5d service nova] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] No waiting events found dispatching network-vif-plugged-22eb23ff-0df1-42e9-92c0-458497610ff9 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:09:23 user nova-compute[74743]: WARNING nova.compute.manager [req-232881a7-1b8a-4083-ac99-9bcb5a35f741 req-ae158aca-3ca1-4f14-a028-72a4cb043d5d service nova] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Received unexpected event network-vif-plugged-22eb23ff-0df1-42e9-92c0-458497610ff9 for instance with vm_state active and task_state rebuilding.
Nov 18 17:09:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77117a2-748d-4a39-8db7-8b965a1725fc/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk.rescue --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk.rescue --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:23 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b51739-7900-47bd-a01e-2e83e2f13ae1/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b51739-7900-47bd-a01e-2e83e2f13ae1/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b51739-7900-47bd-a01e-2e83e2f13ae1/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b51739-7900-47bd-a01e-2e83e2f13ae1/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a9b12da-02c5-42ba-b215-a20df0e3ea4f/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a9b12da-02c5-42ba-b215-a20df0e3ea4f/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a9b12da-02c5-42ba-b215-a20df0e3ea4f/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a9b12da-02c5-42ba-b215-a20df0e3ea4f/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:24 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55192f7b-5aaf-42e6-926a-cf9f43e460ca/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55192f7b-5aaf-42e6-926a-cf9f43e460ca/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55192f7b-5aaf-42e6-926a-cf9f43e460ca/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55192f7b-5aaf-42e6-926a-cf9f43e460ca/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5c74497-1d1c-48a0-9b0a-e7df2a41361c/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5c74497-1d1c-48a0-9b0a-e7df2a41361c/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5c74497-1d1c-48a0-9b0a-e7df2a41361c/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5c74497-1d1c-48a0-9b0a-e7df2a41361c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:26 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:09:26 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:09:26 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Hypervisor/Node resource view: name=user free_ram=7213MB free_disk=25.544174194335938GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74743) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 17:09:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:09:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:09:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3003eceb-41f0-49d4-a190-413aa66abb96 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Acquiring lock "55192f7b-5aaf-42e6-926a-cf9f43e460ca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:09:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3003eceb-41f0-49d4-a190-413aa66abb96 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Lock "55192f7b-5aaf-42e6-926a-cf9f43e460ca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:09:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3003eceb-41f0-49d4-a190-413aa66abb96 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Acquiring lock "55192f7b-5aaf-42e6-926a-cf9f43e460ca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:09:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3003eceb-41f0-49d4-a190-413aa66abb96 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Lock "55192f7b-5aaf-42e6-926a-cf9f43e460ca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:09:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3003eceb-41f0-49d4-a190-413aa66abb96 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Lock "55192f7b-5aaf-42e6-926a-cf9f43e460ca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:09:26 user nova-compute[74743]: INFO nova.compute.manager [None req-3003eceb-41f0-49d4-a190-413aa66abb96 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Terminating instance
Nov 18 17:09:26 user nova-compute[74743]: DEBUG nova.compute.manager [None req-3003eceb-41f0-49d4-a190-413aa66abb96 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Start destroying the instance on the hypervisor. {{(pid=74743) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 17:09:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:26 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 4cce1628-2dcb-40c7-abd4-6a327a432de3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:09:26 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance e9668e1c-1e8d-4dd7-8f58-d453db294557 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:09:26 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance c006a4ad-a8e2-4108-9af1-dec4dd53fcda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:09:26 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 55192f7b-5aaf-42e6-926a-cf9f43e460ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:09:26 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance a77117a2-748d-4a39-8db7-8b965a1725fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:09:26 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 49ebdd5a-824d-476a-bd10-3b891bbfe9e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:09:26 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance c5c74497-1d1c-48a0-9b0a-e7df2a41361c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:09:26 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 8a9b12da-02c5-42ba-b215-a20df0e3ea4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:09:26 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance e2b51739-7900-47bd-a01e-2e83e2f13ae1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:09:26 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 0ad8aa2d-663c-4829-87f9-07959105ca68 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:09:26 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 7764af08-2214-4a2f-84c4-cab1366e198d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:09:26 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 17:09:26 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 17:09:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:26 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Refreshing inventories for resource provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 18 17:09:26 user nova-compute[74743]: DEBUG nova.compute.manager [req-7e4619cf-415c-45e7-9e23-a23c3714abce req-d552973a-4ffc-43a0-81c6-7802d15ee3e7 service nova] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Received event network-vif-unplugged-3fecf596-29c4-44af-bbe1-25589e8aa794 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:09:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-7e4619cf-415c-45e7-9e23-a23c3714abce req-d552973a-4ffc-43a0-81c6-7802d15ee3e7 service nova] Acquiring lock "55192f7b-5aaf-42e6-926a-cf9f43e460ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:09:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-7e4619cf-415c-45e7-9e23-a23c3714abce req-d552973a-4ffc-43a0-81c6-7802d15ee3e7 service nova] Lock "55192f7b-5aaf-42e6-926a-cf9f43e460ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:09:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-7e4619cf-415c-45e7-9e23-a23c3714abce req-d552973a-4ffc-43a0-81c6-7802d15ee3e7 service nova] Lock "55192f7b-5aaf-42e6-926a-cf9f43e460ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:09:26 user nova-compute[74743]: DEBUG nova.compute.manager [req-7e4619cf-415c-45e7-9e23-a23c3714abce req-d552973a-4ffc-43a0-81c6-7802d15ee3e7 service nova] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] No waiting events found dispatching network-vif-unplugged-3fecf596-29c4-44af-bbe1-25589e8aa794 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:09:26 user nova-compute[74743]: DEBUG nova.compute.manager [req-7e4619cf-415c-45e7-9e23-a23c3714abce req-d552973a-4ffc-43a0-81c6-7802d15ee3e7 service nova] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Received event network-vif-unplugged-3fecf596-29c4-44af-bbe1-25589e8aa794 for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:09:26 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Updating ProviderTree inventory for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 18 17:09:26 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Updating inventory in ProviderTree for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 18 17:09:26 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Refreshing aggregate associations for resource provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8, aggregates: None {{(pid=74743) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 18 17:09:26 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Refreshing trait associations for resource provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=74743) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 18 17:09:26 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:09:26 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:09:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:26 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Compute_service record updated for user:user {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 17:09:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.888s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:09:26 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Instance destroyed successfully.
Nov 18 17:09:26 user nova-compute[74743]: DEBUG nova.objects.instance [None req-3003eceb-41f0-49d4-a190-413aa66abb96 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Lazy-loading 'resources' on Instance uuid 55192f7b-5aaf-42e6-926a-cf9f43e460ca {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:09:26 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-3003eceb-41f0-49d4-a190-413aa66abb96 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:03:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1823884685',display_name='tempest-VolumesAdminNegativeTest-server-1823884685',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1823884685',id=5,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGPP9lsksFArxs5iFHEi8PYNNWvHYUdLAawuA/+1ivjm+ignM6Cd64ss5YopxV/XhvvrnyE/R11ZJ1l1zaKGVNIZhPKveeZ3qoPb4hibnTVIXDBiAVztQNo6XMZlH4rItA==',key_name='tempest-keypair-863170876',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:03:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c967f66b058543878a89b86b4791d5fc',ramdisk_id='',reservation_id='r-946otidy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-18073692',owner_user_name='tempest-VolumesAdminNegativeTest-18073692-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:03:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99af9f03493348bebcc384eb94d8ea9a',uuid=55192f7b-5aaf-42e6-926a-cf9f43e460ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3fecf596-29c4-44af-bbe1-25589e8aa794", "address": "fa:16:3e:1c:10:2b", "network": {"id": "7537df91-4e59-4569-88de-6dbbd9d5a4e4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1983739170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c967f66b058543878a89b86b4791d5fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fecf596-29", "ovs_interfaceid": "3fecf596-29c4-44af-bbe1-25589e8aa794", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:09:26 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-3003eceb-41f0-49d4-a190-413aa66abb96 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Converting VIF {"id": "3fecf596-29c4-44af-bbe1-25589e8aa794", "address": "fa:16:3e:1c:10:2b", "network": {"id": "7537df91-4e59-4569-88de-6dbbd9d5a4e4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1983739170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c967f66b058543878a89b86b4791d5fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fecf596-29", "ovs_interfaceid": "3fecf596-29c4-44af-bbe1-25589e8aa794", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:09:26 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-3003eceb-41f0-49d4-a190-413aa66abb96 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:10:2b,bridge_name='br-int',has_traffic_filtering=True,id=3fecf596-29c4-44af-bbe1-25589e8aa794,network=Network(7537df91-4e59-4569-88de-6dbbd9d5a4e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fecf596-29') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:09:26 user nova-compute[74743]: DEBUG os_vif [None req-3003eceb-41f0-49d4-a190-413aa66abb96 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:10:2b,bridge_name='br-int',has_traffic_filtering=True,id=3fecf596-29c4-44af-bbe1-25589e8aa794,network=Network(7537df91-4e59-4569-88de-6dbbd9d5a4e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fecf596-29') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:09:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3fecf596-29, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:09:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:09:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8d347003-b3ef-4a1a-8759-a51c87e05494) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:09:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:09:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:26 user nova-compute[74743]: INFO os_vif [None req-3003eceb-41f0-49d4-a190-413aa66abb96 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:10:2b,bridge_name='br-int',has_traffic_filtering=True,id=3fecf596-29c4-44af-bbe1-25589e8aa794,network=Network(7537df91-4e59-4569-88de-6dbbd9d5a4e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fecf596-29')
Nov 18 17:09:26 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-3003eceb-41f0-49d4-a190-413aa66abb96 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Deleting instance files /opt/stack/data/nova/instances/55192f7b-5aaf-42e6-926a-cf9f43e460ca_del
Nov 18 17:09:26 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-3003eceb-41f0-49d4-a190-413aa66abb96 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Deletion of /opt/stack/data/nova/instances/55192f7b-5aaf-42e6-926a-cf9f43e460ca_del complete
Nov 18 17:09:27 user nova-compute[74743]: INFO nova.compute.manager [None req-3003eceb-41f0-49d4-a190-413aa66abb96 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 18 17:09:27 user nova-compute[74743]: DEBUG oslo.service.loopingcall [None req-3003eceb-41f0-49d4-a190-413aa66abb96 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74743) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 17:09:27 user nova-compute[74743]: DEBUG nova.compute.manager [-] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Deallocating network for instance {{(pid=74743) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 17:09:27 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] deallocate_for_instance() {{(pid=74743) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 17:09:27 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:09:27 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:09:27 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:09:27 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:09:27 user nova-compute[74743]: INFO nova.compute.manager [-] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Took 0.88 seconds to deallocate network for instance.
Nov 18 17:09:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3003eceb-41f0-49d4-a190-413aa66abb96 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:09:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3003eceb-41f0-49d4-a190-413aa66abb96 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:09:28 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-3003eceb-41f0-49d4-a190-413aa66abb96 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:09:28 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-3003eceb-41f0-49d4-a190-413aa66abb96 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:09:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3003eceb-41f0-49d4-a190-413aa66abb96 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.376s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:09:28 user nova-compute[74743]: INFO nova.scheduler.client.report [None req-3003eceb-41f0-49d4-a190-413aa66abb96 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Deleted allocations for instance 55192f7b-5aaf-42e6-926a-cf9f43e460ca
Nov 18 17:09:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3003eceb-41f0-49d4-a190-413aa66abb96 tempest-VolumesAdminNegativeTest-18073692 tempest-VolumesAdminNegativeTest-18073692-project-member] Lock "55192f7b-5aaf-42e6-926a-cf9f43e460ca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.355s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:09:28 user nova-compute[74743]: DEBUG nova.compute.manager [req-7590b342-fbe6-4f7f-9734-72f2a7fdfbe7 req-3820ecd6-d8e2-4269-9fd9-51abc9bf6568 service nova] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Received event network-vif-plugged-3fecf596-29c4-44af-bbe1-25589e8aa794 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:09:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-7590b342-fbe6-4f7f-9734-72f2a7fdfbe7 req-3820ecd6-d8e2-4269-9fd9-51abc9bf6568 service nova] Acquiring lock "55192f7b-5aaf-42e6-926a-cf9f43e460ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:09:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-7590b342-fbe6-4f7f-9734-72f2a7fdfbe7 req-3820ecd6-d8e2-4269-9fd9-51abc9bf6568 service nova] Lock "55192f7b-5aaf-42e6-926a-cf9f43e460ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:09:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-7590b342-fbe6-4f7f-9734-72f2a7fdfbe7 req-3820ecd6-d8e2-4269-9fd9-51abc9bf6568 service nova] Lock "55192f7b-5aaf-42e6-926a-cf9f43e460ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:09:28 user nova-compute[74743]: DEBUG nova.compute.manager [req-7590b342-fbe6-4f7f-9734-72f2a7fdfbe7 req-3820ecd6-d8e2-4269-9fd9-51abc9bf6568 service nova] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] No waiting events found dispatching network-vif-plugged-3fecf596-29c4-44af-bbe1-25589e8aa794 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:09:28 user nova-compute[74743]: WARNING nova.compute.manager [req-7590b342-fbe6-4f7f-9734-72f2a7fdfbe7 req-3820ecd6-d8e2-4269-9fd9-51abc9bf6568 service nova] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Received unexpected event network-vif-plugged-3fecf596-29c4-44af-bbe1-25589e8aa794 for instance with vm_state deleted and task_state None.
Nov 18 17:09:28 user nova-compute[74743]: DEBUG nova.compute.manager [req-7590b342-fbe6-4f7f-9734-72f2a7fdfbe7 req-3820ecd6-d8e2-4269-9fd9-51abc9bf6568 service nova] [instance: 55192f7b-5aaf-42e6-926a-cf9f43e460ca] Received event network-vif-deleted-3fecf596-29c4-44af-bbe1-25589e8aa794 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:09:28 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Instance destroyed successfully.
Nov 18 17:09:28 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:07:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-196576409',display_name='tempest-ServerActionsTestOtherA-server-927938606',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-196576409',id=15,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJ9kBQV92QaO3NUQbsdxDa+z/O1R04nUATEUKPjnEHL9HBfHVAhzij3/MW2rTF8MFDQnt9uJ84+7PkWlYtClUm5BR319p/vhy/LOgQaMQorogb0O8y32fF069JI6jSm2g==',key_name='tempest-keypair-524527226',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:07:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fb8f5850162c479b8d185e48c03be7d3',ramdisk_id='',reservation_id='r-hahsjukq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-128885625',owner_user_name='tempest-ServerActionsTestOtherA-128885625-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:09:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce3e4cef47114a7c9327db639460d923',uuid=a77117a2-748d-4a39-8db7-8b965a1725fc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22eb23ff-0df1-42e9-92c0-458497610ff9", "address": "fa:16:3e:b3:91:01", "network": {"id": "fd98f398-6576-449b-a737-887906eb6656", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668610993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb8f5850162c479b8d185e48c03be7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22eb23ff-0d", "ovs_interfaceid": "22eb23ff-0df1-42e9-92c0-458497610ff9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:09:28 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Converting VIF {"id": "22eb23ff-0df1-42e9-92c0-458497610ff9", "address": "fa:16:3e:b3:91:01", "network": {"id": "fd98f398-6576-449b-a737-887906eb6656", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668610993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb8f5850162c479b8d185e48c03be7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22eb23ff-0d", "ovs_interfaceid": "22eb23ff-0df1-42e9-92c0-458497610ff9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:09:28 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:91:01,bridge_name='br-int',has_traffic_filtering=True,id=22eb23ff-0df1-42e9-92c0-458497610ff9,network=Network(fd98f398-6576-449b-a737-887906eb6656),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22eb23ff-0d') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:09:28 user nova-compute[74743]: DEBUG os_vif [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:91:01,bridge_name='br-int',has_traffic_filtering=True,id=22eb23ff-0df1-42e9-92c0-458497610ff9,network=Network(fd98f398-6576-449b-a737-887906eb6656),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22eb23ff-0d') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:09:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22eb23ff-0d, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:09:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:09:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a33bfd3b-4425-4cdc-9e62-08fa18ef0f55) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:09:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:28 user nova-compute[74743]: INFO os_vif [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:91:01,bridge_name='br-int',has_traffic_filtering=True,id=22eb23ff-0df1-42e9-92c0-458497610ff9,network=Network(fd98f398-6576-449b-a737-887906eb6656),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22eb23ff-0d')
Nov 18 17:09:28 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] calling os-brick to detach iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 17:09:28 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, {'target_iqn': 'iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ziSgfLDh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:09:28 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 18 17:09:28 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:09:28 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:09:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:09:28 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[ee9260ae-25bb-48a8-8171-c5b196737d1c]: Unexpected error while running command.
Nov 18 17:09:28 user nova-compute[74743]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 18 17:09:28 user nova-compute[74743]: Exit code: 21
Nov 18 17:09:28 user nova-compute[74743]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 18 17:09:28 user nova-compute[74743]: Stderr: '' {{(pid=85244) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Nov 18 17:09:28 user nova-compute[74743]: Traceback (most recent call last):
Nov 18 17:09:28 user nova-compute[74743]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Nov 18 17:09:28 user nova-compute[74743]:     ret = func(*f_args, **f_kwargs)
Nov 18 17:09:28 user nova-compute[74743]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Nov 18 17:09:28 user nova-compute[74743]:     return func(*args, **kwargs)
Nov 18 17:09:28 user nova-compute[74743]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Nov 18 17:09:28 user nova-compute[74743]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Nov 18 17:09:28 user nova-compute[74743]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Nov 18 17:09:28 user nova-compute[74743]:     return putils.execute(on_execute=on_execute,
Nov 18 17:09:28 user nova-compute[74743]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Nov 18 17:09:28 user nova-compute[74743]:     raise ProcessExecutionError(exit_code=_returncode,
Nov 18 17:09:28 user nova-compute[74743]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 18 17:09:28 user nova-compute[74743]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 18 17:09:28 user nova-compute[74743]: Exit code: 21
Nov 18 17:09:28 user nova-compute[74743]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 18 17:09:28 user nova-compute[74743]: Stderr: ''
Nov 18 17:09:28 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9260ae-25bb-48a8-8171-c5b196737d1c]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:28 user nova-compute[74743]: ERROR os_brick.initiator.connectors.iscsi [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 18 17:09:28 user nova-compute[74743]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 18 17:09:28 user nova-compute[74743]: Exit code: 21
Nov 18 17:09:28 user nova-compute[74743]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 18 17:09:28 user nova-compute[74743]: Stderr: ''
Nov 18 17:09:28 user nova-compute[74743]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Nov 18 17:09:28 user nova-compute[74743]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/nova/nova/compute/manager.py", line 4132, in _do_rebuild_instance
Nov 18 17:09:28 user nova-compute[74743]: ERROR os_brick.initiator.connectors.iscsi     self.driver.rebuild(**kwargs)
Nov 18 17:09:28 user nova-compute[74743]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/nova/nova/virt/driver.py", line 384, in rebuild
Nov 18 17:09:28 user nova-compute[74743]: ERROR os_brick.initiator.connectors.iscsi     raise NotImplementedError()
Nov 18 17:09:28 user nova-compute[74743]: ERROR os_brick.initiator.connectors.iscsi NotImplementedError
Nov 18 17:09:28 user nova-compute[74743]: ERROR os_brick.initiator.connectors.iscsi 
Nov 18 17:09:28 user nova-compute[74743]: ERROR os_brick.initiator.connectors.iscsi During handling of the above exception, another exception occurred:
Nov 18 17:09:28 user nova-compute[74743]: ERROR os_brick.initiator.connectors.iscsi 
Nov 18 17:09:28 user nova-compute[74743]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Nov 18 17:09:28 user nova-compute[74743]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Nov 18 17:09:28 user nova-compute[74743]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Nov 18 17:09:28 user nova-compute[74743]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Nov 18 17:09:28 user nova-compute[74743]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Nov 18 17:09:28 user nova-compute[74743]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Nov 18 17:09:28 user nova-compute[74743]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Nov 18 17:09:28 user nova-compute[74743]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Nov 18 17:09:28 user nova-compute[74743]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Nov 18 17:09:28 user nova-compute[74743]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Nov 18 17:09:28 user nova-compute[74743]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Nov 18 17:09:28 user nova-compute[74743]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Nov 18 17:09:28 user nova-compute[74743]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Nov 18 17:09:28 user nova-compute[74743]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Nov 18 17:09:28 user nova-compute[74743]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Nov 18 17:09:28 user nova-compute[74743]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 18 17:09:28 user nova-compute[74743]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Nov 18 17:09:28 user nova-compute[74743]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Nov 18 17:09:28 user nova-compute[74743]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 18 17:09:28 user nova-compute[74743]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Nov 18 17:09:28 user nova-compute[74743]: ERROR os_brick.initiator.connectors.iscsi 
Nov 18 17:09:28 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=74743) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Nov 18 17:09:28 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.032s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:09:28 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] <== disconnect_volume: return (33ms) None {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:09:28 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Disconnected iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 17:09:28 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Deleting instance files /opt/stack/data/nova/instances/a77117a2-748d-4a39-8db7-8b965a1725fc_del
Nov 18 17:09:28 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Deletion of /opt/stack/data/nova/instances/a77117a2-748d-4a39-8db7-8b965a1725fc_del complete
Nov 18 17:09:28 user nova-compute[74743]: INFO nova.virt.block_device [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Booting with volume ec4a2b65-8e33-4a44-8961-7c0570cde14e at /dev/vdb
Nov 18 17:09:28 user nova-compute[74743]: DEBUG os_brick.utils [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:09:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:28 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[751308e3-1fa0-4014-a47b-cc0d42361ec6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1116acd8874d\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:28 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8de21eb-2041-4b3d-81b6-85766c3defa8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:28 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e593feb-8e1a-4bd5-8ee6-68955b097a55]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:28 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[4568d71e-c5ed-4e71-83be-5abb5363d81d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Running cmd (subprocess): nvme version {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] 'nvme version' failed. Not Retrying. {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:09:28 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] nvme not present on system {{(pid=74743) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 17:09:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:09:28 user nova-compute[74743]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 17:09:28 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37b6ee6-481f-4fc2-91ac-9b1c11c5e8c0]: (4, '') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:28 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74743) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 17:09:28 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 17:09:28 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] LIGHTOS: no hostnqn found. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 17:09:28 user nova-compute[74743]: DEBUG os_brick.utils [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1116acd8874d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:09:28 user nova-compute[74743]: DEBUG nova.virt.block_device [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Updating existing volume attachment record: 92d1a34b-7e7c-4cfd-938e-73b87349d063 {{(pid=74743) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG nova.compute.manager [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Start spawning the instance on the hypervisor. {{(pid=74743) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Creating instance directory {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 17:09:29 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Creating image(s)
Nov 18 17:09:29 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Did not create local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Ensure instance console log exists: /opt/stack/data/nova/instances/7764af08-2214-4a2f-84c4-cab1366e198d/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Start _get_guest_xml network_info=[{"id": "b8787812-1f2e-4f67-8a5c-9eede06d1506", "address": "fa:16:3e:bd:2f:d7", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8787812-1f", "ovs_interfaceid": "b8787812-1f2e-4f67-8a5c-9eede06d1506", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': 'b66df61d-2bab-4f45-8375-d3b414111fae', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cFXSkHrj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7764af08-2214-4a2f-84c4-cab1366e198d', 'attached_at': '', 'detached_at': '', 'volume_id': '2bf86bdf-9bdc-4e39-a057-e6c34bc0daad', 'serial': '2bf86bdf-9bdc-4e39-a057-e6c34bc0daad'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:09:29 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:09:29 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:09:29 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Calling os-brick to attach iSCSI Volume {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cFXSkHrj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:09:29 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:09:29 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:09:29 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:09:29 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:09:29 user nova-compute[74743]: INFO os_brick.initiator.connectors.iscsi [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 17:09:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad -p 172.16.0.220:3260 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3dff8cd-aef4-41d5-8a73-8f4d41a7da22]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 17:09:29 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad -p 172.16.0.220:3260 --interface default --op new {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a7616c-e6de-41bd-8e8b-c8bc79c34d10]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad] added\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad] added
Nov 18 17:09:29 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b34a3f6-f82a-4d65-9836-351c67d3c08b]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a1e39e-86b8-4d7f-82c8-d5a794169e87]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cFXSkHrj {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cFXSkHrj" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d382420-6d1c-475a-b70e-13c54eda822a]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cFXSkHrj'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b27955-7bea-43ac-a1b1-6b4871269f8e]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f76510-dca2-4e39-b51f-efb6592affe2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 18 17:09:29 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 18 17:09:29 user nova-compute[74743]:  {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:09:29 user nova-compute[74743]: WARNING os_brick.initiator.connectors.iscsi [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 18 17:09:29 user nova-compute[74743]: 
Nov 18 17:09:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad -p 172.16.0.220:3260 --login {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b39c096-82e7-42d9-8511-879706d5b23f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad, portal: 172.16.0.220,3260]
Nov 18 17:09:29 user nova-compute[74743]: Login to [iface: default, target: iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad, portal: 172.16.0.220,3260] successful.
Nov 18 17:09:29 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d98a194-1381-4fa4-8776-7968d7795903]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e6f290-bc49-403e-b919-14b9700b82a1]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad (non-flash)
Nov 18 17:09:29 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad (non-flash)
Nov 18 17:09:29 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Connected to 172.16.0.220:3260 {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=74743) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74743) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[e265eaaa-f499-413e-a146-de4d6c39f35e]: (4, ('- - 0', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cFXSkHrj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 17:09:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:30 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:09:30 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '26165643965353566', 'path': '/dev/sdb'} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:09:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165643965353566', 'path': '/dev/sdb'} {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 17:09:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:09:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1253403991',display_name='tempest-TestVolumeBootPattern-server-1253403991',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1253403991',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a956c4d6e4304d34872ecf989279c886',ramdisk_id='',reservation_id='r-4ue1yy61',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1373443944',owner_user_name='tempest-TestVolumeBootPattern-1373443944-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:09:16Z,user_data=None,user_id='89ce0d4bf7234c348b9b1a8979609c7b',uuid=7764af08-2214-4a2f-84c4-cab1366e198d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8787812-1f2e-4f67-8a5c-9eede06d1506", "address": "fa:16:3e:bd:2f:d7", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8787812-1f", "ovs_interfaceid": "b8787812-1f2e-4f67-8a5c-9eede06d1506", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:09:30 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Converting VIF {"id": "b8787812-1f2e-4f67-8a5c-9eede06d1506", "address": "fa:16:3e:bd:2f:d7", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8787812-1f", "ovs_interfaceid": "b8787812-1f2e-4f67-8a5c-9eede06d1506", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:09:30 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:2f:d7,bridge_name='br-int',has_traffic_filtering=True,id=b8787812-1f2e-4f67-8a5c-9eede06d1506,network=Network(fc55f18a-b779-4b04-8828-278ecd62211a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8787812-1f') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:09:30 user nova-compute[74743]: DEBUG nova.objects.instance [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lazy-loading 'pci_devices' on Instance uuid 7764af08-2214-4a2f-84c4-cab1366e198d {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:09:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:09:30 user nova-compute[74743]:   <uuid>7764af08-2214-4a2f-84c4-cab1366e198d</uuid>
Nov 18 17:09:30 user nova-compute[74743]:   <name>instance-00000015</name>
Nov 18 17:09:30 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:09:30 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:09:30 user nova-compute[74743]:   <metadata>
Nov 18 17:09:30 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:09:30 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:09:30 user nova-compute[74743]:       <nova:name>tempest-TestVolumeBootPattern-server-1253403991</nova:name>
Nov 18 17:09:30 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:09:29</nova:creationTime>
Nov 18 17:09:30 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:09:30 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:09:30 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:09:30 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:09:30 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:09:30 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:09:30 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:09:30 user nova-compute[74743]:       <nova:owner>
Nov 18 17:09:30 user nova-compute[74743]:         <nova:user uuid="89ce0d4bf7234c348b9b1a8979609c7b">tempest-TestVolumeBootPattern-1373443944-project-member</nova:user>
Nov 18 17:09:30 user nova-compute[74743]:         <nova:project uuid="a956c4d6e4304d34872ecf989279c886">tempest-TestVolumeBootPattern-1373443944</nova:project>
Nov 18 17:09:30 user nova-compute[74743]:       </nova:owner>
Nov 18 17:09:30 user nova-compute[74743]:       <nova:ports>
Nov 18 17:09:30 user nova-compute[74743]:         <nova:port uuid="b8787812-1f2e-4f67-8a5c-9eede06d1506">
Nov 18 17:09:30 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 18 17:09:30 user nova-compute[74743]:         </nova:port>
Nov 18 17:09:30 user nova-compute[74743]:       </nova:ports>
Nov 18 17:09:30 user nova-compute[74743]:     </nova:instance>
Nov 18 17:09:30 user nova-compute[74743]:   </metadata>
Nov 18 17:09:30 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:09:30 user nova-compute[74743]:     <system>
Nov 18 17:09:30 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:09:30 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:09:30 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:09:30 user nova-compute[74743]:       <entry name="serial">7764af08-2214-4a2f-84c4-cab1366e198d</entry>
Nov 18 17:09:30 user nova-compute[74743]:       <entry name="uuid">7764af08-2214-4a2f-84c4-cab1366e198d</entry>
Nov 18 17:09:30 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:09:30 user nova-compute[74743]:     </system>
Nov 18 17:09:30 user nova-compute[74743]:   </sysinfo>
Nov 18 17:09:30 user nova-compute[74743]:   <os>
Nov 18 17:09:30 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:09:30 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:09:30 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:09:30 user nova-compute[74743]:   </os>
Nov 18 17:09:30 user nova-compute[74743]:   <features>
Nov 18 17:09:30 user nova-compute[74743]:     <acpi/>
Nov 18 17:09:30 user nova-compute[74743]:     <apic/>
Nov 18 17:09:30 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:09:30 user nova-compute[74743]:   </features>
Nov 18 17:09:30 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:09:30 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:09:30 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:09:30 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:09:30 user nova-compute[74743]:   </clock>
Nov 18 17:09:30 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:09:30 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:09:30 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:09:30 user nova-compute[74743]:   </cpu>
Nov 18 17:09:30 user nova-compute[74743]:   <devices>
Nov 18 17:09:30 user nova-compute[74743]:     <disk type="block" device="disk">
Nov 18 17:09:30 user nova-compute[74743]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:09:30 user nova-compute[74743]:       <source dev="/dev/sdb"/>
Nov 18 17:09:30 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:09:30 user nova-compute[74743]:       <serial>2bf86bdf-9bdc-4e39-a057-e6c34bc0daad</serial>
Nov 18 17:09:30 user nova-compute[74743]:     </disk>
Nov 18 17:09:30 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:09:30 user nova-compute[74743]:       <mac address="fa:16:3e:bd:2f:d7"/>
Nov 18 17:09:30 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:09:30 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:09:30 user nova-compute[74743]:       <target dev="tapb8787812-1f"/>
Nov 18 17:09:30 user nova-compute[74743]:     </interface>
Nov 18 17:09:30 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:09:30 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/7764af08-2214-4a2f-84c4-cab1366e198d/console.log" append="off"/>
Nov 18 17:09:30 user nova-compute[74743]:     </serial>
Nov 18 17:09:30 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:09:30 user nova-compute[74743]:     <video>
Nov 18 17:09:30 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:09:30 user nova-compute[74743]:     </video>
Nov 18 17:09:30 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:09:30 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:09:30 user nova-compute[74743]:     </rng>
Nov 18 17:09:30 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:09:30 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:09:30 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:09:30 user nova-compute[74743]:     </memballoon>
Nov 18 17:09:30 user nova-compute[74743]:   </devices>
Nov 18 17:09:30 user nova-compute[74743]: </domain>
Nov 18 17:09:30 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:09:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:09:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1253403991',display_name='tempest-TestVolumeBootPattern-server-1253403991',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1253403991',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a956c4d6e4304d34872ecf989279c886',ramdisk_id='',reservation_id='r-4ue1yy61',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1373443944',owner_user_name='tempest-TestVolumeBootPattern-1373443944-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:09:16Z,user_data=None,user_id='89ce0d4bf7234c348b9b1a8979609c7b',uuid=7764af08-2214-4a2f-84c4-cab1366e198d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8787812-1f2e-4f67-8a5c-9eede06d1506", "address": "fa:16:3e:bd:2f:d7", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8787812-1f", "ovs_interfaceid": "b8787812-1f2e-4f67-8a5c-9eede06d1506", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:09:30 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Converting VIF {"id": "b8787812-1f2e-4f67-8a5c-9eede06d1506", "address": "fa:16:3e:bd:2f:d7", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8787812-1f", "ovs_interfaceid": "b8787812-1f2e-4f67-8a5c-9eede06d1506", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:09:30 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:2f:d7,bridge_name='br-int',has_traffic_filtering=True,id=b8787812-1f2e-4f67-8a5c-9eede06d1506,network=Network(fc55f18a-b779-4b04-8828-278ecd62211a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8787812-1f') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:09:30 user nova-compute[74743]: DEBUG os_vif [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:2f:d7,bridge_name='br-int',has_traffic_filtering=True,id=b8787812-1f2e-4f67-8a5c-9eede06d1506,network=Network(fc55f18a-b779-4b04-8828-278ecd62211a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8787812-1f') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:09:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:09:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:09:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6409be40-1b96-5bdb-8fe7-8b20f117fb6e', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:09:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb8787812-1f, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:09:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb8787812-1f, col_values=(('qos', UUID('38284f97-e8d8-46d5-8887-1c717ccc7e2c')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:09:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb8787812-1f, col_values=(('external_ids', {'iface-id': 'b8787812-1f2e-4f67-8a5c-9eede06d1506', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:2f:d7', 'vm-uuid': '7764af08-2214-4a2f-84c4-cab1366e198d'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:09:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:09:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:30 user nova-compute[74743]: INFO os_vif [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:2f:d7,bridge_name='br-int',has_traffic_filtering=True,id=b8787812-1f2e-4f67-8a5c-9eede06d1506,network=Network(fc55f18a-b779-4b04-8828-278ecd62211a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8787812-1f')
Nov 18 17:09:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:09:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] No VIF found with MAC fa:16:3e:bd:2f:d7, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:09:31 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:31 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:31 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:31 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:32 user nova-compute[74743]: DEBUG nova.compute.manager [req-f4f77755-cd5c-47d4-9290-1810fa593193 req-879e5c96-cf74-4b9f-bf40-4aeb94d399c6 service nova] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Received event network-vif-plugged-b8787812-1f2e-4f67-8a5c-9eede06d1506 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:09:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f4f77755-cd5c-47d4-9290-1810fa593193 req-879e5c96-cf74-4b9f-bf40-4aeb94d399c6 service nova] Acquiring lock "7764af08-2214-4a2f-84c4-cab1366e198d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:09:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f4f77755-cd5c-47d4-9290-1810fa593193 req-879e5c96-cf74-4b9f-bf40-4aeb94d399c6 service nova] Lock "7764af08-2214-4a2f-84c4-cab1366e198d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:09:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f4f77755-cd5c-47d4-9290-1810fa593193 req-879e5c96-cf74-4b9f-bf40-4aeb94d399c6 service nova] Lock "7764af08-2214-4a2f-84c4-cab1366e198d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:09:32 user nova-compute[74743]: DEBUG nova.compute.manager [req-f4f77755-cd5c-47d4-9290-1810fa593193 req-879e5c96-cf74-4b9f-bf40-4aeb94d399c6 service nova] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] No waiting events found dispatching network-vif-plugged-b8787812-1f2e-4f67-8a5c-9eede06d1506 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:09:32 user nova-compute[74743]: WARNING nova.compute.manager [req-f4f77755-cd5c-47d4-9290-1810fa593193 req-879e5c96-cf74-4b9f-bf40-4aeb94d399c6 service nova] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Received unexpected event network-vif-plugged-b8787812-1f2e-4f67-8a5c-9eede06d1506 for instance with vm_state building and task_state spawning.
Nov 18 17:09:32 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:32 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:32 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:32 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:34 user nova-compute[74743]: DEBUG nova.compute.manager [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:09:34 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Guest created on hypervisor {{(pid=74743) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 17:09:34 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Instance spawned successfully.
Nov 18 17:09:34 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 17:09:34 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Found default for hw_cdrom_bus of ide {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:09:34 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Found default for hw_disk_bus of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:09:34 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Found default for hw_input_bus of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:09:34 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Found default for hw_pointer_model of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:09:34 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Found default for hw_video_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:09:34 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Found default for hw_vif_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:09:34 user nova-compute[74743]: DEBUG nova.compute.manager [req-f86a093f-0808-409f-a9fa-c7239e33a33d req-be942806-c0d6-4aed-b1de-67f0e1396757 service nova] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Received event network-vif-plugged-b8787812-1f2e-4f67-8a5c-9eede06d1506 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:09:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f86a093f-0808-409f-a9fa-c7239e33a33d req-be942806-c0d6-4aed-b1de-67f0e1396757 service nova] Acquiring lock "7764af08-2214-4a2f-84c4-cab1366e198d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:09:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f86a093f-0808-409f-a9fa-c7239e33a33d req-be942806-c0d6-4aed-b1de-67f0e1396757 service nova] Lock "7764af08-2214-4a2f-84c4-cab1366e198d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:09:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f86a093f-0808-409f-a9fa-c7239e33a33d req-be942806-c0d6-4aed-b1de-67f0e1396757 service nova] Lock "7764af08-2214-4a2f-84c4-cab1366e198d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:09:34 user nova-compute[74743]: DEBUG nova.compute.manager [req-f86a093f-0808-409f-a9fa-c7239e33a33d req-be942806-c0d6-4aed-b1de-67f0e1396757 service nova] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] No waiting events found dispatching network-vif-plugged-b8787812-1f2e-4f67-8a5c-9eede06d1506 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:09:34 user nova-compute[74743]: WARNING nova.compute.manager [req-f86a093f-0808-409f-a9fa-c7239e33a33d req-be942806-c0d6-4aed-b1de-67f0e1396757 service nova] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Received unexpected event network-vif-plugged-b8787812-1f2e-4f67-8a5c-9eede06d1506 for instance with vm_state building and task_state spawning.
Nov 18 17:09:34 user nova-compute[74743]: DEBUG nova.compute.manager [req-bd40a5b4-25c2-4043-a42e-c021a1b56472 req-4ae69944-a85d-4106-ad61-ee41143531c7 service nova] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Received event network-changed-c66ef239-8068-4eff-807a-830d5f3d0dba {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:09:34 user nova-compute[74743]: DEBUG nova.compute.manager [req-bd40a5b4-25c2-4043-a42e-c021a1b56472 req-4ae69944-a85d-4106-ad61-ee41143531c7 service nova] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Refreshing instance network info cache due to event network-changed-c66ef239-8068-4eff-807a-830d5f3d0dba. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:09:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-bd40a5b4-25c2-4043-a42e-c021a1b56472 req-4ae69944-a85d-4106-ad61-ee41143531c7 service nova] Acquiring lock "refresh_cache-49ebdd5a-824d-476a-bd10-3b891bbfe9e2" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:09:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-bd40a5b4-25c2-4043-a42e-c021a1b56472 req-4ae69944-a85d-4106-ad61-ee41143531c7 service nova] Acquired lock "refresh_cache-49ebdd5a-824d-476a-bd10-3b891bbfe9e2" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:09:34 user nova-compute[74743]: DEBUG nova.network.neutron [req-bd40a5b4-25c2-4043-a42e-c021a1b56472 req-4ae69944-a85d-4106-ad61-ee41143531c7 service nova] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Refreshing network info cache for port c66ef239-8068-4eff-807a-830d5f3d0dba {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:09:34 user nova-compute[74743]: INFO nova.compute.manager [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Took 5.26 seconds to spawn the instance on the hypervisor.
Nov 18 17:09:34 user nova-compute[74743]: DEBUG nova.compute.manager [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:09:34 user nova-compute[74743]: INFO nova.compute.manager [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Took 19.17 seconds to build instance.
Nov 18 17:09:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-805d9dc0-5f65-46b8-b4ac-d592b0d5369a tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "7764af08-2214-4a2f-84c4-cab1366e198d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.273s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:09:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:34 user nova-compute[74743]: DEBUG nova.network.neutron [req-bd40a5b4-25c2-4043-a42e-c021a1b56472 req-4ae69944-a85d-4106-ad61-ee41143531c7 service nova] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Updated VIF entry in instance network info cache for port c66ef239-8068-4eff-807a-830d5f3d0dba. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:09:34 user nova-compute[74743]: DEBUG nova.network.neutron [req-bd40a5b4-25c2-4043-a42e-c021a1b56472 req-4ae69944-a85d-4106-ad61-ee41143531c7 service nova] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Updating instance_info_cache with network_info: [{"id": "c66ef239-8068-4eff-807a-830d5f3d0dba", "address": "fa:16:3e:f3:3d:ca", "network": {"id": "79046ec4-e7a8-4b7d-8607-3205067366b6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1734449136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8955c5a052b34bde997f9db74d302edb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66ef239-80", "ovs_interfaceid": "c66ef239-8068-4eff-807a-830d5f3d0dba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:09:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-bd40a5b4-25c2-4043-a42e-c021a1b56472 req-4ae69944-a85d-4106-ad61-ee41143531c7 service nova] Releasing lock "refresh_cache-49ebdd5a-824d-476a-bd10-3b891bbfe9e2" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:09:35 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Creating instance directory {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 17:09:35 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Creating image(s)
Nov 18 17:09:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquiring lock "/opt/stack/data/nova/instances/a77117a2-748d-4a39-8db7-8b965a1725fc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:09:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "/opt/stack/data/nova/instances/a77117a2-748d-4a39-8db7-8b965a1725fc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:09:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "/opt/stack/data/nova/instances/a77117a2-748d-4a39-8db7-8b965a1725fc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:09:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.205s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquiring lock "c188b3a997bfafa42fa341f9dcc326545681eed9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:09:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:09:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.191s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/a77117a2-748d-4a39-8db7-8b965a1725fc/disk 1073741824 {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:35 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/a77117a2-748d-4a39-8db7-8b965a1725fc/disk 1073741824" returned: 0 in 0.056s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:09:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.179s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:35 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a77117a2-748d-4a39-8db7-8b965a1725fc/disk. size=1073741824 {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 17:09:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77117a2-748d-4a39-8db7-8b965a1725fc/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77117a2-748d-4a39-8db7-8b965a1725fc/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:35 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Cannot resize image /opt/stack/data/nova/instances/a77117a2-748d-4a39-8db7-8b965a1725fc/disk to a smaller size. {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 17:09:35 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Created local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 17:09:35 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Ensure instance console log exists: /opt/stack/data/nova/instances/a77117a2-748d-4a39-8db7-8b965a1725fc/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:09:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:09:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:09:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:09:35 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Start _get_guest_xml network_info=[{"id": "22eb23ff-0df1-42e9-92c0-458497610ff9", "address": "fa:16:3e:b3:91:01", "network": {"id": "fd98f398-6576-449b-a737-887906eb6656", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668610993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb8f5850162c479b8d185e48c03be7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22eb23ff-0d", "ovs_interfaceid": "22eb23ff-0df1-42e9-92c0-458497610ff9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '9536f6cf-95c4-40e2-864a-09a91525678a'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'boot_index': None, 'mount_device': '/dev/vdb', 'attachment_id': '92d1a34b-7e7c-4cfd-938e-73b87349d063', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ziSgfLDh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a77117a2-748d-4a39-8db7-8b965a1725fc', 'attached_at': '', 'detached_at': '', 'volume_id': 'ec4a2b65-8e33-4a44-8961-7c0570cde14e', 'serial': 'ec4a2b65-8e33-4a44-8961-7c0570cde14e'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:09:35 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 18 17:09:35 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 18 17:09:35 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:09:35 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:09:35 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:09:35 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:09:35 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:09:35 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:09:35 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:09:35 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:09:35 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:09:35 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:09:35 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:09:35 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:09:35 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:09:35 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:09:35 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:09:35 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:09:35 user nova-compute[74743]: DEBUG nova.objects.instance [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lazy-loading 'vcpu_model' on Instance uuid a77117a2-748d-4a39-8db7-8b965a1725fc {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:09:35 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Calling os-brick to attach iSCSI Volume {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 17:09:35 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ziSgfLDh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:09:35 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 18 17:09:35 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:09:35 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:09:35 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 18 17:09:35 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:09:35 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:09:35 user nova-compute[74743]: INFO os_brick.initiator.connectors.iscsi [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 17:09:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e -p 172.16.0.220:3260 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:36 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ee2cde-add7-4fbc-87c3-06f52025a2f2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:36 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 17:09:36 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:09:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e -p 172.16.0.220:3260 --interface default --op new {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:36 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[4387081d-39b5-4b7a-ae1b-12c63b963e5a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e] added\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:36 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e] added
Nov 18 17:09:36 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:09:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:36 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be1581e-5e17-4405-8aee-5333fa63a931]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:36 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:09:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:36 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9257a1-7cef-498f-b8f6-f3fbb59966cc]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:36 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:09:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ziSgfLDh {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ziSgfLDh" returned: 0 in 0.030s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:36 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f4fb4f-1344-4540-ab2a-8d1057887979]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:36 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ziSgfLDh'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:09:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:36 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[4771c731-947e-42e4-895a-c4fa022365e1]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:36 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:09:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:36 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b561b59-8792-42d9-9dee-3aaba651ac55]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:36 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad (non-flash)
Nov 18 17:09:36 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:09:36 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad (non-flash)
Nov 18 17:09:36 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:09:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e -p 172.16.0.220:3260 --login {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:36 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d527de7-84d0-4b29-a8ea-9d32edb20a91]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:36 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e, portal: 172.16.0.220,3260]
Nov 18 17:09:36 user nova-compute[74743]: Login to [iface: default, target: iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e, portal: 172.16.0.220,3260] successful.
Nov 18 17:09:36 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:09:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:36 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d968e25c-d338-44af-9b69-d35f5b6d81a3]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:36 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:09:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:36 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf20e012-226c-4466-8020-3794acb8deff]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:36 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad (non-flash)
Nov 18 17:09:36 user nova-compute[74743]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)
Nov 18 17:09:36 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:09:36 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad (non-flash)
Nov 18 17:09:36 user nova-compute[74743]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)
Nov 18 17:09:36 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:09:36 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:09:36 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Connected to 172.16.0.220:3260 {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 17:09:36 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] HCTL ('34', '-', '-', 0) found on session 21 with lun 0 {{(pid=74743) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 17:09:36 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74743) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 17:09:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:36 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0cda12e-e150-4c73-9e57-db0076d73c18]: (4, ('- - 0', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:36 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:09:36 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ziSgfLDh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 17:09:36 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:37 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:09:37 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '26466353433383230', 'path': '/dev/sdc'} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:09:37 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26466353433383230', 'path': '/dev/sdc'} {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 17:09:37 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-18T17:07:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-196576409',display_name='tempest-ServerActionsTestOtherA-server-927938606',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-196576409',id=15,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJ9kBQV92QaO3NUQbsdxDa+z/O1R04nUATEUKPjnEHL9HBfHVAhzij3/MW2rTF8MFDQnt9uJ84+7PkWlYtClUm5BR319p/vhy/LOgQaMQorogb0O8y32fF069JI6jSm2g==',key_name='tempest-keypair-524527226',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:07:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fb8f5850162c479b8d185e48c03be7d3',ramdisk_id='',reservation_id='r-hahsjukq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-128885625',owner_user_name='tempest-ServerActionsTestOtherA-128885625-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:09:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce3e4cef47114a7c9327db639460d923',uuid=a77117a2-748d-4a39-8db7-8b965a1725fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22eb23ff-0df1-42e9-92c0-458497610ff9", "address": "fa:16:3e:b3:91:01", "network": {"id": "fd98f398-6576-449b-a737-887906eb6656", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668610993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb8f5850162c479b8d185e48c03be7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22eb23ff-0d", "ovs_interfaceid": "22eb23ff-0df1-42e9-92c0-458497610ff9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:09:37 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Converting VIF {"id": "22eb23ff-0df1-42e9-92c0-458497610ff9", "address": "fa:16:3e:b3:91:01", "network": {"id": "fd98f398-6576-449b-a737-887906eb6656", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668610993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb8f5850162c479b8d185e48c03be7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22eb23ff-0d", "ovs_interfaceid": "22eb23ff-0df1-42e9-92c0-458497610ff9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:09:37 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:91:01,bridge_name='br-int',has_traffic_filtering=True,id=22eb23ff-0df1-42e9-92c0-458497610ff9,network=Network(fd98f398-6576-449b-a737-887906eb6656),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22eb23ff-0d') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:09:37 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:09:37 user nova-compute[74743]:   <uuid>a77117a2-748d-4a39-8db7-8b965a1725fc</uuid>
Nov 18 17:09:37 user nova-compute[74743]:   <name>instance-0000000f</name>
Nov 18 17:09:37 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:09:37 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:09:37 user nova-compute[74743]:   <metadata>
Nov 18 17:09:37 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:09:37 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:09:37 user nova-compute[74743]:       <nova:name>tempest-ServerActionsTestOtherA-server-927938606</nova:name>
Nov 18 17:09:37 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:09:35</nova:creationTime>
Nov 18 17:09:37 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:09:37 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:09:37 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:09:37 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:09:37 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:09:37 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:09:37 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:09:37 user nova-compute[74743]:       <nova:owner>
Nov 18 17:09:37 user nova-compute[74743]:         <nova:user uuid="ce3e4cef47114a7c9327db639460d923">tempest-ServerActionsTestOtherA-128885625-project-member</nova:user>
Nov 18 17:09:37 user nova-compute[74743]:         <nova:project uuid="fb8f5850162c479b8d185e48c03be7d3">tempest-ServerActionsTestOtherA-128885625</nova:project>
Nov 18 17:09:37 user nova-compute[74743]:       </nova:owner>
Nov 18 17:09:37 user nova-compute[74743]:       <nova:root type="image" uuid="9536f6cf-95c4-40e2-864a-09a91525678a"/>
Nov 18 17:09:37 user nova-compute[74743]:       <nova:ports>
Nov 18 17:09:37 user nova-compute[74743]:         <nova:port uuid="22eb23ff-0df1-42e9-92c0-458497610ff9">
Nov 18 17:09:37 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 18 17:09:37 user nova-compute[74743]:         </nova:port>
Nov 18 17:09:37 user nova-compute[74743]:       </nova:ports>
Nov 18 17:09:37 user nova-compute[74743]:     </nova:instance>
Nov 18 17:09:37 user nova-compute[74743]:   </metadata>
Nov 18 17:09:37 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:09:37 user nova-compute[74743]:     <system>
Nov 18 17:09:37 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:09:37 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:09:37 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:09:37 user nova-compute[74743]:       <entry name="serial">a77117a2-748d-4a39-8db7-8b965a1725fc</entry>
Nov 18 17:09:37 user nova-compute[74743]:       <entry name="uuid">a77117a2-748d-4a39-8db7-8b965a1725fc</entry>
Nov 18 17:09:37 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:09:37 user nova-compute[74743]:     </system>
Nov 18 17:09:37 user nova-compute[74743]:   </sysinfo>
Nov 18 17:09:37 user nova-compute[74743]:   <os>
Nov 18 17:09:37 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:09:37 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:09:37 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:09:37 user nova-compute[74743]:   </os>
Nov 18 17:09:37 user nova-compute[74743]:   <features>
Nov 18 17:09:37 user nova-compute[74743]:     <acpi/>
Nov 18 17:09:37 user nova-compute[74743]:     <apic/>
Nov 18 17:09:37 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:09:37 user nova-compute[74743]:   </features>
Nov 18 17:09:37 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:09:37 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:09:37 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:09:37 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:09:37 user nova-compute[74743]:   </clock>
Nov 18 17:09:37 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:09:37 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:09:37 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:09:37 user nova-compute[74743]:   </cpu>
Nov 18 17:09:37 user nova-compute[74743]:   <devices>
Nov 18 17:09:37 user nova-compute[74743]:     <disk type="file" device="disk">
Nov 18 17:09:37 user nova-compute[74743]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 17:09:37 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/a77117a2-748d-4a39-8db7-8b965a1725fc/disk"/>
Nov 18 17:09:37 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:09:37 user nova-compute[74743]:     </disk>
Nov 18 17:09:37 user nova-compute[74743]:     <disk type="block" device="disk">
Nov 18 17:09:37 user nova-compute[74743]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:09:37 user nova-compute[74743]:       <source dev="/dev/sdc"/>
Nov 18 17:09:37 user nova-compute[74743]:       <target dev="vdb" bus="virtio"/>
Nov 18 17:09:37 user nova-compute[74743]:       <serial>ec4a2b65-8e33-4a44-8961-7c0570cde14e</serial>
Nov 18 17:09:37 user nova-compute[74743]:     </disk>
Nov 18 17:09:37 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:09:37 user nova-compute[74743]:       <mac address="fa:16:3e:b3:91:01"/>
Nov 18 17:09:37 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:09:37 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:09:37 user nova-compute[74743]:       <target dev="tap22eb23ff-0d"/>
Nov 18 17:09:37 user nova-compute[74743]:     </interface>
Nov 18 17:09:37 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:09:37 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/a77117a2-748d-4a39-8db7-8b965a1725fc/console.log" append="off"/>
Nov 18 17:09:37 user nova-compute[74743]:     </serial>
Nov 18 17:09:37 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:09:37 user nova-compute[74743]:     <video>
Nov 18 17:09:37 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:09:37 user nova-compute[74743]:     </video>
Nov 18 17:09:37 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:09:37 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:09:37 user nova-compute[74743]:     </rng>
Nov 18 17:09:37 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:09:37 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:09:37 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:09:37 user nova-compute[74743]:     </memballoon>
Nov 18 17:09:37 user nova-compute[74743]:   </devices>
Nov 18 17:09:37 user nova-compute[74743]: </domain>
Nov 18 17:09:37 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:09:37 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-18T17:07:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-196576409',display_name='tempest-ServerActionsTestOtherA-server-927938606',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-196576409',id=15,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJ9kBQV92QaO3NUQbsdxDa+z/O1R04nUATEUKPjnEHL9HBfHVAhzij3/MW2rTF8MFDQnt9uJ84+7PkWlYtClUm5BR319p/vhy/LOgQaMQorogb0O8y32fF069JI6jSm2g==',key_name='tempest-keypair-524527226',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:07:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fb8f5850162c479b8d185e48c03be7d3',ramdisk_id='',reservation_id='r-hahsjukq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-128885625',owner_user_name='tempest-ServerActionsTestOtherA-128885625-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:09:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce3e4cef47114a7c9327db639460d923',uuid=a77117a2-748d-4a39-8db7-8b965a1725fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22eb23ff-0df1-42e9-92c0-458497610ff9", "address": "fa:16:3e:b3:91:01", "network": {"id": "fd98f398-6576-449b-a737-887906eb6656", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668610993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb8f5850162c479b8d185e48c03be7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22eb23ff-0d", "ovs_interfaceid": "22eb23ff-0df1-42e9-92c0-458497610ff9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:09:37 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Converting VIF {"id": "22eb23ff-0df1-42e9-92c0-458497610ff9", "address": "fa:16:3e:b3:91:01", "network": {"id": "fd98f398-6576-449b-a737-887906eb6656", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668610993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb8f5850162c479b8d185e48c03be7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22eb23ff-0d", "ovs_interfaceid": "22eb23ff-0df1-42e9-92c0-458497610ff9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:09:37 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:91:01,bridge_name='br-int',has_traffic_filtering=True,id=22eb23ff-0df1-42e9-92c0-458497610ff9,network=Network(fd98f398-6576-449b-a737-887906eb6656),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22eb23ff-0d') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:09:37 user nova-compute[74743]: DEBUG os_vif [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:91:01,bridge_name='br-int',has_traffic_filtering=True,id=22eb23ff-0df1-42e9-92c0-458497610ff9,network=Network(fd98f398-6576-449b-a737-887906eb6656),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22eb23ff-0d') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:09:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:09:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:09:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd5415b49-4860-5bc9-a3c1-b037a9abfd6f', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:09:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22eb23ff-0d, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:09:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap22eb23ff-0d, col_values=(('qos', UUID('3c30a295-064e-4ffc-8467-df322bb077bb')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:09:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap22eb23ff-0d, col_values=(('external_ids', {'iface-id': '22eb23ff-0df1-42e9-92c0-458497610ff9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:91:01', 'vm-uuid': 'a77117a2-748d-4a39-8db7-8b965a1725fc'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:09:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:09:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:37 user nova-compute[74743]: INFO os_vif [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:91:01,bridge_name='br-int',has_traffic_filtering=True,id=22eb23ff-0df1-42e9-92c0-458497610ff9,network=Network(fd98f398-6576-449b-a737-887906eb6656),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22eb23ff-0d')
Nov 18 17:09:37 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:09:37 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:09:37 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] No VIF found with MAC fa:16:3e:b3:91:01, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:09:38 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:38 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:38 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:39 user nova-compute[74743]: DEBUG nova.compute.manager [req-e1fbbc66-0acb-4b3d-b516-cbdd75b9d7bf req-e761d8c8-2c31-487e-85f2-60224386f0ee service nova] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Received event network-vif-plugged-22eb23ff-0df1-42e9-92c0-458497610ff9 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:09:39 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e1fbbc66-0acb-4b3d-b516-cbdd75b9d7bf req-e761d8c8-2c31-487e-85f2-60224386f0ee service nova] Acquiring lock "a77117a2-748d-4a39-8db7-8b965a1725fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:09:39 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e1fbbc66-0acb-4b3d-b516-cbdd75b9d7bf req-e761d8c8-2c31-487e-85f2-60224386f0ee service nova] Lock "a77117a2-748d-4a39-8db7-8b965a1725fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:09:39 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e1fbbc66-0acb-4b3d-b516-cbdd75b9d7bf req-e761d8c8-2c31-487e-85f2-60224386f0ee service nova] Lock "a77117a2-748d-4a39-8db7-8b965a1725fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:09:39 user nova-compute[74743]: DEBUG nova.compute.manager [req-e1fbbc66-0acb-4b3d-b516-cbdd75b9d7bf req-e761d8c8-2c31-487e-85f2-60224386f0ee service nova] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] No waiting events found dispatching network-vif-plugged-22eb23ff-0df1-42e9-92c0-458497610ff9 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:09:39 user nova-compute[74743]: WARNING nova.compute.manager [req-e1fbbc66-0acb-4b3d-b516-cbdd75b9d7bf req-e761d8c8-2c31-487e-85f2-60224386f0ee service nova] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Received unexpected event network-vif-plugged-22eb23ff-0df1-42e9-92c0-458497610ff9 for instance with vm_state active and task_state rebuild_spawning.
Nov 18 17:09:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:41 user nova-compute[74743]: DEBUG nova.compute.manager [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:09:41 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Guest created on hypervisor {{(pid=74743) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 17:09:41 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Instance spawned successfully.
Nov 18 17:09:41 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 17:09:41 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Found default for hw_cdrom_bus of ide {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:09:41 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Found default for hw_disk_bus of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:09:41 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Found default for hw_input_bus of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:09:41 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Found default for hw_pointer_model of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:09:41 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Found default for hw_video_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:09:41 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Found default for hw_vif_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:09:41 user nova-compute[74743]: DEBUG nova.compute.manager [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:09:41 user nova-compute[74743]: DEBUG nova.compute.manager [req-68ba6479-aeae-4d3f-884a-c6109435d83a req-16fd9ad8-55a5-403a-9cae-4399fb9160aa service nova] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Received event network-vif-plugged-22eb23ff-0df1-42e9-92c0-458497610ff9 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:09:41 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-68ba6479-aeae-4d3f-884a-c6109435d83a req-16fd9ad8-55a5-403a-9cae-4399fb9160aa service nova] Acquiring lock "a77117a2-748d-4a39-8db7-8b965a1725fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:09:41 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-68ba6479-aeae-4d3f-884a-c6109435d83a req-16fd9ad8-55a5-403a-9cae-4399fb9160aa service nova] Lock "a77117a2-748d-4a39-8db7-8b965a1725fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:09:41 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-68ba6479-aeae-4d3f-884a-c6109435d83a req-16fd9ad8-55a5-403a-9cae-4399fb9160aa service nova] Lock "a77117a2-748d-4a39-8db7-8b965a1725fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:09:41 user nova-compute[74743]: DEBUG nova.compute.manager [req-68ba6479-aeae-4d3f-884a-c6109435d83a req-16fd9ad8-55a5-403a-9cae-4399fb9160aa service nova] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] No waiting events found dispatching network-vif-plugged-22eb23ff-0df1-42e9-92c0-458497610ff9 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:09:41 user nova-compute[74743]: WARNING nova.compute.manager [req-68ba6479-aeae-4d3f-884a-c6109435d83a req-16fd9ad8-55a5-403a-9cae-4399fb9160aa service nova] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Received unexpected event network-vif-plugged-22eb23ff-0df1-42e9-92c0-458497610ff9 for instance with vm_state active and task_state rebuild_spawning.
Nov 18 17:09:41 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:09:41 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:09:41 user nova-compute[74743]: DEBUG nova.objects.instance [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74743) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 18 17:09:41 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d1dbbe8a-0906-4597-bf3f-cbad0f5ea1a2 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.098s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:09:42 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:44 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Acquiring lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:09:44 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:09:44 user nova-compute[74743]: DEBUG nova.compute.manager [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Starting instance... {{(pid=74743) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 17:09:44 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:09:44 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:09:44 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74743) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 17:09:44 user nova-compute[74743]: INFO nova.compute.claims [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Claim successful on node user
Nov 18 17:09:44 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:45 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:09:45 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:09:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.597s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:09:45 user nova-compute[74743]: DEBUG nova.compute.manager [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Start building networks asynchronously for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 17:09:45 user nova-compute[74743]: DEBUG nova.compute.manager [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Allocating IP information in the background. {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 17:09:45 user nova-compute[74743]: DEBUG nova.network.neutron [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] allocate_for_instance() {{(pid=74743) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 17:09:45 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 17:09:45 user nova-compute[74743]: DEBUG nova.compute.manager [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Start building block device mappings for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 17:09:45 user nova-compute[74743]: DEBUG nova.policy [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b7230865273e42ac86cf5a340c1bd1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5705e5d6831a4d4dab6ae482e0ca1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74743) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 17:09:45 user nova-compute[74743]: DEBUG nova.compute.manager [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Start spawning the instance on the hypervisor. {{(pid=74743) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 17:09:45 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Creating instance directory {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 17:09:45 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Creating image(s)
Nov 18 17:09:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Acquiring lock "/opt/stack/data/nova/instances/f93bf0ac-ecc8-447d-b9c1-381d36cd3135/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:09:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "/opt/stack/data/nova/instances/f93bf0ac-ecc8-447d-b9c1-381d36cd3135/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:09:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "/opt/stack/data/nova/instances/f93bf0ac-ecc8-447d-b9c1-381d36cd3135/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:09:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.199s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Acquiring lock "c188b3a997bfafa42fa341f9dcc326545681eed9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:09:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:09:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.212s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/f93bf0ac-ecc8-447d-b9c1-381d36cd3135/disk 1073741824 {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/f93bf0ac-ecc8-447d-b9c1-381d36cd3135/disk 1073741824" returned: 0 in 0.052s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:09:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:46 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.226s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:46 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f93bf0ac-ecc8-447d-b9c1-381d36cd3135/disk. size=1073741824 {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 17:09:46 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f93bf0ac-ecc8-447d-b9c1-381d36cd3135/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:46 user nova-compute[74743]: DEBUG nova.network.neutron [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Successfully created port: b307c7c0-aa55-4210-8e16-08b1cee78b4a {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:09:46 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f93bf0ac-ecc8-447d-b9c1-381d36cd3135/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:46 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Cannot resize image /opt/stack/data/nova/instances/f93bf0ac-ecc8-447d-b9c1-381d36cd3135/disk to a smaller size. {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 17:09:46 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Created local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 17:09:46 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Ensure instance console log exists: /opt/stack/data/nova/instances/f93bf0ac-ecc8-447d-b9c1-381d36cd3135/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:09:46 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:09:46 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:09:46 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:09:46 user nova-compute[74743]: DEBUG nova.network.neutron [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Successfully updated port: b307c7c0-aa55-4210-8e16-08b1cee78b4a {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:09:46 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Acquiring lock "refresh_cache-f93bf0ac-ecc8-447d-b9c1-381d36cd3135" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:09:46 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Acquired lock "refresh_cache-f93bf0ac-ecc8-447d-b9c1-381d36cd3135" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:09:46 user nova-compute[74743]: DEBUG nova.network.neutron [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:09:46 user nova-compute[74743]: DEBUG nova.compute.manager [req-8035f1fc-d371-4753-b49a-0e3fae9d53ad req-2f973ac5-f15f-4d2b-92b7-18dc91d54e22 service nova] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Received event network-changed-b307c7c0-aa55-4210-8e16-08b1cee78b4a {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:09:46 user nova-compute[74743]: DEBUG nova.compute.manager [req-8035f1fc-d371-4753-b49a-0e3fae9d53ad req-2f973ac5-f15f-4d2b-92b7-18dc91d54e22 service nova] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Refreshing instance network info cache due to event network-changed-b307c7c0-aa55-4210-8e16-08b1cee78b4a. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:09:46 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-8035f1fc-d371-4753-b49a-0e3fae9d53ad req-2f973ac5-f15f-4d2b-92b7-18dc91d54e22 service nova] Acquiring lock "refresh_cache-f93bf0ac-ecc8-447d-b9c1-381d36cd3135" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:09:46 user nova-compute[74743]: DEBUG nova.network.neutron [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:09:47 user nova-compute[74743]: DEBUG nova.network.neutron [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Updating instance_info_cache with network_info: [{"id": "b307c7c0-aa55-4210-8e16-08b1cee78b4a", "address": "fa:16:3e:f3:91:b0", "network": {"id": "45fa6343-75cf-4308-937b-cddd9ca6b63f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1561993253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5705e5d6831a4d4dab6ae482e0ca1013", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb307c7c0-aa", "ovs_interfaceid": "b307c7c0-aa55-4210-8e16-08b1cee78b4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:09:47 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Releasing lock "refresh_cache-f93bf0ac-ecc8-447d-b9c1-381d36cd3135" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:09:47 user nova-compute[74743]: DEBUG nova.compute.manager [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Instance network_info: |[{"id": "b307c7c0-aa55-4210-8e16-08b1cee78b4a", "address": "fa:16:3e:f3:91:b0", "network": {"id": "45fa6343-75cf-4308-937b-cddd9ca6b63f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1561993253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5705e5d6831a4d4dab6ae482e0ca1013", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb307c7c0-aa", "ovs_interfaceid": "b307c7c0-aa55-4210-8e16-08b1cee78b4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 17:09:47 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-8035f1fc-d371-4753-b49a-0e3fae9d53ad req-2f973ac5-f15f-4d2b-92b7-18dc91d54e22 service nova] Acquired lock "refresh_cache-f93bf0ac-ecc8-447d-b9c1-381d36cd3135" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:09:47 user nova-compute[74743]: DEBUG nova.network.neutron [req-8035f1fc-d371-4753-b49a-0e3fae9d53ad req-2f973ac5-f15f-4d2b-92b7-18dc91d54e22 service nova] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Refreshing network info cache for port b307c7c0-aa55-4210-8e16-08b1cee78b4a {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:09:47 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Start _get_guest_xml network_info=[{"id": "b307c7c0-aa55-4210-8e16-08b1cee78b4a", "address": "fa:16:3e:f3:91:b0", "network": {"id": "45fa6343-75cf-4308-937b-cddd9ca6b63f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1561993253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5705e5d6831a4d4dab6ae482e0ca1013", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb307c7c0-aa", "ovs_interfaceid": "b307c7c0-aa55-4210-8e16-08b1cee78b4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '9536f6cf-95c4-40e2-864a-09a91525678a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:09:47 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:09:47 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:09:47 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:09:47 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:09:47 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:09:47 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:09:47 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:09:47 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:09:47 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:09:47 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:09:47 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:09:47 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:09:47 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:09:47 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:09:47 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:09:47 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:09:47 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:09:47 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:09:47 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:09:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1712639045',display_name='tempest-SnapshotDataIntegrityTests-server-1712639045',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1712639045',id=22,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUdBDG4vH29jPY3bmVUYNHO0oRuii3NuUh/brt0xF7IahYMs+ti5pQThPWS/d5HfTxD6fBmVASDaiGQ6pXd9L/gYzupHfIIkF5jddBDaOc9ACBj7+PyWeJa0uYtyxS1Lw==',key_name='tempest-keypair-2092443033',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5705e5d6831a4d4dab6ae482e0ca1013',ramdisk_id='',reservation_id='r-y1z4jodf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1082949191',owner_user_name='tempest-SnapshotDataIntegrityTests-1082949191-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:09:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7230865273e42ac86cf5a340c1bd1cf',uuid=f93bf0ac-ecc8-447d-b9c1-381d36cd3135,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b307c7c0-aa55-4210-8e16-08b1cee78b4a", "address": "fa:16:3e:f3:91:b0", "network": {"id": "45fa6343-75cf-4308-937b-cddd9ca6b63f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1561993253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5705e5d6831a4d4dab6ae482e0ca1013", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb307c7c0-aa", "ovs_interfaceid": "b307c7c0-aa55-4210-8e16-08b1cee78b4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:09:47 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Converting VIF {"id": "b307c7c0-aa55-4210-8e16-08b1cee78b4a", "address": "fa:16:3e:f3:91:b0", "network": {"id": "45fa6343-75cf-4308-937b-cddd9ca6b63f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1561993253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5705e5d6831a4d4dab6ae482e0ca1013", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb307c7c0-aa", "ovs_interfaceid": "b307c7c0-aa55-4210-8e16-08b1cee78b4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:09:47 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:91:b0,bridge_name='br-int',has_traffic_filtering=True,id=b307c7c0-aa55-4210-8e16-08b1cee78b4a,network=Network(45fa6343-75cf-4308-937b-cddd9ca6b63f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb307c7c0-aa') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:09:47 user nova-compute[74743]: DEBUG nova.objects.instance [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lazy-loading 'pci_devices' on Instance uuid f93bf0ac-ecc8-447d-b9c1-381d36cd3135 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:09:47 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:09:47 user nova-compute[74743]:   <uuid>f93bf0ac-ecc8-447d-b9c1-381d36cd3135</uuid>
Nov 18 17:09:47 user nova-compute[74743]:   <name>instance-00000016</name>
Nov 18 17:09:47 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:09:47 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:09:47 user nova-compute[74743]:   <metadata>
Nov 18 17:09:47 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:09:47 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:09:47 user nova-compute[74743]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1712639045</nova:name>
Nov 18 17:09:47 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:09:47</nova:creationTime>
Nov 18 17:09:47 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:09:47 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:09:47 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:09:47 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:09:47 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:09:47 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:09:47 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:09:47 user nova-compute[74743]:       <nova:owner>
Nov 18 17:09:47 user nova-compute[74743]:         <nova:user uuid="b7230865273e42ac86cf5a340c1bd1cf">tempest-SnapshotDataIntegrityTests-1082949191-project-member</nova:user>
Nov 18 17:09:47 user nova-compute[74743]:         <nova:project uuid="5705e5d6831a4d4dab6ae482e0ca1013">tempest-SnapshotDataIntegrityTests-1082949191</nova:project>
Nov 18 17:09:47 user nova-compute[74743]:       </nova:owner>
Nov 18 17:09:47 user nova-compute[74743]:       <nova:root type="image" uuid="9536f6cf-95c4-40e2-864a-09a91525678a"/>
Nov 18 17:09:47 user nova-compute[74743]:       <nova:ports>
Nov 18 17:09:47 user nova-compute[74743]:         <nova:port uuid="b307c7c0-aa55-4210-8e16-08b1cee78b4a">
Nov 18 17:09:47 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 18 17:09:47 user nova-compute[74743]:         </nova:port>
Nov 18 17:09:47 user nova-compute[74743]:       </nova:ports>
Nov 18 17:09:47 user nova-compute[74743]:     </nova:instance>
Nov 18 17:09:47 user nova-compute[74743]:   </metadata>
Nov 18 17:09:47 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:09:47 user nova-compute[74743]:     <system>
Nov 18 17:09:47 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:09:47 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:09:47 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:09:47 user nova-compute[74743]:       <entry name="serial">f93bf0ac-ecc8-447d-b9c1-381d36cd3135</entry>
Nov 18 17:09:47 user nova-compute[74743]:       <entry name="uuid">f93bf0ac-ecc8-447d-b9c1-381d36cd3135</entry>
Nov 18 17:09:47 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:09:47 user nova-compute[74743]:     </system>
Nov 18 17:09:47 user nova-compute[74743]:   </sysinfo>
Nov 18 17:09:47 user nova-compute[74743]:   <os>
Nov 18 17:09:47 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:09:47 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:09:47 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:09:47 user nova-compute[74743]:   </os>
Nov 18 17:09:47 user nova-compute[74743]:   <features>
Nov 18 17:09:47 user nova-compute[74743]:     <acpi/>
Nov 18 17:09:47 user nova-compute[74743]:     <apic/>
Nov 18 17:09:47 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:09:47 user nova-compute[74743]:   </features>
Nov 18 17:09:47 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:09:47 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:09:47 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:09:47 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:09:47 user nova-compute[74743]:   </clock>
Nov 18 17:09:47 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:09:47 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:09:47 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:09:47 user nova-compute[74743]:   </cpu>
Nov 18 17:09:47 user nova-compute[74743]:   <devices>
Nov 18 17:09:47 user nova-compute[74743]:     <disk type="file" device="disk">
Nov 18 17:09:47 user nova-compute[74743]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 17:09:47 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/f93bf0ac-ecc8-447d-b9c1-381d36cd3135/disk"/>
Nov 18 17:09:47 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:09:47 user nova-compute[74743]:     </disk>
Nov 18 17:09:47 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:09:47 user nova-compute[74743]:       <mac address="fa:16:3e:f3:91:b0"/>
Nov 18 17:09:47 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:09:47 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:09:47 user nova-compute[74743]:       <target dev="tapb307c7c0-aa"/>
Nov 18 17:09:47 user nova-compute[74743]:     </interface>
Nov 18 17:09:47 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:09:47 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/f93bf0ac-ecc8-447d-b9c1-381d36cd3135/console.log" append="off"/>
Nov 18 17:09:47 user nova-compute[74743]:     </serial>
Nov 18 17:09:47 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:09:47 user nova-compute[74743]:     <video>
Nov 18 17:09:47 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:09:47 user nova-compute[74743]:     </video>
Nov 18 17:09:47 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:09:47 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:09:47 user nova-compute[74743]:     </rng>
Nov 18 17:09:47 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:09:47 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:09:47 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:09:47 user nova-compute[74743]:     </memballoon>
Nov 18 17:09:47 user nova-compute[74743]:   </devices>
Nov 18 17:09:47 user nova-compute[74743]: </domain>
Nov 18 17:09:47 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:09:47 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:09:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1712639045',display_name='tempest-SnapshotDataIntegrityTests-server-1712639045',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1712639045',id=22,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUdBDG4vH29jPY3bmVUYNHO0oRuii3NuUh/brt0xF7IahYMs+ti5pQThPWS/d5HfTxD6fBmVASDaiGQ6pXd9L/gYzupHfIIkF5jddBDaOc9ACBj7+PyWeJa0uYtyxS1Lw==',key_name='tempest-keypair-2092443033',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5705e5d6831a4d4dab6ae482e0ca1013',ramdisk_id='',reservation_id='r-y1z4jodf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1082949191',owner_user_name='tempest-SnapshotDataIntegrityTests-1082949191-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:09:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7230865273e42ac86cf5a340c1bd1cf',uuid=f93bf0ac-ecc8-447d-b9c1-381d36cd3135,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b307c7c0-aa55-4210-8e16-08b1cee78b4a", "address": "fa:16:3e:f3:91:b0", "network": {"id": "45fa6343-75cf-4308-937b-cddd9ca6b63f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1561993253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5705e5d6831a4d4dab6ae482e0ca1013", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb307c7c0-aa", "ovs_interfaceid": "b307c7c0-aa55-4210-8e16-08b1cee78b4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:09:47 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Converting VIF {"id": "b307c7c0-aa55-4210-8e16-08b1cee78b4a", "address": "fa:16:3e:f3:91:b0", "network": {"id": "45fa6343-75cf-4308-937b-cddd9ca6b63f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1561993253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5705e5d6831a4d4dab6ae482e0ca1013", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb307c7c0-aa", "ovs_interfaceid": "b307c7c0-aa55-4210-8e16-08b1cee78b4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:09:47 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:91:b0,bridge_name='br-int',has_traffic_filtering=True,id=b307c7c0-aa55-4210-8e16-08b1cee78b4a,network=Network(45fa6343-75cf-4308-937b-cddd9ca6b63f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb307c7c0-aa') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:09:47 user nova-compute[74743]: DEBUG os_vif [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:91:b0,bridge_name='br-int',has_traffic_filtering=True,id=b307c7c0-aa55-4210-8e16-08b1cee78b4a,network=Network(45fa6343-75cf-4308-937b-cddd9ca6b63f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb307c7c0-aa') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:09:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:09:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:09:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1e2dbedc-7fb4-55b5-91c1-a28a23514dd5', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:09:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb307c7c0-aa, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:09:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb307c7c0-aa, col_values=(('qos', UUID('3c912e18-1006-4630-b419-40d6ba568102')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:09:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb307c7c0-aa, col_values=(('external_ids', {'iface-id': 'b307c7c0-aa55-4210-8e16-08b1cee78b4a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:91:b0', 'vm-uuid': 'f93bf0ac-ecc8-447d-b9c1-381d36cd3135'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:09:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:09:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:47 user nova-compute[74743]: INFO os_vif [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:91:b0,bridge_name='br-int',has_traffic_filtering=True,id=b307c7c0-aa55-4210-8e16-08b1cee78b4a,network=Network(45fa6343-75cf-4308-937b-cddd9ca6b63f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb307c7c0-aa')
Nov 18 17:09:47 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:09:47 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] No VIF found with MAC fa:16:3e:f3:91:b0, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:09:47 user nova-compute[74743]: INFO nova.compute.manager [None req-8af6a014-897b-4b8c-8718-d2e1e8ad80d0 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Unrescuing
Nov 18 17:09:47 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8af6a014-897b-4b8c-8718-d2e1e8ad80d0 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Acquiring lock "refresh_cache-4cce1628-2dcb-40c7-abd4-6a327a432de3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:09:47 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8af6a014-897b-4b8c-8718-d2e1e8ad80d0 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Acquired lock "refresh_cache-4cce1628-2dcb-40c7-abd4-6a327a432de3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:09:47 user nova-compute[74743]: DEBUG nova.network.neutron [None req-8af6a014-897b-4b8c-8718-d2e1e8ad80d0 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:09:47 user nova-compute[74743]: DEBUG nova.network.neutron [req-8035f1fc-d371-4753-b49a-0e3fae9d53ad req-2f973ac5-f15f-4d2b-92b7-18dc91d54e22 service nova] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Updated VIF entry in instance network info cache for port b307c7c0-aa55-4210-8e16-08b1cee78b4a. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:09:47 user nova-compute[74743]: DEBUG nova.network.neutron [req-8035f1fc-d371-4753-b49a-0e3fae9d53ad req-2f973ac5-f15f-4d2b-92b7-18dc91d54e22 service nova] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Updating instance_info_cache with network_info: [{"id": "b307c7c0-aa55-4210-8e16-08b1cee78b4a", "address": "fa:16:3e:f3:91:b0", "network": {"id": "45fa6343-75cf-4308-937b-cddd9ca6b63f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1561993253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5705e5d6831a4d4dab6ae482e0ca1013", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb307c7c0-aa", "ovs_interfaceid": "b307c7c0-aa55-4210-8e16-08b1cee78b4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:09:47 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-8035f1fc-d371-4753-b49a-0e3fae9d53ad req-2f973ac5-f15f-4d2b-92b7-18dc91d54e22 service nova] Releasing lock "refresh_cache-f93bf0ac-ecc8-447d-b9c1-381d36cd3135" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:09:47 user nova-compute[74743]: DEBUG nova.network.neutron [None req-8af6a014-897b-4b8c-8718-d2e1e8ad80d0 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Updating instance_info_cache with network_info: [{"id": "28f81291-34bb-4a6f-890b-faea6ef8a385", "address": "fa:16:3e:47:f5:86", "network": {"id": "252343cc-f379-471d-a2c9-99b9a60ebcb4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25c06dc8e7be46229750b8e283622c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28f81291-34", "ovs_interfaceid": "28f81291-34bb-4a6f-890b-faea6ef8a385", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:09:47 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8af6a014-897b-4b8c-8718-d2e1e8ad80d0 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Releasing lock "refresh_cache-4cce1628-2dcb-40c7-abd4-6a327a432de3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:09:47 user nova-compute[74743]: DEBUG nova.objects.instance [None req-8af6a014-897b-4b8c-8718-d2e1e8ad80d0 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lazy-loading 'flavor' on Instance uuid 4cce1628-2dcb-40c7-abd4-6a327a432de3 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:09:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:48 user nova-compute[74743]: DEBUG nova.compute.manager [req-3053582b-4b39-4d33-9c7d-342c8967f937 req-3ff35c8c-7568-4b18-b7a3-bdca6baded47 service nova] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Received event network-vif-unplugged-28f81291-34bb-4a6f-890b-faea6ef8a385 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:09:48 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3053582b-4b39-4d33-9c7d-342c8967f937 req-3ff35c8c-7568-4b18-b7a3-bdca6baded47 service nova] Acquiring lock "4cce1628-2dcb-40c7-abd4-6a327a432de3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:09:48 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3053582b-4b39-4d33-9c7d-342c8967f937 req-3ff35c8c-7568-4b18-b7a3-bdca6baded47 service nova] Lock "4cce1628-2dcb-40c7-abd4-6a327a432de3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:09:48 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3053582b-4b39-4d33-9c7d-342c8967f937 req-3ff35c8c-7568-4b18-b7a3-bdca6baded47 service nova] Lock "4cce1628-2dcb-40c7-abd4-6a327a432de3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:09:48 user nova-compute[74743]: DEBUG nova.compute.manager [req-3053582b-4b39-4d33-9c7d-342c8967f937 req-3ff35c8c-7568-4b18-b7a3-bdca6baded47 service nova] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] No waiting events found dispatching network-vif-unplugged-28f81291-34bb-4a6f-890b-faea6ef8a385 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:09:48 user nova-compute[74743]: WARNING nova.compute.manager [req-3053582b-4b39-4d33-9c7d-342c8967f937 req-3ff35c8c-7568-4b18-b7a3-bdca6baded47 service nova] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Received unexpected event network-vif-unplugged-28f81291-34bb-4a6f-890b-faea6ef8a385 for instance with vm_state rescued and task_state unrescuing.
Nov 18 17:09:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:49 user nova-compute[74743]: DEBUG nova.compute.manager [req-b24aab48-f64b-45f5-a534-de4b4ce985da req-13562247-efd3-4e04-ab40-f4aa250b55d1 service nova] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Received event network-vif-plugged-b307c7c0-aa55-4210-8e16-08b1cee78b4a {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:09:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b24aab48-f64b-45f5-a534-de4b4ce985da req-13562247-efd3-4e04-ab40-f4aa250b55d1 service nova] Acquiring lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:09:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b24aab48-f64b-45f5-a534-de4b4ce985da req-13562247-efd3-4e04-ab40-f4aa250b55d1 service nova] Lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:09:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b24aab48-f64b-45f5-a534-de4b4ce985da req-13562247-efd3-4e04-ab40-f4aa250b55d1 service nova] Lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:09:49 user nova-compute[74743]: DEBUG nova.compute.manager [req-b24aab48-f64b-45f5-a534-de4b4ce985da req-13562247-efd3-4e04-ab40-f4aa250b55d1 service nova] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] No waiting events found dispatching network-vif-plugged-b307c7c0-aa55-4210-8e16-08b1cee78b4a {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:09:49 user nova-compute[74743]: WARNING nova.compute.manager [req-b24aab48-f64b-45f5-a534-de4b4ce985da req-13562247-efd3-4e04-ab40-f4aa250b55d1 service nova] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Received unexpected event network-vif-plugged-b307c7c0-aa55-4210-8e16-08b1cee78b4a for instance with vm_state building and task_state spawning.
Nov 18 17:09:49 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Instance destroyed successfully.
Nov 18 17:09:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:50 user nova-compute[74743]: DEBUG nova.compute.manager [req-67880354-8a2c-4f51-9665-93d50fcac906 req-db67b863-52cb-4f00-ac8a-f0206e951910 service nova] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Received event network-vif-plugged-28f81291-34bb-4a6f-890b-faea6ef8a385 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:09:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-67880354-8a2c-4f51-9665-93d50fcac906 req-db67b863-52cb-4f00-ac8a-f0206e951910 service nova] Acquiring lock "4cce1628-2dcb-40c7-abd4-6a327a432de3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:09:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-67880354-8a2c-4f51-9665-93d50fcac906 req-db67b863-52cb-4f00-ac8a-f0206e951910 service nova] Lock "4cce1628-2dcb-40c7-abd4-6a327a432de3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:09:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-67880354-8a2c-4f51-9665-93d50fcac906 req-db67b863-52cb-4f00-ac8a-f0206e951910 service nova] Lock "4cce1628-2dcb-40c7-abd4-6a327a432de3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:09:50 user nova-compute[74743]: DEBUG nova.compute.manager [req-67880354-8a2c-4f51-9665-93d50fcac906 req-db67b863-52cb-4f00-ac8a-f0206e951910 service nova] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] No waiting events found dispatching network-vif-plugged-28f81291-34bb-4a6f-890b-faea6ef8a385 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:09:50 user nova-compute[74743]: WARNING nova.compute.manager [req-67880354-8a2c-4f51-9665-93d50fcac906 req-db67b863-52cb-4f00-ac8a-f0206e951910 service nova] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Received unexpected event network-vif-plugged-28f81291-34bb-4a6f-890b-faea6ef8a385 for instance with vm_state rescued and task_state unrescuing.
Nov 18 17:09:50 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:50 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:50 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:50 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:51 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:51 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:51 user nova-compute[74743]: DEBUG nova.compute.manager [req-73df91c8-2c8e-449e-9117-db4ac6c408c3 req-a2cbd546-6d81-4ef5-aa12-83155637a22f service nova] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Received event network-vif-plugged-b307c7c0-aa55-4210-8e16-08b1cee78b4a {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:09:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-73df91c8-2c8e-449e-9117-db4ac6c408c3 req-a2cbd546-6d81-4ef5-aa12-83155637a22f service nova] Acquiring lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:09:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-73df91c8-2c8e-449e-9117-db4ac6c408c3 req-a2cbd546-6d81-4ef5-aa12-83155637a22f service nova] Lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:09:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-73df91c8-2c8e-449e-9117-db4ac6c408c3 req-a2cbd546-6d81-4ef5-aa12-83155637a22f service nova] Lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:09:51 user nova-compute[74743]: DEBUG nova.compute.manager [req-73df91c8-2c8e-449e-9117-db4ac6c408c3 req-a2cbd546-6d81-4ef5-aa12-83155637a22f service nova] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] No waiting events found dispatching network-vif-plugged-b307c7c0-aa55-4210-8e16-08b1cee78b4a {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:09:51 user nova-compute[74743]: WARNING nova.compute.manager [req-73df91c8-2c8e-449e-9117-db4ac6c408c3 req-a2cbd546-6d81-4ef5-aa12-83155637a22f service nova] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Received unexpected event network-vif-plugged-b307c7c0-aa55-4210-8e16-08b1cee78b4a for instance with vm_state building and task_state spawning.
Nov 18 17:09:51 user nova-compute[74743]: DEBUG nova.compute.manager [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:09:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Guest created on hypervisor {{(pid=74743) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 17:09:51 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Instance spawned successfully.
Nov 18 17:09:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 17:09:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Found default for hw_cdrom_bus of ide {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:09:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Found default for hw_disk_bus of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:09:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Found default for hw_input_bus of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:09:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Found default for hw_pointer_model of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:09:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Found default for hw_video_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:09:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Found default for hw_vif_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:09:51 user nova-compute[74743]: INFO nova.compute.manager [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Took 6.14 seconds to spawn the instance on the hypervisor.
Nov 18 17:09:51 user nova-compute[74743]: DEBUG nova.compute.manager [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:09:51 user nova-compute[74743]: INFO nova.compute.manager [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Took 7.15 seconds to build instance.
Nov 18 17:09:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-bfdcae18-ce1b-4e64-b286-1921622145bf tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.273s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:09:52 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._sync_power_states {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:09:52 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Triggering sync for uuid 4cce1628-2dcb-40c7-abd4-6a327a432de3 {{(pid=74743) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 17:09:52 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Triggering sync for uuid e9668e1c-1e8d-4dd7-8f58-d453db294557 {{(pid=74743) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 17:09:52 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Triggering sync for uuid c006a4ad-a8e2-4108-9af1-dec4dd53fcda {{(pid=74743) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 17:09:52 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Triggering sync for uuid 49ebdd5a-824d-476a-bd10-3b891bbfe9e2 {{(pid=74743) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 17:09:52 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Triggering sync for uuid c5c74497-1d1c-48a0-9b0a-e7df2a41361c {{(pid=74743) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 17:09:52 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Triggering sync for uuid 8a9b12da-02c5-42ba-b215-a20df0e3ea4f {{(pid=74743) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 17:09:52 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Triggering sync for uuid e2b51739-7900-47bd-a01e-2e83e2f13ae1 {{(pid=74743) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 17:09:52 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Triggering sync for uuid 0ad8aa2d-663c-4829-87f9-07959105ca68 {{(pid=74743) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 17:09:52 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Triggering sync for uuid 7764af08-2214-4a2f-84c4-cab1366e198d {{(pid=74743) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 17:09:52 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Triggering sync for uuid f93bf0ac-ecc8-447d-b9c1-381d36cd3135 {{(pid=74743) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 17:09:52 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Triggering sync for uuid a77117a2-748d-4a39-8db7-8b965a1725fc {{(pid=74743) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 17:09:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "4cce1628-2dcb-40c7-abd4-6a327a432de3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:09:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "4cce1628-2dcb-40c7-abd4-6a327a432de3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:09:52 user nova-compute[74743]: INFO nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] During sync_power_state the instance has a pending task (unrescuing). Skip.
Nov 18 17:09:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "4cce1628-2dcb-40c7-abd4-6a327a432de3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:09:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "e9668e1c-1e8d-4dd7-8f58-d453db294557" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:09:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "e9668e1c-1e8d-4dd7-8f58-d453db294557" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:09:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "c006a4ad-a8e2-4108-9af1-dec4dd53fcda" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:09:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "c006a4ad-a8e2-4108-9af1-dec4dd53fcda" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:09:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "49ebdd5a-824d-476a-bd10-3b891bbfe9e2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:09:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "49ebdd5a-824d-476a-bd10-3b891bbfe9e2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:09:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "c5c74497-1d1c-48a0-9b0a-e7df2a41361c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:09:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "c5c74497-1d1c-48a0-9b0a-e7df2a41361c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:09:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "8a9b12da-02c5-42ba-b215-a20df0e3ea4f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:09:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "8a9b12da-02c5-42ba-b215-a20df0e3ea4f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:09:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "e2b51739-7900-47bd-a01e-2e83e2f13ae1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:09:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "e2b51739-7900-47bd-a01e-2e83e2f13ae1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:09:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "0ad8aa2d-663c-4829-87f9-07959105ca68" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:09:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "0ad8aa2d-663c-4829-87f9-07959105ca68" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:09:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "7764af08-2214-4a2f-84c4-cab1366e198d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:09:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "7764af08-2214-4a2f-84c4-cab1366e198d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:09:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:09:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:09:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "a77117a2-748d-4a39-8db7-8b965a1725fc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:09:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "a77117a2-748d-4a39-8db7-8b965a1725fc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:09:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "e2b51739-7900-47bd-a01e-2e83e2f13ae1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.102s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:09:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "c006a4ad-a8e2-4108-9af1-dec4dd53fcda" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.106s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:09:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "e9668e1c-1e8d-4dd7-8f58-d453db294557" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.113s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:09:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "8a9b12da-02c5-42ba-b215-a20df0e3ea4f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.112s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:09:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.115s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:09:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "49ebdd5a-824d-476a-bd10-3b891bbfe9e2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.121s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:09:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "c5c74497-1d1c-48a0-9b0a-e7df2a41361c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.121s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:09:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "7764af08-2214-4a2f-84c4-cab1366e198d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.123s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:09:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "0ad8aa2d-663c-4829-87f9-07959105ca68" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.134s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:09:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "a77117a2-748d-4a39-8db7-8b965a1725fc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.145s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:09:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:52 user nova-compute[74743]: DEBUG nova.compute.manager [req-3c864c5b-d170-4d08-9b7f-bf7f9c32649f req-f80bda94-3d86-467f-a395-ac0acd34d2f3 service nova] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Received event network-vif-plugged-28f81291-34bb-4a6f-890b-faea6ef8a385 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:09:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3c864c5b-d170-4d08-9b7f-bf7f9c32649f req-f80bda94-3d86-467f-a395-ac0acd34d2f3 service nova] Acquiring lock "4cce1628-2dcb-40c7-abd4-6a327a432de3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:09:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3c864c5b-d170-4d08-9b7f-bf7f9c32649f req-f80bda94-3d86-467f-a395-ac0acd34d2f3 service nova] Lock "4cce1628-2dcb-40c7-abd4-6a327a432de3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:09:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3c864c5b-d170-4d08-9b7f-bf7f9c32649f req-f80bda94-3d86-467f-a395-ac0acd34d2f3 service nova] Lock "4cce1628-2dcb-40c7-abd4-6a327a432de3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:09:52 user nova-compute[74743]: DEBUG nova.compute.manager [req-3c864c5b-d170-4d08-9b7f-bf7f9c32649f req-f80bda94-3d86-467f-a395-ac0acd34d2f3 service nova] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] No waiting events found dispatching network-vif-plugged-28f81291-34bb-4a6f-890b-faea6ef8a385 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:09:52 user nova-compute[74743]: WARNING nova.compute.manager [req-3c864c5b-d170-4d08-9b7f-bf7f9c32649f req-f80bda94-3d86-467f-a395-ac0acd34d2f3 service nova] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Received unexpected event network-vif-plugged-28f81291-34bb-4a6f-890b-faea6ef8a385 for instance with vm_state rescued and task_state unrescuing.
Nov 18 17:09:52 user nova-compute[74743]: DEBUG nova.compute.manager [req-3c864c5b-d170-4d08-9b7f-bf7f9c32649f req-f80bda94-3d86-467f-a395-ac0acd34d2f3 service nova] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Received event network-vif-plugged-28f81291-34bb-4a6f-890b-faea6ef8a385 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:09:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3c864c5b-d170-4d08-9b7f-bf7f9c32649f req-f80bda94-3d86-467f-a395-ac0acd34d2f3 service nova] Acquiring lock "4cce1628-2dcb-40c7-abd4-6a327a432de3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:09:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3c864c5b-d170-4d08-9b7f-bf7f9c32649f req-f80bda94-3d86-467f-a395-ac0acd34d2f3 service nova] Lock "4cce1628-2dcb-40c7-abd4-6a327a432de3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:09:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3c864c5b-d170-4d08-9b7f-bf7f9c32649f req-f80bda94-3d86-467f-a395-ac0acd34d2f3 service nova] Lock "4cce1628-2dcb-40c7-abd4-6a327a432de3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:09:52 user nova-compute[74743]: DEBUG nova.compute.manager [req-3c864c5b-d170-4d08-9b7f-bf7f9c32649f req-f80bda94-3d86-467f-a395-ac0acd34d2f3 service nova] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] No waiting events found dispatching network-vif-plugged-28f81291-34bb-4a6f-890b-faea6ef8a385 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:09:52 user nova-compute[74743]: WARNING nova.compute.manager [req-3c864c5b-d170-4d08-9b7f-bf7f9c32649f req-f80bda94-3d86-467f-a395-ac0acd34d2f3 service nova] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Received unexpected event network-vif-plugged-28f81291-34bb-4a6f-890b-faea6ef8a385 for instance with vm_state rescued and task_state unrescuing.
Nov 18 17:09:53 user nova-compute[74743]: DEBUG nova.compute.manager [req-922dfc50-13b0-4924-9c3e-85777568c6a4 req-a29f2890-05ed-4cab-89f5-0a56681e3c7e service nova] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Received event network-changed-e5de62fd-2d58-469b-b981-e7519bb831b6 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:09:53 user nova-compute[74743]: DEBUG nova.compute.manager [req-922dfc50-13b0-4924-9c3e-85777568c6a4 req-a29f2890-05ed-4cab-89f5-0a56681e3c7e service nova] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Refreshing instance network info cache due to event network-changed-e5de62fd-2d58-469b-b981-e7519bb831b6. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:09:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-922dfc50-13b0-4924-9c3e-85777568c6a4 req-a29f2890-05ed-4cab-89f5-0a56681e3c7e service nova] Acquiring lock "refresh_cache-c5c74497-1d1c-48a0-9b0a-e7df2a41361c" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:09:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-922dfc50-13b0-4924-9c3e-85777568c6a4 req-a29f2890-05ed-4cab-89f5-0a56681e3c7e service nova] Acquired lock "refresh_cache-c5c74497-1d1c-48a0-9b0a-e7df2a41361c" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:09:53 user nova-compute[74743]: DEBUG nova.network.neutron [req-922dfc50-13b0-4924-9c3e-85777568c6a4 req-a29f2890-05ed-4cab-89f5-0a56681e3c7e service nova] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Refreshing network info cache for port e5de62fd-2d58-469b-b981-e7519bb831b6 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:09:53 user nova-compute[74743]: DEBUG nova.compute.manager [None req-8af6a014-897b-4b8c-8718-d2e1e8ad80d0 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:09:54 user nova-compute[74743]: DEBUG nova.network.neutron [req-922dfc50-13b0-4924-9c3e-85777568c6a4 req-a29f2890-05ed-4cab-89f5-0a56681e3c7e service nova] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Updated VIF entry in instance network info cache for port e5de62fd-2d58-469b-b981-e7519bb831b6. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:09:54 user nova-compute[74743]: DEBUG nova.network.neutron [req-922dfc50-13b0-4924-9c3e-85777568c6a4 req-a29f2890-05ed-4cab-89f5-0a56681e3c7e service nova] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Updating instance_info_cache with network_info: [{"id": "e5de62fd-2d58-469b-b981-e7519bb831b6", "address": "fa:16:3e:45:6a:b6", "network": {"id": "878a81f7-c3ef-4b3b-8074-52d119d989b4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1839718683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c1b4501efb42a482d0faf10fa1ff2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5de62fd-2d", "ovs_interfaceid": "e5de62fd-2d58-469b-b981-e7519bb831b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:09:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-922dfc50-13b0-4924-9c3e-85777568c6a4 req-a29f2890-05ed-4cab-89f5-0a56681e3c7e service nova] Releasing lock "refresh_cache-c5c74497-1d1c-48a0-9b0a-e7df2a41361c" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:09:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8b4d88df-7a2a-4b44-a363-7ff51282b6e5 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Acquiring lock "c5c74497-1d1c-48a0-9b0a-e7df2a41361c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:09:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8b4d88df-7a2a-4b44-a363-7ff51282b6e5 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Lock "c5c74497-1d1c-48a0-9b0a-e7df2a41361c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.004s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:09:54 user nova-compute[74743]: DEBUG nova.objects.instance [None req-8b4d88df-7a2a-4b44-a363-7ff51282b6e5 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Lazy-loading 'flavor' on Instance uuid c5c74497-1d1c-48a0-9b0a-e7df2a41361c {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:09:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8b4d88df-7a2a-4b44-a363-7ff51282b6e5 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Lock "c5c74497-1d1c-48a0-9b0a-e7df2a41361c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.093s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:09:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8b4d88df-7a2a-4b44-a363-7ff51282b6e5 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Acquiring lock "c5c74497-1d1c-48a0-9b0a-e7df2a41361c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:09:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8b4d88df-7a2a-4b44-a363-7ff51282b6e5 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Lock "c5c74497-1d1c-48a0-9b0a-e7df2a41361c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.005s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:09:54 user nova-compute[74743]: INFO nova.compute.manager [None req-8b4d88df-7a2a-4b44-a363-7ff51282b6e5 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Attaching volume a9384403-9a68-4932-b096-1e081db7d703 to /dev/vdb
Nov 18 17:09:55 user nova-compute[74743]: DEBUG os_brick.utils [None req-8b4d88df-7a2a-4b44-a363-7ff51282b6e5 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:09:55 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:55 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.029s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:55 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7beefc-8666-4897-9f90-c805de92ce68]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1116acd8874d\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:55 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:55 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:55 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7b9ffa-238d-4450-b445-a8730f37d6c1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:55 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:55 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:09:55 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3063a58-0d6b-489c-bd07-53a11a4e5561]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:55 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5cab98-db1f-458c-aba9-0a2f20efddcb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:55 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-8b4d88df-7a2a-4b44-a363-7ff51282b6e5 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Running cmd (subprocess): nvme version {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:55 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-8b4d88df-7a2a-4b44-a363-7ff51282b6e5 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] 'nvme version' failed. Not Retrying. {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:09:55 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8b4d88df-7a2a-4b44-a363-7ff51282b6e5 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] nvme not present on system {{(pid=74743) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 17:09:55 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:09:55 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:09:55 user nova-compute[74743]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 17:09:55 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b43254-367b-46a3-bbce-38916f2f025f]: (4, '') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:09:55 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-8b4d88df-7a2a-4b44-a363-7ff51282b6e5 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74743) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 17:09:55 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-8b4d88df-7a2a-4b44-a363-7ff51282b6e5 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 17:09:55 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-8b4d88df-7a2a-4b44-a363-7ff51282b6e5 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] LIGHTOS: no hostnqn found. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 17:09:55 user nova-compute[74743]: DEBUG os_brick.utils [None req-8b4d88df-7a2a-4b44-a363-7ff51282b6e5 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] <== get_connector_properties: return (217ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1116acd8874d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:09:55 user nova-compute[74743]: DEBUG nova.virt.block_device [None req-8b4d88df-7a2a-4b44-a363-7ff51282b6e5 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Updating existing volume attachment record: 4c667426-bfae-4995-b616-8864f0bd4b0b {{(pid=74743) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 17:09:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:09:59 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:01 user nova-compute[74743]: ERROR nova.volume.cinder [None req-8b4d88df-7a2a-4b44-a363-7ff51282b6e5 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Update attachment failed for attachment 4c667426-bfae-4995-b616-8864f0bd4b0b. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-393c7e44-d048-40b9-9a9d-203a99ff1c7f) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-393c7e44-d048-40b9-9a9d-203a99ff1c7f)
Nov 18 17:10:01 user nova-compute[74743]: ERROR nova.compute.manager [None req-8b4d88df-7a2a-4b44-a363-7ff51282b6e5 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Failed to attach a9384403-9a68-4932-b096-1e081db7d703 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-393c7e44-d048-40b9-9a9d-203a99ff1c7f)
Nov 18 17:10:01 user nova-compute[74743]: ERROR nova.compute.manager [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Traceback (most recent call last):
Nov 18 17:10:01 user nova-compute[74743]: ERROR nova.compute.manager [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 18 17:10:01 user nova-compute[74743]: ERROR nova.compute.manager [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 18 17:10:01 user nova-compute[74743]: ERROR nova.compute.manager [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 18 17:10:01 user nova-compute[74743]: ERROR nova.compute.manager [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c]     ret_val = method(obj, context, *args, **kwargs)
Nov 18 17:10:01 user nova-compute[74743]: ERROR nova.compute.manager [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 18 17:10:01 user nova-compute[74743]: ERROR nova.compute.manager [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c]     self._do_attach(context, instance, volume, volume_api,
Nov 18 17:10:01 user nova-compute[74743]: ERROR nova.compute.manager [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 18 17:10:01 user nova-compute[74743]: ERROR nova.compute.manager [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c]     self._volume_attach(context, volume, connector, instance,
Nov 18 17:10:01 user nova-compute[74743]: ERROR nova.compute.manager [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 18 17:10:01 user nova-compute[74743]: ERROR nova.compute.manager [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c]     connection_info = volume_api.attachment_update(
Nov 18 17:10:01 user nova-compute[74743]: ERROR nova.compute.manager [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 18 17:10:01 user nova-compute[74743]: ERROR nova.compute.manager [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c]     res = method(self, ctx, *args, **kwargs)
Nov 18 17:10:01 user nova-compute[74743]: ERROR nova.compute.manager [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 18 17:10:01 user nova-compute[74743]: ERROR nova.compute.manager [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 18 17:10:01 user nova-compute[74743]: ERROR nova.compute.manager [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 18 17:10:01 user nova-compute[74743]: ERROR nova.compute.manager [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c]     with excutils.save_and_reraise_exception():
Nov 18 17:10:01 user nova-compute[74743]: ERROR nova.compute.manager [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 18 17:10:01 user nova-compute[74743]: ERROR nova.compute.manager [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c]     self.force_reraise()
Nov 18 17:10:01 user nova-compute[74743]: ERROR nova.compute.manager [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 18 17:10:01 user nova-compute[74743]: ERROR nova.compute.manager [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c]     raise self.value
Nov 18 17:10:01 user nova-compute[74743]: ERROR nova.compute.manager [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 18 17:10:01 user nova-compute[74743]: ERROR nova.compute.manager [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c]     context, '3.44', skip_version_check=True).attachments.update(
Nov 18 17:10:01 user nova-compute[74743]: ERROR nova.compute.manager [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 18 17:10:01 user nova-compute[74743]: ERROR nova.compute.manager [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c]     return method.func(obj, *args, **kwargs)
Nov 18 17:10:01 user nova-compute[74743]: ERROR nova.compute.manager [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 18 17:10:01 user nova-compute[74743]: ERROR nova.compute.manager [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c]     resp = self._update('/attachments/%s' % id, body)
Nov 18 17:10:01 user nova-compute[74743]: ERROR nova.compute.manager [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 18 17:10:01 user nova-compute[74743]: ERROR nova.compute.manager [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 18 17:10:01 user nova-compute[74743]: ERROR nova.compute.manager [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 18 17:10:01 user nova-compute[74743]: ERROR nova.compute.manager [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c]     return self._cs_request(url, 'PUT', **kwargs)
Nov 18 17:10:01 user nova-compute[74743]: ERROR nova.compute.manager [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 18 17:10:01 user nova-compute[74743]: ERROR nova.compute.manager [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c]     return self.request(url, method, **kwargs)
Nov 18 17:10:01 user nova-compute[74743]: ERROR nova.compute.manager [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 18 17:10:01 user nova-compute[74743]: ERROR nova.compute.manager [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c]     raise exceptions.from_response(resp, body)
Nov 18 17:10:01 user nova-compute[74743]: ERROR nova.compute.manager [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-393c7e44-d048-40b9-9a9d-203a99ff1c7f)
Nov 18 17:10:01 user nova-compute[74743]: ERROR nova.compute.manager [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] 
Nov 18 17:10:01 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8b4d88df-7a2a-4b44-a363-7ff51282b6e5 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Lock "c5c74497-1d1c-48a0-9b0a-e7df2a41361c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.009s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server [None req-8b4d88df-7a2a-4b44-a363-7ff51282b6e5 tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-393c7e44-d048-40b9-9a9d-203a99ff1c7f)
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-393c7e44-d048-40b9-9a9d-203a99ff1c7f)
Nov 18 17:10:01 user nova-compute[74743]: ERROR oslo_messaging.rpc.server 
Nov 18 17:10:02 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:04 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:08 user nova-compute[74743]: DEBUG nova.compute.manager [req-36595484-1ffd-406e-8d66-20d379f305db req-6fd938df-44c6-4d14-b7bb-416b6663ee1d service nova] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Received event network-changed-6e3b96b3-1a83-4b25-ad28-cf77e11ff137 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:10:08 user nova-compute[74743]: DEBUG nova.compute.manager [req-36595484-1ffd-406e-8d66-20d379f305db req-6fd938df-44c6-4d14-b7bb-416b6663ee1d service nova] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Refreshing instance network info cache due to event network-changed-6e3b96b3-1a83-4b25-ad28-cf77e11ff137. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:10:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-36595484-1ffd-406e-8d66-20d379f305db req-6fd938df-44c6-4d14-b7bb-416b6663ee1d service nova] Acquiring lock "refresh_cache-8a9b12da-02c5-42ba-b215-a20df0e3ea4f" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:10:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-36595484-1ffd-406e-8d66-20d379f305db req-6fd938df-44c6-4d14-b7bb-416b6663ee1d service nova] Acquired lock "refresh_cache-8a9b12da-02c5-42ba-b215-a20df0e3ea4f" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:10:08 user nova-compute[74743]: DEBUG nova.network.neutron [req-36595484-1ffd-406e-8d66-20d379f305db req-6fd938df-44c6-4d14-b7bb-416b6663ee1d service nova] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Refreshing network info cache for port 6e3b96b3-1a83-4b25-ad28-cf77e11ff137 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:10:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-23380113-6761-42ee-90d4-1a4498ff4119 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Acquiring lock "8a9b12da-02c5-42ba-b215-a20df0e3ea4f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:10:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-23380113-6761-42ee-90d4-1a4498ff4119 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "8a9b12da-02c5-42ba-b215-a20df0e3ea4f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:10:08 user nova-compute[74743]: DEBUG nova.objects.instance [None req-23380113-6761-42ee-90d4-1a4498ff4119 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lazy-loading 'flavor' on Instance uuid 8a9b12da-02c5-42ba-b215-a20df0e3ea4f {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:10:08 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-23380113-6761-42ee-90d4-1a4498ff4119 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Ignoring supplied device name: /dev/vdb
Nov 18 17:10:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-23380113-6761-42ee-90d4-1a4498ff4119 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "8a9b12da-02c5-42ba-b215-a20df0e3ea4f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:10:08 user nova-compute[74743]: DEBUG nova.network.neutron [req-36595484-1ffd-406e-8d66-20d379f305db req-6fd938df-44c6-4d14-b7bb-416b6663ee1d service nova] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Updated VIF entry in instance network info cache for port 6e3b96b3-1a83-4b25-ad28-cf77e11ff137. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:10:08 user nova-compute[74743]: DEBUG nova.network.neutron [req-36595484-1ffd-406e-8d66-20d379f305db req-6fd938df-44c6-4d14-b7bb-416b6663ee1d service nova] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Updating instance_info_cache with network_info: [{"id": "6e3b96b3-1a83-4b25-ad28-cf77e11ff137", "address": "fa:16:3e:34:83:d5", "network": {"id": "2588909e-8504-407d-bc7b-5d1f3d978395", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1712970821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468d0e7ff32423091ecc55d82deba1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e3b96b3-1a", "ovs_interfaceid": "6e3b96b3-1a83-4b25-ad28-cf77e11ff137", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:10:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-36595484-1ffd-406e-8d66-20d379f305db req-6fd938df-44c6-4d14-b7bb-416b6663ee1d service nova] Releasing lock "refresh_cache-8a9b12da-02c5-42ba-b215-a20df0e3ea4f" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:10:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-23380113-6761-42ee-90d4-1a4498ff4119 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Acquiring lock "8a9b12da-02c5-42ba-b215-a20df0e3ea4f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:10:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-23380113-6761-42ee-90d4-1a4498ff4119 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "8a9b12da-02c5-42ba-b215-a20df0e3ea4f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:10:08 user nova-compute[74743]: INFO nova.compute.manager [None req-23380113-6761-42ee-90d4-1a4498ff4119 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Attaching volume 6cfd3064-bd17-46d8-bbf6-fd6d541424fb to /dev/vdb
Nov 18 17:10:08 user nova-compute[74743]: DEBUG os_brick.utils [None req-23380113-6761-42ee-90d4-1a4498ff4119 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:10:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:08 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4df6a28-568a-4b82-8290-8ec145987825]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1116acd8874d\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:10:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:08 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dcfde7c-ad30-4e9e-bbe9-c75057e86fb1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:10:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:08 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[adaf688e-b56f-4014-91ff-f1c6b3d7942c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:10:08 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[114bb86f-0356-4b57-9a05-588ea1b4cc80]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:10:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-23380113-6761-42ee-90d4-1a4498ff4119 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Running cmd (subprocess): nvme version {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-23380113-6761-42ee-90d4-1a4498ff4119 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] 'nvme version' failed. Not Retrying. {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:10:08 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.nvmeof [None req-23380113-6761-42ee-90d4-1a4498ff4119 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] nvme not present on system {{(pid=74743) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 17:10:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:09 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:10:09 user nova-compute[74743]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 17:10:09 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b77199-fd38-4270-90d1-d7bab9e4be2a]: (4, '') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:10:09 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-23380113-6761-42ee-90d4-1a4498ff4119 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74743) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 17:10:09 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-23380113-6761-42ee-90d4-1a4498ff4119 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 17:10:09 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-23380113-6761-42ee-90d4-1a4498ff4119 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] LIGHTOS: no hostnqn found. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 17:10:09 user nova-compute[74743]: DEBUG os_brick.utils [None req-23380113-6761-42ee-90d4-1a4498ff4119 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1116acd8874d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:10:09 user nova-compute[74743]: DEBUG nova.virt.block_device [None req-23380113-6761-42ee-90d4-1a4498ff4119 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Updating existing volume attachment record: e870440f-77ae-4f6a-b3e1-3d375388d11a {{(pid=74743) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 17:10:09 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:12 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:14 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23380113-6761-42ee-90d4-1a4498ff4119 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Calling os-brick to attach iSCSI Volume {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 17:10:14 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-23380113-6761-42ee-90d4-1a4498ff4119 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dmRFHzoX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:10:14 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-23380113-6761-42ee-90d4-1a4498ff4119 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:10:14 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-23380113-6761-42ee-90d4-1a4498ff4119 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:10:14 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-23380113-6761-42ee-90d4-1a4498ff4119 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:10:14 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-23380113-6761-42ee-90d4-1a4498ff4119 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:10:14 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-23380113-6761-42ee-90d4-1a4498ff4119 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:10:14 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-23380113-6761-42ee-90d4-1a4498ff4119 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:10:14 user nova-compute[74743]: INFO os_brick.initiator.connectors.iscsi [None req-23380113-6761-42ee-90d4-1a4498ff4119 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 17:10:14 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb -p 172.16.0.220:3260 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:14 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:14 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[9620db78-50d1-494f-bfe9-17397f03d4ad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:10:14 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-23380113-6761-42ee-90d4-1a4498ff4119 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 17:10:14 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:10:14 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb -p 172.16.0.220:3260 --interface default --op new {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:14 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:14 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b85f0f4-c5bb-403e-a66c-b4a2ba89fe00]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb] added\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:10:14 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-23380113-6761-42ee-90d4-1a4498ff4119 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb] added
Nov 18 17:10:14 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:10:14 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:14 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:14 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e180c28-e63d-40e6-8f5e-05eb0ec10f5e]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:10:14 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-23380113-6761-42ee-90d4-1a4498ff4119 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:10:14 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:14 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:14 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[103422b2-2209-4589-a057-914fe0719de7]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:10:14 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-23380113-6761-42ee-90d4-1a4498ff4119 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:10:14 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dmRFHzoX {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:14 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dmRFHzoX" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:14 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8b0fad-86b4-475b-8c25-d94f284288c6]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:10:14 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-23380113-6761-42ee-90d4-1a4498ff4119 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dmRFHzoX'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:10:14 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:14 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:14 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[30db4695-8d9e-4f8a-a820-7ce88c438d89]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:10:14 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-23380113-6761-42ee-90d4-1a4498ff4119 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:10:14 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:14 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:14 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[671b9be0-4922-453e-b538-dccc01bec048]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:10:14 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-23380113-6761-42ee-90d4-1a4498ff4119 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad (non-flash)
Nov 18 17:10:14 user nova-compute[74743]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)
Nov 18 17:10:14 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:10:14 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-23380113-6761-42ee-90d4-1a4498ff4119 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad (non-flash)
Nov 18 17:10:14 user nova-compute[74743]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)
Nov 18 17:10:14 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:10:14 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb -p 172.16.0.220:3260 --login {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:14 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:14 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[232ba99b-7950-46fd-a378-1487445d9275]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:10:14 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-23380113-6761-42ee-90d4-1a4498ff4119 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb, portal: 172.16.0.220,3260]
Nov 18 17:10:14 user nova-compute[74743]: Login to [iface: default, target: iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb, portal: 172.16.0.220,3260] successful.
Nov 18 17:10:14 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:10:14 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:14 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:14 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e07bd3a-54d4-4d8c-be8f-45970914d8ac]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:10:14 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-23380113-6761-42ee-90d4-1a4498ff4119 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:10:14 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:14 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:14 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c3d004-8e29-484b-bd73-32cfa739a3f7]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:10:14 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-23380113-6761-42ee-90d4-1a4498ff4119 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad (non-flash)
Nov 18 17:10:14 user nova-compute[74743]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)
Nov 18 17:10:14 user nova-compute[74743]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb (non-flash)
Nov 18 17:10:14 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:10:14 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-23380113-6761-42ee-90d4-1a4498ff4119 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad (non-flash)
Nov 18 17:10:14 user nova-compute[74743]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)
Nov 18 17:10:14 user nova-compute[74743]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb (non-flash)
Nov 18 17:10:14 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:10:14 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-23380113-6761-42ee-90d4-1a4498ff4119 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:10:14 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-23380113-6761-42ee-90d4-1a4498ff4119 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Connected to 172.16.0.220:3260 {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 17:10:14 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-23380113-6761-42ee-90d4-1a4498ff4119 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] HCTL ('35', '-', '-', 0) found on session 24 with lun 0 {{(pid=74743) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 17:10:14 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-23380113-6761-42ee-90d4-1a4498ff4119 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74743) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 17:10:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:15 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[4137e494-dd9b-43d8-af58-c7457c16a7b8]: (4, ('- - 0', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:10:15 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-23380113-6761-42ee-90d4-1a4498ff4119 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:10:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-23380113-6761-42ee-90d4-1a4498ff4119 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dmRFHzoX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 17:10:16 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-23380113-6761-42ee-90d4-1a4498ff4119 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:10:16 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-23380113-6761-42ee-90d4-1a4498ff4119 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26533346635316134', 'path': '/dev/sdd'} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:10:16 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23380113-6761-42ee-90d4-1a4498ff4119 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533346635316134', 'path': '/dev/sdd'} {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 17:10:16 user nova-compute[74743]: DEBUG nova.objects.instance [None req-23380113-6761-42ee-90d4-1a4498ff4119 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lazy-loading 'flavor' on Instance uuid 8a9b12da-02c5-42ba-b215-a20df0e3ea4f {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:10:16 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-23380113-6761-42ee-90d4-1a4498ff4119 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 17:10:16 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:10:16 user nova-compute[74743]:   <source dev="/dev/sdd"/>
Nov 18 17:10:16 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:10:16 user nova-compute[74743]:   <serial>6cfd3064-bd17-46d8-bbf6-fd6d541424fb</serial>
Nov 18 17:10:16 user nova-compute[74743]: </disk>
Nov 18 17:10:16 user nova-compute[74743]:  {{(pid=74743) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 17:10:16 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-23380113-6761-42ee-90d4-1a4498ff4119 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:10:16 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-23380113-6761-42ee-90d4-1a4498ff4119 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:10:16 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-23380113-6761-42ee-90d4-1a4498ff4119 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] No VIF found with MAC fa:16:3e:34:83:d5, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:10:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-23380113-6761-42ee-90d4-1a4498ff4119 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "8a9b12da-02c5-42ba-b215-a20df0e3ea4f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.811s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:10:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:17 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:10:17 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74743) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 17:10:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-417be49b-216f-4680-b909-2e9a0b251942 req-e9d753f8-ed79-469b-8fb3-98ca4fc1a391 service nova] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Received event network-changed-14c7e1ef-5997-4e7f-aebf-baa01bec87a6 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:10:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-417be49b-216f-4680-b909-2e9a0b251942 req-e9d753f8-ed79-469b-8fb3-98ca4fc1a391 service nova] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Refreshing instance network info cache due to event network-changed-14c7e1ef-5997-4e7f-aebf-baa01bec87a6. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:10:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-417be49b-216f-4680-b909-2e9a0b251942 req-e9d753f8-ed79-469b-8fb3-98ca4fc1a391 service nova] Acquiring lock "refresh_cache-e2b51739-7900-47bd-a01e-2e83e2f13ae1" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:10:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-417be49b-216f-4680-b909-2e9a0b251942 req-e9d753f8-ed79-469b-8fb3-98ca4fc1a391 service nova] Acquired lock "refresh_cache-e2b51739-7900-47bd-a01e-2e83e2f13ae1" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:10:18 user nova-compute[74743]: DEBUG nova.network.neutron [req-417be49b-216f-4680-b909-2e9a0b251942 req-e9d753f8-ed79-469b-8fb3-98ca4fc1a391 service nova] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Refreshing network info cache for port 14c7e1ef-5997-4e7f-aebf-baa01bec87a6 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:10:18 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:10:18 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Starting heal instance info cache {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 17:10:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "refresh_cache-e9668e1c-1e8d-4dd7-8f58-d453db294557" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:10:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquired lock "refresh_cache-e9668e1c-1e8d-4dd7-8f58-d453db294557" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:10:18 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Forcefully refreshing network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 17:10:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a5387a24-ca52-48f2-ab4b-c64f75c2cf1b tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Acquiring lock "interface-e2b51739-7900-47bd-a01e-2e83e2f13ae1-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:10:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a5387a24-ca52-48f2-ab4b-c64f75c2cf1b tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Lock "interface-e2b51739-7900-47bd-a01e-2e83e2f13ae1-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:10:18 user nova-compute[74743]: DEBUG nova.objects.instance [None req-a5387a24-ca52-48f2-ab4b-c64f75c2cf1b tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Lazy-loading 'flavor' on Instance uuid e2b51739-7900-47bd-a01e-2e83e2f13ae1 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:10:19 user nova-compute[74743]: DEBUG nova.network.neutron [req-417be49b-216f-4680-b909-2e9a0b251942 req-e9d753f8-ed79-469b-8fb3-98ca4fc1a391 service nova] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Updated VIF entry in instance network info cache for port 14c7e1ef-5997-4e7f-aebf-baa01bec87a6. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:10:19 user nova-compute[74743]: DEBUG nova.network.neutron [req-417be49b-216f-4680-b909-2e9a0b251942 req-e9d753f8-ed79-469b-8fb3-98ca4fc1a391 service nova] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Updating instance_info_cache with network_info: [{"id": "14c7e1ef-5997-4e7f-aebf-baa01bec87a6", "address": "fa:16:3e:2d:fd:f9", "network": {"id": "f6455510-3862-45cf-b6d7-7d92905b0554", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-6755490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c15d7007a99745f1a308b64514566129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c7e1ef-59", "ovs_interfaceid": "14c7e1ef-5997-4e7f-aebf-baa01bec87a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:10:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-417be49b-216f-4680-b909-2e9a0b251942 req-e9d753f8-ed79-469b-8fb3-98ca4fc1a391 service nova] Releasing lock "refresh_cache-e2b51739-7900-47bd-a01e-2e83e2f13ae1" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:10:19 user nova-compute[74743]: DEBUG nova.objects.instance [None req-a5387a24-ca52-48f2-ab4b-c64f75c2cf1b tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Lazy-loading 'pci_requests' on Instance uuid e2b51739-7900-47bd-a01e-2e83e2f13ae1 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:10:19 user nova-compute[74743]: DEBUG nova.objects.base [None req-a5387a24-ca52-48f2-ab4b-c64f75c2cf1b tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Object Instance<e2b51739-7900-47bd-a01e-2e83e2f13ae1> lazy-loaded attributes: flavor,pci_requests {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:10:19 user nova-compute[74743]: DEBUG nova.network.neutron [None req-a5387a24-ca52-48f2-ab4b-c64f75c2cf1b tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] allocate_for_instance() {{(pid=74743) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 17:10:19 user nova-compute[74743]: DEBUG nova.policy [None req-a5387a24-ca52-48f2-ab4b-c64f75c2cf1b tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eb774fdb80ef465187caf4ffd2422e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15d7007a99745f1a308b64514566129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74743) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 17:10:19 user nova-compute[74743]: DEBUG nova.network.neutron [None req-a5387a24-ca52-48f2-ab4b-c64f75c2cf1b tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Successfully created port: 4476b532-0c9f-4fef-aeb3-0c2b048c16b1 {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:10:19 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Updating instance_info_cache with network_info: [{"id": "fcc120f5-04f4-4675-817c-5161cc09a972", "address": "fa:16:3e:12:4a:34", "network": {"id": "252343cc-f379-471d-a2c9-99b9a60ebcb4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25c06dc8e7be46229750b8e283622c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc120f5-04", "ovs_interfaceid": "fcc120f5-04f4-4675-817c-5161cc09a972", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:10:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Releasing lock "refresh_cache-e9668e1c-1e8d-4dd7-8f58-d453db294557" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:10:19 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Updated the network info_cache for instance {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 17:10:19 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:10:19 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:10:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:20 user nova-compute[74743]: DEBUG nova.network.neutron [None req-a5387a24-ca52-48f2-ab4b-c64f75c2cf1b tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Successfully updated port: 4476b532-0c9f-4fef-aeb3-0c2b048c16b1 {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:10:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a5387a24-ca52-48f2-ab4b-c64f75c2cf1b tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Acquiring lock "refresh_cache-e2b51739-7900-47bd-a01e-2e83e2f13ae1" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:10:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a5387a24-ca52-48f2-ab4b-c64f75c2cf1b tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Acquired lock "refresh_cache-e2b51739-7900-47bd-a01e-2e83e2f13ae1" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:10:20 user nova-compute[74743]: DEBUG nova.network.neutron [None req-a5387a24-ca52-48f2-ab4b-c64f75c2cf1b tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:10:20 user nova-compute[74743]: DEBUG nova.compute.manager [req-55148e24-bde3-408f-a247-64ddba78cd53 req-21a3d5a2-4f93-4447-bc1a-0dcba90f3534 service nova] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Received event network-changed-4476b532-0c9f-4fef-aeb3-0c2b048c16b1 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:10:20 user nova-compute[74743]: DEBUG nova.compute.manager [req-55148e24-bde3-408f-a247-64ddba78cd53 req-21a3d5a2-4f93-4447-bc1a-0dcba90f3534 service nova] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Refreshing instance network info cache due to event network-changed-4476b532-0c9f-4fef-aeb3-0c2b048c16b1. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:10:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-55148e24-bde3-408f-a247-64ddba78cd53 req-21a3d5a2-4f93-4447-bc1a-0dcba90f3534 service nova] Acquiring lock "refresh_cache-e2b51739-7900-47bd-a01e-2e83e2f13ae1" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:10:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:20 user nova-compute[74743]: DEBUG nova.network.neutron [None req-a5387a24-ca52-48f2-ab4b-c64f75c2cf1b tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Updating instance_info_cache with network_info: [{"id": "14c7e1ef-5997-4e7f-aebf-baa01bec87a6", "address": "fa:16:3e:2d:fd:f9", "network": {"id": "f6455510-3862-45cf-b6d7-7d92905b0554", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-6755490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c15d7007a99745f1a308b64514566129", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c7e1ef-59", "ovs_interfaceid": "14c7e1ef-5997-4e7f-aebf-baa01bec87a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4476b532-0c9f-4fef-aeb3-0c2b048c16b1", "address": "fa:16:3e:a1:76:11", "network": {"id": "5a3f7ae2-082b-4f43-b911-8567500c22bf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-410755460", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c15d7007a99745f1a308b64514566129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4476b532-0c", "ovs_interfaceid": "4476b532-0c9f-4fef-aeb3-0c2b048c16b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:10:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a5387a24-ca52-48f2-ab4b-c64f75c2cf1b tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Releasing lock "refresh_cache-e2b51739-7900-47bd-a01e-2e83e2f13ae1" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:10:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-55148e24-bde3-408f-a247-64ddba78cd53 req-21a3d5a2-4f93-4447-bc1a-0dcba90f3534 service nova] Acquired lock "refresh_cache-e2b51739-7900-47bd-a01e-2e83e2f13ae1" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:10:21 user nova-compute[74743]: DEBUG nova.network.neutron [req-55148e24-bde3-408f-a247-64ddba78cd53 req-21a3d5a2-4f93-4447-bc1a-0dcba90f3534 service nova] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Refreshing network info cache for port 4476b532-0c9f-4fef-aeb3-0c2b048c16b1 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:10:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-a5387a24-ca52-48f2-ab4b-c64f75c2cf1b tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T17:08:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-411956172',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-411956172',id=19,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIsbQN9tS0qcOOC8WPSSYsTCVNWYWYH/K8oXwrg2jt5ZqyybStsLpAIghGB8s0OC3gX9C23pdQMdiUELbHV4Nj+tyYgRoCwRrAGlWKX/+zFnGGmym65cFn63wRBKph/3bw==',key_name='tempest-keypair-1379891500',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:08:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c15d7007a99745f1a308b64514566129',ramdisk_id='',reservation_id='r-xbgsfk5e',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1465741228',owner_user_name='tempest-TaggedAttachmentsTest-1465741228-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:08:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb774fdb80ef465187caf4ffd2422e83',uuid=e2b51739-7900-47bd-a01e-2e83e2f13ae1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4476b532-0c9f-4fef-aeb3-0c2b048c16b1", "address": "fa:16:3e:a1:76:11", "network": {"id": "5a3f7ae2-082b-4f43-b911-8567500c22bf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-410755460", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c15d7007a99745f1a308b64514566129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4476b532-0c", "ovs_interfaceid": "4476b532-0c9f-4fef-aeb3-0c2b048c16b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:10:21 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-a5387a24-ca52-48f2-ab4b-c64f75c2cf1b tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Converting VIF {"id": "4476b532-0c9f-4fef-aeb3-0c2b048c16b1", "address": "fa:16:3e:a1:76:11", "network": {"id": "5a3f7ae2-082b-4f43-b911-8567500c22bf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-410755460", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c15d7007a99745f1a308b64514566129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4476b532-0c", "ovs_interfaceid": "4476b532-0c9f-4fef-aeb3-0c2b048c16b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:10:21 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-a5387a24-ca52-48f2-ab4b-c64f75c2cf1b tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:76:11,bridge_name='br-int',has_traffic_filtering=True,id=4476b532-0c9f-4fef-aeb3-0c2b048c16b1,network=Network(5a3f7ae2-082b-4f43-b911-8567500c22bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4476b532-0c') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:10:21 user nova-compute[74743]: DEBUG os_vif [None req-a5387a24-ca52-48f2-ab4b-c64f75c2cf1b tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:76:11,bridge_name='br-int',has_traffic_filtering=True,id=4476b532-0c9f-4fef-aeb3-0c2b048c16b1,network=Network(5a3f7ae2-082b-4f43-b911-8567500c22bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4476b532-0c') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:10:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:10:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:10:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1173edeb-4921-5768-8e7f-8571e447e5c2', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:10:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4476b532-0c, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:10:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4476b532-0c, col_values=(('qos', UUID('38857b6c-8d5a-4615-a5ec-9f7859709cb9')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:10:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4476b532-0c, col_values=(('external_ids', {'iface-id': '4476b532-0c9f-4fef-aeb3-0c2b048c16b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:76:11', 'vm-uuid': 'e2b51739-7900-47bd-a01e-2e83e2f13ae1'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:10:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:10:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:21 user nova-compute[74743]: INFO os_vif [None req-a5387a24-ca52-48f2-ab4b-c64f75c2cf1b tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:76:11,bridge_name='br-int',has_traffic_filtering=True,id=4476b532-0c9f-4fef-aeb3-0c2b048c16b1,network=Network(5a3f7ae2-082b-4f43-b911-8567500c22bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4476b532-0c')
Nov 18 17:10:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-a5387a24-ca52-48f2-ab4b-c64f75c2cf1b tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T17:08:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-411956172',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-411956172',id=19,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIsbQN9tS0qcOOC8WPSSYsTCVNWYWYH/K8oXwrg2jt5ZqyybStsLpAIghGB8s0OC3gX9C23pdQMdiUELbHV4Nj+tyYgRoCwRrAGlWKX/+zFnGGmym65cFn63wRBKph/3bw==',key_name='tempest-keypair-1379891500',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:08:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c15d7007a99745f1a308b64514566129',ramdisk_id='',reservation_id='r-xbgsfk5e',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1465741228',owner_user_name='tempest-TaggedAttachmentsTest-1465741228-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:08:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb774fdb80ef465187caf4ffd2422e83',uuid=e2b51739-7900-47bd-a01e-2e83e2f13ae1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4476b532-0c9f-4fef-aeb3-0c2b048c16b1", "address": "fa:16:3e:a1:76:11", "network": {"id": "5a3f7ae2-082b-4f43-b911-8567500c22bf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-410755460", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c15d7007a99745f1a308b64514566129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4476b532-0c", "ovs_interfaceid": "4476b532-0c9f-4fef-aeb3-0c2b048c16b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:10:21 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-a5387a24-ca52-48f2-ab4b-c64f75c2cf1b tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Converting VIF {"id": "4476b532-0c9f-4fef-aeb3-0c2b048c16b1", "address": "fa:16:3e:a1:76:11", "network": {"id": "5a3f7ae2-082b-4f43-b911-8567500c22bf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-410755460", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c15d7007a99745f1a308b64514566129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4476b532-0c", "ovs_interfaceid": "4476b532-0c9f-4fef-aeb3-0c2b048c16b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:10:21 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-a5387a24-ca52-48f2-ab4b-c64f75c2cf1b tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:76:11,bridge_name='br-int',has_traffic_filtering=True,id=4476b532-0c9f-4fef-aeb3-0c2b048c16b1,network=Network(5a3f7ae2-082b-4f43-b911-8567500c22bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4476b532-0c') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:10:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-a5387a24-ca52-48f2-ab4b-c64f75c2cf1b tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] attach device xml: <interface type="ethernet">
Nov 18 17:10:21 user nova-compute[74743]:   <mac address="fa:16:3e:a1:76:11"/>
Nov 18 17:10:21 user nova-compute[74743]:   <model type="virtio"/>
Nov 18 17:10:21 user nova-compute[74743]:   <mtu size="1442"/>
Nov 18 17:10:21 user nova-compute[74743]:   <target dev="tap4476b532-0c"/>
Nov 18 17:10:21 user nova-compute[74743]: </interface>
Nov 18 17:10:21 user nova-compute[74743]:  {{(pid=74743) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 17:10:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:21 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:10:21 user nova-compute[74743]: DEBUG nova.compute.manager [req-c1db3169-b48a-4696-ab5d-5baa34b76dea req-db9e5b9c-3d98-4012-927a-d5ffa81a84fa service nova] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Received event network-vif-plugged-4476b532-0c9f-4fef-aeb3-0c2b048c16b1 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:10:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-c1db3169-b48a-4696-ab5d-5baa34b76dea req-db9e5b9c-3d98-4012-927a-d5ffa81a84fa service nova] Acquiring lock "e2b51739-7900-47bd-a01e-2e83e2f13ae1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:10:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-c1db3169-b48a-4696-ab5d-5baa34b76dea req-db9e5b9c-3d98-4012-927a-d5ffa81a84fa service nova] Lock "e2b51739-7900-47bd-a01e-2e83e2f13ae1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:10:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-c1db3169-b48a-4696-ab5d-5baa34b76dea req-db9e5b9c-3d98-4012-927a-d5ffa81a84fa service nova] Lock "e2b51739-7900-47bd-a01e-2e83e2f13ae1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:10:21 user nova-compute[74743]: DEBUG nova.compute.manager [req-c1db3169-b48a-4696-ab5d-5baa34b76dea req-db9e5b9c-3d98-4012-927a-d5ffa81a84fa service nova] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] No waiting events found dispatching network-vif-plugged-4476b532-0c9f-4fef-aeb3-0c2b048c16b1 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:10:21 user nova-compute[74743]: WARNING nova.compute.manager [req-c1db3169-b48a-4696-ab5d-5baa34b76dea req-db9e5b9c-3d98-4012-927a-d5ffa81a84fa service nova] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Received unexpected event network-vif-plugged-4476b532-0c9f-4fef-aeb3-0c2b048c16b1 for instance with vm_state active and task_state None.
Nov 18 17:10:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-a5387a24-ca52-48f2-ab4b-c64f75c2cf1b tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:10:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-a5387a24-ca52-48f2-ab4b-c64f75c2cf1b tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] No BDM found with device name hda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:10:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-a5387a24-ca52-48f2-ab4b-c64f75c2cf1b tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] No VIF found with MAC fa:16:3e:2d:fd:f9, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:10:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-a5387a24-ca52-48f2-ab4b-c64f75c2cf1b tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:10:21 user nova-compute[74743]:   <nova:package version="0.0.0"/>
Nov 18 17:10:21 user nova-compute[74743]:   <nova:name>tempest-device-tagging-server-411956172</nova:name>
Nov 18 17:10:21 user nova-compute[74743]:   <nova:creationTime>2023-11-18 17:10:21</nova:creationTime>
Nov 18 17:10:21 user nova-compute[74743]:   <nova:flavor name="m1.tiny">
Nov 18 17:10:21 user nova-compute[74743]:     <nova:memory>512</nova:memory>
Nov 18 17:10:21 user nova-compute[74743]:     <nova:disk>1</nova:disk>
Nov 18 17:10:21 user nova-compute[74743]:     <nova:swap>0</nova:swap>
Nov 18 17:10:21 user nova-compute[74743]:     <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:10:21 user nova-compute[74743]:     <nova:vcpus>1</nova:vcpus>
Nov 18 17:10:21 user nova-compute[74743]:   </nova:flavor>
Nov 18 17:10:21 user nova-compute[74743]:   <nova:owner>
Nov 18 17:10:21 user nova-compute[74743]:     <nova:user uuid="eb774fdb80ef465187caf4ffd2422e83">tempest-TaggedAttachmentsTest-1465741228-project-member</nova:user>
Nov 18 17:10:21 user nova-compute[74743]:     <nova:project uuid="c15d7007a99745f1a308b64514566129">tempest-TaggedAttachmentsTest-1465741228</nova:project>
Nov 18 17:10:21 user nova-compute[74743]:   </nova:owner>
Nov 18 17:10:21 user nova-compute[74743]:   <nova:root type="image" uuid="9536f6cf-95c4-40e2-864a-09a91525678a"/>
Nov 18 17:10:21 user nova-compute[74743]:   <nova:ports>
Nov 18 17:10:21 user nova-compute[74743]:     <nova:port uuid="14c7e1ef-5997-4e7f-aebf-baa01bec87a6">
Nov 18 17:10:21 user nova-compute[74743]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 18 17:10:21 user nova-compute[74743]:     </nova:port>
Nov 18 17:10:21 user nova-compute[74743]:     <nova:port uuid="4476b532-0c9f-4fef-aeb3-0c2b048c16b1">
Nov 18 17:10:21 user nova-compute[74743]:       <nova:ip type="fixed" address="10.10.10.154" ipVersion="4"/>
Nov 18 17:10:21 user nova-compute[74743]:     </nova:port>
Nov 18 17:10:21 user nova-compute[74743]:   </nova:ports>
Nov 18 17:10:21 user nova-compute[74743]: </nova:instance>
Nov 18 17:10:21 user nova-compute[74743]:  {{(pid=74743) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 18 17:10:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a5387a24-ca52-48f2-ab4b-c64f75c2cf1b tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Lock "interface-e2b51739-7900-47bd-a01e-2e83e2f13ae1-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 2.886s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:10:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:21 user nova-compute[74743]: DEBUG nova.network.neutron [req-55148e24-bde3-408f-a247-64ddba78cd53 req-21a3d5a2-4f93-4447-bc1a-0dcba90f3534 service nova] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Updated VIF entry in instance network info cache for port 4476b532-0c9f-4fef-aeb3-0c2b048c16b1. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:10:21 user nova-compute[74743]: DEBUG nova.network.neutron [req-55148e24-bde3-408f-a247-64ddba78cd53 req-21a3d5a2-4f93-4447-bc1a-0dcba90f3534 service nova] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Updating instance_info_cache with network_info: [{"id": "14c7e1ef-5997-4e7f-aebf-baa01bec87a6", "address": "fa:16:3e:2d:fd:f9", "network": {"id": "f6455510-3862-45cf-b6d7-7d92905b0554", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-6755490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c15d7007a99745f1a308b64514566129", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c7e1ef-59", "ovs_interfaceid": "14c7e1ef-5997-4e7f-aebf-baa01bec87a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4476b532-0c9f-4fef-aeb3-0c2b048c16b1", "address": "fa:16:3e:a1:76:11", "network": {"id": "5a3f7ae2-082b-4f43-b911-8567500c22bf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-410755460", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c15d7007a99745f1a308b64514566129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4476b532-0c", "ovs_interfaceid": "4476b532-0c9f-4fef-aeb3-0c2b048c16b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:10:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-55148e24-bde3-408f-a247-64ddba78cd53 req-21a3d5a2-4f93-4447-bc1a-0dcba90f3534 service nova] Releasing lock "refresh_cache-e2b51739-7900-47bd-a01e-2e83e2f13ae1" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:10:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d49781c0-d19d-4675-9570-81d105a2f883 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Acquiring lock "e2b51739-7900-47bd-a01e-2e83e2f13ae1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:10:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d49781c0-d19d-4675-9570-81d105a2f883 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Lock "e2b51739-7900-47bd-a01e-2e83e2f13ae1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:10:22 user nova-compute[74743]: DEBUG nova.objects.instance [None req-d49781c0-d19d-4675-9570-81d105a2f883 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Lazy-loading 'flavor' on Instance uuid e2b51739-7900-47bd-a01e-2e83e2f13ae1 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:10:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d49781c0-d19d-4675-9570-81d105a2f883 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Lock "e2b51739-7900-47bd-a01e-2e83e2f13ae1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:10:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d49781c0-d19d-4675-9570-81d105a2f883 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Acquiring lock "e2b51739-7900-47bd-a01e-2e83e2f13ae1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:10:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d49781c0-d19d-4675-9570-81d105a2f883 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Lock "e2b51739-7900-47bd-a01e-2e83e2f13ae1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:10:22 user nova-compute[74743]: INFO nova.compute.manager [None req-d49781c0-d19d-4675-9570-81d105a2f883 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Attaching volume 7574a709-d136-4d1b-8861-67c33e5c88c6 to /dev/vdb
Nov 18 17:10:22 user nova-compute[74743]: DEBUG os_brick.utils [None req-d49781c0-d19d-4675-9570-81d105a2f883 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:10:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:22 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba5f5dd-6bfb-4817-8ebf-1bc06ab909bd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1116acd8874d\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:10:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:22 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:10:22 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:10:22 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:10:22 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:10:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:22 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[89aceb5a-ecb1-4231-84f2-a553346f6228]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:10:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:22 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be9b76a-440a-4611-9034-006a5d0642b2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:10:22 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[40bb92b1-1d52-4094-839e-74c250550ee7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:10:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d49781c0-d19d-4675-9570-81d105a2f883 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Running cmd (subprocess): nvme version {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d49781c0-d19d-4675-9570-81d105a2f883 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] 'nvme version' failed. Not Retrying. {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:10:22 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d49781c0-d19d-4675-9570-81d105a2f883 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] nvme not present on system {{(pid=74743) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 17:10:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:10:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:10:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:10:22 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Auditing locally available compute resources for user (node: user) {{(pid=74743) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 17:10:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:10:22 user nova-compute[74743]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 17:10:22 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c2237d-6a3a-4177-8e89-015d93e2b938]: (4, '') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:10:22 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-d49781c0-d19d-4675-9570-81d105a2f883 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74743) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 17:10:22 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-d49781c0-d19d-4675-9570-81d105a2f883 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 17:10:22 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-d49781c0-d19d-4675-9570-81d105a2f883 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] LIGHTOS: no hostnqn found. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 17:10:22 user nova-compute[74743]: DEBUG os_brick.utils [None req-d49781c0-d19d-4675-9570-81d105a2f883 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1116acd8874d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:10:22 user nova-compute[74743]: DEBUG nova.virt.block_device [None req-d49781c0-d19d-4675-9570-81d105a2f883 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Updating existing volume attachment record: e7fadf1c-2700-48f5-899a-12659615658b {{(pid=74743) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 17:10:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f93bf0ac-ecc8-447d-b9c1-381d36cd3135/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f93bf0ac-ecc8-447d-b9c1-381d36cd3135/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f93bf0ac-ecc8-447d-b9c1-381d36cd3135/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f93bf0ac-ecc8-447d-b9c1-381d36cd3135/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:23 user nova-compute[74743]: DEBUG nova.compute.manager [req-a69f647b-07b2-45cb-8bc1-79a7a19fd5dc req-67da1dbc-377c-4843-8339-ce15316f149b service nova] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Received event network-vif-plugged-4476b532-0c9f-4fef-aeb3-0c2b048c16b1 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:10:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a69f647b-07b2-45cb-8bc1-79a7a19fd5dc req-67da1dbc-377c-4843-8339-ce15316f149b service nova] Acquiring lock "e2b51739-7900-47bd-a01e-2e83e2f13ae1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:10:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a69f647b-07b2-45cb-8bc1-79a7a19fd5dc req-67da1dbc-377c-4843-8339-ce15316f149b service nova] Lock "e2b51739-7900-47bd-a01e-2e83e2f13ae1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:10:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a69f647b-07b2-45cb-8bc1-79a7a19fd5dc req-67da1dbc-377c-4843-8339-ce15316f149b service nova] Lock "e2b51739-7900-47bd-a01e-2e83e2f13ae1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:10:23 user nova-compute[74743]: DEBUG nova.compute.manager [req-a69f647b-07b2-45cb-8bc1-79a7a19fd5dc req-67da1dbc-377c-4843-8339-ce15316f149b service nova] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] No waiting events found dispatching network-vif-plugged-4476b532-0c9f-4fef-aeb3-0c2b048c16b1 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:10:23 user nova-compute[74743]: WARNING nova.compute.manager [req-a69f647b-07b2-45cb-8bc1-79a7a19fd5dc req-67da1dbc-377c-4843-8339-ce15316f149b service nova] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Received unexpected event network-vif-plugged-4476b532-0c9f-4fef-aeb3-0c2b048c16b1 for instance with vm_state active and task_state None.
Nov 18 17:10:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:23 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:24 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:10:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad8aa2d-663c-4829-87f9-07959105ca68/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:24 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad8aa2d-663c-4829-87f9-07959105ca68/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad8aa2d-663c-4829-87f9-07959105ca68/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad8aa2d-663c-4829-87f9-07959105ca68/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77117a2-748d-4a39-8db7-8b965a1725fc/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77117a2-748d-4a39-8db7-8b965a1725fc/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77117a2-748d-4a39-8db7-8b965a1725fc/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77117a2-748d-4a39-8db7-8b965a1725fc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:25 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:10:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b51739-7900-47bd-a01e-2e83e2f13ae1/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b51739-7900-47bd-a01e-2e83e2f13ae1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b51739-7900-47bd-a01e-2e83e2f13ae1/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b51739-7900-47bd-a01e-2e83e2f13ae1/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a9b12da-02c5-42ba-b215-a20df0e3ea4f/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a9b12da-02c5-42ba-b215-a20df0e3ea4f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a9b12da-02c5-42ba-b215-a20df0e3ea4f/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a9b12da-02c5-42ba-b215-a20df0e3ea4f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:26 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:10:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5c74497-1d1c-48a0-9b0a-e7df2a41361c/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5c74497-1d1c-48a0-9b0a-e7df2a41361c/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5c74497-1d1c-48a0-9b0a-e7df2a41361c/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5c74497-1d1c-48a0-9b0a-e7df2a41361c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:27 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:10:27 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:10:27 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Hypervisor/Node resource view: name=user free_ram=7009MB free_disk=25.528072357177734GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74743) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 17:10:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:10:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:10:27 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 4cce1628-2dcb-40c7-abd4-6a327a432de3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:10:27 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance e9668e1c-1e8d-4dd7-8f58-d453db294557 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:10:27 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance c006a4ad-a8e2-4108-9af1-dec4dd53fcda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:10:27 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance a77117a2-748d-4a39-8db7-8b965a1725fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:10:27 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 49ebdd5a-824d-476a-bd10-3b891bbfe9e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:10:27 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance c5c74497-1d1c-48a0-9b0a-e7df2a41361c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:10:27 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 8a9b12da-02c5-42ba-b215-a20df0e3ea4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:10:27 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance e2b51739-7900-47bd-a01e-2e83e2f13ae1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:10:27 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 0ad8aa2d-663c-4829-87f9-07959105ca68 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:10:27 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 7764af08-2214-4a2f-84c4-cab1366e198d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:10:27 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance f93bf0ac-ecc8-447d-b9c1-381d36cd3135 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:10:27 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 17:10:27 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 17:10:27 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:10:27 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:10:27 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Compute_service record updated for user:user {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 17:10:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.524s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:10:28 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d49781c0-d19d-4675-9570-81d105a2f883 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Calling os-brick to attach iSCSI Volume {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 17:10:28 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49781c0-d19d-4675-9570-81d105a2f883 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7574a709-d136-4d1b-8861-67c33e5c88c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MmeZChtz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:10:28 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-d49781c0-d19d-4675-9570-81d105a2f883 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:10:28 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-d49781c0-d19d-4675-9570-81d105a2f883 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:10:28 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-d49781c0-d19d-4675-9570-81d105a2f883 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:10:28 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-d49781c0-d19d-4675-9570-81d105a2f883 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:10:28 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-d49781c0-d19d-4675-9570-81d105a2f883 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7574a709-d136-4d1b-8861-67c33e5c88c6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:10:28 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-d49781c0-d19d-4675-9570-81d105a2f883 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7574a709-d136-4d1b-8861-67c33e5c88c6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:10:28 user nova-compute[74743]: INFO os_brick.initiator.connectors.iscsi [None req-d49781c0-d19d-4675-9570-81d105a2f883 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 17:10:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7574a709-d136-4d1b-8861-67c33e5c88c6 -p 172.16.0.220:3260 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7574a709-d136-4d1b-8861-67c33e5c88c6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:28 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95b369f-5855-4366-a403-134fea7a75ab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:10:28 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49781c0-d19d-4675-9570-81d105a2f883 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 17:10:28 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:10:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7574a709-d136-4d1b-8861-67c33e5c88c6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7574a709-d136-4d1b-8861-67c33e5c88c6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:28 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4dbfb61-7801-49b9-9ff9-b81d6aec4e9e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7574a709-d136-4d1b-8861-67c33e5c88c6] added\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:10:28 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49781c0-d19d-4675-9570-81d105a2f883 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7574a709-d136-4d1b-8861-67c33e5c88c6] added
Nov 18 17:10:28 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:10:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7574a709-d136-4d1b-8861-67c33e5c88c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7574a709-d136-4d1b-8861-67c33e5c88c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:28 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c87d537-5c49-4734-9b09-b1a4b332be06]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:10:28 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49781c0-d19d-4675-9570-81d105a2f883 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:10:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7574a709-d136-4d1b-8861-67c33e5c88c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7574a709-d136-4d1b-8861-67c33e5c88c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:28 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[22834e8c-297d-4341-a72c-69319ee8f511]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:10:28 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49781c0-d19d-4675-9570-81d105a2f883 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:10:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7574a709-d136-4d1b-8861-67c33e5c88c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MmeZChtz {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7574a709-d136-4d1b-8861-67c33e5c88c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MmeZChtz" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:28 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0acdb3-a46a-404e-91a6-191a948e52ea]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:10:28 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49781c0-d19d-4675-9570-81d105a2f883 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MmeZChtz'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:10:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7574a709-d136-4d1b-8861-67c33e5c88c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7574a709-d136-4d1b-8861-67c33e5c88c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:28 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e546cbd-53b9-4ef5-ad21-3f9cc6b9e819]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:10:28 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49781c0-d19d-4675-9570-81d105a2f883 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:10:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:28 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e491b7-3611-45a7-9e9f-5ce4fb217ee4]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:10:28 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49781c0-d19d-4675-9570-81d105a2f883 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad (non-flash)
Nov 18 17:10:28 user nova-compute[74743]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)
Nov 18 17:10:28 user nova-compute[74743]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb (non-flash)
Nov 18 17:10:28 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:10:28 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49781c0-d19d-4675-9570-81d105a2f883 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad (non-flash)
Nov 18 17:10:28 user nova-compute[74743]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)
Nov 18 17:10:28 user nova-compute[74743]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb (non-flash)
Nov 18 17:10:28 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:10:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7574a709-d136-4d1b-8861-67c33e5c88c6 -p 172.16.0.220:3260 --login {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7574a709-d136-4d1b-8861-67c33e5c88c6 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:28 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fc1ae4-e8c5-4b8e-9ff7-fcd45e40f3e6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7574a709-d136-4d1b-8861-67c33e5c88c6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7574a709-d136-4d1b-8861-67c33e5c88c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:10:28 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49781c0-d19d-4675-9570-81d105a2f883 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7574a709-d136-4d1b-8861-67c33e5c88c6, portal: 172.16.0.220,3260]
Nov 18 17:10:28 user nova-compute[74743]: Login to [iface: default, target: iqn.2010-10.org.openstack:7574a709-d136-4d1b-8861-67c33e5c88c6, portal: 172.16.0.220,3260] successful.
Nov 18 17:10:28 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:10:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7574a709-d136-4d1b-8861-67c33e5c88c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7574a709-d136-4d1b-8861-67c33e5c88c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:28 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f4b58c-7714-4f28-9fc8-93ae8d35d8b8]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:10:28 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49781c0-d19d-4675-9570-81d105a2f883 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:10:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:28 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f2d21f-e64e-4382-8453-f323e773e4d6]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7574a709-d136-4d1b-8861-67c33e5c88c6 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:10:28 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49781c0-d19d-4675-9570-81d105a2f883 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad (non-flash)
Nov 18 17:10:28 user nova-compute[74743]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)
Nov 18 17:10:28 user nova-compute[74743]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb (non-flash)
Nov 18 17:10:28 user nova-compute[74743]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7574a709-d136-4d1b-8861-67c33e5c88c6 (non-flash)
Nov 18 17:10:28 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:10:28 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49781c0-d19d-4675-9570-81d105a2f883 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad (non-flash)
Nov 18 17:10:28 user nova-compute[74743]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)
Nov 18 17:10:28 user nova-compute[74743]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb (non-flash)
Nov 18 17:10:28 user nova-compute[74743]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7574a709-d136-4d1b-8861-67c33e5c88c6 (non-flash)
Nov 18 17:10:28 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:10:28 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-d49781c0-d19d-4675-9570-81d105a2f883 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7574a709-d136-4d1b-8861-67c33e5c88c6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:10:28 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49781c0-d19d-4675-9570-81d105a2f883 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Connected to 172.16.0.220:3260 {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 17:10:28 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-d49781c0-d19d-4675-9570-81d105a2f883 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] HCTL ('36', '-', '-', 0) found on session 25 with lun 0 {{(pid=74743) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 17:10:28 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-d49781c0-d19d-4675-9570-81d105a2f883 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74743) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 17:10:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:28 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df15663-b017-4aeb-a7fd-7589c4cdf34e]: (4, ('- - 0', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:10:28 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-d49781c0-d19d-4675-9570-81d105a2f883 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: None {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:10:29 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-d49781c0-d19d-4675-9570-81d105a2f883 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:10:29 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49781c0-d19d-4675-9570-81d105a2f883 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:7574a709-d136-4d1b-8861-67c33e5c88c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MmeZChtz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 17:10:29 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-d49781c0-d19d-4675-9570-81d105a2f883 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:10:29 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49781c0-d19d-4675-9570-81d105a2f883 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '26165396239323538', 'path': '/dev/sde'} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:10:29 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d49781c0-d19d-4675-9570-81d105a2f883 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165396239323538', 'path': '/dev/sde'} {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 17:10:29 user nova-compute[74743]: DEBUG nova.objects.instance [None req-d49781c0-d19d-4675-9570-81d105a2f883 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Lazy-loading 'flavor' on Instance uuid e2b51739-7900-47bd-a01e-2e83e2f13ae1 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:10:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:29 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-d49781c0-d19d-4675-9570-81d105a2f883 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 17:10:29 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:10:29 user nova-compute[74743]:   <source dev="/dev/sde"/>
Nov 18 17:10:29 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:10:29 user nova-compute[74743]:   <serial>7574a709-d136-4d1b-8861-67c33e5c88c6</serial>
Nov 18 17:10:29 user nova-compute[74743]: </disk>
Nov 18 17:10:29 user nova-compute[74743]:  {{(pid=74743) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 17:10:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d49781c0-d19d-4675-9570-81d105a2f883 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:10:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d49781c0-d19d-4675-9570-81d105a2f883 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] No BDM found with device name hda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:10:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d49781c0-d19d-4675-9570-81d105a2f883 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] No VIF found with MAC fa:16:3e:2d:fd:f9, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:10:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d49781c0-d19d-4675-9570-81d105a2f883 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Lock "e2b51739-7900-47bd-a01e-2e83e2f13ae1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.833s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:10:31 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Acquiring lock "2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:10:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Lock "2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:10:31 user nova-compute[74743]: DEBUG nova.compute.manager [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] Starting instance... {{(pid=74743) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 17:10:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8efca81f-87b7-42d2-b1d3-54cb30cd2b84 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Acquiring lock "e2b51739-7900-47bd-a01e-2e83e2f13ae1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:10:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8efca81f-87b7-42d2-b1d3-54cb30cd2b84 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Lock "e2b51739-7900-47bd-a01e-2e83e2f13ae1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:10:31 user nova-compute[74743]: INFO nova.compute.manager [None req-8efca81f-87b7-42d2-b1d3-54cb30cd2b84 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Detaching volume 7574a709-d136-4d1b-8861-67c33e5c88c6
Nov 18 17:10:31 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:31 user nova-compute[74743]: INFO nova.virt.block_device [None req-8efca81f-87b7-42d2-b1d3-54cb30cd2b84 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Attempting to driver detach volume 7574a709-d136-4d1b-8861-67c33e5c88c6 from mountpoint /dev/vdb
Nov 18 17:10:31 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-8efca81f-87b7-42d2-b1d3-54cb30cd2b84 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Attempting to detach device vdb from instance e2b51739-7900-47bd-a01e-2e83e2f13ae1 from the persistent domain config. {{(pid=74743) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 17:10:31 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-8efca81f-87b7-42d2-b1d3-54cb30cd2b84 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 17:10:31 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:10:31 user nova-compute[74743]:   <source dev="/dev/sde"/>
Nov 18 17:10:31 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:10:31 user nova-compute[74743]:   <serial>7574a709-d136-4d1b-8861-67c33e5c88c6</serial>
Nov 18 17:10:31 user nova-compute[74743]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 18 17:10:31 user nova-compute[74743]: </disk>
Nov 18 17:10:31 user nova-compute[74743]:  {{(pid=74743) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 17:10:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:10:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:10:32 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74743) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 17:10:32 user nova-compute[74743]: INFO nova.compute.claims [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] Claim successful on node user
Nov 18 17:10:32 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-8efca81f-87b7-42d2-b1d3-54cb30cd2b84 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Successfully detached device vdb from instance e2b51739-7900-47bd-a01e-2e83e2f13ae1 from the persistent domain config.
Nov 18 17:10:32 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-8efca81f-87b7-42d2-b1d3-54cb30cd2b84 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e2b51739-7900-47bd-a01e-2e83e2f13ae1 from the live domain config. {{(pid=74743) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 17:10:32 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-8efca81f-87b7-42d2-b1d3-54cb30cd2b84 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 17:10:32 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:10:32 user nova-compute[74743]:   <source dev="/dev/sde"/>
Nov 18 17:10:32 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:10:32 user nova-compute[74743]:   <serial>7574a709-d136-4d1b-8861-67c33e5c88c6</serial>
Nov 18 17:10:32 user nova-compute[74743]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 18 17:10:32 user nova-compute[74743]: </disk>
Nov 18 17:10:32 user nova-compute[74743]:  {{(pid=74743) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 17:10:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f3e81143-633d-4627-91fc-9997249c55d8 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Acquiring lock "8a9b12da-02c5-42ba-b215-a20df0e3ea4f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:10:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f3e81143-633d-4627-91fc-9997249c55d8 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "8a9b12da-02c5-42ba-b215-a20df0e3ea4f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:10:32 user nova-compute[74743]: INFO nova.compute.manager [None req-f3e81143-633d-4627-91fc-9997249c55d8 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Detaching volume 6cfd3064-bd17-46d8-bbf6-fd6d541424fb
Nov 18 17:10:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-221f40a4-bda4-4b82-a519-8a8913939056 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Acquiring lock "8a9b12da-02c5-42ba-b215-a20df0e3ea4f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:10:32 user nova-compute[74743]: INFO nova.virt.block_device [None req-f3e81143-633d-4627-91fc-9997249c55d8 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Attempting to driver detach volume 6cfd3064-bd17-46d8-bbf6-fd6d541424fb from mountpoint /dev/vdb
Nov 18 17:10:32 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-f3e81143-633d-4627-91fc-9997249c55d8 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Attempting to detach device vdb from instance 8a9b12da-02c5-42ba-b215-a20df0e3ea4f from the persistent domain config. {{(pid=74743) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 17:10:32 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-f3e81143-633d-4627-91fc-9997249c55d8 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 17:10:32 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:10:32 user nova-compute[74743]:   <source dev="/dev/sdd"/>
Nov 18 17:10:32 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:10:32 user nova-compute[74743]:   <serial>6cfd3064-bd17-46d8-bbf6-fd6d541424fb</serial>
Nov 18 17:10:32 user nova-compute[74743]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 17:10:32 user nova-compute[74743]: </disk>
Nov 18 17:10:32 user nova-compute[74743]:  {{(pid=74743) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 17:10:32 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-f3e81143-633d-4627-91fc-9997249c55d8 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Successfully detached device vdb from instance 8a9b12da-02c5-42ba-b215-a20df0e3ea4f from the persistent domain config.
Nov 18 17:10:32 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-f3e81143-633d-4627-91fc-9997249c55d8 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8a9b12da-02c5-42ba-b215-a20df0e3ea4f from the live domain config. {{(pid=74743) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 17:10:32 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-f3e81143-633d-4627-91fc-9997249c55d8 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 17:10:32 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:10:32 user nova-compute[74743]:   <source dev="/dev/sdd"/>
Nov 18 17:10:32 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:10:32 user nova-compute[74743]:   <serial>6cfd3064-bd17-46d8-bbf6-fd6d541424fb</serial>
Nov 18 17:10:32 user nova-compute[74743]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 17:10:32 user nova-compute[74743]: </disk>
Nov 18 17:10:32 user nova-compute[74743]:  {{(pid=74743) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 17:10:32 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-8efca81f-87b7-42d2-b1d3-54cb30cd2b84 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e2b51739-7900-47bd-a01e-2e83e2f13ae1 {{(pid=74743) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 17:10:32 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:10:32 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:10:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.556s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:10:32 user nova-compute[74743]: DEBUG nova.compute.manager [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] Start building networks asynchronously for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 17:10:32 user nova-compute[74743]: DEBUG nova.compute.manager [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] Allocating IP information in the background. {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 17:10:32 user nova-compute[74743]: DEBUG nova.network.neutron [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] allocate_for_instance() {{(pid=74743) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 17:10:32 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 17:10:32 user nova-compute[74743]: DEBUG nova.compute.manager [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] Start building block device mappings for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 17:10:32 user nova-compute[74743]: DEBUG nova.policy [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '357f81ed0cae4dda9721d5ce81d23be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57ac6e8f2384c6fb2bb4cbdeee429c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74743) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 17:10:32 user nova-compute[74743]: DEBUG nova.compute.manager [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] Start spawning the instance on the hypervisor. {{(pid=74743) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 17:10:32 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] Creating instance directory {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 17:10:32 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] Creating image(s)
Nov 18 17:10:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Acquiring lock "/opt/stack/data/nova/instances/2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:10:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Lock "/opt/stack/data/nova/instances/2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:10:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Lock "/opt/stack/data/nova/instances/2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:10:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:32 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-f3e81143-633d-4627-91fc-9997249c55d8 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8a9b12da-02c5-42ba-b215-a20df0e3ea4f {{(pid=74743) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 17:10:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.176s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Acquiring lock "c188b3a997bfafa42fa341f9dcc326545681eed9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:10:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:10:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.180s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4/disk 1073741824 {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4/disk 1073741824" returned: 0 in 0.059s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:10:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:33 user nova-compute[74743]: DEBUG nova.network.neutron [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] Successfully created port: 8e586810-21e7-43d2-80dc-66c83416b245 {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:10:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquiring lock "aefe3db1-b9bb-4cce-aa31-d0b6684ad791" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:10:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "aefe3db1-b9bb-4cce-aa31-d0b6684ad791" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:10:33 user nova-compute[74743]: DEBUG nova.compute.manager [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Starting instance... {{(pid=74743) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 17:10:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.175s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:33 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4/disk. size=1073741824 {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 17:10:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:10:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:10:33 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74743) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 17:10:33 user nova-compute[74743]: INFO nova.compute.claims [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Claim successful on node user
Nov 18 17:10:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:33 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Cannot resize image /opt/stack/data/nova/instances/2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4/disk to a smaller size. {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 17:10:33 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] Created local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 17:10:33 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] Ensure instance console log exists: /opt/stack/data/nova/instances/2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:10:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:10:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:10:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:10:33 user nova-compute[74743]: DEBUG nova.network.neutron [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] Successfully updated port: 8e586810-21e7-43d2-80dc-66c83416b245 {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:10:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Acquiring lock "refresh_cache-2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:10:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Acquired lock "refresh_cache-2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:10:33 user nova-compute[74743]: DEBUG nova.network.neutron [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:10:33 user nova-compute[74743]: DEBUG nova.compute.manager [req-3b3340a6-4a1a-4a3c-9fff-00c9d3e37266 req-51c92e2a-918a-48f7-acab-af4015f243b3 service nova] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] Received event network-changed-8e586810-21e7-43d2-80dc-66c83416b245 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:10:33 user nova-compute[74743]: DEBUG nova.compute.manager [req-3b3340a6-4a1a-4a3c-9fff-00c9d3e37266 req-51c92e2a-918a-48f7-acab-af4015f243b3 service nova] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] Refreshing instance network info cache due to event network-changed-8e586810-21e7-43d2-80dc-66c83416b245. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:10:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3b3340a6-4a1a-4a3c-9fff-00c9d3e37266 req-51c92e2a-918a-48f7-acab-af4015f243b3 service nova] Acquiring lock "refresh_cache-2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:10:33 user nova-compute[74743]: DEBUG nova.network.neutron [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:10:33 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:10:33 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:10:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.478s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:10:33 user nova-compute[74743]: DEBUG nova.compute.manager [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Start building networks asynchronously for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG nova.compute.manager [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Allocating IP information in the background. {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG nova.network.neutron [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] allocate_for_instance() {{(pid=74743) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 17:10:34 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 17:10:34 user nova-compute[74743]: DEBUG nova.compute.manager [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Start building block device mappings for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG nova.policy [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5639bd2666534fdca04d0958dcdc9f54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0fda74575d488a94e2dcfdc016598c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74743) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG nova.network.neutron [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] Updating instance_info_cache with network_info: [{"id": "8e586810-21e7-43d2-80dc-66c83416b245", "address": "fa:16:3e:ee:61:55", "network": {"id": "13e0d3be-e4a3-4f20-8aac-1cf64be1e1b2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-853497736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b57ac6e8f2384c6fb2bb4cbdeee429c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e586810-21", "ovs_interfaceid": "8e586810-21e7-43d2-80dc-66c83416b245", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Releasing lock "refresh_cache-2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG nova.compute.manager [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] Instance network_info: |[{"id": "8e586810-21e7-43d2-80dc-66c83416b245", "address": "fa:16:3e:ee:61:55", "network": {"id": "13e0d3be-e4a3-4f20-8aac-1cf64be1e1b2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-853497736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b57ac6e8f2384c6fb2bb4cbdeee429c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e586810-21", "ovs_interfaceid": "8e586810-21e7-43d2-80dc-66c83416b245", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3b3340a6-4a1a-4a3c-9fff-00c9d3e37266 req-51c92e2a-918a-48f7-acab-af4015f243b3 service nova] Acquired lock "refresh_cache-2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG nova.network.neutron [req-3b3340a6-4a1a-4a3c-9fff-00c9d3e37266 req-51c92e2a-918a-48f7-acab-af4015f243b3 service nova] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] Refreshing network info cache for port 8e586810-21e7-43d2-80dc-66c83416b245 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] Start _get_guest_xml network_info=[{"id": "8e586810-21e7-43d2-80dc-66c83416b245", "address": "fa:16:3e:ee:61:55", "network": {"id": "13e0d3be-e4a3-4f20-8aac-1cf64be1e1b2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-853497736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b57ac6e8f2384c6fb2bb4cbdeee429c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e586810-21", "ovs_interfaceid": "8e586810-21e7-43d2-80dc-66c83416b245", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '9536f6cf-95c4-40e2-864a-09a91525678a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:10:34 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:10:34 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:10:34 user nova-compute[74743]: DEBUG nova.compute.manager [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Start spawning the instance on the hypervisor. {{(pid=74743) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Creating instance directory {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 17:10:34 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Creating image(s)
Nov 18 17:10:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquiring lock "/opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "/opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "/opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:10:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1163566358',display_name='tempest-ServersNegativeTestJSON-server-1163566358',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1163566358',id=23,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b57ac6e8f2384c6fb2bb4cbdeee429c0',ramdisk_id='',reservation_id='r-m3ql625q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-840944804',owner_user_name='tempest-ServersNegativeTestJSON-840944804-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:10:33Z,user_data=None,user_id='357f81ed0cae4dda9721d5ce81d23be5',uuid=2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e586810-21e7-43d2-80dc-66c83416b245", "address": "fa:16:3e:ee:61:55", "network": {"id": "13e0d3be-e4a3-4f20-8aac-1cf64be1e1b2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-853497736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b57ac6e8f2384c6fb2bb4cbdeee429c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e586810-21", "ovs_interfaceid": "8e586810-21e7-43d2-80dc-66c83416b245", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Converting VIF {"id": "8e586810-21e7-43d2-80dc-66c83416b245", "address": "fa:16:3e:ee:61:55", "network": {"id": "13e0d3be-e4a3-4f20-8aac-1cf64be1e1b2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-853497736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b57ac6e8f2384c6fb2bb4cbdeee429c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e586810-21", "ovs_interfaceid": "8e586810-21e7-43d2-80dc-66c83416b245", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:61:55,bridge_name='br-int',has_traffic_filtering=True,id=8e586810-21e7-43d2-80dc-66c83416b245,network=Network(13e0d3be-e4a3-4f20-8aac-1cf64be1e1b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e586810-21') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG nova.objects.instance [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Lazy-loading 'pci_devices' on Instance uuid 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:10:34 user nova-compute[74743]:   <uuid>2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4</uuid>
Nov 18 17:10:34 user nova-compute[74743]:   <name>instance-00000017</name>
Nov 18 17:10:34 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:10:34 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:10:34 user nova-compute[74743]:   <metadata>
Nov 18 17:10:34 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:10:34 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:10:34 user nova-compute[74743]:       <nova:name>tempest-ServersNegativeTestJSON-server-1163566358</nova:name>
Nov 18 17:10:34 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:10:34</nova:creationTime>
Nov 18 17:10:34 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:10:34 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:10:34 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:10:34 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:10:34 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:10:34 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:10:34 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:10:34 user nova-compute[74743]:       <nova:owner>
Nov 18 17:10:34 user nova-compute[74743]:         <nova:user uuid="357f81ed0cae4dda9721d5ce81d23be5">tempest-ServersNegativeTestJSON-840944804-project-member</nova:user>
Nov 18 17:10:34 user nova-compute[74743]:         <nova:project uuid="b57ac6e8f2384c6fb2bb4cbdeee429c0">tempest-ServersNegativeTestJSON-840944804</nova:project>
Nov 18 17:10:34 user nova-compute[74743]:       </nova:owner>
Nov 18 17:10:34 user nova-compute[74743]:       <nova:root type="image" uuid="9536f6cf-95c4-40e2-864a-09a91525678a"/>
Nov 18 17:10:34 user nova-compute[74743]:       <nova:ports>
Nov 18 17:10:34 user nova-compute[74743]:         <nova:port uuid="8e586810-21e7-43d2-80dc-66c83416b245">
Nov 18 17:10:34 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 18 17:10:34 user nova-compute[74743]:         </nova:port>
Nov 18 17:10:34 user nova-compute[74743]:       </nova:ports>
Nov 18 17:10:34 user nova-compute[74743]:     </nova:instance>
Nov 18 17:10:34 user nova-compute[74743]:   </metadata>
Nov 18 17:10:34 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:10:34 user nova-compute[74743]:     <system>
Nov 18 17:10:34 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:10:34 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:10:34 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:10:34 user nova-compute[74743]:       <entry name="serial">2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4</entry>
Nov 18 17:10:34 user nova-compute[74743]:       <entry name="uuid">2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4</entry>
Nov 18 17:10:34 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:10:34 user nova-compute[74743]:     </system>
Nov 18 17:10:34 user nova-compute[74743]:   </sysinfo>
Nov 18 17:10:34 user nova-compute[74743]:   <os>
Nov 18 17:10:34 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:10:34 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:10:34 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:10:34 user nova-compute[74743]:   </os>
Nov 18 17:10:34 user nova-compute[74743]:   <features>
Nov 18 17:10:34 user nova-compute[74743]:     <acpi/>
Nov 18 17:10:34 user nova-compute[74743]:     <apic/>
Nov 18 17:10:34 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:10:34 user nova-compute[74743]:   </features>
Nov 18 17:10:34 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:10:34 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:10:34 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:10:34 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:10:34 user nova-compute[74743]:   </clock>
Nov 18 17:10:34 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:10:34 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:10:34 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:10:34 user nova-compute[74743]:   </cpu>
Nov 18 17:10:34 user nova-compute[74743]:   <devices>
Nov 18 17:10:34 user nova-compute[74743]:     <disk type="file" device="disk">
Nov 18 17:10:34 user nova-compute[74743]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 17:10:34 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4/disk"/>
Nov 18 17:10:34 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:10:34 user nova-compute[74743]:     </disk>
Nov 18 17:10:34 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:10:34 user nova-compute[74743]:       <mac address="fa:16:3e:ee:61:55"/>
Nov 18 17:10:34 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:10:34 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:10:34 user nova-compute[74743]:       <target dev="tap8e586810-21"/>
Nov 18 17:10:34 user nova-compute[74743]:     </interface>
Nov 18 17:10:34 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:10:34 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4/console.log" append="off"/>
Nov 18 17:10:34 user nova-compute[74743]:     </serial>
Nov 18 17:10:34 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:10:34 user nova-compute[74743]:     <video>
Nov 18 17:10:34 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:10:34 user nova-compute[74743]:     </video>
Nov 18 17:10:34 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:10:34 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:10:34 user nova-compute[74743]:     </rng>
Nov 18 17:10:34 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:10:34 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:10:34 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:10:34 user nova-compute[74743]:     </memballoon>
Nov 18 17:10:34 user nova-compute[74743]:   </devices>
Nov 18 17:10:34 user nova-compute[74743]: </domain>
Nov 18 17:10:34 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:10:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1163566358',display_name='tempest-ServersNegativeTestJSON-server-1163566358',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1163566358',id=23,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b57ac6e8f2384c6fb2bb4cbdeee429c0',ramdisk_id='',reservation_id='r-m3ql625q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-840944804',owner_user_name='tempest-ServersNegativeTestJSON-840944804-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:10:33Z,user_data=None,user_id='357f81ed0cae4dda9721d5ce81d23be5',uuid=2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e586810-21e7-43d2-80dc-66c83416b245", "address": "fa:16:3e:ee:61:55", "network": {"id": "13e0d3be-e4a3-4f20-8aac-1cf64be1e1b2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-853497736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b57ac6e8f2384c6fb2bb4cbdeee429c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e586810-21", "ovs_interfaceid": "8e586810-21e7-43d2-80dc-66c83416b245", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Converting VIF {"id": "8e586810-21e7-43d2-80dc-66c83416b245", "address": "fa:16:3e:ee:61:55", "network": {"id": "13e0d3be-e4a3-4f20-8aac-1cf64be1e1b2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-853497736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b57ac6e8f2384c6fb2bb4cbdeee429c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e586810-21", "ovs_interfaceid": "8e586810-21e7-43d2-80dc-66c83416b245", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:61:55,bridge_name='br-int',has_traffic_filtering=True,id=8e586810-21e7-43d2-80dc-66c83416b245,network=Network(13e0d3be-e4a3-4f20-8aac-1cf64be1e1b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e586810-21') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG os_vif [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:61:55,bridge_name='br-int',has_traffic_filtering=True,id=8e586810-21e7-43d2-80dc-66c83416b245,network=Network(13e0d3be-e4a3-4f20-8aac-1cf64be1e1b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e586810-21') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c35dc2a9-0c3c-5265-a489-5ceec801d50e', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e586810-21, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8e586810-21, col_values=(('qos', UUID('2871696e-e4ca-4377-a949-c6f14e1f8f1f')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8e586810-21, col_values=(('external_ids', {'iface-id': '8e586810-21e7-43d2-80dc-66c83416b245', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:61:55', 'vm-uuid': '2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:34 user nova-compute[74743]: INFO os_vif [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:61:55,bridge_name='br-int',has_traffic_filtering=True,id=8e586810-21e7-43d2-80dc-66c83416b245,network=Network(13e0d3be-e4a3-4f20-8aac-1cf64be1e1b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e586810-21')
Nov 18 17:10:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.181s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquiring lock "c188b3a997bfafa42fa341f9dcc326545681eed9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] No VIF found with MAC fa:16:3e:ee:61:55, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.172s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk 1073741824 {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG nova.network.neutron [req-3b3340a6-4a1a-4a3c-9fff-00c9d3e37266 req-51c92e2a-918a-48f7-acab-af4015f243b3 service nova] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] Updated VIF entry in instance network info cache for port 8e586810-21e7-43d2-80dc-66c83416b245. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG nova.network.neutron [req-3b3340a6-4a1a-4a3c-9fff-00c9d3e37266 req-51c92e2a-918a-48f7-acab-af4015f243b3 service nova] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] Updating instance_info_cache with network_info: [{"id": "8e586810-21e7-43d2-80dc-66c83416b245", "address": "fa:16:3e:ee:61:55", "network": {"id": "13e0d3be-e4a3-4f20-8aac-1cf64be1e1b2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-853497736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b57ac6e8f2384c6fb2bb4cbdeee429c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e586810-21", "ovs_interfaceid": "8e586810-21e7-43d2-80dc-66c83416b245", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk 1073741824" returned: 0 in 0.052s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3b3340a6-4a1a-4a3c-9fff-00c9d3e37266 req-51c92e2a-918a-48f7-acab-af4015f243b3 service nova] Releasing lock "refresh_cache-2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.182s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk. size=1073741824 {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG nova.network.neutron [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Successfully created port: 7bc10485-32b0-44a5-8813-2fa64d1dfbba {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Cannot resize image /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk to a smaller size. {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Created local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Ensure instance console log exists: /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:10:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:10:35 user nova-compute[74743]: DEBUG nova.network.neutron [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Successfully updated port: 7bc10485-32b0-44a5-8813-2fa64d1dfbba {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:10:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquiring lock "refresh_cache-aefe3db1-b9bb-4cce-aa31-d0b6684ad791" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:10:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquired lock "refresh_cache-aefe3db1-b9bb-4cce-aa31-d0b6684ad791" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:10:35 user nova-compute[74743]: DEBUG nova.network.neutron [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:10:35 user nova-compute[74743]: DEBUG nova.compute.manager [req-4310e5f2-4b8b-4e38-bebc-0ca13976cda3 req-1c2ec5c8-019f-4266-b44d-f7f57670c75f service nova] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Received event network-changed-7bc10485-32b0-44a5-8813-2fa64d1dfbba {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:10:35 user nova-compute[74743]: DEBUG nova.compute.manager [req-4310e5f2-4b8b-4e38-bebc-0ca13976cda3 req-1c2ec5c8-019f-4266-b44d-f7f57670c75f service nova] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Refreshing instance network info cache due to event network-changed-7bc10485-32b0-44a5-8813-2fa64d1dfbba. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:10:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4310e5f2-4b8b-4e38-bebc-0ca13976cda3 req-1c2ec5c8-019f-4266-b44d-f7f57670c75f service nova] Acquiring lock "refresh_cache-aefe3db1-b9bb-4cce-aa31-d0b6684ad791" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:10:35 user nova-compute[74743]: DEBUG nova.network.neutron [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:10:35 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:35 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:35 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:35 user nova-compute[74743]: DEBUG nova.network.neutron [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Updating instance_info_cache with network_info: [{"id": "7bc10485-32b0-44a5-8813-2fa64d1dfbba", "address": "fa:16:3e:47:96:7f", "network": {"id": "1bbf6aff-4048-4212-a716-d0628575bfd0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc0fda74575d488a94e2dcfdc016598c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc10485-32", "ovs_interfaceid": "7bc10485-32b0-44a5-8813-2fa64d1dfbba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:10:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Releasing lock "refresh_cache-aefe3db1-b9bb-4cce-aa31-d0b6684ad791" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:10:35 user nova-compute[74743]: DEBUG nova.compute.manager [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Instance network_info: |[{"id": "7bc10485-32b0-44a5-8813-2fa64d1dfbba", "address": "fa:16:3e:47:96:7f", "network": {"id": "1bbf6aff-4048-4212-a716-d0628575bfd0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc0fda74575d488a94e2dcfdc016598c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc10485-32", "ovs_interfaceid": "7bc10485-32b0-44a5-8813-2fa64d1dfbba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 17:10:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4310e5f2-4b8b-4e38-bebc-0ca13976cda3 req-1c2ec5c8-019f-4266-b44d-f7f57670c75f service nova] Acquired lock "refresh_cache-aefe3db1-b9bb-4cce-aa31-d0b6684ad791" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:10:35 user nova-compute[74743]: DEBUG nova.network.neutron [req-4310e5f2-4b8b-4e38-bebc-0ca13976cda3 req-1c2ec5c8-019f-4266-b44d-f7f57670c75f service nova] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Refreshing network info cache for port 7bc10485-32b0-44a5-8813-2fa64d1dfbba {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:10:35 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Start _get_guest_xml network_info=[{"id": "7bc10485-32b0-44a5-8813-2fa64d1dfbba", "address": "fa:16:3e:47:96:7f", "network": {"id": "1bbf6aff-4048-4212-a716-d0628575bfd0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc0fda74575d488a94e2dcfdc016598c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc10485-32", "ovs_interfaceid": "7bc10485-32b0-44a5-8813-2fa64d1dfbba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '9536f6cf-95c4-40e2-864a-09a91525678a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:10:35 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:10:35 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:10:35 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:10:35 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:10:35 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:10:35 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:10:35 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:10:35 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:10:35 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:10:35 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:10:35 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:10:35 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:10:35 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:10:35 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:10:35 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:10:35 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:10:35 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:10:35 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:10:35 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:10:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1636603748',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1636603748',id=24,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc0fda74575d488a94e2dcfdc016598c',ramdisk_id='',reservation_id='r-r63awruk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-633893051',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:10:34Z,user_data=None,user_id='5639bd2666534fdca04d0958dcdc9f54',uuid=aefe3db1-b9bb-4cce-aa31-d0b6684ad791,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7bc10485-32b0-44a5-8813-2fa64d1dfbba", "address": "fa:16:3e:47:96:7f", "network": {"id": "1bbf6aff-4048-4212-a716-d0628575bfd0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc0fda74575d488a94e2dcfdc016598c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc10485-32", "ovs_interfaceid": "7bc10485-32b0-44a5-8813-2fa64d1dfbba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:10:35 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Converting VIF {"id": "7bc10485-32b0-44a5-8813-2fa64d1dfbba", "address": "fa:16:3e:47:96:7f", "network": {"id": "1bbf6aff-4048-4212-a716-d0628575bfd0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc0fda74575d488a94e2dcfdc016598c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc10485-32", "ovs_interfaceid": "7bc10485-32b0-44a5-8813-2fa64d1dfbba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:10:35 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:96:7f,bridge_name='br-int',has_traffic_filtering=True,id=7bc10485-32b0-44a5-8813-2fa64d1dfbba,network=Network(1bbf6aff-4048-4212-a716-d0628575bfd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bc10485-32') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:10:35 user nova-compute[74743]: DEBUG nova.objects.instance [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lazy-loading 'pci_devices' on Instance uuid aefe3db1-b9bb-4cce-aa31-d0b6684ad791 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:10:36 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:10:36 user nova-compute[74743]:   <uuid>aefe3db1-b9bb-4cce-aa31-d0b6684ad791</uuid>
Nov 18 17:10:36 user nova-compute[74743]:   <name>instance-00000018</name>
Nov 18 17:10:36 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:10:36 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:10:36 user nova-compute[74743]:   <metadata>
Nov 18 17:10:36 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:10:36 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:10:36 user nova-compute[74743]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1636603748</nova:name>
Nov 18 17:10:36 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:10:35</nova:creationTime>
Nov 18 17:10:36 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:10:36 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:10:36 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:10:36 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:10:36 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:10:36 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:10:36 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:10:36 user nova-compute[74743]:       <nova:owner>
Nov 18 17:10:36 user nova-compute[74743]:         <nova:user uuid="5639bd2666534fdca04d0958dcdc9f54">tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member</nova:user>
Nov 18 17:10:36 user nova-compute[74743]:         <nova:project uuid="bc0fda74575d488a94e2dcfdc016598c">tempest-ServerBootFromVolumeStableRescueTest-633893051</nova:project>
Nov 18 17:10:36 user nova-compute[74743]:       </nova:owner>
Nov 18 17:10:36 user nova-compute[74743]:       <nova:root type="image" uuid="9536f6cf-95c4-40e2-864a-09a91525678a"/>
Nov 18 17:10:36 user nova-compute[74743]:       <nova:ports>
Nov 18 17:10:36 user nova-compute[74743]:         <nova:port uuid="7bc10485-32b0-44a5-8813-2fa64d1dfbba">
Nov 18 17:10:36 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 18 17:10:36 user nova-compute[74743]:         </nova:port>
Nov 18 17:10:36 user nova-compute[74743]:       </nova:ports>
Nov 18 17:10:36 user nova-compute[74743]:     </nova:instance>
Nov 18 17:10:36 user nova-compute[74743]:   </metadata>
Nov 18 17:10:36 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:10:36 user nova-compute[74743]:     <system>
Nov 18 17:10:36 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:10:36 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:10:36 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:10:36 user nova-compute[74743]:       <entry name="serial">aefe3db1-b9bb-4cce-aa31-d0b6684ad791</entry>
Nov 18 17:10:36 user nova-compute[74743]:       <entry name="uuid">aefe3db1-b9bb-4cce-aa31-d0b6684ad791</entry>
Nov 18 17:10:36 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:10:36 user nova-compute[74743]:     </system>
Nov 18 17:10:36 user nova-compute[74743]:   </sysinfo>
Nov 18 17:10:36 user nova-compute[74743]:   <os>
Nov 18 17:10:36 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:10:36 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:10:36 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:10:36 user nova-compute[74743]:   </os>
Nov 18 17:10:36 user nova-compute[74743]:   <features>
Nov 18 17:10:36 user nova-compute[74743]:     <acpi/>
Nov 18 17:10:36 user nova-compute[74743]:     <apic/>
Nov 18 17:10:36 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:10:36 user nova-compute[74743]:   </features>
Nov 18 17:10:36 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:10:36 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:10:36 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:10:36 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:10:36 user nova-compute[74743]:   </clock>
Nov 18 17:10:36 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:10:36 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:10:36 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:10:36 user nova-compute[74743]:   </cpu>
Nov 18 17:10:36 user nova-compute[74743]:   <devices>
Nov 18 17:10:36 user nova-compute[74743]:     <disk type="file" device="disk">
Nov 18 17:10:36 user nova-compute[74743]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 17:10:36 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk"/>
Nov 18 17:10:36 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:10:36 user nova-compute[74743]:     </disk>
Nov 18 17:10:36 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:10:36 user nova-compute[74743]:       <mac address="fa:16:3e:47:96:7f"/>
Nov 18 17:10:36 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:10:36 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:10:36 user nova-compute[74743]:       <target dev="tap7bc10485-32"/>
Nov 18 17:10:36 user nova-compute[74743]:     </interface>
Nov 18 17:10:36 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:10:36 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/console.log" append="off"/>
Nov 18 17:10:36 user nova-compute[74743]:     </serial>
Nov 18 17:10:36 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:10:36 user nova-compute[74743]:     <video>
Nov 18 17:10:36 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:10:36 user nova-compute[74743]:     </video>
Nov 18 17:10:36 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:10:36 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:10:36 user nova-compute[74743]:     </rng>
Nov 18 17:10:36 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:10:36 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:10:36 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:10:36 user nova-compute[74743]:     </memballoon>
Nov 18 17:10:36 user nova-compute[74743]:   </devices>
Nov 18 17:10:36 user nova-compute[74743]: </domain>
Nov 18 17:10:36 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:10:36 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:10:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1636603748',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1636603748',id=24,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc0fda74575d488a94e2dcfdc016598c',ramdisk_id='',reservation_id='r-r63awruk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-633893051',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:10:34Z,user_data=None,user_id='5639bd2666534fdca04d0958dcdc9f54',uuid=aefe3db1-b9bb-4cce-aa31-d0b6684ad791,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7bc10485-32b0-44a5-8813-2fa64d1dfbba", "address": "fa:16:3e:47:96:7f", "network": {"id": "1bbf6aff-4048-4212-a716-d0628575bfd0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc0fda74575d488a94e2dcfdc016598c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc10485-32", "ovs_interfaceid": "7bc10485-32b0-44a5-8813-2fa64d1dfbba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:10:36 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Converting VIF {"id": "7bc10485-32b0-44a5-8813-2fa64d1dfbba", "address": "fa:16:3e:47:96:7f", "network": {"id": "1bbf6aff-4048-4212-a716-d0628575bfd0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc0fda74575d488a94e2dcfdc016598c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc10485-32", "ovs_interfaceid": "7bc10485-32b0-44a5-8813-2fa64d1dfbba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:10:36 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:96:7f,bridge_name='br-int',has_traffic_filtering=True,id=7bc10485-32b0-44a5-8813-2fa64d1dfbba,network=Network(1bbf6aff-4048-4212-a716-d0628575bfd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bc10485-32') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:10:36 user nova-compute[74743]: DEBUG os_vif [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:96:7f,bridge_name='br-int',has_traffic_filtering=True,id=7bc10485-32b0-44a5-8813-2fa64d1dfbba,network=Network(1bbf6aff-4048-4212-a716-d0628575bfd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bc10485-32') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:10:36 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:36 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:10:36 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:10:36 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:36 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ad71436a-7a6d-53cd-91d7-636a0b64f0ab', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:10:36 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:10:36 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:36 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7bc10485-32, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:10:36 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7bc10485-32, col_values=(('qos', UUID('af6e35ce-4544-4d48-b804-68a2af9ad5da')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:10:36 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7bc10485-32, col_values=(('external_ids', {'iface-id': '7bc10485-32b0-44a5-8813-2fa64d1dfbba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:96:7f', 'vm-uuid': 'aefe3db1-b9bb-4cce-aa31-d0b6684ad791'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:10:36 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:10:36 user nova-compute[74743]: DEBUG nova.compute.manager [req-7d49d905-02e9-497e-99b7-ce91cc82c307 req-1d72db12-15a1-431a-ac65-7ecef96ecdbb service nova] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] Received event network-vif-plugged-8e586810-21e7-43d2-80dc-66c83416b245 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:10:36 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-7d49d905-02e9-497e-99b7-ce91cc82c307 req-1d72db12-15a1-431a-ac65-7ecef96ecdbb service nova] Acquiring lock "2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:10:36 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-7d49d905-02e9-497e-99b7-ce91cc82c307 req-1d72db12-15a1-431a-ac65-7ecef96ecdbb service nova] Lock "2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:10:36 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-7d49d905-02e9-497e-99b7-ce91cc82c307 req-1d72db12-15a1-431a-ac65-7ecef96ecdbb service nova] Lock "2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:10:36 user nova-compute[74743]: DEBUG nova.compute.manager [req-7d49d905-02e9-497e-99b7-ce91cc82c307 req-1d72db12-15a1-431a-ac65-7ecef96ecdbb service nova] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] No waiting events found dispatching network-vif-plugged-8e586810-21e7-43d2-80dc-66c83416b245 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:10:36 user nova-compute[74743]: WARNING nova.compute.manager [req-7d49d905-02e9-497e-99b7-ce91cc82c307 req-1d72db12-15a1-431a-ac65-7ecef96ecdbb service nova] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] Received unexpected event network-vif-plugged-8e586810-21e7-43d2-80dc-66c83416b245 for instance with vm_state building and task_state spawning.
Nov 18 17:10:36 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:36 user nova-compute[74743]: INFO os_vif [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:96:7f,bridge_name='br-int',has_traffic_filtering=True,id=7bc10485-32b0-44a5-8813-2fa64d1dfbba,network=Network(1bbf6aff-4048-4212-a716-d0628575bfd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bc10485-32')
Nov 18 17:10:36 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:10:36 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] No VIF found with MAC fa:16:3e:47:96:7f, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:10:36 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:36 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:36 user nova-compute[74743]: DEBUG nova.network.neutron [req-4310e5f2-4b8b-4e38-bebc-0ca13976cda3 req-1c2ec5c8-019f-4266-b44d-f7f57670c75f service nova] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Updated VIF entry in instance network info cache for port 7bc10485-32b0-44a5-8813-2fa64d1dfbba. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:10:36 user nova-compute[74743]: DEBUG nova.network.neutron [req-4310e5f2-4b8b-4e38-bebc-0ca13976cda3 req-1c2ec5c8-019f-4266-b44d-f7f57670c75f service nova] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Updating instance_info_cache with network_info: [{"id": "7bc10485-32b0-44a5-8813-2fa64d1dfbba", "address": "fa:16:3e:47:96:7f", "network": {"id": "1bbf6aff-4048-4212-a716-d0628575bfd0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc0fda74575d488a94e2dcfdc016598c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc10485-32", "ovs_interfaceid": "7bc10485-32b0-44a5-8813-2fa64d1dfbba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:10:36 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4310e5f2-4b8b-4e38-bebc-0ca13976cda3 req-1c2ec5c8-019f-4266-b44d-f7f57670c75f service nova] Releasing lock "refresh_cache-aefe3db1-b9bb-4cce-aa31-d0b6684ad791" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:10:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:38 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:38 user nova-compute[74743]: DEBUG nova.compute.manager [req-b641562c-66ba-4941-86cb-1eb7ba6277bc req-bf5b9daf-7cca-4d40-941e-afeb960fa24b service nova] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] Received event network-vif-plugged-8e586810-21e7-43d2-80dc-66c83416b245 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:10:38 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b641562c-66ba-4941-86cb-1eb7ba6277bc req-bf5b9daf-7cca-4d40-941e-afeb960fa24b service nova] Acquiring lock "2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:10:38 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b641562c-66ba-4941-86cb-1eb7ba6277bc req-bf5b9daf-7cca-4d40-941e-afeb960fa24b service nova] Lock "2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:10:38 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b641562c-66ba-4941-86cb-1eb7ba6277bc req-bf5b9daf-7cca-4d40-941e-afeb960fa24b service nova] Lock "2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:10:38 user nova-compute[74743]: DEBUG nova.compute.manager [req-b641562c-66ba-4941-86cb-1eb7ba6277bc req-bf5b9daf-7cca-4d40-941e-afeb960fa24b service nova] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] No waiting events found dispatching network-vif-plugged-8e586810-21e7-43d2-80dc-66c83416b245 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:10:38 user nova-compute[74743]: WARNING nova.compute.manager [req-b641562c-66ba-4941-86cb-1eb7ba6277bc req-bf5b9daf-7cca-4d40-941e-afeb960fa24b service nova] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] Received unexpected event network-vif-plugged-8e586810-21e7-43d2-80dc-66c83416b245 for instance with vm_state building and task_state spawning.
Nov 18 17:10:38 user nova-compute[74743]: DEBUG nova.compute.manager [req-b641562c-66ba-4941-86cb-1eb7ba6277bc req-bf5b9daf-7cca-4d40-941e-afeb960fa24b service nova] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Received event network-vif-plugged-7bc10485-32b0-44a5-8813-2fa64d1dfbba {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:10:38 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b641562c-66ba-4941-86cb-1eb7ba6277bc req-bf5b9daf-7cca-4d40-941e-afeb960fa24b service nova] Acquiring lock "aefe3db1-b9bb-4cce-aa31-d0b6684ad791-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:10:38 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b641562c-66ba-4941-86cb-1eb7ba6277bc req-bf5b9daf-7cca-4d40-941e-afeb960fa24b service nova] Lock "aefe3db1-b9bb-4cce-aa31-d0b6684ad791-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:10:38 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b641562c-66ba-4941-86cb-1eb7ba6277bc req-bf5b9daf-7cca-4d40-941e-afeb960fa24b service nova] Lock "aefe3db1-b9bb-4cce-aa31-d0b6684ad791-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:10:38 user nova-compute[74743]: DEBUG nova.compute.manager [req-b641562c-66ba-4941-86cb-1eb7ba6277bc req-bf5b9daf-7cca-4d40-941e-afeb960fa24b service nova] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] No waiting events found dispatching network-vif-plugged-7bc10485-32b0-44a5-8813-2fa64d1dfbba {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:10:38 user nova-compute[74743]: WARNING nova.compute.manager [req-b641562c-66ba-4941-86cb-1eb7ba6277bc req-bf5b9daf-7cca-4d40-941e-afeb960fa24b service nova] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Received unexpected event network-vif-plugged-7bc10485-32b0-44a5-8813-2fa64d1dfbba for instance with vm_state building and task_state spawning.
Nov 18 17:10:38 user nova-compute[74743]: DEBUG nova.compute.manager [req-b641562c-66ba-4941-86cb-1eb7ba6277bc req-bf5b9daf-7cca-4d40-941e-afeb960fa24b service nova] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Received event network-vif-plugged-7bc10485-32b0-44a5-8813-2fa64d1dfbba {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:10:38 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b641562c-66ba-4941-86cb-1eb7ba6277bc req-bf5b9daf-7cca-4d40-941e-afeb960fa24b service nova] Acquiring lock "aefe3db1-b9bb-4cce-aa31-d0b6684ad791-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:10:38 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b641562c-66ba-4941-86cb-1eb7ba6277bc req-bf5b9daf-7cca-4d40-941e-afeb960fa24b service nova] Lock "aefe3db1-b9bb-4cce-aa31-d0b6684ad791-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:10:38 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b641562c-66ba-4941-86cb-1eb7ba6277bc req-bf5b9daf-7cca-4d40-941e-afeb960fa24b service nova] Lock "aefe3db1-b9bb-4cce-aa31-d0b6684ad791-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:10:38 user nova-compute[74743]: DEBUG nova.compute.manager [req-b641562c-66ba-4941-86cb-1eb7ba6277bc req-bf5b9daf-7cca-4d40-941e-afeb960fa24b service nova] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] No waiting events found dispatching network-vif-plugged-7bc10485-32b0-44a5-8813-2fa64d1dfbba {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:10:38 user nova-compute[74743]: WARNING nova.compute.manager [req-b641562c-66ba-4941-86cb-1eb7ba6277bc req-bf5b9daf-7cca-4d40-941e-afeb960fa24b service nova] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Received unexpected event network-vif-plugged-7bc10485-32b0-44a5-8813-2fa64d1dfbba for instance with vm_state building and task_state spawning.
Nov 18 17:10:38 user nova-compute[74743]: DEBUG nova.compute.manager [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:10:38 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] Guest created on hypervisor {{(pid=74743) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 17:10:38 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] Instance spawned successfully.
Nov 18 17:10:38 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 17:10:38 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] Found default for hw_cdrom_bus of ide {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:10:38 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] Found default for hw_disk_bus of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:10:38 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] Found default for hw_input_bus of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:10:38 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] Found default for hw_pointer_model of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:10:38 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] Found default for hw_video_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:10:38 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] Found default for hw_vif_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:10:38 user nova-compute[74743]: INFO nova.compute.manager [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] Took 6.13 seconds to spawn the instance on the hypervisor.
Nov 18 17:10:38 user nova-compute[74743]: DEBUG nova.compute.manager [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:10:38 user nova-compute[74743]: INFO nova.compute.manager [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] Took 6.99 seconds to build instance.
Nov 18 17:10:38 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7fca9149-4040-43d2-8179-efcc3e9ad933 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Lock "2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.149s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:10:39 user nova-compute[74743]: DEBUG nova.compute.manager [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:10:39 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Guest created on hypervisor {{(pid=74743) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 17:10:39 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Instance spawned successfully.
Nov 18 17:10:39 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 17:10:39 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Found default for hw_cdrom_bus of ide {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:10:39 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Found default for hw_disk_bus of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:10:39 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Found default for hw_input_bus of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:10:39 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Found default for hw_pointer_model of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:10:39 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Found default for hw_video_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:10:39 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Found default for hw_vif_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:10:39 user nova-compute[74743]: INFO nova.compute.manager [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Took 5.49 seconds to spawn the instance on the hypervisor.
Nov 18 17:10:39 user nova-compute[74743]: DEBUG nova.compute.manager [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:10:39 user nova-compute[74743]: INFO nova.compute.manager [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Took 6.36 seconds to build instance.
Nov 18 17:10:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:39 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d42293d5-4cc5-486d-a22f-ab252b9540ee tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "aefe3db1-b9bb-4cce-aa31-d0b6684ad791" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.481s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:10:41 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:44 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:51 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:52 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-8efca81f-87b7-42d2-b1d3-54cb30cd2b84 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e2b51739-7900-47bd-a01e-2e83e2f13ae1 is timed out.
Nov 18 17:10:52 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-8efca81f-87b7-42d2-b1d3-54cb30cd2b84 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Successfully detached device vdb from instance e2b51739-7900-47bd-a01e-2e83e2f13ae1 from the live domain config.
Nov 18 17:10:52 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8efca81f-87b7-42d2-b1d3-54cb30cd2b84 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] calling os-brick to detach iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8efca81f-87b7-42d2-b1d3-54cb30cd2b84 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, {'target_iqn': 'iqn.2010-10.org.openstack:7574a709-d136-4d1b-8861-67c33e5c88c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MmeZChtz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:10:52 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-8efca81f-87b7-42d2-b1d3-54cb30cd2b84 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:10:52 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-8efca81f-87b7-42d2-b1d3-54cb30cd2b84 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-8efca81f-87b7-42d2-b1d3-54cb30cd2b84 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee201c95-69b2-4cd5-8b5e-1e54304cf81b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7574a709-d136-4d1b-8861-67c33e5c88c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8efca81f-87b7-42d2-b1d3-54cb30cd2b84 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 17:10:52 user nova-compute[74743]: No targets found.
Nov 18 17:10:52 user nova-compute[74743]: iSNS:
Nov 18 17:10:52 user nova-compute[74743]: No targets found.
Nov 18 17:10:52 user nova-compute[74743]: STATIC:
Nov 18 17:10:52 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb
Nov 18 17:10:52 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:10:52 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:10:52 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e
Nov 18 17:10:52 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:10:52 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:10:52 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad
Nov 18 17:10:52 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:10:52 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:10:52 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:7574a709-d136-4d1b-8861-67c33e5c88c6
Nov 18 17:10:52 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:10:52 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:10:52 user nova-compute[74743]: FIRMWARE:
Nov 18 17:10:52 user nova-compute[74743]: No targets found.
Nov 18 17:10:52 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8efca81f-87b7-42d2-b1d3-54cb30cd2b84 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 17:10:52 user nova-compute[74743]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 17:10:52 user nova-compute[74743]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74743) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8efca81f-87b7-42d2-b1d3-54cb30cd2b84 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7574a709-d136-4d1b-8861-67c33e5c88c6', 0)] {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f2e693-f9f6-4315-b56c-246be7a32063]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7574a709-d136-4d1b-8861-67c33e5c88c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc111b70-0d53-4951-9022-fc572a22ed35]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7574a709-d136-4d1b-8861-67c33e5c88c6 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8efca81f-87b7-42d2-b1d3-54cb30cd2b84 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad (non-flash)
Nov 18 17:10:52 user nova-compute[74743]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)
Nov 18 17:10:52 user nova-compute[74743]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb (non-flash)
Nov 18 17:10:52 user nova-compute[74743]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7574a709-d136-4d1b-8861-67c33e5c88c6 (non-flash)
Nov 18 17:10:52 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8efca81f-87b7-42d2-b1d3-54cb30cd2b84 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad (non-flash)
Nov 18 17:10:52 user nova-compute[74743]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)
Nov 18 17:10:52 user nova-compute[74743]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb (non-flash)
Nov 18 17:10:52 user nova-compute[74743]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7574a709-d136-4d1b-8861-67c33e5c88c6 (non-flash)
Nov 18 17:10:52 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8efca81f-87b7-42d2-b1d3-54cb30cd2b84 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb087cf400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7574a709-d136-4d1b-8861-67c33e5c88c6'): ({'sde'}, set())}) {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-8efca81f-87b7-42d2-b1d3-54cb30cd2b84 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Removing single pathed devices sde {{(pid=74743) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0aa0396-1cfd-475f-8ef5-22f4332177c2]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[e72fa72c-d104-411a-a6b8-a0de8d9b6c80]: (4, ('ok\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-8efca81f-87b7-42d2-b1d3-54cb30cd2b84 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Flushing IO for device /dev/sde {{(pid=74743) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f97793-d2ae-4c8c-a60e-bdd0d4bdb281]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-8efca81f-87b7-42d2-b1d3-54cb30cd2b84 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74743) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4450e44-cbda-431a-8d8a-6d27e16ebfb4]: (4, ('1', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-8efca81f-87b7-42d2-b1d3-54cb30cd2b84 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-8efca81f-87b7-42d2-b1d3-54cb30cd2b84 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] SCSI volumes sde have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8efca81f-87b7-42d2-b1d3-54cb30cd2b84 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7574a709-d136-4d1b-8861-67c33e5c88c6')] {{(pid=74743) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7574a709-d136-4d1b-8861-67c33e5c88c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7574a709-d136-4d1b-8861-67c33e5c88c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2e53ae-4335-4817-88a7-ed73a27a0ea1]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8efca81f-87b7-42d2-b1d3-54cb30cd2b84 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7574a709-d136-4d1b-8861-67c33e5c88c6 -p 172.16.0.220:3260 --logout {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7574a709-d136-4d1b-8861-67c33e5c88c6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[738586a4-3e62-4018-a672-c57dfdabaca9]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:7574a709-d136-4d1b-8861-67c33e5c88c6, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:7574a709-d136-4d1b-8861-67c33e5c88c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8efca81f-87b7-42d2-b1d3-54cb30cd2b84 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:7574a709-d136-4d1b-8861-67c33e5c88c6, portal: 172.16.0.220,3260]
Nov 18 17:10:52 user nova-compute[74743]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:7574a709-d136-4d1b-8861-67c33e5c88c6, portal: 172.16.0.220,3260] successful.
Nov 18 17:10:52 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7574a709-d136-4d1b-8861-67c33e5c88c6 -p 172.16.0.220:3260 --op delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7574a709-d136-4d1b-8861-67c33e5c88c6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[184de45a-7f2a-415c-8896-5d04360dbade]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8efca81f-87b7-42d2-b1d3-54cb30cd2b84 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-8efca81f-87b7-42d2-b1d3-54cb30cd2b84 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8efca81f-87b7-42d2-b1d3-54cb30cd2b84 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] <== disconnect_volume: return (292ms) None {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8efca81f-87b7-42d2-b1d3-54cb30cd2b84 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Disconnected iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 17:10:52 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-f3e81143-633d-4627-91fc-9997249c55d8 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8a9b12da-02c5-42ba-b215-a20df0e3ea4f is timed out.
Nov 18 17:10:52 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-f3e81143-633d-4627-91fc-9997249c55d8 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Successfully detached device vdb from instance 8a9b12da-02c5-42ba-b215-a20df0e3ea4f from the live domain config.
Nov 18 17:10:52 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3e81143-633d-4627-91fc-9997249c55d8 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] calling os-brick to detach iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e81143-633d-4627-91fc-9997249c55d8 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, {'target_iqn': 'iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dmRFHzoX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:10:52 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-f3e81143-633d-4627-91fc-9997249c55d8 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:10:52 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-f3e81143-633d-4627-91fc-9997249c55d8 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-f3e81143-633d-4627-91fc-9997249c55d8 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a461bd-2ecf-4872-a8c7-beecb8168503]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e81143-633d-4627-91fc-9997249c55d8 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 17:10:52 user nova-compute[74743]: No targets found.
Nov 18 17:10:52 user nova-compute[74743]: iSNS:
Nov 18 17:10:52 user nova-compute[74743]: No targets found.
Nov 18 17:10:52 user nova-compute[74743]: STATIC:
Nov 18 17:10:52 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb
Nov 18 17:10:52 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:10:52 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:10:52 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e
Nov 18 17:10:52 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:10:52 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:10:52 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad
Nov 18 17:10:52 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:10:52 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:10:52 user nova-compute[74743]: FIRMWARE:
Nov 18 17:10:52 user nova-compute[74743]: No targets found.
Nov 18 17:10:52 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e81143-633d-4627-91fc-9997249c55d8 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 17:10:52 user nova-compute[74743]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 17:10:52 user nova-compute[74743]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74743) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e81143-633d-4627-91fc-9997249c55d8 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb', 0)] {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aae651f-44e3-4b01-bba6-238b0969c048]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f92447d-4340-488d-b0de-a3003973aba9]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e81143-633d-4627-91fc-9997249c55d8 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad (non-flash)
Nov 18 17:10:52 user nova-compute[74743]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)
Nov 18 17:10:52 user nova-compute[74743]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb (non-flash)
Nov 18 17:10:52 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e81143-633d-4627-91fc-9997249c55d8 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad (non-flash)
Nov 18 17:10:52 user nova-compute[74743]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)
Nov 18 17:10:52 user nova-compute[74743]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb (non-flash)
Nov 18 17:10:52 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e81143-633d-4627-91fc-9997249c55d8 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb087cd750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb'): ({'sdd'}, set())}) {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-f3e81143-633d-4627-91fc-9997249c55d8 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Removing single pathed devices sdd {{(pid=74743) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e03ede-52d9-4811-98dc-da21d9ba1093]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[819356c5-bda5-4b88-84ab-8fe434e764b2]: (4, ('ok\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-f3e81143-633d-4627-91fc-9997249c55d8 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Flushing IO for device /dev/sdd {{(pid=74743) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[751c9913-d419-46d4-9569-14ff725d2f3f]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-f3e81143-633d-4627-91fc-9997249c55d8 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74743) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 17:10:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:53 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9bf98b0-d90f-458e-8291-36097cd48f53]: (4, ('1', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:10:53 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-f3e81143-633d-4627-91fc-9997249c55d8 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 17:10:53 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-f3e81143-633d-4627-91fc-9997249c55d8 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] SCSI volumes sdd have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 17:10:53 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e81143-633d-4627-91fc-9997249c55d8 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb')] {{(pid=74743) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 17:10:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:53 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a48eff9-9310-4ae7-9e4b-fbcee43fcda9]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:10:53 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e81143-633d-4627-91fc-9997249c55d8 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:10:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb -p 172.16.0.220:3260 --logout {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:53 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88bba8c-a3fd-4432-82cf-810695ec0190]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:10:53 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e81143-633d-4627-91fc-9997249c55d8 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb, portal: 172.16.0.220,3260]
Nov 18 17:10:53 user nova-compute[74743]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb, portal: 172.16.0.220,3260] successful.
Nov 18 17:10:53 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:10:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb -p 172.16.0.220:3260 --op delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:53 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cfd0ee3-e224-483a-bc36-e4bb3725b664]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:10:53 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e81143-633d-4627-91fc-9997249c55d8 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:10:53 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-f3e81143-633d-4627-91fc-9997249c55d8 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:10:53 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e81143-633d-4627-91fc-9997249c55d8 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] <== disconnect_volume: return (326ms) None {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:10:53 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3e81143-633d-4627-91fc-9997249c55d8 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Disconnected iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 17:10:53 user nova-compute[74743]: DEBUG nova.objects.instance [None req-8efca81f-87b7-42d2-b1d3-54cb30cd2b84 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Lazy-loading 'flavor' on Instance uuid e2b51739-7900-47bd-a01e-2e83e2f13ae1 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:10:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8efca81f-87b7-42d2-b1d3-54cb30cd2b84 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Lock "e2b51739-7900-47bd-a01e-2e83e2f13ae1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.855s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:10:54 user nova-compute[74743]: DEBUG nova.objects.instance [None req-f3e81143-633d-4627-91fc-9997249c55d8 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lazy-loading 'flavor' on Instance uuid 8a9b12da-02c5-42ba-b215-a20df0e3ea4f {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:10:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f3e81143-633d-4627-91fc-9997249c55d8 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "8a9b12da-02c5-42ba-b215-a20df0e3ea4f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.052s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:10:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-221f40a4-bda4-4b82-a519-8a8913939056 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "8a9b12da-02c5-42ba-b215-a20df0e3ea4f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.940s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:10:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-221f40a4-bda4-4b82-a519-8a8913939056 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Acquiring lock "8a9b12da-02c5-42ba-b215-a20df0e3ea4f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:10:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-221f40a4-bda4-4b82-a519-8a8913939056 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "8a9b12da-02c5-42ba-b215-a20df0e3ea4f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:10:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-221f40a4-bda4-4b82-a519-8a8913939056 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "8a9b12da-02c5-42ba-b215-a20df0e3ea4f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:10:54 user nova-compute[74743]: INFO nova.compute.manager [None req-221f40a4-bda4-4b82-a519-8a8913939056 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Terminating instance
Nov 18 17:10:54 user nova-compute[74743]: DEBUG nova.compute.manager [None req-221f40a4-bda4-4b82-a519-8a8913939056 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Start destroying the instance on the hypervisor. {{(pid=74743) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 17:10:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-11e4f2e6-c40a-4042-b4d2-a382866bc2c1 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Acquiring lock "interface-e2b51739-7900-47bd-a01e-2e83e2f13ae1-4476b532-0c9f-4fef-aeb3-0c2b048c16b1" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:10:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-11e4f2e6-c40a-4042-b4d2-a382866bc2c1 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Lock "interface-e2b51739-7900-47bd-a01e-2e83e2f13ae1-4476b532-0c9f-4fef-aeb3-0c2b048c16b1" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:10:54 user nova-compute[74743]: DEBUG nova.compute.manager [req-08c91f8c-686f-4ebb-b176-709f3b5ffb08 req-23d05d7c-e8ee-495e-ba43-45ef297b1165 service nova] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Received event network-vif-unplugged-6e3b96b3-1a83-4b25-ad28-cf77e11ff137 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:10:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-08c91f8c-686f-4ebb-b176-709f3b5ffb08 req-23d05d7c-e8ee-495e-ba43-45ef297b1165 service nova] Acquiring lock "8a9b12da-02c5-42ba-b215-a20df0e3ea4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:10:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-08c91f8c-686f-4ebb-b176-709f3b5ffb08 req-23d05d7c-e8ee-495e-ba43-45ef297b1165 service nova] Lock "8a9b12da-02c5-42ba-b215-a20df0e3ea4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:10:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-08c91f8c-686f-4ebb-b176-709f3b5ffb08 req-23d05d7c-e8ee-495e-ba43-45ef297b1165 service nova] Lock "8a9b12da-02c5-42ba-b215-a20df0e3ea4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:10:54 user nova-compute[74743]: DEBUG nova.compute.manager [req-08c91f8c-686f-4ebb-b176-709f3b5ffb08 req-23d05d7c-e8ee-495e-ba43-45ef297b1165 service nova] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] No waiting events found dispatching network-vif-unplugged-6e3b96b3-1a83-4b25-ad28-cf77e11ff137 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:10:54 user nova-compute[74743]: DEBUG nova.compute.manager [req-08c91f8c-686f-4ebb-b176-709f3b5ffb08 req-23d05d7c-e8ee-495e-ba43-45ef297b1165 service nova] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Received event network-vif-unplugged-6e3b96b3-1a83-4b25-ad28-cf77e11ff137 for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:10:54 user nova-compute[74743]: DEBUG nova.objects.instance [None req-11e4f2e6-c40a-4042-b4d2-a382866bc2c1 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Lazy-loading 'flavor' on Instance uuid e2b51739-7900-47bd-a01e-2e83e2f13ae1 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:10:54 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-11e4f2e6-c40a-4042-b4d2-a382866bc2c1 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T17:08:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-411956172',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-411956172',id=19,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIsbQN9tS0qcOOC8WPSSYsTCVNWYWYH/K8oXwrg2jt5ZqyybStsLpAIghGB8s0OC3gX9C23pdQMdiUELbHV4Nj+tyYgRoCwRrAGlWKX/+zFnGGmym65cFn63wRBKph/3bw==',key_name='tempest-keypair-1379891500',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:08:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c15d7007a99745f1a308b64514566129',ramdisk_id='',reservation_id='r-xbgsfk5e',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1465741228',owner_user_name='tempest-TaggedAttachmentsTest-1465741228-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:08:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb774fdb80ef465187caf4ffd2422e83',uuid=e2b51739-7900-47bd-a01e-2e83e2f13ae1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4476b532-0c9f-4fef-aeb3-0c2b048c16b1", "address": "fa:16:3e:a1:76:11", "network": {"id": "5a3f7ae2-082b-4f43-b911-8567500c22bf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-410755460", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c15d7007a99745f1a308b64514566129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4476b532-0c", "ovs_interfaceid": "4476b532-0c9f-4fef-aeb3-0c2b048c16b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:10:54 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-11e4f2e6-c40a-4042-b4d2-a382866bc2c1 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Converting VIF {"id": "4476b532-0c9f-4fef-aeb3-0c2b048c16b1", "address": "fa:16:3e:a1:76:11", "network": {"id": "5a3f7ae2-082b-4f43-b911-8567500c22bf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-410755460", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c15d7007a99745f1a308b64514566129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4476b532-0c", "ovs_interfaceid": "4476b532-0c9f-4fef-aeb3-0c2b048c16b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:10:54 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-11e4f2e6-c40a-4042-b4d2-a382866bc2c1 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:76:11,bridge_name='br-int',has_traffic_filtering=True,id=4476b532-0c9f-4fef-aeb3-0c2b048c16b1,network=Network(5a3f7ae2-082b-4f43-b911-8567500c22bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4476b532-0c') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:10:54 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-11e4f2e6-c40a-4042-b4d2-a382866bc2c1 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:a1:76:11"/><model type="virtio"/><mtu size="1442"/><target dev="tap4476b532-0c"/></interface> {{(pid=74743) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 18 17:10:54 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-11e4f2e6-c40a-4042-b4d2-a382866bc2c1 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:a1:76:11"/><model type="virtio"/><mtu size="1442"/><target dev="tap4476b532-0c"/></interface> {{(pid=74743) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 18 17:10:54 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-11e4f2e6-c40a-4042-b4d2-a382866bc2c1 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Attempting to detach device tap4476b532-0c from instance e2b51739-7900-47bd-a01e-2e83e2f13ae1 from the persistent domain config. {{(pid=74743) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 17:10:54 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-11e4f2e6-c40a-4042-b4d2-a382866bc2c1 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] detach device xml: <interface type="ethernet">
Nov 18 17:10:54 user nova-compute[74743]:   <mac address="fa:16:3e:a1:76:11"/>
Nov 18 17:10:54 user nova-compute[74743]:   <model type="virtio"/>
Nov 18 17:10:54 user nova-compute[74743]:   <mtu size="1442"/>
Nov 18 17:10:54 user nova-compute[74743]:   <target dev="tap4476b532-0c"/>
Nov 18 17:10:54 user nova-compute[74743]: </interface>
Nov 18 17:10:54 user nova-compute[74743]:  {{(pid=74743) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 17:10:54 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-11e4f2e6-c40a-4042-b4d2-a382866bc2c1 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:a1:76:11"/><model type="virtio"/><mtu size="1442"/><target dev="tap4476b532-0c"/></interface> {{(pid=74743) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 18 17:10:54 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-11e4f2e6-c40a-4042-b4d2-a382866bc2c1 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:a1:76:11"/><model type="virtio"/><mtu size="1442"/><target dev="tap4476b532-0c"/></interface>not found in domain: <domain type='kvm' id='22'>
Nov 18 17:10:54 user nova-compute[74743]:   <name>instance-00000013</name>
Nov 18 17:10:54 user nova-compute[74743]:   <uuid>e2b51739-7900-47bd-a01e-2e83e2f13ae1</uuid>
Nov 18 17:10:54 user nova-compute[74743]:   <metadata>
Nov 18 17:10:54 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:10:54 user nova-compute[74743]:   <nova:package version="0.0.0"/>
Nov 18 17:10:54 user nova-compute[74743]:   <nova:name>tempest-device-tagging-server-411956172</nova:name>
Nov 18 17:10:54 user nova-compute[74743]:   <nova:creationTime>2023-11-18 17:10:21</nova:creationTime>
Nov 18 17:10:54 user nova-compute[74743]:   <nova:flavor name="m1.tiny">
Nov 18 17:10:54 user nova-compute[74743]:     <nova:memory>512</nova:memory>
Nov 18 17:10:54 user nova-compute[74743]:     <nova:disk>1</nova:disk>
Nov 18 17:10:54 user nova-compute[74743]:     <nova:swap>0</nova:swap>
Nov 18 17:10:54 user nova-compute[74743]:     <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:10:54 user nova-compute[74743]:     <nova:vcpus>1</nova:vcpus>
Nov 18 17:10:54 user nova-compute[74743]:   </nova:flavor>
Nov 18 17:10:54 user nova-compute[74743]:   <nova:owner>
Nov 18 17:10:54 user nova-compute[74743]:     <nova:user uuid="eb774fdb80ef465187caf4ffd2422e83">tempest-TaggedAttachmentsTest-1465741228-project-member</nova:user>
Nov 18 17:10:54 user nova-compute[74743]:     <nova:project uuid="c15d7007a99745f1a308b64514566129">tempest-TaggedAttachmentsTest-1465741228</nova:project>
Nov 18 17:10:54 user nova-compute[74743]:   </nova:owner>
Nov 18 17:10:54 user nova-compute[74743]:   <nova:root type="image" uuid="9536f6cf-95c4-40e2-864a-09a91525678a"/>
Nov 18 17:10:54 user nova-compute[74743]:   <nova:ports>
Nov 18 17:10:54 user nova-compute[74743]:     <nova:port uuid="14c7e1ef-5997-4e7f-aebf-baa01bec87a6">
Nov 18 17:10:54 user nova-compute[74743]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 18 17:10:54 user nova-compute[74743]:     </nova:port>
Nov 18 17:10:54 user nova-compute[74743]:     <nova:port uuid="4476b532-0c9f-4fef-aeb3-0c2b048c16b1">
Nov 18 17:10:54 user nova-compute[74743]:       <nova:ip type="fixed" address="10.10.10.154" ipVersion="4"/>
Nov 18 17:10:54 user nova-compute[74743]:     </nova:port>
Nov 18 17:10:54 user nova-compute[74743]:   </nova:ports>
Nov 18 17:10:54 user nova-compute[74743]: </nova:instance>
Nov 18 17:10:54 user nova-compute[74743]:   </metadata>
Nov 18 17:10:54 user nova-compute[74743]:   <memory unit='KiB'>524288</memory>
Nov 18 17:10:54 user nova-compute[74743]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 18 17:10:54 user nova-compute[74743]:   <vcpu placement='static'>1</vcpu>
Nov 18 17:10:54 user nova-compute[74743]:   <resource>
Nov 18 17:10:54 user nova-compute[74743]:     <partition>/machine</partition>
Nov 18 17:10:54 user nova-compute[74743]:   </resource>
Nov 18 17:10:54 user nova-compute[74743]:   <sysinfo type='smbios'>
Nov 18 17:10:54 user nova-compute[74743]:     <system>
Nov 18 17:10:54 user nova-compute[74743]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 18 17:10:54 user nova-compute[74743]:       <entry name='product'>OpenStack Nova</entry>
Nov 18 17:10:54 user nova-compute[74743]:       <entry name='version'>0.0.0</entry>
Nov 18 17:10:54 user nova-compute[74743]:       <entry name='serial'>e2b51739-7900-47bd-a01e-2e83e2f13ae1</entry>
Nov 18 17:10:54 user nova-compute[74743]:       <entry name='uuid'>e2b51739-7900-47bd-a01e-2e83e2f13ae1</entry>
Nov 18 17:10:54 user nova-compute[74743]:       <entry name='family'>Virtual Machine</entry>
Nov 18 17:10:54 user nova-compute[74743]:     </system>
Nov 18 17:10:54 user nova-compute[74743]:   </sysinfo>
Nov 18 17:10:54 user nova-compute[74743]:   <os>
Nov 18 17:10:54 user nova-compute[74743]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 18 17:10:54 user nova-compute[74743]:     <boot dev='hd'/>
Nov 18 17:10:54 user nova-compute[74743]:     <smbios mode='sysinfo'/>
Nov 18 17:10:54 user nova-compute[74743]:   </os>
Nov 18 17:10:54 user nova-compute[74743]:   <features>
Nov 18 17:10:54 user nova-compute[74743]:     <acpi/>
Nov 18 17:10:54 user nova-compute[74743]:     <apic/>
Nov 18 17:10:54 user nova-compute[74743]:     <vmcoreinfo state='on'/>
Nov 18 17:10:54 user nova-compute[74743]:   </features>
Nov 18 17:10:54 user nova-compute[74743]:   <cpu mode='custom' match='exact' check='full'>
Nov 18 17:10:54 user nova-compute[74743]:     <model fallback='forbid'>Nehalem</model>
Nov 18 17:10:54 user nova-compute[74743]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 18 17:10:54 user nova-compute[74743]:     <feature policy='require' name='vme'/>
Nov 18 17:10:54 user nova-compute[74743]:     <feature policy='require' name='x2apic'/>
Nov 18 17:10:54 user nova-compute[74743]:     <feature policy='require' name='hypervisor'/>
Nov 18 17:10:54 user nova-compute[74743]:   </cpu>
Nov 18 17:10:54 user nova-compute[74743]:   <clock offset='utc'>
Nov 18 17:10:54 user nova-compute[74743]:     <timer name='pit' tickpolicy='delay'/>
Nov 18 17:10:54 user nova-compute[74743]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 18 17:10:54 user nova-compute[74743]:     <timer name='hpet' present='no'/>
Nov 18 17:10:54 user nova-compute[74743]:   </clock>
Nov 18 17:10:54 user nova-compute[74743]:   <on_poweroff>destroy</on_poweroff>
Nov 18 17:10:54 user nova-compute[74743]:   <on_reboot>restart</on_reboot>
Nov 18 17:10:54 user nova-compute[74743]:   <on_crash>destroy</on_crash>
Nov 18 17:10:54 user nova-compute[74743]:   <devices>
Nov 18 17:10:54 user nova-compute[74743]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 18 17:10:54 user nova-compute[74743]:     <disk type='file' device='disk'>
Nov 18 17:10:54 user nova-compute[74743]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 18 17:10:54 user nova-compute[74743]:       <source file='/opt/stack/data/nova/instances/e2b51739-7900-47bd-a01e-2e83e2f13ae1/disk' index='2'/>
Nov 18 17:10:54 user nova-compute[74743]:       <backingStore type='file' index='3'>
Nov 18 17:10:54 user nova-compute[74743]:         <format type='raw'/>
Nov 18 17:10:54 user nova-compute[74743]:         <source file='/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9'/>
Nov 18 17:10:54 user nova-compute[74743]:         <backingStore/>
Nov 18 17:10:54 user nova-compute[74743]:       </backingStore>
Nov 18 17:10:54 user nova-compute[74743]:       <target dev='vda' bus='virtio'/>
Nov 18 17:10:54 user nova-compute[74743]:       <alias name='virtio-disk0'/>
Nov 18 17:10:54 user nova-compute[74743]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 18 17:10:54 user nova-compute[74743]:     </disk>
Nov 18 17:10:54 user nova-compute[74743]:     <disk type='file' device='cdrom'>
Nov 18 17:10:54 user nova-compute[74743]:       <driver name='qemu' type='raw' cache='none'/>
Nov 18 17:10:54 user nova-compute[74743]:       <source file='/opt/stack/data/nova/instances/e2b51739-7900-47bd-a01e-2e83e2f13ae1/disk.config' index='1'/>
Nov 18 17:10:54 user nova-compute[74743]:       <backingStore/>
Nov 18 17:10:54 user nova-compute[74743]:       <target dev='hda' bus='ide'/>
Nov 18 17:10:54 user nova-compute[74743]:       <readonly/>
Nov 18 17:10:54 user nova-compute[74743]:       <alias name='ide0-0-0'/>
Nov 18 17:10:54 user nova-compute[74743]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 18 17:10:54 user nova-compute[74743]:     </disk>
Nov 18 17:10:54 user nova-compute[74743]:     <controller type='usb' index='0' model='none'>
Nov 18 17:10:54 user nova-compute[74743]:       <alias name='usb'/>
Nov 18 17:10:54 user nova-compute[74743]:     </controller>
Nov 18 17:10:54 user nova-compute[74743]:     <controller type='pci' index='0' model='pci-root'>
Nov 18 17:10:54 user nova-compute[74743]:       <alias name='pci.0'/>
Nov 18 17:10:54 user nova-compute[74743]:     </controller>
Nov 18 17:10:54 user nova-compute[74743]:     <controller type='ide' index='0'>
Nov 18 17:10:54 user nova-compute[74743]:       <alias name='ide'/>
Nov 18 17:10:54 user nova-compute[74743]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 18 17:10:54 user nova-compute[74743]:     </controller>
Nov 18 17:10:54 user nova-compute[74743]:     <interface type='ethernet'>
Nov 18 17:10:54 user nova-compute[74743]:       <mac address='fa:16:3e:2d:fd:f9'/>
Nov 18 17:10:54 user nova-compute[74743]:       <target dev='tap14c7e1ef-59'/>
Nov 18 17:10:54 user nova-compute[74743]:       <model type='virtio'/>
Nov 18 17:10:54 user nova-compute[74743]:       <mtu size='1442'/>
Nov 18 17:10:54 user nova-compute[74743]:       <alias name='net0'/>
Nov 18 17:10:54 user nova-compute[74743]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 18 17:10:54 user nova-compute[74743]:     </interface>
Nov 18 17:10:54 user nova-compute[74743]:     <interface type='ethernet'>
Nov 18 17:10:54 user nova-compute[74743]:       <mac address='fa:16:3e:a1:76:11'/>
Nov 18 17:10:54 user nova-compute[74743]:       <target dev='tap4476b532-0c'/>
Nov 18 17:10:54 user nova-compute[74743]:       <model type='virtio'/>
Nov 18 17:10:54 user nova-compute[74743]:       <mtu size='1442'/>
Nov 18 17:10:54 user nova-compute[74743]:       <alias name='net1'/>
Nov 18 17:10:54 user nova-compute[74743]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 18 17:10:54 user nova-compute[74743]:     </interface>
Nov 18 17:10:54 user nova-compute[74743]:     <serial type='pty'>
Nov 18 17:10:54 user nova-compute[74743]:       <source path='/dev/pts/8'/>
Nov 18 17:10:54 user nova-compute[74743]:       <log file='/opt/stack/data/nova/instances/e2b51739-7900-47bd-a01e-2e83e2f13ae1/console.log' append='off'/>
Nov 18 17:10:54 user nova-compute[74743]:       <target type='isa-serial' port='0'>
Nov 18 17:10:54 user nova-compute[74743]:         <model name='isa-serial'/>
Nov 18 17:10:54 user nova-compute[74743]:       </target>
Nov 18 17:10:54 user nova-compute[74743]:       <alias name='serial0'/>
Nov 18 17:10:54 user nova-compute[74743]:     </serial>
Nov 18 17:10:54 user nova-compute[74743]:     <console type='pty' tty='/dev/pts/8'>
Nov 18 17:10:54 user nova-compute[74743]:       <source path='/dev/pts/8'/>
Nov 18 17:10:54 user nova-compute[74743]:       <log file='/opt/stack/data/nova/instances/e2b51739-7900-47bd-a01e-2e83e2f13ae1/console.log' append='off'/>
Nov 18 17:10:54 user nova-compute[74743]:       <target type='serial' port='0'/>
Nov 18 17:10:54 user nova-compute[74743]:       <alias name='serial0'/>
Nov 18 17:10:54 user nova-compute[74743]:     </console>
Nov 18 17:10:54 user nova-compute[74743]:     <input type='mouse' bus='ps2'>
Nov 18 17:10:54 user nova-compute[74743]:       <alias name='input0'/>
Nov 18 17:10:54 user nova-compute[74743]:     </input>
Nov 18 17:10:54 user nova-compute[74743]:     <input type='keyboard' bus='ps2'>
Nov 18 17:10:54 user nova-compute[74743]:       <alias name='input1'/>
Nov 18 17:10:54 user nova-compute[74743]:     </input>
Nov 18 17:10:54 user nova-compute[74743]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Nov 18 17:10:54 user nova-compute[74743]:       <listen type='address' address='0.0.0.0'/>
Nov 18 17:10:54 user nova-compute[74743]:     </graphics>
Nov 18 17:10:54 user nova-compute[74743]:     <audio id='1' type='none'/>
Nov 18 17:10:54 user nova-compute[74743]:     <video>
Nov 18 17:10:54 user nova-compute[74743]:       <model type='virtio' heads='1' primary='yes'/>
Nov 18 17:10:54 user nova-compute[74743]:       <alias name='video0'/>
Nov 18 17:10:54 user nova-compute[74743]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 18 17:10:54 user nova-compute[74743]:     </video>
Nov 18 17:10:54 user nova-compute[74743]:     <memballoon model='virtio'>
Nov 18 17:10:54 user nova-compute[74743]:       <stats period='10'/>
Nov 18 17:10:54 user nova-compute[74743]:       <alias name='balloon0'/>
Nov 18 17:10:54 user nova-compute[74743]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 18 17:10:54 user nova-compute[74743]:     </memballoon>
Nov 18 17:10:54 user nova-compute[74743]:     <rng model='virtio'>
Nov 18 17:10:54 user nova-compute[74743]:       <backend model='random'>/dev/urandom</backend>
Nov 18 17:10:54 user nova-compute[74743]:       <alias name='rng0'/>
Nov 18 17:10:54 user nova-compute[74743]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 18 17:10:54 user nova-compute[74743]:     </rng>
Nov 18 17:10:54 user nova-compute[74743]:   </devices>
Nov 18 17:10:54 user nova-compute[74743]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 18 17:10:54 user nova-compute[74743]:     <label>libvirt-e2b51739-7900-47bd-a01e-2e83e2f13ae1</label>
Nov 18 17:10:54 user nova-compute[74743]:     <imagelabel>libvirt-e2b51739-7900-47bd-a01e-2e83e2f13ae1</imagelabel>
Nov 18 17:10:54 user nova-compute[74743]:   </seclabel>
Nov 18 17:10:54 user nova-compute[74743]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 18 17:10:54 user nova-compute[74743]:     <label>+64055:+108</label>
Nov 18 17:10:54 user nova-compute[74743]:     <imagelabel>+64055:+108</imagelabel>
Nov 18 17:10:54 user nova-compute[74743]:   </seclabel>
Nov 18 17:10:54 user nova-compute[74743]: </domain>
Nov 18 17:10:54 user nova-compute[74743]:  {{(pid=74743) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 18 17:10:54 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-11e4f2e6-c40a-4042-b4d2-a382866bc2c1 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Successfully detached device tap4476b532-0c from instance e2b51739-7900-47bd-a01e-2e83e2f13ae1 from the persistent domain config.
Nov 18 17:10:54 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-11e4f2e6-c40a-4042-b4d2-a382866bc2c1 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] (1/8): Attempting to detach device tap4476b532-0c with device alias net1 from instance e2b51739-7900-47bd-a01e-2e83e2f13ae1 from the live domain config. {{(pid=74743) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 17:10:54 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-11e4f2e6-c40a-4042-b4d2-a382866bc2c1 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] detach device xml: <interface type="ethernet">
Nov 18 17:10:54 user nova-compute[74743]:   <mac address="fa:16:3e:a1:76:11"/>
Nov 18 17:10:54 user nova-compute[74743]:   <model type="virtio"/>
Nov 18 17:10:54 user nova-compute[74743]:   <mtu size="1442"/>
Nov 18 17:10:54 user nova-compute[74743]:   <target dev="tap4476b532-0c"/>
Nov 18 17:10:54 user nova-compute[74743]: </interface>
Nov 18 17:10:54 user nova-compute[74743]:  {{(pid=74743) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 17:10:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:54 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-11e4f2e6-c40a-4042-b4d2-a382866bc2c1 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Start waiting for the detach event from libvirt for device tap4476b532-0c with device alias net1 for instance e2b51739-7900-47bd-a01e-2e83e2f13ae1 {{(pid=74743) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 17:10:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:54 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Instance destroyed successfully.
Nov 18 17:10:54 user nova-compute[74743]: DEBUG nova.objects.instance [None req-221f40a4-bda4-4b82-a519-8a8913939056 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lazy-loading 'resources' on Instance uuid 8a9b12da-02c5-42ba-b215-a20df0e3ea4f {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:10:54 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-221f40a4-bda4-4b82-a519-8a8913939056 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:08:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2117608811',display_name='tempest-VolumesSnapshotTestJSON-instance-2117608811',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2117608811',id=18,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+4EMOOsj8T3vRtmB2AXIxIcp4Bo39KkS2gbtxNjS+u3t5pu+ScTjKs6BJP2HZkZ3GpO2xYUc/hqLzSCTgFK2yYWdaa9XRP7MT8+JmYdBTsGOv0BwzXiPunFpprImiuyw==',key_name='tempest-keypair-38298062',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:08:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4468d0e7ff32423091ecc55d82deba1c',ramdisk_id='',reservation_id='r-u8wvs0d3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1394839673',owner_user_name='tempest-VolumesSnapshotTestJSON-1394839673-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:08:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='351aa457efdc463b95a4c837d26cd23f',uuid=8a9b12da-02c5-42ba-b215-a20df0e3ea4f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e3b96b3-1a83-4b25-ad28-cf77e11ff137", "address": "fa:16:3e:34:83:d5", "network": {"id": "2588909e-8504-407d-bc7b-5d1f3d978395", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1712970821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468d0e7ff32423091ecc55d82deba1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e3b96b3-1a", "ovs_interfaceid": "6e3b96b3-1a83-4b25-ad28-cf77e11ff137", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:10:54 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-221f40a4-bda4-4b82-a519-8a8913939056 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Converting VIF {"id": "6e3b96b3-1a83-4b25-ad28-cf77e11ff137", "address": "fa:16:3e:34:83:d5", "network": {"id": "2588909e-8504-407d-bc7b-5d1f3d978395", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1712970821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468d0e7ff32423091ecc55d82deba1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e3b96b3-1a", "ovs_interfaceid": "6e3b96b3-1a83-4b25-ad28-cf77e11ff137", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:10:54 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-221f40a4-bda4-4b82-a519-8a8913939056 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:83:d5,bridge_name='br-int',has_traffic_filtering=True,id=6e3b96b3-1a83-4b25-ad28-cf77e11ff137,network=Network(2588909e-8504-407d-bc7b-5d1f3d978395),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e3b96b3-1a') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:10:54 user nova-compute[74743]: DEBUG os_vif [None req-221f40a4-bda4-4b82-a519-8a8913939056 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:83:d5,bridge_name='br-int',has_traffic_filtering=True,id=6e3b96b3-1a83-4b25-ad28-cf77e11ff137,network=Network(2588909e-8504-407d-bc7b-5d1f3d978395),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e3b96b3-1a') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:10:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e3b96b3-1a, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:10:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:10:54 user nova-compute[74743]: DEBUG nova.compute.manager [req-ae4e120c-19c6-4089-bab3-67737a9791d4 req-3da0e503-0c2f-47d3-ad9a-709adf241ee0 service nova] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Received event network-vif-unplugged-4476b532-0c9f-4fef-aeb3-0c2b048c16b1 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:10:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ae4e120c-19c6-4089-bab3-67737a9791d4 req-3da0e503-0c2f-47d3-ad9a-709adf241ee0 service nova] Acquiring lock "e2b51739-7900-47bd-a01e-2e83e2f13ae1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:10:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ae4e120c-19c6-4089-bab3-67737a9791d4 req-3da0e503-0c2f-47d3-ad9a-709adf241ee0 service nova] Lock "e2b51739-7900-47bd-a01e-2e83e2f13ae1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:10:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ae4e120c-19c6-4089-bab3-67737a9791d4 req-3da0e503-0c2f-47d3-ad9a-709adf241ee0 service nova] Lock "e2b51739-7900-47bd-a01e-2e83e2f13ae1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:10:54 user nova-compute[74743]: DEBUG nova.compute.manager [req-ae4e120c-19c6-4089-bab3-67737a9791d4 req-3da0e503-0c2f-47d3-ad9a-709adf241ee0 service nova] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] No waiting events found dispatching network-vif-unplugged-4476b532-0c9f-4fef-aeb3-0c2b048c16b1 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:10:54 user nova-compute[74743]: WARNING nova.compute.manager [req-ae4e120c-19c6-4089-bab3-67737a9791d4 req-3da0e503-0c2f-47d3-ad9a-709adf241ee0 service nova] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Received unexpected event network-vif-unplugged-4476b532-0c9f-4fef-aeb3-0c2b048c16b1 for instance with vm_state active and task_state None.
Nov 18 17:10:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d895cb37-48d6-44a1-892d-a87fefced3c5) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:10:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:10:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:55 user nova-compute[74743]: INFO os_vif [None req-221f40a4-bda4-4b82-a519-8a8913939056 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:83:d5,bridge_name='br-int',has_traffic_filtering=True,id=6e3b96b3-1a83-4b25-ad28-cf77e11ff137,network=Network(2588909e-8504-407d-bc7b-5d1f3d978395),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e3b96b3-1a')
Nov 18 17:10:55 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-221f40a4-bda4-4b82-a519-8a8913939056 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] calling os-brick to detach iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 17:10:55 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-221f40a4-bda4-4b82-a519-8a8913939056 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, {'target_iqn': 'iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dmRFHzoX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:10:55 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-221f40a4-bda4-4b82-a519-8a8913939056 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:10:55 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-221f40a4-bda4-4b82-a519-8a8913939056 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:10:55 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-221f40a4-bda4-4b82-a519-8a8913939056 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:10:55 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:55 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:55 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[23db209d-fde9-4e0e-a955-09bae005680f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:10:55 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-221f40a4-bda4-4b82-a519-8a8913939056 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 17:10:55 user nova-compute[74743]: No targets found.
Nov 18 17:10:55 user nova-compute[74743]: iSNS:
Nov 18 17:10:55 user nova-compute[74743]: No targets found.
Nov 18 17:10:55 user nova-compute[74743]: STATIC:
Nov 18 17:10:55 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e
Nov 18 17:10:55 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:10:55 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:10:55 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad
Nov 18 17:10:55 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:10:55 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:10:55 user nova-compute[74743]: FIRMWARE:
Nov 18 17:10:55 user nova-compute[74743]: No targets found.
Nov 18 17:10:55 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:10:55 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-221f40a4-bda4-4b82-a519-8a8913939056 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 17:10:55 user nova-compute[74743]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 17:10:55 user nova-compute[74743]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74743) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 17:10:55 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-221f40a4-bda4-4b82-a519-8a8913939056 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cfd3064-bd17-46d8-bbf6-fd6d541424fb', 0)] {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 17:10:55 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:55 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:55 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[07976930-0aee-470f-8928-4557ffd3103f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:10:55 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:10:55 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:10:55 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8c97cc-1d87-4b6d-a96d-188d256b41b4]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:10:55 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-221f40a4-bda4-4b82-a519-8a8913939056 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad (non-flash)
Nov 18 17:10:55 user nova-compute[74743]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)
Nov 18 17:10:55 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:10:55 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-221f40a4-bda4-4b82-a519-8a8913939056 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad (non-flash)
Nov 18 17:10:55 user nova-compute[74743]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)
Nov 18 17:10:55 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:10:55 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-221f40a4-bda4-4b82-a519-8a8913939056 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb0833edd0>, {}) {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 17:10:55 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-221f40a4-bda4-4b82-a519-8a8913939056 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Disconnecting from: [] {{(pid=74743) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 17:10:55 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-221f40a4-bda4-4b82-a519-8a8913939056 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.069s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:10:55 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-221f40a4-bda4-4b82-a519-8a8913939056 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] <== disconnect_volume: return (70ms) None {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:10:55 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-221f40a4-bda4-4b82-a519-8a8913939056 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Disconnected iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 17:10:55 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-221f40a4-bda4-4b82-a519-8a8913939056 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Deleting instance files /opt/stack/data/nova/instances/8a9b12da-02c5-42ba-b215-a20df0e3ea4f_del
Nov 18 17:10:55 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-221f40a4-bda4-4b82-a519-8a8913939056 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Deletion of /opt/stack/data/nova/instances/8a9b12da-02c5-42ba-b215-a20df0e3ea4f_del complete
Nov 18 17:10:55 user nova-compute[74743]: INFO nova.compute.manager [None req-221f40a4-bda4-4b82-a519-8a8913939056 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 18 17:10:55 user nova-compute[74743]: DEBUG oslo.service.loopingcall [None req-221f40a4-bda4-4b82-a519-8a8913939056 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74743) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 17:10:55 user nova-compute[74743]: DEBUG nova.compute.manager [-] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Deallocating network for instance {{(pid=74743) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 17:10:55 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] deallocate_for_instance() {{(pid=74743) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 17:10:55 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:10:55 user nova-compute[74743]: INFO nova.compute.manager [-] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Took 0.74 seconds to deallocate network for instance.
Nov 18 17:10:55 user nova-compute[74743]: WARNING nova.volume.cinder [None req-221f40a4-bda4-4b82-a519-8a8913939056 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Attachment e870440f-77ae-4f6a-b3e1-3d375388d11a does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = e870440f-77ae-4f6a-b3e1-3d375388d11a. (HTTP 404) (Request-ID: req-d0d26c78-565b-4bc0-880f-ef8465b2ffbd)
Nov 18 17:10:55 user nova-compute[74743]: INFO nova.compute.manager [None req-221f40a4-bda4-4b82-a519-8a8913939056 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Took 0.03 seconds to detach 1 volumes for instance.
Nov 18 17:10:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-221f40a4-bda4-4b82-a519-8a8913939056 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:10:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-221f40a4-bda4-4b82-a519-8a8913939056 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:10:56 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-221f40a4-bda4-4b82-a519-8a8913939056 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:10:56 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-221f40a4-bda4-4b82-a519-8a8913939056 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:10:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-221f40a4-bda4-4b82-a519-8a8913939056 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.359s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:10:56 user nova-compute[74743]: INFO nova.scheduler.client.report [None req-221f40a4-bda4-4b82-a519-8a8913939056 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Deleted allocations for instance 8a9b12da-02c5-42ba-b215-a20df0e3ea4f
Nov 18 17:10:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-221f40a4-bda4-4b82-a519-8a8913939056 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "8a9b12da-02c5-42ba-b215-a20df0e3ea4f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.274s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:10:56 user nova-compute[74743]: DEBUG nova.compute.manager [req-63f82315-f73f-43b2-b124-3e8bab474590 req-927d464b-7bb1-4f20-a865-36c3e08bd589 service nova] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Received event network-vif-plugged-6e3b96b3-1a83-4b25-ad28-cf77e11ff137 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:10:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-63f82315-f73f-43b2-b124-3e8bab474590 req-927d464b-7bb1-4f20-a865-36c3e08bd589 service nova] Acquiring lock "8a9b12da-02c5-42ba-b215-a20df0e3ea4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:10:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-63f82315-f73f-43b2-b124-3e8bab474590 req-927d464b-7bb1-4f20-a865-36c3e08bd589 service nova] Lock "8a9b12da-02c5-42ba-b215-a20df0e3ea4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:10:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-63f82315-f73f-43b2-b124-3e8bab474590 req-927d464b-7bb1-4f20-a865-36c3e08bd589 service nova] Lock "8a9b12da-02c5-42ba-b215-a20df0e3ea4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:10:56 user nova-compute[74743]: DEBUG nova.compute.manager [req-63f82315-f73f-43b2-b124-3e8bab474590 req-927d464b-7bb1-4f20-a865-36c3e08bd589 service nova] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] No waiting events found dispatching network-vif-plugged-6e3b96b3-1a83-4b25-ad28-cf77e11ff137 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:10:56 user nova-compute[74743]: WARNING nova.compute.manager [req-63f82315-f73f-43b2-b124-3e8bab474590 req-927d464b-7bb1-4f20-a865-36c3e08bd589 service nova] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Received unexpected event network-vif-plugged-6e3b96b3-1a83-4b25-ad28-cf77e11ff137 for instance with vm_state deleted and task_state None.
Nov 18 17:10:57 user nova-compute[74743]: DEBUG nova.compute.manager [req-3930f065-0e33-48f6-a751-febb2598d883 req-4c907b1a-a947-4f43-af98-4e7f969d30c6 service nova] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Received event network-vif-plugged-4476b532-0c9f-4fef-aeb3-0c2b048c16b1 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:10:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3930f065-0e33-48f6-a751-febb2598d883 req-4c907b1a-a947-4f43-af98-4e7f969d30c6 service nova] Acquiring lock "e2b51739-7900-47bd-a01e-2e83e2f13ae1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:10:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3930f065-0e33-48f6-a751-febb2598d883 req-4c907b1a-a947-4f43-af98-4e7f969d30c6 service nova] Lock "e2b51739-7900-47bd-a01e-2e83e2f13ae1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:10:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3930f065-0e33-48f6-a751-febb2598d883 req-4c907b1a-a947-4f43-af98-4e7f969d30c6 service nova] Lock "e2b51739-7900-47bd-a01e-2e83e2f13ae1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:10:57 user nova-compute[74743]: DEBUG nova.compute.manager [req-3930f065-0e33-48f6-a751-febb2598d883 req-4c907b1a-a947-4f43-af98-4e7f969d30c6 service nova] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] No waiting events found dispatching network-vif-plugged-4476b532-0c9f-4fef-aeb3-0c2b048c16b1 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:10:57 user nova-compute[74743]: WARNING nova.compute.manager [req-3930f065-0e33-48f6-a751-febb2598d883 req-4c907b1a-a947-4f43-af98-4e7f969d30c6 service nova] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Received unexpected event network-vif-plugged-4476b532-0c9f-4fef-aeb3-0c2b048c16b1 for instance with vm_state active and task_state None.
Nov 18 17:10:57 user nova-compute[74743]: DEBUG nova.compute.manager [req-3930f065-0e33-48f6-a751-febb2598d883 req-4c907b1a-a947-4f43-af98-4e7f969d30c6 service nova] [instance: 8a9b12da-02c5-42ba-b215-a20df0e3ea4f] Received event network-vif-deleted-6e3b96b3-1a83-4b25-ad28-cf77e11ff137 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:10:59 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:10:59 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:04 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:04 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:05 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-b5bf497f-572c-440a-87d9-8cfaa5430de5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "7764af08-2214-4a2f-84c4-cab1366e198d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:11:05 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-b5bf497f-572c-440a-87d9-8cfaa5430de5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "7764af08-2214-4a2f-84c4-cab1366e198d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:11:05 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-b5bf497f-572c-440a-87d9-8cfaa5430de5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "7764af08-2214-4a2f-84c4-cab1366e198d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:11:05 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-b5bf497f-572c-440a-87d9-8cfaa5430de5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "7764af08-2214-4a2f-84c4-cab1366e198d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:11:05 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-b5bf497f-572c-440a-87d9-8cfaa5430de5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "7764af08-2214-4a2f-84c4-cab1366e198d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:11:05 user nova-compute[74743]: INFO nova.compute.manager [None req-b5bf497f-572c-440a-87d9-8cfaa5430de5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Terminating instance
Nov 18 17:11:05 user nova-compute[74743]: DEBUG nova.compute.manager [None req-b5bf497f-572c-440a-87d9-8cfaa5430de5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Start destroying the instance on the hypervisor. {{(pid=74743) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 17:11:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG nova.compute.manager [req-2d2a1ccb-ba80-4a62-a0d6-5f123cad685d req-4c3663c2-6ab4-4d89-8c71-e3b6c3c6baee service nova] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Received event network-vif-unplugged-b8787812-1f2e-4f67-8a5c-9eede06d1506 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-2d2a1ccb-ba80-4a62-a0d6-5f123cad685d req-4c3663c2-6ab4-4d89-8c71-e3b6c3c6baee service nova] Acquiring lock "7764af08-2214-4a2f-84c4-cab1366e198d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-2d2a1ccb-ba80-4a62-a0d6-5f123cad685d req-4c3663c2-6ab4-4d89-8c71-e3b6c3c6baee service nova] Lock "7764af08-2214-4a2f-84c4-cab1366e198d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-2d2a1ccb-ba80-4a62-a0d6-5f123cad685d req-4c3663c2-6ab4-4d89-8c71-e3b6c3c6baee service nova] Lock "7764af08-2214-4a2f-84c4-cab1366e198d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG nova.compute.manager [req-2d2a1ccb-ba80-4a62-a0d6-5f123cad685d req-4c3663c2-6ab4-4d89-8c71-e3b6c3c6baee service nova] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] No waiting events found dispatching network-vif-unplugged-b8787812-1f2e-4f67-8a5c-9eede06d1506 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG nova.compute.manager [req-2d2a1ccb-ba80-4a62-a0d6-5f123cad685d req-4c3663c2-6ab4-4d89-8c71-e3b6c3c6baee service nova] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Received event network-vif-unplugged-b8787812-1f2e-4f67-8a5c-9eede06d1506 for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:11:06 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Instance destroyed successfully.
Nov 18 17:11:06 user nova-compute[74743]: DEBUG nova.objects.instance [None req-b5bf497f-572c-440a-87d9-8cfaa5430de5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lazy-loading 'resources' on Instance uuid 7764af08-2214-4a2f-84c4-cab1366e198d {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-b5bf497f-572c-440a-87d9-8cfaa5430de5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:09:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1253403991',display_name='tempest-TestVolumeBootPattern-server-1253403991',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1253403991',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:09:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a956c4d6e4304d34872ecf989279c886',ramdisk_id='',reservation_id='r-4ue1yy61',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1373443944',owner_user_name='tempest-TestVolumeBootPattern-1373443944-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:09:34Z,user_data=None,user_id='89ce0d4bf7234c348b9b1a8979609c7b',uuid=7764af08-2214-4a2f-84c4-cab1366e198d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b8787812-1f2e-4f67-8a5c-9eede06d1506", "address": "fa:16:3e:bd:2f:d7", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8787812-1f", "ovs_interfaceid": "b8787812-1f2e-4f67-8a5c-9eede06d1506", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-b5bf497f-572c-440a-87d9-8cfaa5430de5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Converting VIF {"id": "b8787812-1f2e-4f67-8a5c-9eede06d1506", "address": "fa:16:3e:bd:2f:d7", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8787812-1f", "ovs_interfaceid": "b8787812-1f2e-4f67-8a5c-9eede06d1506", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-b5bf497f-572c-440a-87d9-8cfaa5430de5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:2f:d7,bridge_name='br-int',has_traffic_filtering=True,id=b8787812-1f2e-4f67-8a5c-9eede06d1506,network=Network(fc55f18a-b779-4b04-8828-278ecd62211a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8787812-1f') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG os_vif [None req-b5bf497f-572c-440a-87d9-8cfaa5430de5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:2f:d7,bridge_name='br-int',has_traffic_filtering=True,id=b8787812-1f2e-4f67-8a5c-9eede06d1506,network=Network(fc55f18a-b779-4b04-8828-278ecd62211a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8787812-1f') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb8787812-1f, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=38284f97-e8d8-46d5-8887-1c717ccc7e2c) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:06 user nova-compute[74743]: INFO os_vif [None req-b5bf497f-572c-440a-87d9-8cfaa5430de5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:2f:d7,bridge_name='br-int',has_traffic_filtering=True,id=b8787812-1f2e-4f67-8a5c-9eede06d1506,network=Network(fc55f18a-b779-4b04-8828-278ecd62211a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8787812-1f')
Nov 18 17:11:06 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5bf497f-572c-440a-87d9-8cfaa5430de5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] calling os-brick to detach iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bf497f-572c-440a-87d9-8cfaa5430de5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, {'target_iqn': 'iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cFXSkHrj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:11:06 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-b5bf497f-572c-440a-87d9-8cfaa5430de5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:11:06 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-b5bf497f-572c-440a-87d9-8cfaa5430de5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-b5bf497f-572c-440a-87d9-8cfaa5430de5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f16f4a-f213-45ab-ab72-5c722104a424]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bf497f-572c-440a-87d9-8cfaa5430de5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 17:11:06 user nova-compute[74743]: No targets found.
Nov 18 17:11:06 user nova-compute[74743]: iSNS:
Nov 18 17:11:06 user nova-compute[74743]: No targets found.
Nov 18 17:11:06 user nova-compute[74743]: STATIC:
Nov 18 17:11:06 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e
Nov 18 17:11:06 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:11:06 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:11:06 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad
Nov 18 17:11:06 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:11:06 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:11:06 user nova-compute[74743]: FIRMWARE:
Nov 18 17:11:06 user nova-compute[74743]: No targets found.
Nov 18 17:11:06 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bf497f-572c-440a-87d9-8cfaa5430de5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 17:11:06 user nova-compute[74743]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 17:11:06 user nova-compute[74743]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74743) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bf497f-572c-440a-87d9-8cfaa5430de5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad', 0)] {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc8d7a8-aa3a-4ff7-995e-9ac4c1ea6f8e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa4b09a-2fc1-42e1-8e50-99e8b43b9b8e]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bf497f-572c-440a-87d9-8cfaa5430de5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad (non-flash)
Nov 18 17:11:06 user nova-compute[74743]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)
Nov 18 17:11:06 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bf497f-572c-440a-87d9-8cfaa5430de5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad (non-flash)
Nov 18 17:11:06 user nova-compute[74743]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)
Nov 18 17:11:06 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bf497f-572c-440a-87d9-8cfaa5430de5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb0833d6c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad'): ({'sdb'}, set())}) {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-b5bf497f-572c-440a-87d9-8cfaa5430de5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Removing single pathed devices sdb {{(pid=74743) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc02d64-5a87-43bb-81ff-dd193c193898]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f5d2b8-9166-485f-aa9c-2db221dc6485]: (4, ('ok\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-b5bf497f-572c-440a-87d9-8cfaa5430de5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Flushing IO for device /dev/sdb {{(pid=74743) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12e94a0-ebd7-4d20-8ae7-b32f703a4774]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-b5bf497f-572c-440a-87d9-8cfaa5430de5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74743) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.063s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d930fd26-401f-4d4f-af2b-d04c64db8b11]: (4, ('1', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-b5bf497f-572c-440a-87d9-8cfaa5430de5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-b5bf497f-572c-440a-87d9-8cfaa5430de5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] SCSI volumes sdb have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bf497f-572c-440a-87d9-8cfaa5430de5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad')] {{(pid=74743) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87491fd-6d92-43ce-9047-a5ac654109b7]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bf497f-572c-440a-87d9-8cfaa5430de5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:11:06 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad -p 172.16.0.220:3260 --logout {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:07 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:07 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d5d6bb-e3da-415a-910e-9b15fc0a8ab9]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:07 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bf497f-572c-440a-87d9-8cfaa5430de5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad, portal: 172.16.0.220,3260]
Nov 18 17:11:07 user nova-compute[74743]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad, portal: 172.16.0.220,3260] successful.
Nov 18 17:11:07 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:11:07 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad -p 172.16.0.220:3260 --op delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:07 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bf86bdf-9bdc-4e39-a057-e6c34bc0daad -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:07 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ab92db-ee64-4932-acd2-4e283df32620]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:07 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bf497f-572c-440a-87d9-8cfaa5430de5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:11:07 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-b5bf497f-572c-440a-87d9-8cfaa5430de5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:11:07 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bf497f-572c-440a-87d9-8cfaa5430de5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] <== disconnect_volume: return (293ms) None {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:11:07 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5bf497f-572c-440a-87d9-8cfaa5430de5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Disconnected iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 17:11:07 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-b5bf497f-572c-440a-87d9-8cfaa5430de5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Deleting instance files /opt/stack/data/nova/instances/7764af08-2214-4a2f-84c4-cab1366e198d_del
Nov 18 17:11:07 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-b5bf497f-572c-440a-87d9-8cfaa5430de5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Deletion of /opt/stack/data/nova/instances/7764af08-2214-4a2f-84c4-cab1366e198d_del complete
Nov 18 17:11:07 user nova-compute[74743]: INFO nova.compute.manager [None req-b5bf497f-572c-440a-87d9-8cfaa5430de5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 18 17:11:07 user nova-compute[74743]: DEBUG oslo.service.loopingcall [None req-b5bf497f-572c-440a-87d9-8cfaa5430de5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74743) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 17:11:07 user nova-compute[74743]: DEBUG nova.compute.manager [-] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Deallocating network for instance {{(pid=74743) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 17:11:07 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] deallocate_for_instance() {{(pid=74743) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 17:11:07 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:11:07 user nova-compute[74743]: INFO nova.compute.manager [-] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Took 0.43 seconds to deallocate network for instance.
Nov 18 17:11:07 user nova-compute[74743]: DEBUG nova.compute.manager [req-68858287-a1a3-47a5-8762-2c70706846ee req-acd3e067-d3f8-4699-8b83-ab49013e677e service nova] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Received event network-vif-deleted-b8787812-1f2e-4f67-8a5c-9eede06d1506 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:11:08 user nova-compute[74743]: DEBUG nova.compute.manager [req-c3992c01-cd0a-4cc8-8e88-5ca3bd65ed0e req-365ba7b0-6744-400a-9e64-0f9b2d7d2526 service nova] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Received event network-vif-plugged-b8787812-1f2e-4f67-8a5c-9eede06d1506 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:11:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-c3992c01-cd0a-4cc8-8e88-5ca3bd65ed0e req-365ba7b0-6744-400a-9e64-0f9b2d7d2526 service nova] Acquiring lock "7764af08-2214-4a2f-84c4-cab1366e198d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:11:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-c3992c01-cd0a-4cc8-8e88-5ca3bd65ed0e req-365ba7b0-6744-400a-9e64-0f9b2d7d2526 service nova] Lock "7764af08-2214-4a2f-84c4-cab1366e198d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:11:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-c3992c01-cd0a-4cc8-8e88-5ca3bd65ed0e req-365ba7b0-6744-400a-9e64-0f9b2d7d2526 service nova] Lock "7764af08-2214-4a2f-84c4-cab1366e198d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:11:08 user nova-compute[74743]: DEBUG nova.compute.manager [req-c3992c01-cd0a-4cc8-8e88-5ca3bd65ed0e req-365ba7b0-6744-400a-9e64-0f9b2d7d2526 service nova] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] No waiting events found dispatching network-vif-plugged-b8787812-1f2e-4f67-8a5c-9eede06d1506 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:11:08 user nova-compute[74743]: WARNING nova.compute.manager [req-c3992c01-cd0a-4cc8-8e88-5ca3bd65ed0e req-365ba7b0-6744-400a-9e64-0f9b2d7d2526 service nova] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Received unexpected event network-vif-plugged-b8787812-1f2e-4f67-8a5c-9eede06d1506 for instance with vm_state active and task_state deleting.
Nov 18 17:11:08 user nova-compute[74743]: INFO nova.compute.manager [None req-b5bf497f-572c-440a-87d9-8cfaa5430de5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Took 0.74 seconds to detach 1 volumes for instance.
Nov 18 17:11:08 user nova-compute[74743]: DEBUG nova.compute.manager [None req-b5bf497f-572c-440a-87d9-8cfaa5430de5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 7764af08-2214-4a2f-84c4-cab1366e198d] Deleting volume: 2bf86bdf-9bdc-4e39-a057-e6c34bc0daad {{(pid=74743) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 18 17:11:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-b5bf497f-572c-440a-87d9-8cfaa5430de5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:11:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-b5bf497f-572c-440a-87d9-8cfaa5430de5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:11:08 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-b5bf497f-572c-440a-87d9-8cfaa5430de5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:11:08 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-b5bf497f-572c-440a-87d9-8cfaa5430de5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:11:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-b5bf497f-572c-440a-87d9-8cfaa5430de5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.350s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:11:08 user nova-compute[74743]: INFO nova.scheduler.client.report [None req-b5bf497f-572c-440a-87d9-8cfaa5430de5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Deleted allocations for instance 7764af08-2214-4a2f-84c4-cab1366e198d
Nov 18 17:11:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-b5bf497f-572c-440a-87d9-8cfaa5430de5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "7764af08-2214-4a2f-84c4-cab1366e198d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.975s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:11:09 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:14 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-11e4f2e6-c40a-4042-b4d2-a382866bc2c1 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Waiting for libvirt event about the detach of device tap4476b532-0c with device alias net1 from instance e2b51739-7900-47bd-a01e-2e83e2f13ae1 is timed out.
Nov 18 17:11:14 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-11e4f2e6-c40a-4042-b4d2-a382866bc2c1 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:a1:76:11"/><model type="virtio"/><mtu size="1442"/><target dev="tap4476b532-0c"/></interface> {{(pid=74743) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 18 17:11:14 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-11e4f2e6-c40a-4042-b4d2-a382866bc2c1 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:a1:76:11"/><model type="virtio"/><mtu size="1442"/><target dev="tap4476b532-0c"/></interface>not found in domain: <domain type='kvm' id='22'>
Nov 18 17:11:14 user nova-compute[74743]:   <name>instance-00000013</name>
Nov 18 17:11:14 user nova-compute[74743]:   <uuid>e2b51739-7900-47bd-a01e-2e83e2f13ae1</uuid>
Nov 18 17:11:14 user nova-compute[74743]:   <metadata>
Nov 18 17:11:14 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:11:14 user nova-compute[74743]:   <nova:package version="0.0.0"/>
Nov 18 17:11:14 user nova-compute[74743]:   <nova:name>tempest-device-tagging-server-411956172</nova:name>
Nov 18 17:11:14 user nova-compute[74743]:   <nova:creationTime>2023-11-18 17:10:21</nova:creationTime>
Nov 18 17:11:14 user nova-compute[74743]:   <nova:flavor name="m1.tiny">
Nov 18 17:11:14 user nova-compute[74743]:     <nova:memory>512</nova:memory>
Nov 18 17:11:14 user nova-compute[74743]:     <nova:disk>1</nova:disk>
Nov 18 17:11:14 user nova-compute[74743]:     <nova:swap>0</nova:swap>
Nov 18 17:11:14 user nova-compute[74743]:     <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:11:14 user nova-compute[74743]:     <nova:vcpus>1</nova:vcpus>
Nov 18 17:11:14 user nova-compute[74743]:   </nova:flavor>
Nov 18 17:11:14 user nova-compute[74743]:   <nova:owner>
Nov 18 17:11:14 user nova-compute[74743]:     <nova:user uuid="eb774fdb80ef465187caf4ffd2422e83">tempest-TaggedAttachmentsTest-1465741228-project-member</nova:user>
Nov 18 17:11:14 user nova-compute[74743]:     <nova:project uuid="c15d7007a99745f1a308b64514566129">tempest-TaggedAttachmentsTest-1465741228</nova:project>
Nov 18 17:11:14 user nova-compute[74743]:   </nova:owner>
Nov 18 17:11:14 user nova-compute[74743]:   <nova:root type="image" uuid="9536f6cf-95c4-40e2-864a-09a91525678a"/>
Nov 18 17:11:14 user nova-compute[74743]:   <nova:ports>
Nov 18 17:11:14 user nova-compute[74743]:     <nova:port uuid="14c7e1ef-5997-4e7f-aebf-baa01bec87a6">
Nov 18 17:11:14 user nova-compute[74743]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 18 17:11:14 user nova-compute[74743]:     </nova:port>
Nov 18 17:11:14 user nova-compute[74743]:     <nova:port uuid="4476b532-0c9f-4fef-aeb3-0c2b048c16b1">
Nov 18 17:11:14 user nova-compute[74743]:       <nova:ip type="fixed" address="10.10.10.154" ipVersion="4"/>
Nov 18 17:11:14 user nova-compute[74743]:     </nova:port>
Nov 18 17:11:14 user nova-compute[74743]:   </nova:ports>
Nov 18 17:11:14 user nova-compute[74743]: </nova:instance>
Nov 18 17:11:14 user nova-compute[74743]:   </metadata>
Nov 18 17:11:14 user nova-compute[74743]:   <memory unit='KiB'>524288</memory>
Nov 18 17:11:14 user nova-compute[74743]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 18 17:11:14 user nova-compute[74743]:   <vcpu placement='static'>1</vcpu>
Nov 18 17:11:14 user nova-compute[74743]:   <resource>
Nov 18 17:11:14 user nova-compute[74743]:     <partition>/machine</partition>
Nov 18 17:11:14 user nova-compute[74743]:   </resource>
Nov 18 17:11:14 user nova-compute[74743]:   <sysinfo type='smbios'>
Nov 18 17:11:14 user nova-compute[74743]:     <system>
Nov 18 17:11:14 user nova-compute[74743]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 18 17:11:14 user nova-compute[74743]:       <entry name='product'>OpenStack Nova</entry>
Nov 18 17:11:14 user nova-compute[74743]:       <entry name='version'>0.0.0</entry>
Nov 18 17:11:14 user nova-compute[74743]:       <entry name='serial'>e2b51739-7900-47bd-a01e-2e83e2f13ae1</entry>
Nov 18 17:11:14 user nova-compute[74743]:       <entry name='uuid'>e2b51739-7900-47bd-a01e-2e83e2f13ae1</entry>
Nov 18 17:11:14 user nova-compute[74743]:       <entry name='family'>Virtual Machine</entry>
Nov 18 17:11:14 user nova-compute[74743]:     </system>
Nov 18 17:11:14 user nova-compute[74743]:   </sysinfo>
Nov 18 17:11:14 user nova-compute[74743]:   <os>
Nov 18 17:11:14 user nova-compute[74743]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 18 17:11:14 user nova-compute[74743]:     <boot dev='hd'/>
Nov 18 17:11:14 user nova-compute[74743]:     <smbios mode='sysinfo'/>
Nov 18 17:11:14 user nova-compute[74743]:   </os>
Nov 18 17:11:14 user nova-compute[74743]:   <features>
Nov 18 17:11:14 user nova-compute[74743]:     <acpi/>
Nov 18 17:11:14 user nova-compute[74743]:     <apic/>
Nov 18 17:11:14 user nova-compute[74743]:     <vmcoreinfo state='on'/>
Nov 18 17:11:14 user nova-compute[74743]:   </features>
Nov 18 17:11:14 user nova-compute[74743]:   <cpu mode='custom' match='exact' check='full'>
Nov 18 17:11:14 user nova-compute[74743]:     <model fallback='forbid'>Nehalem</model>
Nov 18 17:11:14 user nova-compute[74743]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 18 17:11:14 user nova-compute[74743]:     <feature policy='require' name='vme'/>
Nov 18 17:11:14 user nova-compute[74743]:     <feature policy='require' name='x2apic'/>
Nov 18 17:11:14 user nova-compute[74743]:     <feature policy='require' name='hypervisor'/>
Nov 18 17:11:14 user nova-compute[74743]:   </cpu>
Nov 18 17:11:14 user nova-compute[74743]:   <clock offset='utc'>
Nov 18 17:11:14 user nova-compute[74743]:     <timer name='pit' tickpolicy='delay'/>
Nov 18 17:11:14 user nova-compute[74743]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 18 17:11:14 user nova-compute[74743]:     <timer name='hpet' present='no'/>
Nov 18 17:11:14 user nova-compute[74743]:   </clock>
Nov 18 17:11:14 user nova-compute[74743]:   <on_poweroff>destroy</on_poweroff>
Nov 18 17:11:14 user nova-compute[74743]:   <on_reboot>restart</on_reboot>
Nov 18 17:11:14 user nova-compute[74743]:   <on_crash>destroy</on_crash>
Nov 18 17:11:14 user nova-compute[74743]:   <devices>
Nov 18 17:11:14 user nova-compute[74743]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 18 17:11:14 user nova-compute[74743]:     <disk type='file' device='disk'>
Nov 18 17:11:14 user nova-compute[74743]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 18 17:11:14 user nova-compute[74743]:       <source file='/opt/stack/data/nova/instances/e2b51739-7900-47bd-a01e-2e83e2f13ae1/disk' index='2'/>
Nov 18 17:11:14 user nova-compute[74743]:       <backingStore type='file' index='3'>
Nov 18 17:11:14 user nova-compute[74743]:         <format type='raw'/>
Nov 18 17:11:14 user nova-compute[74743]:         <source file='/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9'/>
Nov 18 17:11:14 user nova-compute[74743]:         <backingStore/>
Nov 18 17:11:14 user nova-compute[74743]:       </backingStore>
Nov 18 17:11:14 user nova-compute[74743]:       <target dev='vda' bus='virtio'/>
Nov 18 17:11:14 user nova-compute[74743]:       <alias name='virtio-disk0'/>
Nov 18 17:11:14 user nova-compute[74743]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 18 17:11:14 user nova-compute[74743]:     </disk>
Nov 18 17:11:14 user nova-compute[74743]:     <disk type='file' device='cdrom'>
Nov 18 17:11:14 user nova-compute[74743]:       <driver name='qemu' type='raw' cache='none'/>
Nov 18 17:11:14 user nova-compute[74743]:       <source file='/opt/stack/data/nova/instances/e2b51739-7900-47bd-a01e-2e83e2f13ae1/disk.config' index='1'/>
Nov 18 17:11:14 user nova-compute[74743]:       <backingStore/>
Nov 18 17:11:14 user nova-compute[74743]:       <target dev='hda' bus='ide'/>
Nov 18 17:11:14 user nova-compute[74743]:       <readonly/>
Nov 18 17:11:14 user nova-compute[74743]:       <alias name='ide0-0-0'/>
Nov 18 17:11:14 user nova-compute[74743]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 18 17:11:14 user nova-compute[74743]:     </disk>
Nov 18 17:11:14 user nova-compute[74743]:     <controller type='usb' index='0' model='none'>
Nov 18 17:11:14 user nova-compute[74743]:       <alias name='usb'/>
Nov 18 17:11:14 user nova-compute[74743]:     </controller>
Nov 18 17:11:14 user nova-compute[74743]:     <controller type='pci' index='0' model='pci-root'>
Nov 18 17:11:14 user nova-compute[74743]:       <alias name='pci.0'/>
Nov 18 17:11:14 user nova-compute[74743]:     </controller>
Nov 18 17:11:14 user nova-compute[74743]:     <controller type='ide' index='0'>
Nov 18 17:11:14 user nova-compute[74743]:       <alias name='ide'/>
Nov 18 17:11:14 user nova-compute[74743]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 18 17:11:14 user nova-compute[74743]:     </controller>
Nov 18 17:11:14 user nova-compute[74743]:     <interface type='ethernet'>
Nov 18 17:11:14 user nova-compute[74743]:       <mac address='fa:16:3e:2d:fd:f9'/>
Nov 18 17:11:14 user nova-compute[74743]:       <target dev='tap14c7e1ef-59'/>
Nov 18 17:11:14 user nova-compute[74743]:       <model type='virtio'/>
Nov 18 17:11:14 user nova-compute[74743]:       <mtu size='1442'/>
Nov 18 17:11:14 user nova-compute[74743]:       <alias name='net0'/>
Nov 18 17:11:14 user nova-compute[74743]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 18 17:11:14 user nova-compute[74743]:     </interface>
Nov 18 17:11:14 user nova-compute[74743]:     <serial type='pty'>
Nov 18 17:11:14 user nova-compute[74743]:       <source path='/dev/pts/8'/>
Nov 18 17:11:14 user nova-compute[74743]:       <log file='/opt/stack/data/nova/instances/e2b51739-7900-47bd-a01e-2e83e2f13ae1/console.log' append='off'/>
Nov 18 17:11:14 user nova-compute[74743]:       <target type='isa-serial' port='0'>
Nov 18 17:11:14 user nova-compute[74743]:         <model name='isa-serial'/>
Nov 18 17:11:14 user nova-compute[74743]:       </target>
Nov 18 17:11:14 user nova-compute[74743]:       <alias name='serial0'/>
Nov 18 17:11:14 user nova-compute[74743]:     </serial>
Nov 18 17:11:14 user nova-compute[74743]:     <console type='pty' tty='/dev/pts/8'>
Nov 18 17:11:14 user nova-compute[74743]:       <source path='/dev/pts/8'/>
Nov 18 17:11:14 user nova-compute[74743]:       <log file='/opt/stack/data/nova/instances/e2b51739-7900-47bd-a01e-2e83e2f13ae1/console.log' append='off'/>
Nov 18 17:11:14 user nova-compute[74743]:       <target type='serial' port='0'/>
Nov 18 17:11:14 user nova-compute[74743]:       <alias name='serial0'/>
Nov 18 17:11:14 user nova-compute[74743]:     </console>
Nov 18 17:11:14 user nova-compute[74743]:     <input type='mouse' bus='ps2'>
Nov 18 17:11:14 user nova-compute[74743]:       <alias name='input0'/>
Nov 18 17:11:14 user nova-compute[74743]:     </input>
Nov 18 17:11:14 user nova-compute[74743]:     <input type='keyboard' bus='ps2'>
Nov 18 17:11:14 user nova-compute[74743]:       <alias name='input1'/>
Nov 18 17:11:14 user nova-compute[74743]:     </input>
Nov 18 17:11:14 user nova-compute[74743]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Nov 18 17:11:14 user nova-compute[74743]:       <listen type='address' address='0.0.0.0'/>
Nov 18 17:11:14 user nova-compute[74743]:     </graphics>
Nov 18 17:11:14 user nova-compute[74743]:     <audio id='1' type='none'/>
Nov 18 17:11:14 user nova-compute[74743]:     <video>
Nov 18 17:11:14 user nova-compute[74743]:       <model type='virtio' heads='1' primary='yes'/>
Nov 18 17:11:14 user nova-compute[74743]:       <alias name='video0'/>
Nov 18 17:11:14 user nova-compute[74743]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 18 17:11:14 user nova-compute[74743]:     </video>
Nov 18 17:11:14 user nova-compute[74743]:     <memballoon model='virtio'>
Nov 18 17:11:14 user nova-compute[74743]:       <stats period='10'/>
Nov 18 17:11:14 user nova-compute[74743]:       <alias name='balloon0'/>
Nov 18 17:11:14 user nova-compute[74743]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 18 17:11:14 user nova-compute[74743]:     </memballoon>
Nov 18 17:11:14 user nova-compute[74743]:     <rng model='virtio'>
Nov 18 17:11:14 user nova-compute[74743]:       <backend model='random'>/dev/urandom</backend>
Nov 18 17:11:14 user nova-compute[74743]:       <alias name='rng0'/>
Nov 18 17:11:14 user nova-compute[74743]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 18 17:11:14 user nova-compute[74743]:     </rng>
Nov 18 17:11:14 user nova-compute[74743]:   </devices>
Nov 18 17:11:14 user nova-compute[74743]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 18 17:11:14 user nova-compute[74743]:     <label>libvirt-e2b51739-7900-47bd-a01e-2e83e2f13ae1</label>
Nov 18 17:11:14 user nova-compute[74743]:     <imagelabel>libvirt-e2b51739-7900-47bd-a01e-2e83e2f13ae1</imagelabel>
Nov 18 17:11:14 user nova-compute[74743]:   </seclabel>
Nov 18 17:11:14 user nova-compute[74743]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 18 17:11:14 user nova-compute[74743]:     <label>+64055:+108</label>
Nov 18 17:11:14 user nova-compute[74743]:     <imagelabel>+64055:+108</imagelabel>
Nov 18 17:11:14 user nova-compute[74743]:   </seclabel>
Nov 18 17:11:14 user nova-compute[74743]: </domain>
Nov 18 17:11:14 user nova-compute[74743]:  {{(pid=74743) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 18 17:11:14 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-11e4f2e6-c40a-4042-b4d2-a382866bc2c1 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Successfully detached device tap4476b532-0c from instance e2b51739-7900-47bd-a01e-2e83e2f13ae1 from the live domain config.
Nov 18 17:11:14 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-11e4f2e6-c40a-4042-b4d2-a382866bc2c1 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T17:08:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-411956172',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-411956172',id=19,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIsbQN9tS0qcOOC8WPSSYsTCVNWYWYH/K8oXwrg2jt5ZqyybStsLpAIghGB8s0OC3gX9C23pdQMdiUELbHV4Nj+tyYgRoCwRrAGlWKX/+zFnGGmym65cFn63wRBKph/3bw==',key_name='tempest-keypair-1379891500',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:08:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c15d7007a99745f1a308b64514566129',ramdisk_id='',reservation_id='r-xbgsfk5e',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1465741228',owner_user_name='tempest-TaggedAttachmentsTest-1465741228-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:08:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb774fdb80ef465187caf4ffd2422e83',uuid=e2b51739-7900-47bd-a01e-2e83e2f13ae1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4476b532-0c9f-4fef-aeb3-0c2b048c16b1", "address": "fa:16:3e:a1:76:11", "network": {"id": "5a3f7ae2-082b-4f43-b911-8567500c22bf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-410755460", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c15d7007a99745f1a308b64514566129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4476b532-0c", "ovs_interfaceid": "4476b532-0c9f-4fef-aeb3-0c2b048c16b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:11:14 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-11e4f2e6-c40a-4042-b4d2-a382866bc2c1 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Converting VIF {"id": "4476b532-0c9f-4fef-aeb3-0c2b048c16b1", "address": "fa:16:3e:a1:76:11", "network": {"id": "5a3f7ae2-082b-4f43-b911-8567500c22bf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-410755460", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c15d7007a99745f1a308b64514566129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4476b532-0c", "ovs_interfaceid": "4476b532-0c9f-4fef-aeb3-0c2b048c16b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:11:14 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-11e4f2e6-c40a-4042-b4d2-a382866bc2c1 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:76:11,bridge_name='br-int',has_traffic_filtering=True,id=4476b532-0c9f-4fef-aeb3-0c2b048c16b1,network=Network(5a3f7ae2-082b-4f43-b911-8567500c22bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4476b532-0c') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:11:14 user nova-compute[74743]: DEBUG os_vif [None req-11e4f2e6-c40a-4042-b4d2-a382866bc2c1 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:76:11,bridge_name='br-int',has_traffic_filtering=True,id=4476b532-0c9f-4fef-aeb3-0c2b048c16b1,network=Network(5a3f7ae2-082b-4f43-b911-8567500c22bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4476b532-0c') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:11:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4476b532-0c, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:11:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:11:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=38857b6c-8d5a-4615-a5ec-9f7859709cb9) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:11:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:14 user nova-compute[74743]: INFO os_vif [None req-11e4f2e6-c40a-4042-b4d2-a382866bc2c1 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:76:11,bridge_name='br-int',has_traffic_filtering=True,id=4476b532-0c9f-4fef-aeb3-0c2b048c16b1,network=Network(5a3f7ae2-082b-4f43-b911-8567500c22bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4476b532-0c')
Nov 18 17:11:14 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-11e4f2e6-c40a-4042-b4d2-a382866bc2c1 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:11:14 user nova-compute[74743]:   <nova:package version="0.0.0"/>
Nov 18 17:11:14 user nova-compute[74743]:   <nova:name>tempest-device-tagging-server-411956172</nova:name>
Nov 18 17:11:14 user nova-compute[74743]:   <nova:creationTime>2023-11-18 17:11:14</nova:creationTime>
Nov 18 17:11:14 user nova-compute[74743]:   <nova:flavor name="m1.tiny">
Nov 18 17:11:14 user nova-compute[74743]:     <nova:memory>512</nova:memory>
Nov 18 17:11:14 user nova-compute[74743]:     <nova:disk>1</nova:disk>
Nov 18 17:11:14 user nova-compute[74743]:     <nova:swap>0</nova:swap>
Nov 18 17:11:14 user nova-compute[74743]:     <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:11:14 user nova-compute[74743]:     <nova:vcpus>1</nova:vcpus>
Nov 18 17:11:14 user nova-compute[74743]:   </nova:flavor>
Nov 18 17:11:14 user nova-compute[74743]:   <nova:owner>
Nov 18 17:11:14 user nova-compute[74743]:     <nova:user uuid="eb774fdb80ef465187caf4ffd2422e83">tempest-TaggedAttachmentsTest-1465741228-project-member</nova:user>
Nov 18 17:11:14 user nova-compute[74743]:     <nova:project uuid="c15d7007a99745f1a308b64514566129">tempest-TaggedAttachmentsTest-1465741228</nova:project>
Nov 18 17:11:14 user nova-compute[74743]:   </nova:owner>
Nov 18 17:11:14 user nova-compute[74743]:   <nova:root type="image" uuid="9536f6cf-95c4-40e2-864a-09a91525678a"/>
Nov 18 17:11:14 user nova-compute[74743]:   <nova:ports>
Nov 18 17:11:14 user nova-compute[74743]:     <nova:port uuid="14c7e1ef-5997-4e7f-aebf-baa01bec87a6">
Nov 18 17:11:14 user nova-compute[74743]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 18 17:11:14 user nova-compute[74743]:     </nova:port>
Nov 18 17:11:14 user nova-compute[74743]:   </nova:ports>
Nov 18 17:11:14 user nova-compute[74743]: </nova:instance>
Nov 18 17:11:14 user nova-compute[74743]:  {{(pid=74743) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 18 17:11:15 user nova-compute[74743]: DEBUG nova.compute.manager [req-f4cd47b9-e5c5-4b11-9cd2-8b526eb55b4d req-42f5bd88-a941-42f8-b3e0-7a45a8e6c841 service nova] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Received event network-vif-deleted-4476b532-0c9f-4fef-aeb3-0c2b048c16b1 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:11:15 user nova-compute[74743]: INFO nova.compute.manager [req-f4cd47b9-e5c5-4b11-9cd2-8b526eb55b4d req-42f5bd88-a941-42f8-b3e0-7a45a8e6c841 service nova] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Neutron deleted interface 4476b532-0c9f-4fef-aeb3-0c2b048c16b1; detaching it from the instance and deleting it from the info cache
Nov 18 17:11:15 user nova-compute[74743]: DEBUG nova.network.neutron [req-f4cd47b9-e5c5-4b11-9cd2-8b526eb55b4d req-42f5bd88-a941-42f8-b3e0-7a45a8e6c841 service nova] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Updating instance_info_cache with network_info: [{"id": "14c7e1ef-5997-4e7f-aebf-baa01bec87a6", "address": "fa:16:3e:2d:fd:f9", "network": {"id": "f6455510-3862-45cf-b6d7-7d92905b0554", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-6755490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c15d7007a99745f1a308b64514566129", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c7e1ef-59", "ovs_interfaceid": "14c7e1ef-5997-4e7f-aebf-baa01bec87a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:11:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-11e4f2e6-c40a-4042-b4d2-a382866bc2c1 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Acquiring lock "refresh_cache-e2b51739-7900-47bd-a01e-2e83e2f13ae1" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:11:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-11e4f2e6-c40a-4042-b4d2-a382866bc2c1 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Acquired lock "refresh_cache-e2b51739-7900-47bd-a01e-2e83e2f13ae1" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:11:15 user nova-compute[74743]: DEBUG nova.network.neutron [None req-11e4f2e6-c40a-4042-b4d2-a382866bc2c1 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:11:15 user nova-compute[74743]: DEBUG nova.objects.instance [req-f4cd47b9-e5c5-4b11-9cd2-8b526eb55b4d req-42f5bd88-a941-42f8-b3e0-7a45a8e6c841 service nova] Lazy-loading 'system_metadata' on Instance uuid e2b51739-7900-47bd-a01e-2e83e2f13ae1 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:11:15 user nova-compute[74743]: DEBUG nova.objects.instance [req-f4cd47b9-e5c5-4b11-9cd2-8b526eb55b4d req-42f5bd88-a941-42f8-b3e0-7a45a8e6c841 service nova] Lazy-loading 'flavor' on Instance uuid e2b51739-7900-47bd-a01e-2e83e2f13ae1 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:11:15 user nova-compute[74743]: DEBUG nova.objects.base [req-f4cd47b9-e5c5-4b11-9cd2-8b526eb55b4d req-42f5bd88-a941-42f8-b3e0-7a45a8e6c841 service nova] Object Instance<e2b51739-7900-47bd-a01e-2e83e2f13ae1> lazy-loaded attributes: system_metadata,flavor {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:11:15 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [req-f4cd47b9-e5c5-4b11-9cd2-8b526eb55b4d req-42f5bd88-a941-42f8-b3e0-7a45a8e6c841 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T17:08:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-411956172',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-411956172',id=19,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIsbQN9tS0qcOOC8WPSSYsTCVNWYWYH/K8oXwrg2jt5ZqyybStsLpAIghGB8s0OC3gX9C23pdQMdiUELbHV4Nj+tyYgRoCwRrAGlWKX/+zFnGGmym65cFn63wRBKph/3bw==',key_name='tempest-keypair-1379891500',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:08:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c15d7007a99745f1a308b64514566129',ramdisk_id='',reservation_id='r-xbgsfk5e',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1465741228',owner_user_name='tempest-TaggedAttachmentsTest-1465741228-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:08:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb774fdb80ef465187caf4ffd2422e83',uuid=e2b51739-7900-47bd-a01e-2e83e2f13ae1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4476b532-0c9f-4fef-aeb3-0c2b048c16b1", "address": "fa:16:3e:a1:76:11", "network": {"id": "5a3f7ae2-082b-4f43-b911-8567500c22bf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-410755460", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c15d7007a99745f1a308b64514566129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4476b532-0c", "ovs_interfaceid": "4476b532-0c9f-4fef-aeb3-0c2b048c16b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:11:15 user nova-compute[74743]: DEBUG nova.network.os_vif_util [req-f4cd47b9-e5c5-4b11-9cd2-8b526eb55b4d req-42f5bd88-a941-42f8-b3e0-7a45a8e6c841 service nova] Converting VIF {"id": "4476b532-0c9f-4fef-aeb3-0c2b048c16b1", "address": "fa:16:3e:a1:76:11", "network": {"id": "5a3f7ae2-082b-4f43-b911-8567500c22bf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-410755460", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c15d7007a99745f1a308b64514566129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4476b532-0c", "ovs_interfaceid": "4476b532-0c9f-4fef-aeb3-0c2b048c16b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:11:15 user nova-compute[74743]: DEBUG nova.network.os_vif_util [req-f4cd47b9-e5c5-4b11-9cd2-8b526eb55b4d req-42f5bd88-a941-42f8-b3e0-7a45a8e6c841 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:76:11,bridge_name='br-int',has_traffic_filtering=True,id=4476b532-0c9f-4fef-aeb3-0c2b048c16b1,network=Network(5a3f7ae2-082b-4f43-b911-8567500c22bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4476b532-0c') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:11:15 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [req-f4cd47b9-e5c5-4b11-9cd2-8b526eb55b4d req-42f5bd88-a941-42f8-b3e0-7a45a8e6c841 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:a1:76:11"/><model type="virtio"/><mtu size="1442"/><target dev="tap4476b532-0c"/></interface> {{(pid=74743) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 18 17:11:15 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [req-f4cd47b9-e5c5-4b11-9cd2-8b526eb55b4d req-42f5bd88-a941-42f8-b3e0-7a45a8e6c841 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:a1:76:11"/><model type="virtio"/><mtu size="1442"/><target dev="tap4476b532-0c"/></interface>not found in domain: <domain type='kvm' id='22'>
Nov 18 17:11:15 user nova-compute[74743]:   <name>instance-00000013</name>
Nov 18 17:11:15 user nova-compute[74743]:   <uuid>e2b51739-7900-47bd-a01e-2e83e2f13ae1</uuid>
Nov 18 17:11:15 user nova-compute[74743]:   <metadata>
Nov 18 17:11:15 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:11:15 user nova-compute[74743]:   <nova:package version="0.0.0"/>
Nov 18 17:11:15 user nova-compute[74743]:   <nova:name>tempest-device-tagging-server-411956172</nova:name>
Nov 18 17:11:15 user nova-compute[74743]:   <nova:creationTime>2023-11-18 17:11:14</nova:creationTime>
Nov 18 17:11:15 user nova-compute[74743]:   <nova:flavor name="m1.tiny">
Nov 18 17:11:15 user nova-compute[74743]:     <nova:memory>512</nova:memory>
Nov 18 17:11:15 user nova-compute[74743]:     <nova:disk>1</nova:disk>
Nov 18 17:11:15 user nova-compute[74743]:     <nova:swap>0</nova:swap>
Nov 18 17:11:15 user nova-compute[74743]:     <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:11:15 user nova-compute[74743]:     <nova:vcpus>1</nova:vcpus>
Nov 18 17:11:15 user nova-compute[74743]:   </nova:flavor>
Nov 18 17:11:15 user nova-compute[74743]:   <nova:owner>
Nov 18 17:11:15 user nova-compute[74743]:     <nova:user uuid="eb774fdb80ef465187caf4ffd2422e83">tempest-TaggedAttachmentsTest-1465741228-project-member</nova:user>
Nov 18 17:11:15 user nova-compute[74743]:     <nova:project uuid="c15d7007a99745f1a308b64514566129">tempest-TaggedAttachmentsTest-1465741228</nova:project>
Nov 18 17:11:15 user nova-compute[74743]:   </nova:owner>
Nov 18 17:11:15 user nova-compute[74743]:   <nova:root type="image" uuid="9536f6cf-95c4-40e2-864a-09a91525678a"/>
Nov 18 17:11:15 user nova-compute[74743]:   <nova:ports>
Nov 18 17:11:15 user nova-compute[74743]:     <nova:port uuid="14c7e1ef-5997-4e7f-aebf-baa01bec87a6">
Nov 18 17:11:15 user nova-compute[74743]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 18 17:11:15 user nova-compute[74743]:     </nova:port>
Nov 18 17:11:15 user nova-compute[74743]:   </nova:ports>
Nov 18 17:11:15 user nova-compute[74743]: </nova:instance>
Nov 18 17:11:15 user nova-compute[74743]:   </metadata>
Nov 18 17:11:15 user nova-compute[74743]:   <memory unit='KiB'>524288</memory>
Nov 18 17:11:15 user nova-compute[74743]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 18 17:11:15 user nova-compute[74743]:   <vcpu placement='static'>1</vcpu>
Nov 18 17:11:15 user nova-compute[74743]:   <resource>
Nov 18 17:11:15 user nova-compute[74743]:     <partition>/machine</partition>
Nov 18 17:11:15 user nova-compute[74743]:   </resource>
Nov 18 17:11:15 user nova-compute[74743]:   <sysinfo type='smbios'>
Nov 18 17:11:15 user nova-compute[74743]:     <system>
Nov 18 17:11:15 user nova-compute[74743]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 18 17:11:15 user nova-compute[74743]:       <entry name='product'>OpenStack Nova</entry>
Nov 18 17:11:15 user nova-compute[74743]:       <entry name='version'>0.0.0</entry>
Nov 18 17:11:15 user nova-compute[74743]:       <entry name='serial'>e2b51739-7900-47bd-a01e-2e83e2f13ae1</entry>
Nov 18 17:11:15 user nova-compute[74743]:       <entry name='uuid'>e2b51739-7900-47bd-a01e-2e83e2f13ae1</entry>
Nov 18 17:11:15 user nova-compute[74743]:       <entry name='family'>Virtual Machine</entry>
Nov 18 17:11:15 user nova-compute[74743]:     </system>
Nov 18 17:11:15 user nova-compute[74743]:   </sysinfo>
Nov 18 17:11:15 user nova-compute[74743]:   <os>
Nov 18 17:11:15 user nova-compute[74743]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 18 17:11:15 user nova-compute[74743]:     <boot dev='hd'/>
Nov 18 17:11:15 user nova-compute[74743]:     <smbios mode='sysinfo'/>
Nov 18 17:11:15 user nova-compute[74743]:   </os>
Nov 18 17:11:15 user nova-compute[74743]:   <features>
Nov 18 17:11:15 user nova-compute[74743]:     <acpi/>
Nov 18 17:11:15 user nova-compute[74743]:     <apic/>
Nov 18 17:11:15 user nova-compute[74743]:     <vmcoreinfo state='on'/>
Nov 18 17:11:15 user nova-compute[74743]:   </features>
Nov 18 17:11:15 user nova-compute[74743]:   <cpu mode='custom' match='exact' check='full'>
Nov 18 17:11:15 user nova-compute[74743]:     <model fallback='forbid'>Nehalem</model>
Nov 18 17:11:15 user nova-compute[74743]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 18 17:11:15 user nova-compute[74743]:     <feature policy='require' name='vme'/>
Nov 18 17:11:15 user nova-compute[74743]:     <feature policy='require' name='x2apic'/>
Nov 18 17:11:15 user nova-compute[74743]:     <feature policy='require' name='hypervisor'/>
Nov 18 17:11:15 user nova-compute[74743]:   </cpu>
Nov 18 17:11:15 user nova-compute[74743]:   <clock offset='utc'>
Nov 18 17:11:15 user nova-compute[74743]:     <timer name='pit' tickpolicy='delay'/>
Nov 18 17:11:15 user nova-compute[74743]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 18 17:11:15 user nova-compute[74743]:     <timer name='hpet' present='no'/>
Nov 18 17:11:15 user nova-compute[74743]:   </clock>
Nov 18 17:11:15 user nova-compute[74743]:   <on_poweroff>destroy</on_poweroff>
Nov 18 17:11:15 user nova-compute[74743]:   <on_reboot>restart</on_reboot>
Nov 18 17:11:15 user nova-compute[74743]:   <on_crash>destroy</on_crash>
Nov 18 17:11:15 user nova-compute[74743]:   <devices>
Nov 18 17:11:15 user nova-compute[74743]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 18 17:11:15 user nova-compute[74743]:     <disk type='file' device='disk'>
Nov 18 17:11:15 user nova-compute[74743]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 18 17:11:15 user nova-compute[74743]:       <source file='/opt/stack/data/nova/instances/e2b51739-7900-47bd-a01e-2e83e2f13ae1/disk' index='2'/>
Nov 18 17:11:15 user nova-compute[74743]:       <backingStore type='file' index='3'>
Nov 18 17:11:15 user nova-compute[74743]:         <format type='raw'/>
Nov 18 17:11:15 user nova-compute[74743]:         <source file='/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9'/>
Nov 18 17:11:15 user nova-compute[74743]:         <backingStore/>
Nov 18 17:11:15 user nova-compute[74743]:       </backingStore>
Nov 18 17:11:15 user nova-compute[74743]:       <target dev='vda' bus='virtio'/>
Nov 18 17:11:15 user nova-compute[74743]:       <alias name='virtio-disk0'/>
Nov 18 17:11:15 user nova-compute[74743]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 18 17:11:15 user nova-compute[74743]:     </disk>
Nov 18 17:11:15 user nova-compute[74743]:     <disk type='file' device='cdrom'>
Nov 18 17:11:15 user nova-compute[74743]:       <driver name='qemu' type='raw' cache='none'/>
Nov 18 17:11:15 user nova-compute[74743]:       <source file='/opt/stack/data/nova/instances/e2b51739-7900-47bd-a01e-2e83e2f13ae1/disk.config' index='1'/>
Nov 18 17:11:15 user nova-compute[74743]:       <backingStore/>
Nov 18 17:11:15 user nova-compute[74743]:       <target dev='hda' bus='ide'/>
Nov 18 17:11:15 user nova-compute[74743]:       <readonly/>
Nov 18 17:11:15 user nova-compute[74743]:       <alias name='ide0-0-0'/>
Nov 18 17:11:15 user nova-compute[74743]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 18 17:11:15 user nova-compute[74743]:     </disk>
Nov 18 17:11:15 user nova-compute[74743]:     <controller type='usb' index='0' model='none'>
Nov 18 17:11:15 user nova-compute[74743]:       <alias name='usb'/>
Nov 18 17:11:15 user nova-compute[74743]:     </controller>
Nov 18 17:11:15 user nova-compute[74743]:     <controller type='pci' index='0' model='pci-root'>
Nov 18 17:11:15 user nova-compute[74743]:       <alias name='pci.0'/>
Nov 18 17:11:15 user nova-compute[74743]:     </controller>
Nov 18 17:11:15 user nova-compute[74743]:     <controller type='ide' index='0'>
Nov 18 17:11:15 user nova-compute[74743]:       <alias name='ide'/>
Nov 18 17:11:15 user nova-compute[74743]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 18 17:11:15 user nova-compute[74743]:     </controller>
Nov 18 17:11:15 user nova-compute[74743]:     <interface type='ethernet'>
Nov 18 17:11:15 user nova-compute[74743]:       <mac address='fa:16:3e:2d:fd:f9'/>
Nov 18 17:11:15 user nova-compute[74743]:       <target dev='tap14c7e1ef-59'/>
Nov 18 17:11:15 user nova-compute[74743]:       <model type='virtio'/>
Nov 18 17:11:15 user nova-compute[74743]:       <mtu size='1442'/>
Nov 18 17:11:15 user nova-compute[74743]:       <alias name='net0'/>
Nov 18 17:11:15 user nova-compute[74743]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 18 17:11:15 user nova-compute[74743]:     </interface>
Nov 18 17:11:15 user nova-compute[74743]:     <serial type='pty'>
Nov 18 17:11:15 user nova-compute[74743]:       <source path='/dev/pts/8'/>
Nov 18 17:11:15 user nova-compute[74743]:       <log file='/opt/stack/data/nova/instances/e2b51739-7900-47bd-a01e-2e83e2f13ae1/console.log' append='off'/>
Nov 18 17:11:15 user nova-compute[74743]:       <target type='isa-serial' port='0'>
Nov 18 17:11:15 user nova-compute[74743]:         <model name='isa-serial'/>
Nov 18 17:11:15 user nova-compute[74743]:       </target>
Nov 18 17:11:15 user nova-compute[74743]:       <alias name='serial0'/>
Nov 18 17:11:15 user nova-compute[74743]:     </serial>
Nov 18 17:11:15 user nova-compute[74743]:     <console type='pty' tty='/dev/pts/8'>
Nov 18 17:11:15 user nova-compute[74743]:       <source path='/dev/pts/8'/>
Nov 18 17:11:15 user nova-compute[74743]:       <log file='/opt/stack/data/nova/instances/e2b51739-7900-47bd-a01e-2e83e2f13ae1/console.log' append='off'/>
Nov 18 17:11:15 user nova-compute[74743]:       <target type='serial' port='0'/>
Nov 18 17:11:15 user nova-compute[74743]:       <alias name='serial0'/>
Nov 18 17:11:15 user nova-compute[74743]:     </console>
Nov 18 17:11:15 user nova-compute[74743]:     <input type='mouse' bus='ps2'>
Nov 18 17:11:15 user nova-compute[74743]:       <alias name='input0'/>
Nov 18 17:11:15 user nova-compute[74743]:     </input>
Nov 18 17:11:15 user nova-compute[74743]:     <input type='keyboard' bus='ps2'>
Nov 18 17:11:15 user nova-compute[74743]:       <alias name='input1'/>
Nov 18 17:11:15 user nova-compute[74743]:     </input>
Nov 18 17:11:15 user nova-compute[74743]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Nov 18 17:11:15 user nova-compute[74743]:       <listen type='address' address='0.0.0.0'/>
Nov 18 17:11:15 user nova-compute[74743]:     </graphics>
Nov 18 17:11:15 user nova-compute[74743]:     <audio id='1' type='none'/>
Nov 18 17:11:15 user nova-compute[74743]:     <video>
Nov 18 17:11:15 user nova-compute[74743]:       <model type='virtio' heads='1' primary='yes'/>
Nov 18 17:11:15 user nova-compute[74743]:       <alias name='video0'/>
Nov 18 17:11:15 user nova-compute[74743]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 18 17:11:15 user nova-compute[74743]:     </video>
Nov 18 17:11:15 user nova-compute[74743]:     <memballoon model='virtio'>
Nov 18 17:11:15 user nova-compute[74743]:       <stats period='10'/>
Nov 18 17:11:15 user nova-compute[74743]:       <alias name='balloon0'/>
Nov 18 17:11:15 user nova-compute[74743]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 18 17:11:15 user nova-compute[74743]:     </memballoon>
Nov 18 17:11:15 user nova-compute[74743]:     <rng model='virtio'>
Nov 18 17:11:15 user nova-compute[74743]:       <backend model='random'>/dev/urandom</backend>
Nov 18 17:11:15 user nova-compute[74743]:       <alias name='rng0'/>
Nov 18 17:11:15 user nova-compute[74743]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 18 17:11:15 user nova-compute[74743]:     </rng>
Nov 18 17:11:15 user nova-compute[74743]:   </devices>
Nov 18 17:11:15 user nova-compute[74743]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 18 17:11:15 user nova-compute[74743]:     <label>libvirt-e2b51739-7900-47bd-a01e-2e83e2f13ae1</label>
Nov 18 17:11:15 user nova-compute[74743]:     <imagelabel>libvirt-e2b51739-7900-47bd-a01e-2e83e2f13ae1</imagelabel>
Nov 18 17:11:15 user nova-compute[74743]:   </seclabel>
Nov 18 17:11:15 user nova-compute[74743]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 18 17:11:15 user nova-compute[74743]:     <label>+64055:+108</label>
Nov 18 17:11:15 user nova-compute[74743]:     <imagelabel>+64055:+108</imagelabel>
Nov 18 17:11:15 user nova-compute[74743]:   </seclabel>
Nov 18 17:11:15 user nova-compute[74743]: </domain>
Nov 18 17:11:15 user nova-compute[74743]:  {{(pid=74743) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 18 17:11:15 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [req-f4cd47b9-e5c5-4b11-9cd2-8b526eb55b4d req-42f5bd88-a941-42f8-b3e0-7a45a8e6c841 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:a1:76:11"/><model type="virtio"/><mtu size="1442"/><target dev="tap4476b532-0c"/></interface> {{(pid=74743) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 18 17:11:15 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [req-f4cd47b9-e5c5-4b11-9cd2-8b526eb55b4d req-42f5bd88-a941-42f8-b3e0-7a45a8e6c841 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:a1:76:11"/><model type="virtio"/><mtu size="1442"/><target dev="tap4476b532-0c"/></interface>not found in domain: <domain type='kvm' id='22'>
Nov 18 17:11:15 user nova-compute[74743]:   <name>instance-00000013</name>
Nov 18 17:11:15 user nova-compute[74743]:   <uuid>e2b51739-7900-47bd-a01e-2e83e2f13ae1</uuid>
Nov 18 17:11:15 user nova-compute[74743]:   <metadata>
Nov 18 17:11:15 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:11:15 user nova-compute[74743]:   <nova:package version="0.0.0"/>
Nov 18 17:11:15 user nova-compute[74743]:   <nova:name>tempest-device-tagging-server-411956172</nova:name>
Nov 18 17:11:15 user nova-compute[74743]:   <nova:creationTime>2023-11-18 17:11:14</nova:creationTime>
Nov 18 17:11:15 user nova-compute[74743]:   <nova:flavor name="m1.tiny">
Nov 18 17:11:15 user nova-compute[74743]:     <nova:memory>512</nova:memory>
Nov 18 17:11:15 user nova-compute[74743]:     <nova:disk>1</nova:disk>
Nov 18 17:11:15 user nova-compute[74743]:     <nova:swap>0</nova:swap>
Nov 18 17:11:15 user nova-compute[74743]:     <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:11:15 user nova-compute[74743]:     <nova:vcpus>1</nova:vcpus>
Nov 18 17:11:15 user nova-compute[74743]:   </nova:flavor>
Nov 18 17:11:15 user nova-compute[74743]:   <nova:owner>
Nov 18 17:11:15 user nova-compute[74743]:     <nova:user uuid="eb774fdb80ef465187caf4ffd2422e83">tempest-TaggedAttachmentsTest-1465741228-project-member</nova:user>
Nov 18 17:11:15 user nova-compute[74743]:     <nova:project uuid="c15d7007a99745f1a308b64514566129">tempest-TaggedAttachmentsTest-1465741228</nova:project>
Nov 18 17:11:15 user nova-compute[74743]:   </nova:owner>
Nov 18 17:11:15 user nova-compute[74743]:   <nova:root type="image" uuid="9536f6cf-95c4-40e2-864a-09a91525678a"/>
Nov 18 17:11:15 user nova-compute[74743]:   <nova:ports>
Nov 18 17:11:15 user nova-compute[74743]:     <nova:port uuid="14c7e1ef-5997-4e7f-aebf-baa01bec87a6">
Nov 18 17:11:15 user nova-compute[74743]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 18 17:11:15 user nova-compute[74743]:     </nova:port>
Nov 18 17:11:15 user nova-compute[74743]:   </nova:ports>
Nov 18 17:11:15 user nova-compute[74743]: </nova:instance>
Nov 18 17:11:15 user nova-compute[74743]:   </metadata>
Nov 18 17:11:15 user nova-compute[74743]:   <memory unit='KiB'>524288</memory>
Nov 18 17:11:15 user nova-compute[74743]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 18 17:11:15 user nova-compute[74743]:   <vcpu placement='static'>1</vcpu>
Nov 18 17:11:15 user nova-compute[74743]:   <resource>
Nov 18 17:11:15 user nova-compute[74743]:     <partition>/machine</partition>
Nov 18 17:11:15 user nova-compute[74743]:   </resource>
Nov 18 17:11:15 user nova-compute[74743]:   <sysinfo type='smbios'>
Nov 18 17:11:15 user nova-compute[74743]:     <system>
Nov 18 17:11:15 user nova-compute[74743]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 18 17:11:15 user nova-compute[74743]:       <entry name='product'>OpenStack Nova</entry>
Nov 18 17:11:15 user nova-compute[74743]:       <entry name='version'>0.0.0</entry>
Nov 18 17:11:15 user nova-compute[74743]:       <entry name='serial'>e2b51739-7900-47bd-a01e-2e83e2f13ae1</entry>
Nov 18 17:11:15 user nova-compute[74743]:       <entry name='uuid'>e2b51739-7900-47bd-a01e-2e83e2f13ae1</entry>
Nov 18 17:11:15 user nova-compute[74743]:       <entry name='family'>Virtual Machine</entry>
Nov 18 17:11:15 user nova-compute[74743]:     </system>
Nov 18 17:11:15 user nova-compute[74743]:   </sysinfo>
Nov 18 17:11:15 user nova-compute[74743]:   <os>
Nov 18 17:11:15 user nova-compute[74743]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 18 17:11:15 user nova-compute[74743]:     <boot dev='hd'/>
Nov 18 17:11:15 user nova-compute[74743]:     <smbios mode='sysinfo'/>
Nov 18 17:11:15 user nova-compute[74743]:   </os>
Nov 18 17:11:15 user nova-compute[74743]:   <features>
Nov 18 17:11:15 user nova-compute[74743]:     <acpi/>
Nov 18 17:11:15 user nova-compute[74743]:     <apic/>
Nov 18 17:11:15 user nova-compute[74743]:     <vmcoreinfo state='on'/>
Nov 18 17:11:15 user nova-compute[74743]:   </features>
Nov 18 17:11:15 user nova-compute[74743]:   <cpu mode='custom' match='exact' check='full'>
Nov 18 17:11:15 user nova-compute[74743]:     <model fallback='forbid'>Nehalem</model>
Nov 18 17:11:15 user nova-compute[74743]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 18 17:11:15 user nova-compute[74743]:     <feature policy='require' name='vme'/>
Nov 18 17:11:15 user nova-compute[74743]:     <feature policy='require' name='x2apic'/>
Nov 18 17:11:15 user nova-compute[74743]:     <feature policy='require' name='hypervisor'/>
Nov 18 17:11:15 user nova-compute[74743]:   </cpu>
Nov 18 17:11:15 user nova-compute[74743]:   <clock offset='utc'>
Nov 18 17:11:15 user nova-compute[74743]:     <timer name='pit' tickpolicy='delay'/>
Nov 18 17:11:15 user nova-compute[74743]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 18 17:11:15 user nova-compute[74743]:     <timer name='hpet' present='no'/>
Nov 18 17:11:15 user nova-compute[74743]:   </clock>
Nov 18 17:11:15 user nova-compute[74743]:   <on_poweroff>destroy</on_poweroff>
Nov 18 17:11:15 user nova-compute[74743]:   <on_reboot>restart</on_reboot>
Nov 18 17:11:15 user nova-compute[74743]:   <on_crash>destroy</on_crash>
Nov 18 17:11:15 user nova-compute[74743]:   <devices>
Nov 18 17:11:15 user nova-compute[74743]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 18 17:11:15 user nova-compute[74743]:     <disk type='file' device='disk'>
Nov 18 17:11:15 user nova-compute[74743]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 18 17:11:15 user nova-compute[74743]:       <source file='/opt/stack/data/nova/instances/e2b51739-7900-47bd-a01e-2e83e2f13ae1/disk' index='2'/>
Nov 18 17:11:15 user nova-compute[74743]:       <backingStore type='file' index='3'>
Nov 18 17:11:15 user nova-compute[74743]:         <format type='raw'/>
Nov 18 17:11:15 user nova-compute[74743]:         <source file='/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9'/>
Nov 18 17:11:15 user nova-compute[74743]:         <backingStore/>
Nov 18 17:11:15 user nova-compute[74743]:       </backingStore>
Nov 18 17:11:15 user nova-compute[74743]:       <target dev='vda' bus='virtio'/>
Nov 18 17:11:15 user nova-compute[74743]:       <alias name='virtio-disk0'/>
Nov 18 17:11:15 user nova-compute[74743]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 18 17:11:15 user nova-compute[74743]:     </disk>
Nov 18 17:11:15 user nova-compute[74743]:     <disk type='file' device='cdrom'>
Nov 18 17:11:15 user nova-compute[74743]:       <driver name='qemu' type='raw' cache='none'/>
Nov 18 17:11:15 user nova-compute[74743]:       <source file='/opt/stack/data/nova/instances/e2b51739-7900-47bd-a01e-2e83e2f13ae1/disk.config' index='1'/>
Nov 18 17:11:15 user nova-compute[74743]:       <backingStore/>
Nov 18 17:11:15 user nova-compute[74743]:       <target dev='hda' bus='ide'/>
Nov 18 17:11:15 user nova-compute[74743]:       <readonly/>
Nov 18 17:11:15 user nova-compute[74743]:       <alias name='ide0-0-0'/>
Nov 18 17:11:15 user nova-compute[74743]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 18 17:11:15 user nova-compute[74743]:     </disk>
Nov 18 17:11:15 user nova-compute[74743]:     <controller type='usb' index='0' model='none'>
Nov 18 17:11:15 user nova-compute[74743]:       <alias name='usb'/>
Nov 18 17:11:15 user nova-compute[74743]:     </controller>
Nov 18 17:11:15 user nova-compute[74743]:     <controller type='pci' index='0' model='pci-root'>
Nov 18 17:11:15 user nova-compute[74743]:       <alias name='pci.0'/>
Nov 18 17:11:15 user nova-compute[74743]:     </controller>
Nov 18 17:11:15 user nova-compute[74743]:     <controller type='ide' index='0'>
Nov 18 17:11:15 user nova-compute[74743]:       <alias name='ide'/>
Nov 18 17:11:15 user nova-compute[74743]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 18 17:11:15 user nova-compute[74743]:     </controller>
Nov 18 17:11:15 user nova-compute[74743]:     <interface type='ethernet'>
Nov 18 17:11:15 user nova-compute[74743]:       <mac address='fa:16:3e:2d:fd:f9'/>
Nov 18 17:11:15 user nova-compute[74743]:       <target dev='tap14c7e1ef-59'/>
Nov 18 17:11:15 user nova-compute[74743]:       <model type='virtio'/>
Nov 18 17:11:15 user nova-compute[74743]:       <mtu size='1442'/>
Nov 18 17:11:15 user nova-compute[74743]:       <alias name='net0'/>
Nov 18 17:11:15 user nova-compute[74743]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 18 17:11:15 user nova-compute[74743]:     </interface>
Nov 18 17:11:15 user nova-compute[74743]:     <serial type='pty'>
Nov 18 17:11:15 user nova-compute[74743]:       <source path='/dev/pts/8'/>
Nov 18 17:11:15 user nova-compute[74743]:       <log file='/opt/stack/data/nova/instances/e2b51739-7900-47bd-a01e-2e83e2f13ae1/console.log' append='off'/>
Nov 18 17:11:15 user nova-compute[74743]:       <target type='isa-serial' port='0'>
Nov 18 17:11:15 user nova-compute[74743]:         <model name='isa-serial'/>
Nov 18 17:11:15 user nova-compute[74743]:       </target>
Nov 18 17:11:15 user nova-compute[74743]:       <alias name='serial0'/>
Nov 18 17:11:15 user nova-compute[74743]:     </serial>
Nov 18 17:11:15 user nova-compute[74743]:     <console type='pty' tty='/dev/pts/8'>
Nov 18 17:11:15 user nova-compute[74743]:       <source path='/dev/pts/8'/>
Nov 18 17:11:15 user nova-compute[74743]:       <log file='/opt/stack/data/nova/instances/e2b51739-7900-47bd-a01e-2e83e2f13ae1/console.log' append='off'/>
Nov 18 17:11:15 user nova-compute[74743]:       <target type='serial' port='0'/>
Nov 18 17:11:15 user nova-compute[74743]:       <alias name='serial0'/>
Nov 18 17:11:15 user nova-compute[74743]:     </console>
Nov 18 17:11:15 user nova-compute[74743]:     <input type='mouse' bus='ps2'>
Nov 18 17:11:15 user nova-compute[74743]:       <alias name='input0'/>
Nov 18 17:11:15 user nova-compute[74743]:     </input>
Nov 18 17:11:15 user nova-compute[74743]:     <input type='keyboard' bus='ps2'>
Nov 18 17:11:15 user nova-compute[74743]:       <alias name='input1'/>
Nov 18 17:11:15 user nova-compute[74743]:     </input>
Nov 18 17:11:15 user nova-compute[74743]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Nov 18 17:11:15 user nova-compute[74743]:       <listen type='address' address='0.0.0.0'/>
Nov 18 17:11:15 user nova-compute[74743]:     </graphics>
Nov 18 17:11:15 user nova-compute[74743]:     <audio id='1' type='none'/>
Nov 18 17:11:15 user nova-compute[74743]:     <video>
Nov 18 17:11:15 user nova-compute[74743]:       <model type='virtio' heads='1' primary='yes'/>
Nov 18 17:11:15 user nova-compute[74743]:       <alias name='video0'/>
Nov 18 17:11:15 user nova-compute[74743]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 18 17:11:15 user nova-compute[74743]:     </video>
Nov 18 17:11:15 user nova-compute[74743]:     <memballoon model='virtio'>
Nov 18 17:11:15 user nova-compute[74743]:       <stats period='10'/>
Nov 18 17:11:15 user nova-compute[74743]:       <alias name='balloon0'/>
Nov 18 17:11:15 user nova-compute[74743]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 18 17:11:15 user nova-compute[74743]:     </memballoon>
Nov 18 17:11:15 user nova-compute[74743]:     <rng model='virtio'>
Nov 18 17:11:15 user nova-compute[74743]:       <backend model='random'>/dev/urandom</backend>
Nov 18 17:11:15 user nova-compute[74743]:       <alias name='rng0'/>
Nov 18 17:11:15 user nova-compute[74743]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 18 17:11:15 user nova-compute[74743]:     </rng>
Nov 18 17:11:15 user nova-compute[74743]:   </devices>
Nov 18 17:11:15 user nova-compute[74743]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 18 17:11:15 user nova-compute[74743]:     <label>libvirt-e2b51739-7900-47bd-a01e-2e83e2f13ae1</label>
Nov 18 17:11:15 user nova-compute[74743]:     <imagelabel>libvirt-e2b51739-7900-47bd-a01e-2e83e2f13ae1</imagelabel>
Nov 18 17:11:15 user nova-compute[74743]:   </seclabel>
Nov 18 17:11:15 user nova-compute[74743]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 18 17:11:15 user nova-compute[74743]:     <label>+64055:+108</label>
Nov 18 17:11:15 user nova-compute[74743]:     <imagelabel>+64055:+108</imagelabel>
Nov 18 17:11:15 user nova-compute[74743]:   </seclabel>
Nov 18 17:11:15 user nova-compute[74743]: </domain>
Nov 18 17:11:15 user nova-compute[74743]:  {{(pid=74743) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 18 17:11:15 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [req-f4cd47b9-e5c5-4b11-9cd2-8b526eb55b4d req-42f5bd88-a941-42f8-b3e0-7a45a8e6c841 service nova] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Detaching interface fa:16:3e:a1:76:11 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap4476b532-0c' not found.
Nov 18 17:11:15 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [req-f4cd47b9-e5c5-4b11-9cd2-8b526eb55b4d req-42f5bd88-a941-42f8-b3e0-7a45a8e6c841 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T17:08:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-411956172',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-411956172',id=19,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIsbQN9tS0qcOOC8WPSSYsTCVNWYWYH/K8oXwrg2jt5ZqyybStsLpAIghGB8s0OC3gX9C23pdQMdiUELbHV4Nj+tyYgRoCwRrAGlWKX/+zFnGGmym65cFn63wRBKph/3bw==',key_name='tempest-keypair-1379891500',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:08:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c15d7007a99745f1a308b64514566129',ramdisk_id='',reservation_id='r-xbgsfk5e',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1465741228',owner_user_name='tempest-TaggedAttachmentsTest-1465741228-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:08:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb774fdb80ef465187caf4ffd2422e83',uuid=e2b51739-7900-47bd-a01e-2e83e2f13ae1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4476b532-0c9f-4fef-aeb3-0c2b048c16b1", "address": "fa:16:3e:a1:76:11", "network": {"id": "5a3f7ae2-082b-4f43-b911-8567500c22bf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-410755460", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c15d7007a99745f1a308b64514566129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4476b532-0c", "ovs_interfaceid": "4476b532-0c9f-4fef-aeb3-0c2b048c16b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:11:15 user nova-compute[74743]: DEBUG nova.network.os_vif_util [req-f4cd47b9-e5c5-4b11-9cd2-8b526eb55b4d req-42f5bd88-a941-42f8-b3e0-7a45a8e6c841 service nova] Converting VIF {"id": "4476b532-0c9f-4fef-aeb3-0c2b048c16b1", "address": "fa:16:3e:a1:76:11", "network": {"id": "5a3f7ae2-082b-4f43-b911-8567500c22bf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-410755460", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c15d7007a99745f1a308b64514566129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4476b532-0c", "ovs_interfaceid": "4476b532-0c9f-4fef-aeb3-0c2b048c16b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:11:15 user nova-compute[74743]: DEBUG nova.network.os_vif_util [req-f4cd47b9-e5c5-4b11-9cd2-8b526eb55b4d req-42f5bd88-a941-42f8-b3e0-7a45a8e6c841 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:76:11,bridge_name='br-int',has_traffic_filtering=True,id=4476b532-0c9f-4fef-aeb3-0c2b048c16b1,network=Network(5a3f7ae2-082b-4f43-b911-8567500c22bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4476b532-0c') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:11:15 user nova-compute[74743]: DEBUG os_vif [req-f4cd47b9-e5c5-4b11-9cd2-8b526eb55b4d req-42f5bd88-a941-42f8-b3e0-7a45a8e6c841 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:76:11,bridge_name='br-int',has_traffic_filtering=True,id=4476b532-0c9f-4fef-aeb3-0c2b048c16b1,network=Network(5a3f7ae2-082b-4f43-b911-8567500c22bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4476b532-0c') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:11:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4476b532-0c, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:11:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:11:15 user nova-compute[74743]: INFO os_vif [req-f4cd47b9-e5c5-4b11-9cd2-8b526eb55b4d req-42f5bd88-a941-42f8-b3e0-7a45a8e6c841 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:76:11,bridge_name='br-int',has_traffic_filtering=True,id=4476b532-0c9f-4fef-aeb3-0c2b048c16b1,network=Network(5a3f7ae2-082b-4f43-b911-8567500c22bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4476b532-0c')
Nov 18 17:11:15 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [req-f4cd47b9-e5c5-4b11-9cd2-8b526eb55b4d req-42f5bd88-a941-42f8-b3e0-7a45a8e6c841 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:11:15 user nova-compute[74743]:   <nova:package version="0.0.0"/>
Nov 18 17:11:15 user nova-compute[74743]:   <nova:name>tempest-device-tagging-server-411956172</nova:name>
Nov 18 17:11:15 user nova-compute[74743]:   <nova:creationTime>2023-11-18 17:11:15</nova:creationTime>
Nov 18 17:11:15 user nova-compute[74743]:   <nova:flavor name="m1.tiny">
Nov 18 17:11:15 user nova-compute[74743]:     <nova:memory>512</nova:memory>
Nov 18 17:11:15 user nova-compute[74743]:     <nova:disk>1</nova:disk>
Nov 18 17:11:15 user nova-compute[74743]:     <nova:swap>0</nova:swap>
Nov 18 17:11:15 user nova-compute[74743]:     <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:11:15 user nova-compute[74743]:     <nova:vcpus>1</nova:vcpus>
Nov 18 17:11:15 user nova-compute[74743]:   </nova:flavor>
Nov 18 17:11:15 user nova-compute[74743]:   <nova:owner>
Nov 18 17:11:15 user nova-compute[74743]:     <nova:user uuid="eb774fdb80ef465187caf4ffd2422e83">tempest-TaggedAttachmentsTest-1465741228-project-member</nova:user>
Nov 18 17:11:15 user nova-compute[74743]:     <nova:project uuid="c15d7007a99745f1a308b64514566129">tempest-TaggedAttachmentsTest-1465741228</nova:project>
Nov 18 17:11:15 user nova-compute[74743]:   </nova:owner>
Nov 18 17:11:15 user nova-compute[74743]:   <nova:root type="image" uuid="9536f6cf-95c4-40e2-864a-09a91525678a"/>
Nov 18 17:11:15 user nova-compute[74743]:   <nova:ports>
Nov 18 17:11:15 user nova-compute[74743]:     <nova:port uuid="14c7e1ef-5997-4e7f-aebf-baa01bec87a6">
Nov 18 17:11:15 user nova-compute[74743]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 18 17:11:15 user nova-compute[74743]:     </nova:port>
Nov 18 17:11:15 user nova-compute[74743]:   </nova:ports>
Nov 18 17:11:15 user nova-compute[74743]: </nova:instance>
Nov 18 17:11:15 user nova-compute[74743]:  {{(pid=74743) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 18 17:11:16 user nova-compute[74743]: DEBUG nova.network.neutron [None req-11e4f2e6-c40a-4042-b4d2-a382866bc2c1 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Updating instance_info_cache with network_info: [{"id": "14c7e1ef-5997-4e7f-aebf-baa01bec87a6", "address": "fa:16:3e:2d:fd:f9", "network": {"id": "f6455510-3862-45cf-b6d7-7d92905b0554", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-6755490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c15d7007a99745f1a308b64514566129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c7e1ef-59", "ovs_interfaceid": "14c7e1ef-5997-4e7f-aebf-baa01bec87a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:11:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-11e4f2e6-c40a-4042-b4d2-a382866bc2c1 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Releasing lock "refresh_cache-e2b51739-7900-47bd-a01e-2e83e2f13ae1" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:11:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-11e4f2e6-c40a-4042-b4d2-a382866bc2c1 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Lock "interface-e2b51739-7900-47bd-a01e-2e83e2f13ae1-4476b532-0c9f-4fef-aeb3-0c2b048c16b1" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.710s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:11:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:23 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:24 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:24 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:11:24 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:11:24 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:11:25 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Starting heal instance info cache {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 17:11:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "refresh_cache-c006a4ad-a8e2-4108-9af1-dec4dd53fcda" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:11:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquired lock "refresh_cache-c006a4ad-a8e2-4108-9af1-dec4dd53fcda" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:11:25 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Forcefully refreshing network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 17:11:25 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Updating instance_info_cache with network_info: [{"id": "999980cf-efd0-4b78-aa42-f4e80073b5a9", "address": "fa:16:3e:e4:7e:f3", "network": {"id": "fd98f398-6576-449b-a737-887906eb6656", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668610993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb8f5850162c479b8d185e48c03be7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap999980cf-ef", "ovs_interfaceid": "999980cf-efd0-4b78-aa42-f4e80073b5a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:11:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Releasing lock "refresh_cache-c006a4ad-a8e2-4108-9af1-dec4dd53fcda" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:11:25 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Updated the network info_cache for instance {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 17:11:25 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:11:25 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:11:25 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:11:25 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:11:25 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:11:25 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:11:25 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74743) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 17:11:25 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:11:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:11:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:11:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:11:25 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Auditing locally available compute resources for user (node: user) {{(pid=74743) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 17:11:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f93bf0ac-ecc8-447d-b9c1-381d36cd3135/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f93bf0ac-ecc8-447d-b9c1-381d36cd3135/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f93bf0ac-ecc8-447d-b9c1-381d36cd3135/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f93bf0ac-ecc8-447d-b9c1-381d36cd3135/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad8aa2d-663c-4829-87f9-07959105ca68/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad8aa2d-663c-4829-87f9-07959105ca68/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad8aa2d-663c-4829-87f9-07959105ca68/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-dafe53e8-df47-4841-b87d-e674666b2252 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Acquiring lock "49ebdd5a-824d-476a-bd10-3b891bbfe9e2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:11:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-dafe53e8-df47-4841-b87d-e674666b2252 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Lock "49ebdd5a-824d-476a-bd10-3b891bbfe9e2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:11:28 user nova-compute[74743]: DEBUG nova.objects.instance [None req-dafe53e8-df47-4841-b87d-e674666b2252 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Lazy-loading 'flavor' on Instance uuid 49ebdd5a-824d-476a-bd10-3b891bbfe9e2 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:11:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-dafe53e8-df47-4841-b87d-e674666b2252 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Lock "49ebdd5a-824d-476a-bd10-3b891bbfe9e2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:11:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad8aa2d-663c-4829-87f9-07959105ca68/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77117a2-748d-4a39-8db7-8b965a1725fc/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-dafe53e8-df47-4841-b87d-e674666b2252 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Acquiring lock "49ebdd5a-824d-476a-bd10-3b891bbfe9e2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:11:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-dafe53e8-df47-4841-b87d-e674666b2252 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Lock "49ebdd5a-824d-476a-bd10-3b891bbfe9e2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:11:28 user nova-compute[74743]: INFO nova.compute.manager [None req-dafe53e8-df47-4841-b87d-e674666b2252 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Attaching volume 37e6161c-f450-4fe5-910c-e369f18f48d5 to /dev/vdb
Nov 18 17:11:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77117a2-748d-4a39-8db7-8b965a1725fc/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77117a2-748d-4a39-8db7-8b965a1725fc/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:28 user nova-compute[74743]: DEBUG os_brick.utils [None req-dafe53e8-df47-4841-b87d-e674666b2252 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:11:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:28 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b09e45b-8eca-49e0-b305-2f8cae86b0d6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1116acd8874d\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:28 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e379dc-76e5-41d8-a7a8-4b3c384376dd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:28 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ad19df-4ac4-4dbb-a981-8fc765595042]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:28 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[456065d8-dfc8-4053-b728-0ad3acb7d44d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-dafe53e8-df47-4841-b87d-e674666b2252 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Running cmd (subprocess): nvme version {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-dafe53e8-df47-4841-b87d-e674666b2252 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] 'nvme version' failed. Not Retrying. {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:11:28 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dafe53e8-df47-4841-b87d-e674666b2252 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] nvme not present on system {{(pid=74743) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 17:11:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77117a2-748d-4a39-8db7-8b965a1725fc/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:28 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:11:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:11:28 user nova-compute[74743]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 17:11:28 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0eb271c-74c9-41c1-aa47-d1b8779ac9ea]: (4, '') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:28 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-dafe53e8-df47-4841-b87d-e674666b2252 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74743) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 17:11:28 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-dafe53e8-df47-4841-b87d-e674666b2252 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 17:11:28 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-dafe53e8-df47-4841-b87d-e674666b2252 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] LIGHTOS: no hostnqn found. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 17:11:28 user nova-compute[74743]: DEBUG os_brick.utils [None req-dafe53e8-df47-4841-b87d-e674666b2252 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1116acd8874d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:11:28 user nova-compute[74743]: DEBUG nova.virt.block_device [None req-dafe53e8-df47-4841-b87d-e674666b2252 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Updating existing volume attachment record: 80d47f5f-381a-482f-ba38-c1fedc5aa81c {{(pid=74743) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 17:11:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b51739-7900-47bd-a01e-2e83e2f13ae1/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b51739-7900-47bd-a01e-2e83e2f13ae1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b51739-7900-47bd-a01e-2e83e2f13ae1/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b51739-7900-47bd-a01e-2e83e2f13ae1/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5c74497-1d1c-48a0-9b0a-e7df2a41361c/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5c74497-1d1c-48a0-9b0a-e7df2a41361c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5c74497-1d1c-48a0-9b0a-e7df2a41361c/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5c74497-1d1c-48a0-9b0a-e7df2a41361c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:30 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:11:30 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:11:30 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Hypervisor/Node resource view: name=user free_ram=7237MB free_disk=25.4873046875GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74743) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 17:11:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:11:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:11:30 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 4cce1628-2dcb-40c7-abd4-6a327a432de3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:11:30 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance e9668e1c-1e8d-4dd7-8f58-d453db294557 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:11:30 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance c006a4ad-a8e2-4108-9af1-dec4dd53fcda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:11:30 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance a77117a2-748d-4a39-8db7-8b965a1725fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:11:30 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 49ebdd5a-824d-476a-bd10-3b891bbfe9e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:11:30 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance c5c74497-1d1c-48a0-9b0a-e7df2a41361c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:11:30 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance e2b51739-7900-47bd-a01e-2e83e2f13ae1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:11:30 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 0ad8aa2d-663c-4829-87f9-07959105ca68 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:11:30 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance f93bf0ac-ecc8-447d-b9c1-381d36cd3135 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:11:30 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:11:30 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance aefe3db1-b9bb-4cce-aa31-d0b6684ad791 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:11:30 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 17:11:30 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 17:11:31 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:11:31 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:11:31 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Compute_service record updated for user:user {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 17:11:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.485s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dafe53e8-df47-4841-b87d-e674666b2252 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Calling os-brick to attach iSCSI Volume {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafe53e8-df47-4841-b87d-e674666b2252 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RWDmrpXN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:11:34 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-dafe53e8-df47-4841-b87d-e674666b2252 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:11:34 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-dafe53e8-df47-4841-b87d-e674666b2252 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-dafe53e8-df47-4841-b87d-e674666b2252 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:11:34 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-dafe53e8-df47-4841-b87d-e674666b2252 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:11:34 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-dafe53e8-df47-4841-b87d-e674666b2252 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-dafe53e8-df47-4841-b87d-e674666b2252 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:11:34 user nova-compute[74743]: INFO os_brick.initiator.connectors.iscsi [None req-dafe53e8-df47-4841-b87d-e674666b2252 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 17:11:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[568b623c-4b4a-4f17-b1cb-ac4c97c2fd34]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafe53e8-df47-4841-b87d-e674666b2252 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 17:11:34 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[735f0fc2-43cd-4151-9ad1-37bbe13ced5a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5] added\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafe53e8-df47-4841-b87d-e674666b2252 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5] added
Nov 18 17:11:34 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d0be5a-60c1-4db6-bc12-bbbb0c449765]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafe53e8-df47-4841-b87d-e674666b2252 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2558ed-7e9b-4235-8f1a-34097b46b84e]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafe53e8-df47-4841-b87d-e674666b2252 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RWDmrpXN {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RWDmrpXN" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbaaf531-03f8-4faf-919c-fe4f06d82b0a]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafe53e8-df47-4841-b87d-e674666b2252 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RWDmrpXN'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[387355d5-fc42-4e9d-a9bf-b3dde149e077]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafe53e8-df47-4841-b87d-e674666b2252 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37cb678-691a-4209-b9f8-4289682a4d05]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafe53e8-df47-4841-b87d-e674666b2252 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)
Nov 18 17:11:34 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafe53e8-df47-4841-b87d-e674666b2252 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)
Nov 18 17:11:34 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --login {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[893ec8c3-9f0d-4ed2-97a4-b4bae77c20d7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafe53e8-df47-4841-b87d-e674666b2252 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5, portal: 172.16.0.220,3260]
Nov 18 17:11:34 user nova-compute[74743]: Login to [iface: default, target: iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5, portal: 172.16.0.220,3260] successful.
Nov 18 17:11:34 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6bd597-1d43-4048-9d96-491e9102e9f3]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafe53e8-df47-4841-b87d-e674666b2252 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[916ece66-51c4-46e2-9f15-ce80f93ed40a]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafe53e8-df47-4841-b87d-e674666b2252 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)
Nov 18 17:11:34 user nova-compute[74743]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:11:34 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafe53e8-df47-4841-b87d-e674666b2252 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)
Nov 18 17:11:34 user nova-compute[74743]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:11:34 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-dafe53e8-df47-4841-b87d-e674666b2252 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafe53e8-df47-4841-b87d-e674666b2252 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Connected to 172.16.0.220:3260 {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-dafe53e8-df47-4841-b87d-e674666b2252 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] HCTL ('33', '-', '-', 0) found on session 26 with lun 0 {{(pid=74743) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-dafe53e8-df47-4841-b87d-e674666b2252 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74743) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5e96ea-d2e4-4954-be7a-ee5d0a90da52]: (4, ('- - 0', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-dafe53e8-df47-4841-b87d-e674666b2252 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafe53e8-df47-4841-b87d-e674666b2252 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RWDmrpXN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74743) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:11:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:35 user nova-compute[74743]: DEBUG nova.compute.manager [req-f8fcac7b-ecb8-4e8f-98b1-a8d29893a37e req-8f5a6f81-a2d5-46b8-9bf0-03699584b1c2 service nova] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Received event network-changed-b307c7c0-aa55-4210-8e16-08b1cee78b4a {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:11:35 user nova-compute[74743]: DEBUG nova.compute.manager [req-f8fcac7b-ecb8-4e8f-98b1-a8d29893a37e req-8f5a6f81-a2d5-46b8-9bf0-03699584b1c2 service nova] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Refreshing instance network info cache due to event network-changed-b307c7c0-aa55-4210-8e16-08b1cee78b4a. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:11:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f8fcac7b-ecb8-4e8f-98b1-a8d29893a37e req-8f5a6f81-a2d5-46b8-9bf0-03699584b1c2 service nova] Acquiring lock "refresh_cache-f93bf0ac-ecc8-447d-b9c1-381d36cd3135" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:11:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f8fcac7b-ecb8-4e8f-98b1-a8d29893a37e req-8f5a6f81-a2d5-46b8-9bf0-03699584b1c2 service nova] Acquired lock "refresh_cache-f93bf0ac-ecc8-447d-b9c1-381d36cd3135" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:11:35 user nova-compute[74743]: DEBUG nova.network.neutron [req-f8fcac7b-ecb8-4e8f-98b1-a8d29893a37e req-8f5a6f81-a2d5-46b8-9bf0-03699584b1c2 service nova] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Refreshing network info cache for port b307c7c0-aa55-4210-8e16-08b1cee78b4a {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:11:35 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-dafe53e8-df47-4841-b87d-e674666b2252 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:11:35 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafe53e8-df47-4841-b87d-e674666b2252 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23961366339306534', 'path': '/dev/sdb'} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:11:35 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dafe53e8-df47-4841-b87d-e674666b2252 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961366339306534', 'path': '/dev/sdb'} {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 17:11:35 user nova-compute[74743]: DEBUG nova.objects.instance [None req-dafe53e8-df47-4841-b87d-e674666b2252 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Lazy-loading 'flavor' on Instance uuid 49ebdd5a-824d-476a-bd10-3b891bbfe9e2 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:11:35 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-dafe53e8-df47-4841-b87d-e674666b2252 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 17:11:35 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:11:35 user nova-compute[74743]:   <source dev="/dev/sdb"/>
Nov 18 17:11:35 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:11:35 user nova-compute[74743]:   <serial>37e6161c-f450-4fe5-910c-e369f18f48d5</serial>
Nov 18 17:11:35 user nova-compute[74743]: </disk>
Nov 18 17:11:35 user nova-compute[74743]:  {{(pid=74743) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 17:11:35 user nova-compute[74743]: DEBUG nova.network.neutron [req-f8fcac7b-ecb8-4e8f-98b1-a8d29893a37e req-8f5a6f81-a2d5-46b8-9bf0-03699584b1c2 service nova] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Updated VIF entry in instance network info cache for port b307c7c0-aa55-4210-8e16-08b1cee78b4a. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:11:35 user nova-compute[74743]: DEBUG nova.network.neutron [req-f8fcac7b-ecb8-4e8f-98b1-a8d29893a37e req-8f5a6f81-a2d5-46b8-9bf0-03699584b1c2 service nova] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Updating instance_info_cache with network_info: [{"id": "b307c7c0-aa55-4210-8e16-08b1cee78b4a", "address": "fa:16:3e:f3:91:b0", "network": {"id": "45fa6343-75cf-4308-937b-cddd9ca6b63f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1561993253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5705e5d6831a4d4dab6ae482e0ca1013", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb307c7c0-aa", "ovs_interfaceid": "b307c7c0-aa55-4210-8e16-08b1cee78b4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:11:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f8fcac7b-ecb8-4e8f-98b1-a8d29893a37e req-8f5a6f81-a2d5-46b8-9bf0-03699584b1c2 service nova] Releasing lock "refresh_cache-f93bf0ac-ecc8-447d-b9c1-381d36cd3135" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:11:36 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-dafe53e8-df47-4841-b87d-e674666b2252 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:11:36 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-dafe53e8-df47-4841-b87d-e674666b2252 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:11:36 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-dafe53e8-df47-4841-b87d-e674666b2252 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] No VIF found with MAC fa:16:3e:f3:3d:ca, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:11:36 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-dafe53e8-df47-4841-b87d-e674666b2252 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Lock "49ebdd5a-824d-476a-bd10-3b891bbfe9e2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.630s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:11:36 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Acquiring lock "180f2f7e-9df5-480f-adde-d8e10ee14b07" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:11:36 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "180f2f7e-9df5-480f-adde-d8e10ee14b07" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:11:36 user nova-compute[74743]: DEBUG nova.compute.manager [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Starting instance... {{(pid=74743) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 17:11:36 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:11:36 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:11:36 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74743) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 17:11:36 user nova-compute[74743]: INFO nova.compute.claims [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Claim successful on node user
Nov 18 17:11:36 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:11:36 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:11:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.419s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:11:37 user nova-compute[74743]: DEBUG nova.compute.manager [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Start building networks asynchronously for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 17:11:37 user nova-compute[74743]: DEBUG nova.compute.manager [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Allocating IP information in the background. {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 17:11:37 user nova-compute[74743]: DEBUG nova.network.neutron [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] allocate_for_instance() {{(pid=74743) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 17:11:37 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 17:11:37 user nova-compute[74743]: DEBUG nova.compute.manager [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Start building block device mappings for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 17:11:37 user nova-compute[74743]: DEBUG nova.policy [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '351aa457efdc463b95a4c837d26cd23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4468d0e7ff32423091ecc55d82deba1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74743) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 17:11:37 user nova-compute[74743]: DEBUG nova.compute.manager [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Start spawning the instance on the hypervisor. {{(pid=74743) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 17:11:37 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Creating instance directory {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 17:11:37 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Creating image(s)
Nov 18 17:11:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Acquiring lock "/opt/stack/data/nova/instances/180f2f7e-9df5-480f-adde-d8e10ee14b07/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:11:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "/opt/stack/data/nova/instances/180f2f7e-9df5-480f-adde-d8e10ee14b07/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:11:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "/opt/stack/data/nova/instances/180f2f7e-9df5-480f-adde-d8e10ee14b07/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:11:37 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:37 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.181s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Acquiring lock "c188b3a997bfafa42fa341f9dcc326545681eed9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:11:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:11:37 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:37 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.169s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:37 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/180f2f7e-9df5-480f-adde-d8e10ee14b07/disk 1073741824 {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:37 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/180f2f7e-9df5-480f-adde-d8e10ee14b07/disk 1073741824" returned: 0 in 0.050s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:11:37 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:37 user nova-compute[74743]: DEBUG nova.network.neutron [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Successfully created port: ba661621-6683-462f-ba90-5de9da77c1a3 {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:11:37 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.177s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:37 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Checking if we can resize image /opt/stack/data/nova/instances/180f2f7e-9df5-480f-adde-d8e10ee14b07/disk. size=1073741824 {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 17:11:37 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/180f2f7e-9df5-480f-adde-d8e10ee14b07/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/180f2f7e-9df5-480f-adde-d8e10ee14b07/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:38 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Cannot resize image /opt/stack/data/nova/instances/180f2f7e-9df5-480f-adde-d8e10ee14b07/disk to a smaller size. {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 17:11:38 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Created local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 17:11:38 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Ensure instance console log exists: /opt/stack/data/nova/instances/180f2f7e-9df5-480f-adde-d8e10ee14b07/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:11:38 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:11:38 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:11:38 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:11:38 user nova-compute[74743]: DEBUG nova.network.neutron [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Successfully updated port: ba661621-6683-462f-ba90-5de9da77c1a3 {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:11:38 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Acquiring lock "refresh_cache-180f2f7e-9df5-480f-adde-d8e10ee14b07" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:11:38 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Acquired lock "refresh_cache-180f2f7e-9df5-480f-adde-d8e10ee14b07" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:11:38 user nova-compute[74743]: DEBUG nova.network.neutron [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:11:38 user nova-compute[74743]: DEBUG nova.compute.manager [req-fb461bf1-6fc7-4e2c-99ab-67dbe6399d6a req-4cd14064-4791-4c8b-a903-c44ac25b07f2 service nova] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Received event network-changed-ba661621-6683-462f-ba90-5de9da77c1a3 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:11:38 user nova-compute[74743]: DEBUG nova.compute.manager [req-fb461bf1-6fc7-4e2c-99ab-67dbe6399d6a req-4cd14064-4791-4c8b-a903-c44ac25b07f2 service nova] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Refreshing instance network info cache due to event network-changed-ba661621-6683-462f-ba90-5de9da77c1a3. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:11:38 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-fb461bf1-6fc7-4e2c-99ab-67dbe6399d6a req-4cd14064-4791-4c8b-a903-c44ac25b07f2 service nova] Acquiring lock "refresh_cache-180f2f7e-9df5-480f-adde-d8e10ee14b07" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:11:38 user nova-compute[74743]: DEBUG nova.network.neutron [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:11:38 user nova-compute[74743]: DEBUG nova.compute.manager [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Stashing vm_state: active {{(pid=74743) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 18 17:11:38 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:11:38 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:11:38 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74743) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 17:11:38 user nova-compute[74743]: INFO nova.compute.claims [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Claim successful on node user
Nov 18 17:11:38 user nova-compute[74743]: DEBUG nova.network.neutron [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Updating instance_info_cache with network_info: [{"id": "ba661621-6683-462f-ba90-5de9da77c1a3", "address": "fa:16:3e:4a:ca:b3", "network": {"id": "2588909e-8504-407d-bc7b-5d1f3d978395", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1712970821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468d0e7ff32423091ecc55d82deba1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba661621-66", "ovs_interfaceid": "ba661621-6683-462f-ba90-5de9da77c1a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:11:38 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Releasing lock "refresh_cache-180f2f7e-9df5-480f-adde-d8e10ee14b07" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:11:38 user nova-compute[74743]: DEBUG nova.compute.manager [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Instance network_info: |[{"id": "ba661621-6683-462f-ba90-5de9da77c1a3", "address": "fa:16:3e:4a:ca:b3", "network": {"id": "2588909e-8504-407d-bc7b-5d1f3d978395", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1712970821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468d0e7ff32423091ecc55d82deba1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba661621-66", "ovs_interfaceid": "ba661621-6683-462f-ba90-5de9da77c1a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 17:11:38 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-fb461bf1-6fc7-4e2c-99ab-67dbe6399d6a req-4cd14064-4791-4c8b-a903-c44ac25b07f2 service nova] Acquired lock "refresh_cache-180f2f7e-9df5-480f-adde-d8e10ee14b07" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:11:38 user nova-compute[74743]: DEBUG nova.network.neutron [req-fb461bf1-6fc7-4e2c-99ab-67dbe6399d6a req-4cd14064-4791-4c8b-a903-c44ac25b07f2 service nova] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Refreshing network info cache for port ba661621-6683-462f-ba90-5de9da77c1a3 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:11:38 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Start _get_guest_xml network_info=[{"id": "ba661621-6683-462f-ba90-5de9da77c1a3", "address": "fa:16:3e:4a:ca:b3", "network": {"id": "2588909e-8504-407d-bc7b-5d1f3d978395", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1712970821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468d0e7ff32423091ecc55d82deba1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba661621-66", "ovs_interfaceid": "ba661621-6683-462f-ba90-5de9da77c1a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '9536f6cf-95c4-40e2-864a-09a91525678a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:11:38 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:11:38 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:11:38 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:11:38 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:11:38 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:11:38 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:11:38 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:11:38 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:11:38 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:11:38 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:11:38 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:11:38 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:11:38 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:11:38 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:11:38 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:11:38 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:11:38 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:11:38 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:11:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-734211408',display_name='tempest-VolumesSnapshotTestJSON-instance-734211408',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-734211408',id=25,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlAxUA0RbCbI8SGx7xgkWEg4DLVYjb03OqLFipKjYIXFH34rBAR7hCH4LKdisTnMhSc91fec7waeCXYKiCo05BCIDtkfDC18gGGtJJui/2LUNRPFqxQSGXhkQMXSnh55Q==',key_name='tempest-keypair-849319058',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4468d0e7ff32423091ecc55d82deba1c',ramdisk_id='',reservation_id='r-mg9uhpwj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1394839673',owner_user_name='tempest-VolumesSnapshotTestJSON-1394839673-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:11:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='351aa457efdc463b95a4c837d26cd23f',uuid=180f2f7e-9df5-480f-adde-d8e10ee14b07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba661621-6683-462f-ba90-5de9da77c1a3", "address": "fa:16:3e:4a:ca:b3", "network": {"id": "2588909e-8504-407d-bc7b-5d1f3d978395", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1712970821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468d0e7ff32423091ecc55d82deba1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba661621-66", "ovs_interfaceid": "ba661621-6683-462f-ba90-5de9da77c1a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Converting VIF {"id": "ba661621-6683-462f-ba90-5de9da77c1a3", "address": "fa:16:3e:4a:ca:b3", "network": {"id": "2588909e-8504-407d-bc7b-5d1f3d978395", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1712970821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468d0e7ff32423091ecc55d82deba1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba661621-66", "ovs_interfaceid": "ba661621-6683-462f-ba90-5de9da77c1a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:ca:b3,bridge_name='br-int',has_traffic_filtering=True,id=ba661621-6683-462f-ba90-5de9da77c1a3,network=Network(2588909e-8504-407d-bc7b-5d1f3d978395),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba661621-66') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG nova.objects.instance [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lazy-loading 'pci_devices' on Instance uuid 180f2f7e-9df5-480f-adde-d8e10ee14b07 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-37e9bd33-ccd7-4034-aa21-a53eee48f71d tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Acquiring lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-37e9bd33-ccd7-4034-aa21-a53eee48f71d tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:11:39 user nova-compute[74743]:   <uuid>180f2f7e-9df5-480f-adde-d8e10ee14b07</uuid>
Nov 18 17:11:39 user nova-compute[74743]:   <name>instance-00000019</name>
Nov 18 17:11:39 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:11:39 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:11:39 user nova-compute[74743]:   <metadata>
Nov 18 17:11:39 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:11:39 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:11:39 user nova-compute[74743]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-734211408</nova:name>
Nov 18 17:11:39 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:11:38</nova:creationTime>
Nov 18 17:11:39 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:11:39 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:11:39 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:11:39 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:11:39 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:11:39 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:11:39 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:11:39 user nova-compute[74743]:       <nova:owner>
Nov 18 17:11:39 user nova-compute[74743]:         <nova:user uuid="351aa457efdc463b95a4c837d26cd23f">tempest-VolumesSnapshotTestJSON-1394839673-project-member</nova:user>
Nov 18 17:11:39 user nova-compute[74743]:         <nova:project uuid="4468d0e7ff32423091ecc55d82deba1c">tempest-VolumesSnapshotTestJSON-1394839673</nova:project>
Nov 18 17:11:39 user nova-compute[74743]:       </nova:owner>
Nov 18 17:11:39 user nova-compute[74743]:       <nova:root type="image" uuid="9536f6cf-95c4-40e2-864a-09a91525678a"/>
Nov 18 17:11:39 user nova-compute[74743]:       <nova:ports>
Nov 18 17:11:39 user nova-compute[74743]:         <nova:port uuid="ba661621-6683-462f-ba90-5de9da77c1a3">
Nov 18 17:11:39 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 18 17:11:39 user nova-compute[74743]:         </nova:port>
Nov 18 17:11:39 user nova-compute[74743]:       </nova:ports>
Nov 18 17:11:39 user nova-compute[74743]:     </nova:instance>
Nov 18 17:11:39 user nova-compute[74743]:   </metadata>
Nov 18 17:11:39 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:11:39 user nova-compute[74743]:     <system>
Nov 18 17:11:39 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:11:39 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:11:39 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:11:39 user nova-compute[74743]:       <entry name="serial">180f2f7e-9df5-480f-adde-d8e10ee14b07</entry>
Nov 18 17:11:39 user nova-compute[74743]:       <entry name="uuid">180f2f7e-9df5-480f-adde-d8e10ee14b07</entry>
Nov 18 17:11:39 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:11:39 user nova-compute[74743]:     </system>
Nov 18 17:11:39 user nova-compute[74743]:   </sysinfo>
Nov 18 17:11:39 user nova-compute[74743]:   <os>
Nov 18 17:11:39 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:11:39 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:11:39 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:11:39 user nova-compute[74743]:   </os>
Nov 18 17:11:39 user nova-compute[74743]:   <features>
Nov 18 17:11:39 user nova-compute[74743]:     <acpi/>
Nov 18 17:11:39 user nova-compute[74743]:     <apic/>
Nov 18 17:11:39 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:11:39 user nova-compute[74743]:   </features>
Nov 18 17:11:39 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:11:39 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:11:39 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:11:39 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:11:39 user nova-compute[74743]:   </clock>
Nov 18 17:11:39 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:11:39 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:11:39 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:11:39 user nova-compute[74743]:   </cpu>
Nov 18 17:11:39 user nova-compute[74743]:   <devices>
Nov 18 17:11:39 user nova-compute[74743]:     <disk type="file" device="disk">
Nov 18 17:11:39 user nova-compute[74743]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 17:11:39 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/180f2f7e-9df5-480f-adde-d8e10ee14b07/disk"/>
Nov 18 17:11:39 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:11:39 user nova-compute[74743]:     </disk>
Nov 18 17:11:39 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:11:39 user nova-compute[74743]:       <mac address="fa:16:3e:4a:ca:b3"/>
Nov 18 17:11:39 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:11:39 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:11:39 user nova-compute[74743]:       <target dev="tapba661621-66"/>
Nov 18 17:11:39 user nova-compute[74743]:     </interface>
Nov 18 17:11:39 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:11:39 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/180f2f7e-9df5-480f-adde-d8e10ee14b07/console.log" append="off"/>
Nov 18 17:11:39 user nova-compute[74743]:     </serial>
Nov 18 17:11:39 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:11:39 user nova-compute[74743]:     <video>
Nov 18 17:11:39 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:11:39 user nova-compute[74743]:     </video>
Nov 18 17:11:39 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:11:39 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:11:39 user nova-compute[74743]:     </rng>
Nov 18 17:11:39 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:11:39 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:11:39 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:11:39 user nova-compute[74743]:     </memballoon>
Nov 18 17:11:39 user nova-compute[74743]:   </devices>
Nov 18 17:11:39 user nova-compute[74743]: </domain>
Nov 18 17:11:39 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:11:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-734211408',display_name='tempest-VolumesSnapshotTestJSON-instance-734211408',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-734211408',id=25,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlAxUA0RbCbI8SGx7xgkWEg4DLVYjb03OqLFipKjYIXFH34rBAR7hCH4LKdisTnMhSc91fec7waeCXYKiCo05BCIDtkfDC18gGGtJJui/2LUNRPFqxQSGXhkQMXSnh55Q==',key_name='tempest-keypair-849319058',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4468d0e7ff32423091ecc55d82deba1c',ramdisk_id='',reservation_id='r-mg9uhpwj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1394839673',owner_user_name='tempest-VolumesSnapshotTestJSON-1394839673-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:11:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='351aa457efdc463b95a4c837d26cd23f',uuid=180f2f7e-9df5-480f-adde-d8e10ee14b07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba661621-6683-462f-ba90-5de9da77c1a3", "address": "fa:16:3e:4a:ca:b3", "network": {"id": "2588909e-8504-407d-bc7b-5d1f3d978395", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1712970821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468d0e7ff32423091ecc55d82deba1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba661621-66", "ovs_interfaceid": "ba661621-6683-462f-ba90-5de9da77c1a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Converting VIF {"id": "ba661621-6683-462f-ba90-5de9da77c1a3", "address": "fa:16:3e:4a:ca:b3", "network": {"id": "2588909e-8504-407d-bc7b-5d1f3d978395", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1712970821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468d0e7ff32423091ecc55d82deba1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba661621-66", "ovs_interfaceid": "ba661621-6683-462f-ba90-5de9da77c1a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:ca:b3,bridge_name='br-int',has_traffic_filtering=True,id=ba661621-6683-462f-ba90-5de9da77c1a3,network=Network(2588909e-8504-407d-bc7b-5d1f3d978395),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba661621-66') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG os_vif [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:ca:b3,bridge_name='br-int',has_traffic_filtering=True,id=ba661621-6683-462f-ba90-5de9da77c1a3,network=Network(2588909e-8504-407d-bc7b-5d1f3d978395),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba661621-66') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:11:39 user nova-compute[74743]: INFO nova.compute.resource_tracker [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Updating resource usage from migration 5037668c-b927-4d04-8e21-0ec32794efcf
Nov 18 17:11:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '28d8b6d7-35a4-5db4-b456-586e3a57cbe3', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG nova.objects.instance [None req-37e9bd33-ccd7-4034-aa21-a53eee48f71d tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lazy-loading 'flavor' on Instance uuid f93bf0ac-ecc8-447d-b9c1-381d36cd3135 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba661621-66, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapba661621-66, col_values=(('qos', UUID('7a7a5e03-a0e1-4e8e-bb25-39cd68464bfd')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapba661621-66, col_values=(('external_ids', {'iface-id': 'ba661621-6683-462f-ba90-5de9da77c1a3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:ca:b3', 'vm-uuid': '180f2f7e-9df5-480f-adde-d8e10ee14b07'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:39 user nova-compute[74743]: INFO os_vif [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:ca:b3,bridge_name='br-int',has_traffic_filtering=True,id=ba661621-6683-462f-ba90-5de9da77c1a3,network=Network(2588909e-8504-407d-bc7b-5d1f3d978395),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba661621-66')
Nov 18 17:11:39 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-37e9bd33-ccd7-4034-aa21-a53eee48f71d tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.191s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] No VIF found with MAC fa:16:3e:4a:ca:b3, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-37e9bd33-ccd7-4034-aa21-a53eee48f71d tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Acquiring lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-37e9bd33-ccd7-4034-aa21-a53eee48f71d tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:11:39 user nova-compute[74743]: INFO nova.compute.manager [None req-37e9bd33-ccd7-4034-aa21-a53eee48f71d tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Attaching volume cbbc1108-8470-4c44-a28c-c66012ea375e to /dev/vdb
Nov 18 17:11:39 user nova-compute[74743]: DEBUG os_brick.utils [None req-37e9bd33-ccd7-4034-aa21-a53eee48f71d tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf3b46a-05b8-4fff-951a-df538b987844]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1116acd8874d\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG nova.network.neutron [req-fb461bf1-6fc7-4e2c-99ab-67dbe6399d6a req-4cd14064-4791-4c8b-a903-c44ac25b07f2 service nova] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Updated VIF entry in instance network info cache for port ba661621-6683-462f-ba90-5de9da77c1a3. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG nova.network.neutron [req-fb461bf1-6fc7-4e2c-99ab-67dbe6399d6a req-4cd14064-4791-4c8b-a903-c44ac25b07f2 service nova] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Updating instance_info_cache with network_info: [{"id": "ba661621-6683-462f-ba90-5de9da77c1a3", "address": "fa:16:3e:4a:ca:b3", "network": {"id": "2588909e-8504-407d-bc7b-5d1f3d978395", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1712970821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468d0e7ff32423091ecc55d82deba1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba661621-66", "ovs_interfaceid": "ba661621-6683-462f-ba90-5de9da77c1a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e5866d-1317-4b57-bc65-c10619b286a0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-fb461bf1-6fc7-4e2c-99ab-67dbe6399d6a req-4cd14064-4791-4c8b-a903-c44ac25b07f2 service nova] Releasing lock "refresh_cache-180f2f7e-9df5-480f-adde-d8e10ee14b07" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72312cd-cafb-4718-9db8-da03755dfc2b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a01f065-59cb-4e02-b278-883b408b4951]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-37e9bd33-ccd7-4034-aa21-a53eee48f71d tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Running cmd (subprocess): nvme version {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-37e9bd33-ccd7-4034-aa21-a53eee48f71d tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] 'nvme version' failed. Not Retrying. {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.nvmeof [None req-37e9bd33-ccd7-4034-aa21-a53eee48f71d tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] nvme not present on system {{(pid=74743) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:11:39 user nova-compute[74743]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 17:11:39 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d809d2-ec91-4856-860c-bfed6ea3a9bc]: (4, '') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-37e9bd33-ccd7-4034-aa21-a53eee48f71d tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74743) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-37e9bd33-ccd7-4034-aa21-a53eee48f71d tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-37e9bd33-ccd7-4034-aa21-a53eee48f71d tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] LIGHTOS: no hostnqn found. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG os_brick.utils [None req-37e9bd33-ccd7-4034-aa21-a53eee48f71d tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1116acd8874d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG nova.virt.block_device [None req-37e9bd33-ccd7-4034-aa21-a53eee48f71d tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Updating existing volume attachment record: 9fe47108-8b8c-477a-8af1-ae3591495d18 {{(pid=74743) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.771s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:11:39 user nova-compute[74743]: INFO nova.compute.manager [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Migrating
Nov 18 17:11:39 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:11:39 user nova-compute[74743]: INFO nova.compute.rpcapi [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 18 17:11:39 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Acquiring lock "refresh_cache-49ebdd5a-824d-476a-bd10-3b891bbfe9e2" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Acquired lock "refresh_cache-49ebdd5a-824d-476a-bd10-3b891bbfe9e2" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG nova.network.neutron [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:11:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:40 user nova-compute[74743]: DEBUG nova.network.neutron [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Updating instance_info_cache with network_info: [{"id": "c66ef239-8068-4eff-807a-830d5f3d0dba", "address": "fa:16:3e:f3:3d:ca", "network": {"id": "79046ec4-e7a8-4b7d-8607-3205067366b6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1734449136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8955c5a052b34bde997f9db74d302edb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66ef239-80", "ovs_interfaceid": "c66ef239-8068-4eff-807a-830d5f3d0dba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:11:40 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Releasing lock "refresh_cache-49ebdd5a-824d-476a-bd10-3b891bbfe9e2" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:11:40 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Starting migrate_disk_and_power_off {{(pid=74743) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 18 17:11:40 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:40 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:40 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:40 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:40 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:40 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:40 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:40 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:40 user nova-compute[74743]: DEBUG nova.compute.manager [req-4dbe374f-242d-4016-840b-8adc165b5355 req-031323ed-e492-424a-a6f3-a366425887f6 service nova] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Received event network-vif-unplugged-c66ef239-8068-4eff-807a-830d5f3d0dba {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:11:40 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4dbe374f-242d-4016-840b-8adc165b5355 req-031323ed-e492-424a-a6f3-a366425887f6 service nova] Acquiring lock "49ebdd5a-824d-476a-bd10-3b891bbfe9e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:11:40 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4dbe374f-242d-4016-840b-8adc165b5355 req-031323ed-e492-424a-a6f3-a366425887f6 service nova] Lock "49ebdd5a-824d-476a-bd10-3b891bbfe9e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:11:40 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4dbe374f-242d-4016-840b-8adc165b5355 req-031323ed-e492-424a-a6f3-a366425887f6 service nova] Lock "49ebdd5a-824d-476a-bd10-3b891bbfe9e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:11:40 user nova-compute[74743]: DEBUG nova.compute.manager [req-4dbe374f-242d-4016-840b-8adc165b5355 req-031323ed-e492-424a-a6f3-a366425887f6 service nova] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] No waiting events found dispatching network-vif-unplugged-c66ef239-8068-4eff-807a-830d5f3d0dba {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:11:40 user nova-compute[74743]: WARNING nova.compute.manager [req-4dbe374f-242d-4016-840b-8adc165b5355 req-031323ed-e492-424a-a6f3-a366425887f6 service nova] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Received unexpected event network-vif-unplugged-c66ef239-8068-4eff-807a-830d5f3d0dba for instance with vm_state active and task_state resize_migrating.
Nov 18 17:11:41 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:41 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Instance destroyed successfully.
Nov 18 17:11:41 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:07:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-761441758',display_name='tempest-ServerActionsTestOtherB-server-761441758',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-761441758',id=16,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHSxRrGlHxDyqlCOq0hy6p31kUDSaQIxafGDavUpZ/Ka4RS6tIfzT5avp8Ymkenpc8OEHVquoqpPuZPk62jn4N2SagQ88JWrrx/6+VzSF8w9eq7GAvBHe/3/xNVOBksa4g==',key_name='tempest-keypair-1267949685',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:07:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8955c5a052b34bde997f9db74d302edb',ramdisk_id='',reservation_id='r-ewenialm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2984948',owner_user_name='tempest-ServerActionsTestOtherB-2984948-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:11:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c37b5fe2f7d74cab894eef0f41c6a5ed',uuid=49ebdd5a-824d-476a-bd10-3b891bbfe9e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c66ef239-8068-4eff-807a-830d5f3d0dba", "address": "fa:16:3e:f3:3d:ca", "network": {"id": "79046ec4-e7a8-4b7d-8607-3205067366b6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1734449136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1734449136-network", "vif_mac": "fa:16:3e:f3:3d:ca"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8955c5a052b34bde997f9db74d302edb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66ef239-80", "ovs_interfaceid": "c66ef239-8068-4eff-807a-830d5f3d0dba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Converting VIF {"id": "c66ef239-8068-4eff-807a-830d5f3d0dba", "address": "fa:16:3e:f3:3d:ca", "network": {"id": "79046ec4-e7a8-4b7d-8607-3205067366b6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1734449136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1734449136-network", "vif_mac": "fa:16:3e:f3:3d:ca"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8955c5a052b34bde997f9db74d302edb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66ef239-80", "ovs_interfaceid": "c66ef239-8068-4eff-807a-830d5f3d0dba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:3d:ca,bridge_name='br-int',has_traffic_filtering=True,id=c66ef239-8068-4eff-807a-830d5f3d0dba,network=Network(79046ec4-e7a8-4b7d-8607-3205067366b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66ef239-80') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG os_vif [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:3d:ca,bridge_name='br-int',has_traffic_filtering=True,id=c66ef239-8068-4eff-807a-830d5f3d0dba,network=Network(79046ec4-e7a8-4b7d-8607-3205067366b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66ef239-80') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc66ef239-80, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5411aab5-6c45-437d-af75-c5370f2de59a) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:41 user nova-compute[74743]: INFO os_vif [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:3d:ca,bridge_name='br-int',has_traffic_filtering=True,id=c66ef239-8068-4eff-807a-830d5f3d0dba,network=Network(79046ec4-e7a8-4b7d-8607-3205067366b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66ef239-80')
Nov 18 17:11:41 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] calling os-brick to detach iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, {'target_iqn': 'iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RWDmrpXN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:11:41 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:11:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2a7d51-4102-402e-b3bb-f8c0fac569d4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 17:11:41 user nova-compute[74743]: No targets found.
Nov 18 17:11:41 user nova-compute[74743]: iSNS:
Nov 18 17:11:41 user nova-compute[74743]: No targets found.
Nov 18 17:11:41 user nova-compute[74743]: STATIC:
Nov 18 17:11:41 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5
Nov 18 17:11:41 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:11:41 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:11:41 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e
Nov 18 17:11:41 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:11:41 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:11:41 user nova-compute[74743]: FIRMWARE:
Nov 18 17:11:41 user nova-compute[74743]: No targets found.
Nov 18 17:11:41 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 17:11:41 user nova-compute[74743]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 17:11:41 user nova-compute[74743]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74743) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5', 0)] {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0071847-986a-41d7-af16-ce4246c0cc19]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[24728748-ca72-4cba-9a9f-d444f7506b57]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)
Nov 18 17:11:41 user nova-compute[74743]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:11:41 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)
Nov 18 17:11:41 user nova-compute[74743]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:11:41 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb2810bb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5'): ({'sdb'}, set())}) {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Removing single pathed devices sdb {{(pid=74743) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d129384-de33-4e00-9da6-e63086d36e23]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c9e8a9-8147-41a8-b948-11197a8908b0]: (4, ('ok\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Flushing IO for device /dev/sdb {{(pid=74743) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3d2406-5628-4f68-bbd1-84c0bb9e1bd5]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74743) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.131s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c290c8-e2c6-4884-bd03-49c41b9c692f]: (4, ('1', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] SCSI volumes sdb have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5')] {{(pid=74743) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3df119-91c3-47e1-a75f-c73937f85b4d]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --logout {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d263d3-3142-49f2-8c14-39adf4634849]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5, portal: 172.16.0.220,3260]
Nov 18 17:11:41 user nova-compute[74743]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5, portal: 172.16.0.220,3260] successful.
Nov 18 17:11:41 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --op delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bdd6e70-8980-4036-9410-a08d2a6c0445]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.405s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] <== disconnect_volume: return (407ms) None {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Disconnected iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:42 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:42 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:11:42 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2_resize/disk /opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/disk {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:42 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] CMD "cp -r /opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2_resize/disk /opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/disk" returned: 0 in 0.426s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:42 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2_resize/disk.info /opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/disk.info {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:42 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] CMD "cp -r /opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2_resize/disk.info /opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/disk.info" returned: 0 in 0.031s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:42 user nova-compute[74743]: DEBUG nova.compute.manager [req-75b64aae-7f65-4d23-974f-dab2c0fc6355 req-774e39c4-7d8f-4add-aebf-011bc3652115 service nova] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Received event network-vif-plugged-c66ef239-8068-4eff-807a-830d5f3d0dba {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:11:42 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-75b64aae-7f65-4d23-974f-dab2c0fc6355 req-774e39c4-7d8f-4add-aebf-011bc3652115 service nova] Acquiring lock "49ebdd5a-824d-476a-bd10-3b891bbfe9e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:11:42 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-75b64aae-7f65-4d23-974f-dab2c0fc6355 req-774e39c4-7d8f-4add-aebf-011bc3652115 service nova] Lock "49ebdd5a-824d-476a-bd10-3b891bbfe9e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:11:42 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-75b64aae-7f65-4d23-974f-dab2c0fc6355 req-774e39c4-7d8f-4add-aebf-011bc3652115 service nova] Lock "49ebdd5a-824d-476a-bd10-3b891bbfe9e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:11:42 user nova-compute[74743]: DEBUG nova.compute.manager [req-75b64aae-7f65-4d23-974f-dab2c0fc6355 req-774e39c4-7d8f-4add-aebf-011bc3652115 service nova] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] No waiting events found dispatching network-vif-plugged-c66ef239-8068-4eff-807a-830d5f3d0dba {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:11:42 user nova-compute[74743]: WARNING nova.compute.manager [req-75b64aae-7f65-4d23-974f-dab2c0fc6355 req-774e39c4-7d8f-4add-aebf-011bc3652115 service nova] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Received unexpected event network-vif-plugged-c66ef239-8068-4eff-807a-830d5f3d0dba for instance with vm_state active and task_state resize_migrating.
Nov 18 17:11:42 user nova-compute[74743]: DEBUG nova.compute.manager [req-75b64aae-7f65-4d23-974f-dab2c0fc6355 req-774e39c4-7d8f-4add-aebf-011bc3652115 service nova] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Received event network-vif-plugged-ba661621-6683-462f-ba90-5de9da77c1a3 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:11:42 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-75b64aae-7f65-4d23-974f-dab2c0fc6355 req-774e39c4-7d8f-4add-aebf-011bc3652115 service nova] Acquiring lock "180f2f7e-9df5-480f-adde-d8e10ee14b07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:11:42 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-75b64aae-7f65-4d23-974f-dab2c0fc6355 req-774e39c4-7d8f-4add-aebf-011bc3652115 service nova] Lock "180f2f7e-9df5-480f-adde-d8e10ee14b07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:11:42 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-75b64aae-7f65-4d23-974f-dab2c0fc6355 req-774e39c4-7d8f-4add-aebf-011bc3652115 service nova] Lock "180f2f7e-9df5-480f-adde-d8e10ee14b07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:11:42 user nova-compute[74743]: DEBUG nova.compute.manager [req-75b64aae-7f65-4d23-974f-dab2c0fc6355 req-774e39c4-7d8f-4add-aebf-011bc3652115 service nova] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] No waiting events found dispatching network-vif-plugged-ba661621-6683-462f-ba90-5de9da77c1a3 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:11:42 user nova-compute[74743]: WARNING nova.compute.manager [req-75b64aae-7f65-4d23-974f-dab2c0fc6355 req-774e39c4-7d8f-4add-aebf-011bc3652115 service nova] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Received unexpected event network-vif-plugged-ba661621-6683-462f-ba90-5de9da77c1a3 for instance with vm_state building and task_state spawning.
Nov 18 17:11:42 user nova-compute[74743]: DEBUG nova.compute.manager [req-75b64aae-7f65-4d23-974f-dab2c0fc6355 req-774e39c4-7d8f-4add-aebf-011bc3652115 service nova] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Received event network-vif-plugged-ba661621-6683-462f-ba90-5de9da77c1a3 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:11:42 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-75b64aae-7f65-4d23-974f-dab2c0fc6355 req-774e39c4-7d8f-4add-aebf-011bc3652115 service nova] Acquiring lock "180f2f7e-9df5-480f-adde-d8e10ee14b07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:11:42 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-75b64aae-7f65-4d23-974f-dab2c0fc6355 req-774e39c4-7d8f-4add-aebf-011bc3652115 service nova] Lock "180f2f7e-9df5-480f-adde-d8e10ee14b07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:11:42 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-75b64aae-7f65-4d23-974f-dab2c0fc6355 req-774e39c4-7d8f-4add-aebf-011bc3652115 service nova] Lock "180f2f7e-9df5-480f-adde-d8e10ee14b07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:11:42 user nova-compute[74743]: DEBUG nova.compute.manager [req-75b64aae-7f65-4d23-974f-dab2c0fc6355 req-774e39c4-7d8f-4add-aebf-011bc3652115 service nova] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] No waiting events found dispatching network-vif-plugged-ba661621-6683-462f-ba90-5de9da77c1a3 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:11:42 user nova-compute[74743]: WARNING nova.compute.manager [req-75b64aae-7f65-4d23-974f-dab2c0fc6355 req-774e39c4-7d8f-4add-aebf-011bc3652115 service nova] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Received unexpected event network-vif-plugged-ba661621-6683-462f-ba90-5de9da77c1a3 for instance with vm_state building and task_state spawning.
Nov 18 17:11:43 user nova-compute[74743]: DEBUG nova.compute.manager [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:11:43 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Guest created on hypervisor {{(pid=74743) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 17:11:43 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Instance spawned successfully.
Nov 18 17:11:43 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 17:11:43 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Found default for hw_cdrom_bus of ide {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:11:43 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Found default for hw_disk_bus of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:11:43 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Found default for hw_input_bus of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:11:43 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Found default for hw_pointer_model of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:11:43 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Found default for hw_video_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:11:43 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Found default for hw_vif_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:11:43 user nova-compute[74743]: INFO nova.compute.manager [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Took 5.98 seconds to spawn the instance on the hypervisor.
Nov 18 17:11:43 user nova-compute[74743]: DEBUG nova.compute.manager [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:11:43 user nova-compute[74743]: INFO nova.compute.manager [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Took 6.79 seconds to build instance.
Nov 18 17:11:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d0f18250-2809-461b-8dd0-1840f82f9488 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "180f2f7e-9df5-480f-adde-d8e10ee14b07" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.887s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:11:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Acquiring lock "cd467693-8b2d-4e3d-9b1a-7581c6ae6153" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:11:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "cd467693-8b2d-4e3d-9b1a-7581c6ae6153" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:11:43 user nova-compute[74743]: DEBUG nova.compute.manager [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Starting instance... {{(pid=74743) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 17:11:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:11:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:11:43 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74743) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 17:11:43 user nova-compute[74743]: INFO nova.compute.claims [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Claim successful on node user
Nov 18 17:11:43 user nova-compute[74743]: DEBUG nova.network.neutron [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Port c66ef239-8068-4eff-807a-830d5f3d0dba binding to destination host user is already ACTIVE {{(pid=74743) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 18 17:11:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Acquiring lock "49ebdd5a-824d-476a-bd10-3b891bbfe9e2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:11:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Lock "49ebdd5a-824d-476a-bd10-3b891bbfe9e2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:11:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Lock "49ebdd5a-824d-476a-bd10-3b891bbfe9e2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:11:44 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Acquiring lock "refresh_cache-49ebdd5a-824d-476a-bd10-3b891bbfe9e2" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:11:44 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Acquired lock "refresh_cache-49ebdd5a-824d-476a-bd10-3b891bbfe9e2" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:11:44 user nova-compute[74743]: DEBUG nova.network.neutron [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:11:44 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:11:44 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:11:44 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.685s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:11:44 user nova-compute[74743]: DEBUG nova.compute.manager [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Start building networks asynchronously for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 17:11:44 user nova-compute[74743]: DEBUG nova.compute.manager [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Allocating IP information in the background. {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 17:11:44 user nova-compute[74743]: DEBUG nova.network.neutron [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] allocate_for_instance() {{(pid=74743) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 17:11:44 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 17:11:44 user nova-compute[74743]: DEBUG nova.compute.manager [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Start building block device mappings for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 17:11:44 user nova-compute[74743]: DEBUG nova.policy [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1470478a455242f9ad92eaf95dc6a2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c06dc8e7be46229750b8e283622c9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74743) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 17:11:44 user nova-compute[74743]: DEBUG nova.network.neutron [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Updating instance_info_cache with network_info: [{"id": "c66ef239-8068-4eff-807a-830d5f3d0dba", "address": "fa:16:3e:f3:3d:ca", "network": {"id": "79046ec4-e7a8-4b7d-8607-3205067366b6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1734449136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8955c5a052b34bde997f9db74d302edb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66ef239-80", "ovs_interfaceid": "c66ef239-8068-4eff-807a-830d5f3d0dba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:11:44 user nova-compute[74743]: DEBUG nova.compute.manager [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Start spawning the instance on the hypervisor. {{(pid=74743) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 17:11:44 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Creating instance directory {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 17:11:44 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Creating image(s)
Nov 18 17:11:44 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Acquiring lock "/opt/stack/data/nova/instances/cd467693-8b2d-4e3d-9b1a-7581c6ae6153/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:11:44 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "/opt/stack/data/nova/instances/cd467693-8b2d-4e3d-9b1a-7581c6ae6153/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:11:44 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "/opt/stack/data/nova/instances/cd467693-8b2d-4e3d-9b1a-7581c6ae6153/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:11:44 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Releasing lock "refresh_cache-49ebdd5a-824d-476a-bd10-3b891bbfe9e2" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:11:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:44 user nova-compute[74743]: DEBUG os_brick.utils [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:11:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:44 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[64168f5a-6bb0-4ef0-bc4a-c4ae16c95fde]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1116acd8874d\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.193s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:44 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Acquiring lock "c188b3a997bfafa42fa341f9dcc326545681eed9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:11:44 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:11:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:44 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[86dad810-b424-4b0c-a9a9-4c21b00aa211]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:44 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:44 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ceb4611-2b95-420e-a96b-deccdcabb0a7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:44 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff0b98b-0025-4c7a-92da-92d3bba0d400]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Running cmd (subprocess): nvme version {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] 'nvme version' failed. Not Retrying. {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:11:44 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] nvme not present on system {{(pid=74743) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 17:11:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:11:44 user nova-compute[74743]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 17:11:44 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3bb98b8-48f1-4c0c-9651-e6e9036ba8fa]: (4, '') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:44 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74743) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 17:11:44 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 17:11:44 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] LIGHTOS: no hostnqn found. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG os_brick.utils [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] <== get_connector_properties: return (175ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1116acd8874d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.202s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/cd467693-8b2d-4e3d-9b1a-7581c6ae6153/disk 1073741824 {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/cd467693-8b2d-4e3d-9b1a-7581c6ae6153/disk 1073741824" returned: 0 in 0.070s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG nova.network.neutron [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Successfully created port: 106be5e5-0143-4ab2-8e1f-30b2e46c5753 {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.201s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cd467693-8b2d-4e3d-9b1a-7581c6ae6153/disk. size=1073741824 {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd467693-8b2d-4e3d-9b1a-7581c6ae6153/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd467693-8b2d-4e3d-9b1a-7581c6ae6153/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Cannot resize image /opt/stack/data/nova/instances/cd467693-8b2d-4e3d-9b1a-7581c6ae6153/disk to a smaller size. {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Created local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Ensure instance console log exists: /opt/stack/data/nova/instances/cd467693-8b2d-4e3d-9b1a-7581c6ae6153/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37e9bd33-ccd7-4034-aa21-a53eee48f71d tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Calling os-brick to attach iSCSI Volume {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e9bd33-ccd7-4034-aa21-a53eee48f71d tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ApUghBxk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:11:45 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-37e9bd33-ccd7-4034-aa21-a53eee48f71d tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:11:45 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-37e9bd33-ccd7-4034-aa21-a53eee48f71d tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-37e9bd33-ccd7-4034-aa21-a53eee48f71d tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:11:45 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-37e9bd33-ccd7-4034-aa21-a53eee48f71d tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:11:45 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-37e9bd33-ccd7-4034-aa21-a53eee48f71d tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-37e9bd33-ccd7-4034-aa21-a53eee48f71d tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:11:45 user nova-compute[74743]: INFO os_brick.initiator.connectors.iscsi [None req-37e9bd33-ccd7-4034-aa21-a53eee48f71d tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 17:11:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e -p 172.16.0.220:3260 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0d3903-06b4-4e20-be02-4e3f5a27c5bd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e9bd33-ccd7-4034-aa21-a53eee48f71d tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 17:11:45 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e -p 172.16.0.220:3260 --interface default --op new {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0d4efb-06c2-4a94-b321-8b64138a545f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e] added\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e9bd33-ccd7-4034-aa21-a53eee48f71d tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e] added
Nov 18 17:11:45 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[395d511b-8172-40fa-8f49-36d7aa7ef6f8]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e9bd33-ccd7-4034-aa21-a53eee48f71d tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ad20fc-3491-471b-9b8d-a28847e3eeb7]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e9bd33-ccd7-4034-aa21-a53eee48f71d tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ApUghBxk {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ApUghBxk" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[7314b993-2d21-487d-9818-264ef988ae8f]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e9bd33-ccd7-4034-aa21-a53eee48f71d tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ApUghBxk'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e654230-ca86-4e3a-8aef-9f33c9b6b2e5]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e9bd33-ccd7-4034-aa21-a53eee48f71d tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1bdff98-63bb-45d0-bec6-3ab074d8e707]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e9bd33-ccd7-4034-aa21-a53eee48f71d tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)
Nov 18 17:11:45 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e9bd33-ccd7-4034-aa21-a53eee48f71d tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)
Nov 18 17:11:45 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e -p 172.16.0.220:3260 --login {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb964741-6f5d-42ea-bf30-0c0b1e0890aa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e9bd33-ccd7-4034-aa21-a53eee48f71d tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e, portal: 172.16.0.220,3260]
Nov 18 17:11:45 user nova-compute[74743]: Login to [iface: default, target: iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e, portal: 172.16.0.220,3260] successful.
Nov 18 17:11:45 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-aa01cb2b-a452-48c3-9301-ef717501c133 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Acquiring lock "e2b51739-7900-47bd-a01e-2e83e2f13ae1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-aa01cb2b-a452-48c3-9301-ef717501c133 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Lock "e2b51739-7900-47bd-a01e-2e83e2f13ae1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-aa01cb2b-a452-48c3-9301-ef717501c133 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Acquiring lock "e2b51739-7900-47bd-a01e-2e83e2f13ae1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-aa01cb2b-a452-48c3-9301-ef717501c133 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Lock "e2b51739-7900-47bd-a01e-2e83e2f13ae1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-aa01cb2b-a452-48c3-9301-ef717501c133 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Lock "e2b51739-7900-47bd-a01e-2e83e2f13ae1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e15c52-f285-4ed6-8877-634d53ffee6a]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e9bd33-ccd7-4034-aa21-a53eee48f71d tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:11:45 user nova-compute[74743]: INFO nova.compute.manager [None req-aa01cb2b-a452-48c3-9301-ef717501c133 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Terminating instance
Nov 18 17:11:45 user nova-compute[74743]: DEBUG nova.compute.manager [None req-aa01cb2b-a452-48c3-9301-ef717501c133 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Start destroying the instance on the hypervisor. {{(pid=74743) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[42bcb067-f616-4cb0-a665-138e79bdd811]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e9bd33-ccd7-4034-aa21-a53eee48f71d tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)
Nov 18 17:11:45 user nova-compute[74743]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e (non-flash)
Nov 18 17:11:45 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e9bd33-ccd7-4034-aa21-a53eee48f71d tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)
Nov 18 17:11:45 user nova-compute[74743]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e (non-flash)
Nov 18 17:11:45 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-37e9bd33-ccd7-4034-aa21-a53eee48f71d tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e9bd33-ccd7-4034-aa21-a53eee48f71d tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Connected to 172.16.0.220:3260 {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-37e9bd33-ccd7-4034-aa21-a53eee48f71d tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=74743) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-37e9bd33-ccd7-4034-aa21-a53eee48f71d tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74743) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a78df6c-acab-417d-8de1-1627b08789f4]: (4, ('- - 0', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-37e9bd33-ccd7-4034-aa21-a53eee48f71d tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e9bd33-ccd7-4034-aa21-a53eee48f71d tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ApUghBxk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 17:11:45 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG nova.network.neutron [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Successfully updated port: 106be5e5-0143-4ab2-8e1f-30b2e46c5753 {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Acquiring lock "refresh_cache-cd467693-8b2d-4e3d-9b1a-7581c6ae6153" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Acquired lock "refresh_cache-cd467693-8b2d-4e3d-9b1a-7581c6ae6153" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG nova.network.neutron [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG nova.compute.manager [req-cca7277f-8a51-4209-a4b0-b7d02b9bba76 req-6d0c5bd6-4264-494e-9309-0ce6d05b6210 service nova] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Received event network-changed-106be5e5-0143-4ab2-8e1f-30b2e46c5753 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG nova.compute.manager [req-cca7277f-8a51-4209-a4b0-b7d02b9bba76 req-6d0c5bd6-4264-494e-9309-0ce6d05b6210 service nova] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Refreshing instance network info cache due to event network-changed-106be5e5-0143-4ab2-8e1f-30b2e46c5753. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-cca7277f-8a51-4209-a4b0-b7d02b9bba76 req-6d0c5bd6-4264-494e-9309-0ce6d05b6210 service nova] Acquiring lock "refresh_cache-cd467693-8b2d-4e3d-9b1a-7581c6ae6153" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG nova.network.neutron [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG nova.compute.manager [req-6aa8ad6c-eb97-483d-a8a2-5c9cc9299df9 req-8133b914-fe49-4fcb-b44b-4709f7947fb0 service nova] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Received event network-vif-unplugged-14c7e1ef-5997-4e7f-aebf-baa01bec87a6 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-6aa8ad6c-eb97-483d-a8a2-5c9cc9299df9 req-8133b914-fe49-4fcb-b44b-4709f7947fb0 service nova] Acquiring lock "e2b51739-7900-47bd-a01e-2e83e2f13ae1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-6aa8ad6c-eb97-483d-a8a2-5c9cc9299df9 req-8133b914-fe49-4fcb-b44b-4709f7947fb0 service nova] Lock "e2b51739-7900-47bd-a01e-2e83e2f13ae1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-6aa8ad6c-eb97-483d-a8a2-5c9cc9299df9 req-8133b914-fe49-4fcb-b44b-4709f7947fb0 service nova] Lock "e2b51739-7900-47bd-a01e-2e83e2f13ae1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG nova.compute.manager [req-6aa8ad6c-eb97-483d-a8a2-5c9cc9299df9 req-8133b914-fe49-4fcb-b44b-4709f7947fb0 service nova] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] No waiting events found dispatching network-vif-unplugged-14c7e1ef-5997-4e7f-aebf-baa01bec87a6 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG nova.compute.manager [req-6aa8ad6c-eb97-483d-a8a2-5c9cc9299df9 req-8133b914-fe49-4fcb-b44b-4709f7947fb0 service nova] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Received event network-vif-unplugged-14c7e1ef-5997-4e7f-aebf-baa01bec87a6 for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG nova.network.neutron [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Updating instance_info_cache with network_info: [{"id": "106be5e5-0143-4ab2-8e1f-30b2e46c5753", "address": "fa:16:3e:35:df:4c", "network": {"id": "252343cc-f379-471d-a2c9-99b9a60ebcb4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25c06dc8e7be46229750b8e283622c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106be5e5-01", "ovs_interfaceid": "106be5e5-0143-4ab2-8e1f-30b2e46c5753", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Releasing lock "refresh_cache-cd467693-8b2d-4e3d-9b1a-7581c6ae6153" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG nova.compute.manager [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Instance network_info: |[{"id": "106be5e5-0143-4ab2-8e1f-30b2e46c5753", "address": "fa:16:3e:35:df:4c", "network": {"id": "252343cc-f379-471d-a2c9-99b9a60ebcb4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25c06dc8e7be46229750b8e283622c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106be5e5-01", "ovs_interfaceid": "106be5e5-0143-4ab2-8e1f-30b2e46c5753", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-cca7277f-8a51-4209-a4b0-b7d02b9bba76 req-6d0c5bd6-4264-494e-9309-0ce6d05b6210 service nova] Acquired lock "refresh_cache-cd467693-8b2d-4e3d-9b1a-7581c6ae6153" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG nova.network.neutron [req-cca7277f-8a51-4209-a4b0-b7d02b9bba76 req-6d0c5bd6-4264-494e-9309-0ce6d05b6210 service nova] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Refreshing network info cache for port 106be5e5-0143-4ab2-8e1f-30b2e46c5753 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Start _get_guest_xml network_info=[{"id": "106be5e5-0143-4ab2-8e1f-30b2e46c5753", "address": "fa:16:3e:35:df:4c", "network": {"id": "252343cc-f379-471d-a2c9-99b9a60ebcb4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25c06dc8e7be46229750b8e283622c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106be5e5-01", "ovs_interfaceid": "106be5e5-0143-4ab2-8e1f-30b2e46c5753", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '9536f6cf-95c4-40e2-864a-09a91525678a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:11:46 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:11:46 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:11:46 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:11:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1273732704',display_name='tempest-ServerRescueNegativeTestJSON-server-1273732704',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1273732704',id=26,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5i5YEzixtVxmS2iOjWM8/2naGXJ4Q5v/0QysXM2kLdJlCMCc++QaAgvj846YeFr6GNwkzyQptK6eTbco8N4N7YhM2ZbtBzmmRMtT6vYLz0rUMuGW/QGr33NXVcCB2opA==',key_name='tempest-keypair-2052404341',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='25c06dc8e7be46229750b8e283622c9b',ramdisk_id='',reservation_id='r-uxhicdwp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-732707405',owner_user_name='tempest-ServerRescueNegativeTestJSON-732707405-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:11:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1470478a455242f9ad92eaf95dc6a2f4',uuid=cd467693-8b2d-4e3d-9b1a-7581c6ae6153,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "106be5e5-0143-4ab2-8e1f-30b2e46c5753", "address": "fa:16:3e:35:df:4c", "network": {"id": "252343cc-f379-471d-a2c9-99b9a60ebcb4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25c06dc8e7be46229750b8e283622c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106be5e5-01", "ovs_interfaceid": "106be5e5-0143-4ab2-8e1f-30b2e46c5753", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Converting VIF {"id": "106be5e5-0143-4ab2-8e1f-30b2e46c5753", "address": "fa:16:3e:35:df:4c", "network": {"id": "252343cc-f379-471d-a2c9-99b9a60ebcb4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25c06dc8e7be46229750b8e283622c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106be5e5-01", "ovs_interfaceid": "106be5e5-0143-4ab2-8e1f-30b2e46c5753", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:df:4c,bridge_name='br-int',has_traffic_filtering=True,id=106be5e5-0143-4ab2-8e1f-30b2e46c5753,network=Network(252343cc-f379-471d-a2c9-99b9a60ebcb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap106be5e5-01') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG nova.objects.instance [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lazy-loading 'pci_devices' on Instance uuid cd467693-8b2d-4e3d-9b1a-7581c6ae6153 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:11:46 user nova-compute[74743]:   <uuid>cd467693-8b2d-4e3d-9b1a-7581c6ae6153</uuid>
Nov 18 17:11:46 user nova-compute[74743]:   <name>instance-0000001a</name>
Nov 18 17:11:46 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:11:46 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:11:46 user nova-compute[74743]:   <metadata>
Nov 18 17:11:46 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:11:46 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:11:46 user nova-compute[74743]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1273732704</nova:name>
Nov 18 17:11:46 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:11:46</nova:creationTime>
Nov 18 17:11:46 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:11:46 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:11:46 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:11:46 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:11:46 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:11:46 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:11:46 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:11:46 user nova-compute[74743]:       <nova:owner>
Nov 18 17:11:46 user nova-compute[74743]:         <nova:user uuid="1470478a455242f9ad92eaf95dc6a2f4">tempest-ServerRescueNegativeTestJSON-732707405-project-member</nova:user>
Nov 18 17:11:46 user nova-compute[74743]:         <nova:project uuid="25c06dc8e7be46229750b8e283622c9b">tempest-ServerRescueNegativeTestJSON-732707405</nova:project>
Nov 18 17:11:46 user nova-compute[74743]:       </nova:owner>
Nov 18 17:11:46 user nova-compute[74743]:       <nova:root type="image" uuid="9536f6cf-95c4-40e2-864a-09a91525678a"/>
Nov 18 17:11:46 user nova-compute[74743]:       <nova:ports>
Nov 18 17:11:46 user nova-compute[74743]:         <nova:port uuid="106be5e5-0143-4ab2-8e1f-30b2e46c5753">
Nov 18 17:11:46 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 18 17:11:46 user nova-compute[74743]:         </nova:port>
Nov 18 17:11:46 user nova-compute[74743]:       </nova:ports>
Nov 18 17:11:46 user nova-compute[74743]:     </nova:instance>
Nov 18 17:11:46 user nova-compute[74743]:   </metadata>
Nov 18 17:11:46 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:11:46 user nova-compute[74743]:     <system>
Nov 18 17:11:46 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:11:46 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:11:46 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:11:46 user nova-compute[74743]:       <entry name="serial">cd467693-8b2d-4e3d-9b1a-7581c6ae6153</entry>
Nov 18 17:11:46 user nova-compute[74743]:       <entry name="uuid">cd467693-8b2d-4e3d-9b1a-7581c6ae6153</entry>
Nov 18 17:11:46 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:11:46 user nova-compute[74743]:     </system>
Nov 18 17:11:46 user nova-compute[74743]:   </sysinfo>
Nov 18 17:11:46 user nova-compute[74743]:   <os>
Nov 18 17:11:46 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:11:46 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:11:46 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:11:46 user nova-compute[74743]:   </os>
Nov 18 17:11:46 user nova-compute[74743]:   <features>
Nov 18 17:11:46 user nova-compute[74743]:     <acpi/>
Nov 18 17:11:46 user nova-compute[74743]:     <apic/>
Nov 18 17:11:46 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:11:46 user nova-compute[74743]:   </features>
Nov 18 17:11:46 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:11:46 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:11:46 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:11:46 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:11:46 user nova-compute[74743]:   </clock>
Nov 18 17:11:46 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:11:46 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:11:46 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:11:46 user nova-compute[74743]:   </cpu>
Nov 18 17:11:46 user nova-compute[74743]:   <devices>
Nov 18 17:11:46 user nova-compute[74743]:     <disk type="file" device="disk">
Nov 18 17:11:46 user nova-compute[74743]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 17:11:46 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/cd467693-8b2d-4e3d-9b1a-7581c6ae6153/disk"/>
Nov 18 17:11:46 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:11:46 user nova-compute[74743]:     </disk>
Nov 18 17:11:46 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:11:46 user nova-compute[74743]:       <mac address="fa:16:3e:35:df:4c"/>
Nov 18 17:11:46 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:11:46 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:11:46 user nova-compute[74743]:       <target dev="tap106be5e5-01"/>
Nov 18 17:11:46 user nova-compute[74743]:     </interface>
Nov 18 17:11:46 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:11:46 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/cd467693-8b2d-4e3d-9b1a-7581c6ae6153/console.log" append="off"/>
Nov 18 17:11:46 user nova-compute[74743]:     </serial>
Nov 18 17:11:46 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:11:46 user nova-compute[74743]:     <video>
Nov 18 17:11:46 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:11:46 user nova-compute[74743]:     </video>
Nov 18 17:11:46 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:11:46 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:11:46 user nova-compute[74743]:     </rng>
Nov 18 17:11:46 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:11:46 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:11:46 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:11:46 user nova-compute[74743]:     </memballoon>
Nov 18 17:11:46 user nova-compute[74743]:   </devices>
Nov 18 17:11:46 user nova-compute[74743]: </domain>
Nov 18 17:11:46 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:11:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1273732704',display_name='tempest-ServerRescueNegativeTestJSON-server-1273732704',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1273732704',id=26,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5i5YEzixtVxmS2iOjWM8/2naGXJ4Q5v/0QysXM2kLdJlCMCc++QaAgvj846YeFr6GNwkzyQptK6eTbco8N4N7YhM2ZbtBzmmRMtT6vYLz0rUMuGW/QGr33NXVcCB2opA==',key_name='tempest-keypair-2052404341',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='25c06dc8e7be46229750b8e283622c9b',ramdisk_id='',reservation_id='r-uxhicdwp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-732707405',owner_user_name='tempest-ServerRescueNegativeTestJSON-732707405-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:11:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1470478a455242f9ad92eaf95dc6a2f4',uuid=cd467693-8b2d-4e3d-9b1a-7581c6ae6153,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "106be5e5-0143-4ab2-8e1f-30b2e46c5753", "address": "fa:16:3e:35:df:4c", "network": {"id": "252343cc-f379-471d-a2c9-99b9a60ebcb4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25c06dc8e7be46229750b8e283622c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106be5e5-01", "ovs_interfaceid": "106be5e5-0143-4ab2-8e1f-30b2e46c5753", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Converting VIF {"id": "106be5e5-0143-4ab2-8e1f-30b2e46c5753", "address": "fa:16:3e:35:df:4c", "network": {"id": "252343cc-f379-471d-a2c9-99b9a60ebcb4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25c06dc8e7be46229750b8e283622c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106be5e5-01", "ovs_interfaceid": "106be5e5-0143-4ab2-8e1f-30b2e46c5753", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:df:4c,bridge_name='br-int',has_traffic_filtering=True,id=106be5e5-0143-4ab2-8e1f-30b2e46c5753,network=Network(252343cc-f379-471d-a2c9-99b9a60ebcb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap106be5e5-01') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG os_vif [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:df:4c,bridge_name='br-int',has_traffic_filtering=True,id=106be5e5-0143-4ab2-8e1f-30b2e46c5753,network=Network(252343cc-f379-471d-a2c9-99b9a60ebcb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap106be5e5-01') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '015ae550-e43a-5ecb-999b-04cc33b3eacc', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap106be5e5-01, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap106be5e5-01, col_values=(('qos', UUID('866a069e-2c33-4250-a3b8-280de27d22e4')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap106be5e5-01, col_values=(('external_ids', {'iface-id': '106be5e5-0143-4ab2-8e1f-30b2e46c5753', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:df:4c', 'vm-uuid': 'cd467693-8b2d-4e3d-9b1a-7581c6ae6153'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:46 user nova-compute[74743]: INFO os_vif [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:df:4c,bridge_name='br-int',has_traffic_filtering=True,id=106be5e5-0143-4ab2-8e1f-30b2e46c5753,network=Network(252343cc-f379-471d-a2c9-99b9a60ebcb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap106be5e5-01')
Nov 18 17:11:46 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Instance destroyed successfully.
Nov 18 17:11:46 user nova-compute[74743]: DEBUG nova.objects.instance [None req-aa01cb2b-a452-48c3-9301-ef717501c133 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Lazy-loading 'resources' on Instance uuid e2b51739-7900-47bd-a01e-2e83e2f13ae1 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-aa01cb2b-a452-48c3-9301-ef717501c133 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T17:08:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-411956172',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-411956172',id=19,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIsbQN9tS0qcOOC8WPSSYsTCVNWYWYH/K8oXwrg2jt5ZqyybStsLpAIghGB8s0OC3gX9C23pdQMdiUELbHV4Nj+tyYgRoCwRrAGlWKX/+zFnGGmym65cFn63wRBKph/3bw==',key_name='tempest-keypair-1379891500',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:08:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c15d7007a99745f1a308b64514566129',ramdisk_id='',reservation_id='r-xbgsfk5e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1465741228',owner_user_name='tempest-TaggedAttachmentsTest-1465741228-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:08:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb774fdb80ef465187caf4ffd2422e83',uuid=e2b51739-7900-47bd-a01e-2e83e2f13ae1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "14c7e1ef-5997-4e7f-aebf-baa01bec87a6", "address": "fa:16:3e:2d:fd:f9", "network": {"id": "f6455510-3862-45cf-b6d7-7d92905b0554", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-6755490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c15d7007a99745f1a308b64514566129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c7e1ef-59", "ovs_interfaceid": "14c7e1ef-5997-4e7f-aebf-baa01bec87a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-aa01cb2b-a452-48c3-9301-ef717501c133 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Converting VIF {"id": "14c7e1ef-5997-4e7f-aebf-baa01bec87a6", "address": "fa:16:3e:2d:fd:f9", "network": {"id": "f6455510-3862-45cf-b6d7-7d92905b0554", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-6755490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c15d7007a99745f1a308b64514566129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c7e1ef-59", "ovs_interfaceid": "14c7e1ef-5997-4e7f-aebf-baa01bec87a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-aa01cb2b-a452-48c3-9301-ef717501c133 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:fd:f9,bridge_name='br-int',has_traffic_filtering=True,id=14c7e1ef-5997-4e7f-aebf-baa01bec87a6,network=Network(f6455510-3862-45cf-b6d7-7d92905b0554),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14c7e1ef-59') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG os_vif [None req-aa01cb2b-a452-48c3-9301-ef717501c133 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:fd:f9,bridge_name='br-int',has_traffic_filtering=True,id=14c7e1ef-5997-4e7f-aebf-baa01bec87a6,network=Network(f6455510-3862-45cf-b6d7-7d92905b0554),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14c7e1ef-59') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap14c7e1ef-59, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=15d92045-ab42-41b5-9cca-c19b7f2b1b7e) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:46 user nova-compute[74743]: INFO os_vif [None req-aa01cb2b-a452-48c3-9301-ef717501c133 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:fd:f9,bridge_name='br-int',has_traffic_filtering=True,id=14c7e1ef-5997-4e7f-aebf-baa01bec87a6,network=Network(f6455510-3862-45cf-b6d7-7d92905b0554),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14c7e1ef-59')
Nov 18 17:11:46 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-aa01cb2b-a452-48c3-9301-ef717501c133 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Deleting instance files /opt/stack/data/nova/instances/e2b51739-7900-47bd-a01e-2e83e2f13ae1_del
Nov 18 17:11:46 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-aa01cb2b-a452-48c3-9301-ef717501c133 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Deletion of /opt/stack/data/nova/instances/e2b51739-7900-47bd-a01e-2e83e2f13ae1_del complete
Nov 18 17:11:46 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] No VIF found with MAC fa:16:3e:35:df:4c, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:11:46 user nova-compute[74743]: INFO nova.compute.manager [None req-aa01cb2b-a452-48c3-9301-ef717501c133 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 18 17:11:46 user nova-compute[74743]: DEBUG oslo.service.loopingcall [None req-aa01cb2b-a452-48c3-9301-ef717501c133 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74743) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG nova.compute.manager [-] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Deallocating network for instance {{(pid=74743) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] deallocate_for_instance() {{(pid=74743) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG nova.network.neutron [req-cca7277f-8a51-4209-a4b0-b7d02b9bba76 req-6d0c5bd6-4264-494e-9309-0ce6d05b6210 service nova] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Updated VIF entry in instance network info cache for port 106be5e5-0143-4ab2-8e1f-30b2e46c5753. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG nova.network.neutron [req-cca7277f-8a51-4209-a4b0-b7d02b9bba76 req-6d0c5bd6-4264-494e-9309-0ce6d05b6210 service nova] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Updating instance_info_cache with network_info: [{"id": "106be5e5-0143-4ab2-8e1f-30b2e46c5753", "address": "fa:16:3e:35:df:4c", "network": {"id": "252343cc-f379-471d-a2c9-99b9a60ebcb4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25c06dc8e7be46229750b8e283622c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106be5e5-01", "ovs_interfaceid": "106be5e5-0143-4ab2-8e1f-30b2e46c5753", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-37e9bd33-ccd7-4034-aa21-a53eee48f71d tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e9bd33-ccd7-4034-aa21-a53eee48f71d tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '23831363737373430', 'path': '/dev/sdb'} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37e9bd33-ccd7-4034-aa21-a53eee48f71d tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831363737373430', 'path': '/dev/sdb'} {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-cca7277f-8a51-4209-a4b0-b7d02b9bba76 req-6d0c5bd6-4264-494e-9309-0ce6d05b6210 service nova] Releasing lock "refresh_cache-cd467693-8b2d-4e3d-9b1a-7581c6ae6153" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG nova.objects.instance [None req-37e9bd33-ccd7-4034-aa21-a53eee48f71d tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lazy-loading 'flavor' on Instance uuid f93bf0ac-ecc8-447d-b9c1-381d36cd3135 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:11:46 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-37e9bd33-ccd7-4034-aa21-a53eee48f71d tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 17:11:46 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:11:46 user nova-compute[74743]:   <source dev="/dev/sdb"/>
Nov 18 17:11:46 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:11:46 user nova-compute[74743]:   <serial>cbbc1108-8470-4c44-a28c-c66012ea375e</serial>
Nov 18 17:11:46 user nova-compute[74743]: </disk>
Nov 18 17:11:46 user nova-compute[74743]:  {{(pid=74743) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 17:11:47 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-37e9bd33-ccd7-4034-aa21-a53eee48f71d tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:11:47 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-37e9bd33-ccd7-4034-aa21-a53eee48f71d tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:11:47 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-37e9bd33-ccd7-4034-aa21-a53eee48f71d tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] No VIF found with MAC fa:16:3e:f3:91:b0, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:11:48 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:11:48 user nova-compute[74743]: INFO nova.compute.manager [-] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Took 1.24 seconds to deallocate network for instance.
Nov 18 17:11:48 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-37e9bd33-ccd7-4034-aa21-a53eee48f71d tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.749s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:11:48 user nova-compute[74743]: DEBUG nova.compute.manager [req-8b753b10-ff03-4ca8-ba7c-a602097a1cef req-dcda422f-6791-48e1-b934-abec33ec6a18 service nova] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Received event network-vif-deleted-14c7e1ef-5997-4e7f-aebf-baa01bec87a6 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:11:48 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-aa01cb2b-a452-48c3-9301-ef717501c133 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:11:48 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-aa01cb2b-a452-48c3-9301-ef717501c133 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:11:48 user nova-compute[74743]: DEBUG nova.compute.manager [req-d2079ed3-af91-45b7-b687-b83ffbe247e6 req-f1260161-7547-407c-9681-50e2b789f85a service nova] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Received event network-vif-plugged-14c7e1ef-5997-4e7f-aebf-baa01bec87a6 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:11:48 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d2079ed3-af91-45b7-b687-b83ffbe247e6 req-f1260161-7547-407c-9681-50e2b789f85a service nova] Acquiring lock "e2b51739-7900-47bd-a01e-2e83e2f13ae1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:11:48 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d2079ed3-af91-45b7-b687-b83ffbe247e6 req-f1260161-7547-407c-9681-50e2b789f85a service nova] Lock "e2b51739-7900-47bd-a01e-2e83e2f13ae1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:11:48 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d2079ed3-af91-45b7-b687-b83ffbe247e6 req-f1260161-7547-407c-9681-50e2b789f85a service nova] Lock "e2b51739-7900-47bd-a01e-2e83e2f13ae1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:11:48 user nova-compute[74743]: DEBUG nova.compute.manager [req-d2079ed3-af91-45b7-b687-b83ffbe247e6 req-f1260161-7547-407c-9681-50e2b789f85a service nova] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] No waiting events found dispatching network-vif-plugged-14c7e1ef-5997-4e7f-aebf-baa01bec87a6 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:11:48 user nova-compute[74743]: WARNING nova.compute.manager [req-d2079ed3-af91-45b7-b687-b83ffbe247e6 req-f1260161-7547-407c-9681-50e2b789f85a service nova] [instance: e2b51739-7900-47bd-a01e-2e83e2f13ae1] Received unexpected event network-vif-plugged-14c7e1ef-5997-4e7f-aebf-baa01bec87a6 for instance with vm_state deleted and task_state None.
Nov 18 17:11:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:48 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-aa01cb2b-a452-48c3-9301-ef717501c133 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:11:48 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-aa01cb2b-a452-48c3-9301-ef717501c133 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:11:48 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-aa01cb2b-a452-48c3-9301-ef717501c133 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.586s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:11:48 user nova-compute[74743]: INFO nova.scheduler.client.report [None req-aa01cb2b-a452-48c3-9301-ef717501c133 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Deleted allocations for instance e2b51739-7900-47bd-a01e-2e83e2f13ae1
Nov 18 17:11:48 user nova-compute[74743]: DEBUG nova.compute.manager [req-f1d197c9-6fd6-47c3-85b8-8a74ec800357 req-afb5cf79-fe32-4b7a-a71b-dc8a3e378325 service nova] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Received event network-vif-plugged-106be5e5-0143-4ab2-8e1f-30b2e46c5753 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:11:48 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f1d197c9-6fd6-47c3-85b8-8a74ec800357 req-afb5cf79-fe32-4b7a-a71b-dc8a3e378325 service nova] Acquiring lock "cd467693-8b2d-4e3d-9b1a-7581c6ae6153-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:11:48 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f1d197c9-6fd6-47c3-85b8-8a74ec800357 req-afb5cf79-fe32-4b7a-a71b-dc8a3e378325 service nova] Lock "cd467693-8b2d-4e3d-9b1a-7581c6ae6153-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:11:48 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f1d197c9-6fd6-47c3-85b8-8a74ec800357 req-afb5cf79-fe32-4b7a-a71b-dc8a3e378325 service nova] Lock "cd467693-8b2d-4e3d-9b1a-7581c6ae6153-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:11:48 user nova-compute[74743]: DEBUG nova.compute.manager [req-f1d197c9-6fd6-47c3-85b8-8a74ec800357 req-afb5cf79-fe32-4b7a-a71b-dc8a3e378325 service nova] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] No waiting events found dispatching network-vif-plugged-106be5e5-0143-4ab2-8e1f-30b2e46c5753 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:11:48 user nova-compute[74743]: WARNING nova.compute.manager [req-f1d197c9-6fd6-47c3-85b8-8a74ec800357 req-afb5cf79-fe32-4b7a-a71b-dc8a3e378325 service nova] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Received unexpected event network-vif-plugged-106be5e5-0143-4ab2-8e1f-30b2e46c5753 for instance with vm_state building and task_state spawning.
Nov 18 17:11:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:48 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-aa01cb2b-a452-48c3-9301-ef717501c133 tempest-TaggedAttachmentsTest-1465741228 tempest-TaggedAttachmentsTest-1465741228-project-member] Lock "e2b51739-7900-47bd-a01e-2e83e2f13ae1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.082s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:11:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:50 user nova-compute[74743]: DEBUG nova.compute.manager [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:11:50 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Guest created on hypervisor {{(pid=74743) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 17:11:50 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Instance spawned successfully.
Nov 18 17:11:50 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 17:11:50 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Found default for hw_cdrom_bus of ide {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:11:50 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Found default for hw_disk_bus of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:11:50 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Found default for hw_input_bus of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:11:50 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Found default for hw_pointer_model of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:11:50 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Found default for hw_video_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:11:50 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Found default for hw_vif_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:11:50 user nova-compute[74743]: DEBUG nova.compute.manager [req-b8dc6c92-963f-4af3-8a81-18f254e6dec9 req-8d23e489-7542-473a-ae9f-3d80e7854d58 service nova] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Received event network-vif-plugged-106be5e5-0143-4ab2-8e1f-30b2e46c5753 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:11:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b8dc6c92-963f-4af3-8a81-18f254e6dec9 req-8d23e489-7542-473a-ae9f-3d80e7854d58 service nova] Acquiring lock "cd467693-8b2d-4e3d-9b1a-7581c6ae6153-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:11:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b8dc6c92-963f-4af3-8a81-18f254e6dec9 req-8d23e489-7542-473a-ae9f-3d80e7854d58 service nova] Lock "cd467693-8b2d-4e3d-9b1a-7581c6ae6153-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:11:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b8dc6c92-963f-4af3-8a81-18f254e6dec9 req-8d23e489-7542-473a-ae9f-3d80e7854d58 service nova] Lock "cd467693-8b2d-4e3d-9b1a-7581c6ae6153-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:11:50 user nova-compute[74743]: DEBUG nova.compute.manager [req-b8dc6c92-963f-4af3-8a81-18f254e6dec9 req-8d23e489-7542-473a-ae9f-3d80e7854d58 service nova] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] No waiting events found dispatching network-vif-plugged-106be5e5-0143-4ab2-8e1f-30b2e46c5753 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:11:50 user nova-compute[74743]: WARNING nova.compute.manager [req-b8dc6c92-963f-4af3-8a81-18f254e6dec9 req-8d23e489-7542-473a-ae9f-3d80e7854d58 service nova] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Received unexpected event network-vif-plugged-106be5e5-0143-4ab2-8e1f-30b2e46c5753 for instance with vm_state building and task_state spawning.
Nov 18 17:11:50 user nova-compute[74743]: INFO nova.compute.manager [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Took 6.32 seconds to spawn the instance on the hypervisor.
Nov 18 17:11:50 user nova-compute[74743]: DEBUG nova.compute.manager [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:11:51 user nova-compute[74743]: INFO nova.compute.manager [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Took 7.48 seconds to build instance.
Nov 18 17:11:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7f6ed7cb-69c5-464e-ad8c-6de9451acbca tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "cd467693-8b2d-4e3d-9b1a-7581c6ae6153" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.677s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Starting finish_migration {{(pid=74743) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Instance directory exists: not creating {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 18 17:11:51 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Creating image(s)
Nov 18 17:11:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.223s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Checking if we can resize image /opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/disk. size=21474836480 {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/disk 21474836480 {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/disk 21474836480" returned: 0 in 0.057s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Did not create local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Ensure instance console log exists: /opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Start _get_guest_xml network_info=[{"id": "c66ef239-8068-4eff-807a-830d5f3d0dba", "address": "fa:16:3e:f3:3d:ca", "network": {"id": "79046ec4-e7a8-4b7d-8607-3205067366b6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1734449136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1734449136-network", "vif_mac": "fa:16:3e:f3:3d:ca"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8955c5a052b34bde997f9db74d302edb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66ef239-80", "ovs_interfaceid": "c66ef239-8068-4eff-807a-830d5f3d0dba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '9536f6cf-95c4-40e2-864a-09a91525678a'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'boot_index': None, 'mount_device': '/dev/vdb', 'attachment_id': 'b6d7446f-6d10-4f78-9337-21b5d3e98b15', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RWDmrpXN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '49ebdd5a-824d-476a-bd10-3b891bbfe9e2', 'attached_at': '2023-11-18T17:11:51.000000', 'detached_at': '', 'volume_id': '37e6161c-f450-4fe5-910c-e369f18f48d5', 'serial': '37e6161c-f450-4fe5-910c-e369f18f48d5'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:51 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:11:51 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:11:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Calling os-brick to attach iSCSI Volume {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RWDmrpXN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:11:51 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:11:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:11:51 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:11:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:11:51 user nova-compute[74743]: INFO os_brick.initiator.connectors.iscsi [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 17:11:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c28a86-a46d-4488-8332-2a6e2d995784]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 17:11:51 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[164fb6c4-cb00-457b-a59c-1c038e647d27]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5] added\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5] added
Nov 18 17:11:51 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e04f7e-97ac-4019-a30d-c16eca8223f3]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[e559612c-fb92-4316-b030-e6f9dae1353c]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RWDmrpXN {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RWDmrpXN" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a9eb8e-c16a-4663-bc20-b213a9ff4d0d]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RWDmrpXN'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce682e0-769e-4109-b7b7-9cb1f144d9aa]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aec3d78-e76b-4186-8862-a77503738dcd]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)
Nov 18 17:11:51 user nova-compute[74743]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e (non-flash)
Nov 18 17:11:51 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)
Nov 18 17:11:51 user nova-compute[74743]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e (non-flash)
Nov 18 17:11:51 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:11:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --login {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:52 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead5ad6d-54d7-4ec1-a8cb-2deea5abdbc2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:52 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5, portal: 172.16.0.220,3260]
Nov 18 17:11:52 user nova-compute[74743]: Login to [iface: default, target: iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5, portal: 172.16.0.220,3260] successful.
Nov 18 17:11:52 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:11:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:52 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7f0383-3964-44ac-a8fe-1f0135ff2d7e]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:52 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:11:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:52 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[227df38b-3c0b-47ed-adda-614010928498]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:52 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)
Nov 18 17:11:52 user nova-compute[74743]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e (non-flash)
Nov 18 17:11:52 user nova-compute[74743]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:11:52 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:11:52 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)
Nov 18 17:11:52 user nova-compute[74743]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e (non-flash)
Nov 18 17:11:52 user nova-compute[74743]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:11:52 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:11:52 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:11:52 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Connected to 172.16.0.220:3260 {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 17:11:52 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] HCTL ('35', '-', '-', 0) found on session 28 with lun 0 {{(pid=74743) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 17:11:52 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74743) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 17:11:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:11:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:11:52 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90bab12-c11c-41ad-81fa-8e4dd51cd092]: (4, ('- - 0', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:11:52 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: None {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:11:53 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:11:53 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RWDmrpXN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 17:11:53 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:11:53 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23961366339306534', 'path': '/dev/sdd'} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:11:53 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961366339306534', 'path': '/dev/sdd'} {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 17:11:53 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:07:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-761441758',display_name='tempest-ServerActionsTestOtherB-server-761441758',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-761441758',id=16,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHSxRrGlHxDyqlCOq0hy6p31kUDSaQIxafGDavUpZ/Ka4RS6tIfzT5avp8Ymkenpc8OEHVquoqpPuZPk62jn4N2SagQ88JWrrx/6+VzSF8w9eq7GAvBHe/3/xNVOBksa4g==',key_name='tempest-keypair-1267949685',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:07:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8955c5a052b34bde997f9db74d302edb',ramdisk_id='',reservation_id='r-ewenialm',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2984948',owner_user_name='tempest-ServerActionsTestOtherB-2984948-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:11:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c37b5fe2f7d74cab894eef0f41c6a5ed',uuid=49ebdd5a-824d-476a-bd10-3b891bbfe9e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c66ef239-8068-4eff-807a-830d5f3d0dba", "address": "fa:16:3e:f3:3d:ca", "network": {"id": "79046ec4-e7a8-4b7d-8607-3205067366b6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1734449136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1734449136-network", "vif_mac": "fa:16:3e:f3:3d:ca"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8955c5a052b34bde997f9db74d302edb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66ef239-80", "ovs_interfaceid": "c66ef239-8068-4eff-807a-830d5f3d0dba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:11:53 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Converting VIF {"id": "c66ef239-8068-4eff-807a-830d5f3d0dba", "address": "fa:16:3e:f3:3d:ca", "network": {"id": "79046ec4-e7a8-4b7d-8607-3205067366b6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1734449136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1734449136-network", "vif_mac": "fa:16:3e:f3:3d:ca"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8955c5a052b34bde997f9db74d302edb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66ef239-80", "ovs_interfaceid": "c66ef239-8068-4eff-807a-830d5f3d0dba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:11:53 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:3d:ca,bridge_name='br-int',has_traffic_filtering=True,id=c66ef239-8068-4eff-807a-830d5f3d0dba,network=Network(79046ec4-e7a8-4b7d-8607-3205067366b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66ef239-80') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:11:53 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:11:53 user nova-compute[74743]:   <uuid>49ebdd5a-824d-476a-bd10-3b891bbfe9e2</uuid>
Nov 18 17:11:53 user nova-compute[74743]:   <name>instance-00000010</name>
Nov 18 17:11:53 user nova-compute[74743]:   <memory>2097152</memory>
Nov 18 17:11:53 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:11:53 user nova-compute[74743]:   <metadata>
Nov 18 17:11:53 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:11:53 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:11:53 user nova-compute[74743]:       <nova:name>tempest-ServerActionsTestOtherB-server-761441758</nova:name>
Nov 18 17:11:53 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:11:51</nova:creationTime>
Nov 18 17:11:53 user nova-compute[74743]:       <nova:flavor name="m1.small">
Nov 18 17:11:53 user nova-compute[74743]:         <nova:memory>2048</nova:memory>
Nov 18 17:11:53 user nova-compute[74743]:         <nova:disk>20</nova:disk>
Nov 18 17:11:53 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:11:53 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:11:53 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:11:53 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:11:53 user nova-compute[74743]:       <nova:owner>
Nov 18 17:11:53 user nova-compute[74743]:         <nova:user uuid="c37b5fe2f7d74cab894eef0f41c6a5ed">tempest-ServerActionsTestOtherB-2984948-project-member</nova:user>
Nov 18 17:11:53 user nova-compute[74743]:         <nova:project uuid="8955c5a052b34bde997f9db74d302edb">tempest-ServerActionsTestOtherB-2984948</nova:project>
Nov 18 17:11:53 user nova-compute[74743]:       </nova:owner>
Nov 18 17:11:53 user nova-compute[74743]:       <nova:root type="image" uuid="9536f6cf-95c4-40e2-864a-09a91525678a"/>
Nov 18 17:11:53 user nova-compute[74743]:       <nova:ports>
Nov 18 17:11:53 user nova-compute[74743]:         <nova:port uuid="c66ef239-8068-4eff-807a-830d5f3d0dba">
Nov 18 17:11:53 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 18 17:11:53 user nova-compute[74743]:         </nova:port>
Nov 18 17:11:53 user nova-compute[74743]:       </nova:ports>
Nov 18 17:11:53 user nova-compute[74743]:     </nova:instance>
Nov 18 17:11:53 user nova-compute[74743]:   </metadata>
Nov 18 17:11:53 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:11:53 user nova-compute[74743]:     <system>
Nov 18 17:11:53 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:11:53 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:11:53 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:11:53 user nova-compute[74743]:       <entry name="serial">49ebdd5a-824d-476a-bd10-3b891bbfe9e2</entry>
Nov 18 17:11:53 user nova-compute[74743]:       <entry name="uuid">49ebdd5a-824d-476a-bd10-3b891bbfe9e2</entry>
Nov 18 17:11:53 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:11:53 user nova-compute[74743]:     </system>
Nov 18 17:11:53 user nova-compute[74743]:   </sysinfo>
Nov 18 17:11:53 user nova-compute[74743]:   <os>
Nov 18 17:11:53 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:11:53 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:11:53 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:11:53 user nova-compute[74743]:   </os>
Nov 18 17:11:53 user nova-compute[74743]:   <features>
Nov 18 17:11:53 user nova-compute[74743]:     <acpi/>
Nov 18 17:11:53 user nova-compute[74743]:     <apic/>
Nov 18 17:11:53 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:11:53 user nova-compute[74743]:   </features>
Nov 18 17:11:53 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:11:53 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:11:53 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:11:53 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:11:53 user nova-compute[74743]:   </clock>
Nov 18 17:11:53 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:11:53 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:11:53 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:11:53 user nova-compute[74743]:   </cpu>
Nov 18 17:11:53 user nova-compute[74743]:   <devices>
Nov 18 17:11:53 user nova-compute[74743]:     <disk type="file" device="disk">
Nov 18 17:11:53 user nova-compute[74743]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 17:11:53 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/disk"/>
Nov 18 17:11:53 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:11:53 user nova-compute[74743]:     </disk>
Nov 18 17:11:53 user nova-compute[74743]:     <disk type="block" device="disk">
Nov 18 17:11:53 user nova-compute[74743]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:11:53 user nova-compute[74743]:       <source dev="/dev/sdd"/>
Nov 18 17:11:53 user nova-compute[74743]:       <target dev="vdb" bus="virtio"/>
Nov 18 17:11:53 user nova-compute[74743]:       <serial>37e6161c-f450-4fe5-910c-e369f18f48d5</serial>
Nov 18 17:11:53 user nova-compute[74743]:     </disk>
Nov 18 17:11:53 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:11:53 user nova-compute[74743]:       <mac address="fa:16:3e:f3:3d:ca"/>
Nov 18 17:11:53 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:11:53 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:11:53 user nova-compute[74743]:       <target dev="tapc66ef239-80"/>
Nov 18 17:11:53 user nova-compute[74743]:     </interface>
Nov 18 17:11:53 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:11:53 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/console.log" append="off"/>
Nov 18 17:11:53 user nova-compute[74743]:     </serial>
Nov 18 17:11:53 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:11:53 user nova-compute[74743]:     <video>
Nov 18 17:11:53 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:11:53 user nova-compute[74743]:     </video>
Nov 18 17:11:53 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:11:53 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:11:53 user nova-compute[74743]:     </rng>
Nov 18 17:11:53 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:11:53 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:11:53 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:11:53 user nova-compute[74743]:     </memballoon>
Nov 18 17:11:53 user nova-compute[74743]:   </devices>
Nov 18 17:11:53 user nova-compute[74743]: </domain>
Nov 18 17:11:53 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:11:53 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:07:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-761441758',display_name='tempest-ServerActionsTestOtherB-server-761441758',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-761441758',id=16,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHSxRrGlHxDyqlCOq0hy6p31kUDSaQIxafGDavUpZ/Ka4RS6tIfzT5avp8Ymkenpc8OEHVquoqpPuZPk62jn4N2SagQ88JWrrx/6+VzSF8w9eq7GAvBHe/3/xNVOBksa4g==',key_name='tempest-keypair-1267949685',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:07:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8955c5a052b34bde997f9db74d302edb',ramdisk_id='',reservation_id='r-ewenialm',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2984948',owner_user_name='tempest-ServerActionsTestOtherB-2984948-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:11:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c37b5fe2f7d74cab894eef0f41c6a5ed',uuid=49ebdd5a-824d-476a-bd10-3b891bbfe9e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c66ef239-8068-4eff-807a-830d5f3d0dba", "address": "fa:16:3e:f3:3d:ca", "network": {"id": "79046ec4-e7a8-4b7d-8607-3205067366b6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1734449136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1734449136-network", "vif_mac": "fa:16:3e:f3:3d:ca"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8955c5a052b34bde997f9db74d302edb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66ef239-80", "ovs_interfaceid": "c66ef239-8068-4eff-807a-830d5f3d0dba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:11:53 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Converting VIF {"id": "c66ef239-8068-4eff-807a-830d5f3d0dba", "address": "fa:16:3e:f3:3d:ca", "network": {"id": "79046ec4-e7a8-4b7d-8607-3205067366b6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1734449136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1734449136-network", "vif_mac": "fa:16:3e:f3:3d:ca"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8955c5a052b34bde997f9db74d302edb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66ef239-80", "ovs_interfaceid": "c66ef239-8068-4eff-807a-830d5f3d0dba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:11:53 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:3d:ca,bridge_name='br-int',has_traffic_filtering=True,id=c66ef239-8068-4eff-807a-830d5f3d0dba,network=Network(79046ec4-e7a8-4b7d-8607-3205067366b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66ef239-80') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:11:53 user nova-compute[74743]: DEBUG os_vif [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:3d:ca,bridge_name='br-int',has_traffic_filtering=True,id=c66ef239-8068-4eff-807a-830d5f3d0dba,network=Network(79046ec4-e7a8-4b7d-8607-3205067366b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66ef239-80') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:11:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:11:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:11:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd9453b78-1231-55b7-b004-020385db604d', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:11:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:11:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc66ef239-80, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:11:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc66ef239-80, col_values=(('qos', UUID('9de8e832-af92-4a41-8c41-69e7987ab84a')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:11:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc66ef239-80, col_values=(('external_ids', {'iface-id': 'c66ef239-8068-4eff-807a-830d5f3d0dba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:3d:ca', 'vm-uuid': '49ebdd5a-824d-476a-bd10-3b891bbfe9e2'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:11:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:11:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:53 user nova-compute[74743]: INFO os_vif [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:3d:ca,bridge_name='br-int',has_traffic_filtering=True,id=c66ef239-8068-4eff-807a-830d5f3d0dba,network=Network(79046ec4-e7a8-4b7d-8607-3205067366b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66ef239-80')
Nov 18 17:11:53 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:11:53 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:11:53 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] No VIF found with MAC fa:16:3e:f3:3d:ca, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:11:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:54 user nova-compute[74743]: DEBUG nova.compute.manager [req-4a69899f-c9d0-4933-8c59-9b99d8c83972 req-4c069688-0bbe-419c-a66e-95997580e4a1 service nova] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Received event network-vif-plugged-c66ef239-8068-4eff-807a-830d5f3d0dba {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:11:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4a69899f-c9d0-4933-8c59-9b99d8c83972 req-4c069688-0bbe-419c-a66e-95997580e4a1 service nova] Acquiring lock "49ebdd5a-824d-476a-bd10-3b891bbfe9e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:11:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4a69899f-c9d0-4933-8c59-9b99d8c83972 req-4c069688-0bbe-419c-a66e-95997580e4a1 service nova] Lock "49ebdd5a-824d-476a-bd10-3b891bbfe9e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:11:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4a69899f-c9d0-4933-8c59-9b99d8c83972 req-4c069688-0bbe-419c-a66e-95997580e4a1 service nova] Lock "49ebdd5a-824d-476a-bd10-3b891bbfe9e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:11:54 user nova-compute[74743]: DEBUG nova.compute.manager [req-4a69899f-c9d0-4933-8c59-9b99d8c83972 req-4c069688-0bbe-419c-a66e-95997580e4a1 service nova] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] No waiting events found dispatching network-vif-plugged-c66ef239-8068-4eff-807a-830d5f3d0dba {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:11:54 user nova-compute[74743]: WARNING nova.compute.manager [req-4a69899f-c9d0-4933-8c59-9b99d8c83972 req-4c069688-0bbe-419c-a66e-95997580e4a1 service nova] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Received unexpected event network-vif-plugged-c66ef239-8068-4eff-807a-830d5f3d0dba for instance with vm_state active and task_state resize_finish.
Nov 18 17:11:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:56 user nova-compute[74743]: DEBUG nova.compute.manager [req-9dc937ed-7201-4de9-a5bf-3cb03cdd2d2e req-88357464-3772-4456-a657-08bc91acbcd7 service nova] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Received event network-vif-plugged-c66ef239-8068-4eff-807a-830d5f3d0dba {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:11:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-9dc937ed-7201-4de9-a5bf-3cb03cdd2d2e req-88357464-3772-4456-a657-08bc91acbcd7 service nova] Acquiring lock "49ebdd5a-824d-476a-bd10-3b891bbfe9e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:11:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-9dc937ed-7201-4de9-a5bf-3cb03cdd2d2e req-88357464-3772-4456-a657-08bc91acbcd7 service nova] Lock "49ebdd5a-824d-476a-bd10-3b891bbfe9e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:11:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-9dc937ed-7201-4de9-a5bf-3cb03cdd2d2e req-88357464-3772-4456-a657-08bc91acbcd7 service nova] Lock "49ebdd5a-824d-476a-bd10-3b891bbfe9e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:11:57 user nova-compute[74743]: DEBUG nova.compute.manager [req-9dc937ed-7201-4de9-a5bf-3cb03cdd2d2e req-88357464-3772-4456-a657-08bc91acbcd7 service nova] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] No waiting events found dispatching network-vif-plugged-c66ef239-8068-4eff-807a-830d5f3d0dba {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:11:57 user nova-compute[74743]: WARNING nova.compute.manager [req-9dc937ed-7201-4de9-a5bf-3cb03cdd2d2e req-88357464-3772-4456-a657-08bc91acbcd7 service nova] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Received unexpected event network-vif-plugged-c66ef239-8068-4eff-807a-830d5f3d0dba for instance with vm_state active and task_state resize_finish.
Nov 18 17:11:57 user nova-compute[74743]: DEBUG nova.compute.manager [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:11:57 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Instance running successfully.
Nov 18 17:11:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Failed to set time: agent not configured {{(pid=74743) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 18 17:11:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-1e620a8d-14fc-4443-b753-6f9b1daa2187 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] finish_migration finished successfully. {{(pid=74743) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 18 17:11:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:11:59 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:12:01 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-277fe3c9-e848-45ce-92f6-e715271f01dd tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Acquiring lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:12:01 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-277fe3c9-e848-45ce-92f6-e715271f01dd tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:12:01 user nova-compute[74743]: INFO nova.compute.manager [None req-277fe3c9-e848-45ce-92f6-e715271f01dd tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Detaching volume cbbc1108-8470-4c44-a28c-c66012ea375e
Nov 18 17:12:01 user nova-compute[74743]: INFO nova.virt.block_device [None req-277fe3c9-e848-45ce-92f6-e715271f01dd tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Attempting to driver detach volume cbbc1108-8470-4c44-a28c-c66012ea375e from mountpoint /dev/vdb
Nov 18 17:12:01 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-277fe3c9-e848-45ce-92f6-e715271f01dd tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Attempting to detach device vdb from instance f93bf0ac-ecc8-447d-b9c1-381d36cd3135 from the persistent domain config. {{(pid=74743) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 17:12:01 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-277fe3c9-e848-45ce-92f6-e715271f01dd tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 17:12:01 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:12:01 user nova-compute[74743]:   <source dev="/dev/sdb"/>
Nov 18 17:12:01 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:12:01 user nova-compute[74743]:   <serial>cbbc1108-8470-4c44-a28c-c66012ea375e</serial>
Nov 18 17:12:01 user nova-compute[74743]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 17:12:01 user nova-compute[74743]: </disk>
Nov 18 17:12:01 user nova-compute[74743]:  {{(pid=74743) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 17:12:01 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-277fe3c9-e848-45ce-92f6-e715271f01dd tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Successfully detached device vdb from instance f93bf0ac-ecc8-447d-b9c1-381d36cd3135 from the persistent domain config.
Nov 18 17:12:01 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-277fe3c9-e848-45ce-92f6-e715271f01dd tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f93bf0ac-ecc8-447d-b9c1-381d36cd3135 from the live domain config. {{(pid=74743) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 17:12:01 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-277fe3c9-e848-45ce-92f6-e715271f01dd tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 17:12:01 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:12:01 user nova-compute[74743]:   <source dev="/dev/sdb"/>
Nov 18 17:12:01 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:12:01 user nova-compute[74743]:   <serial>cbbc1108-8470-4c44-a28c-c66012ea375e</serial>
Nov 18 17:12:01 user nova-compute[74743]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 17:12:01 user nova-compute[74743]: </disk>
Nov 18 17:12:01 user nova-compute[74743]:  {{(pid=74743) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 17:12:02 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-277fe3c9-e848-45ce-92f6-e715271f01dd tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f93bf0ac-ecc8-447d-b9c1-381d36cd3135 {{(pid=74743) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 17:12:03 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:12:04 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:12:08 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:12:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:12:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:12:08 user nova-compute[74743]: DEBUG nova.compute.manager [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Starting instance... {{(pid=74743) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 17:12:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:12:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:12:08 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74743) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 17:12:08 user nova-compute[74743]: INFO nova.compute.claims [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Claim successful on node user
Nov 18 17:12:08 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:12:08 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:12:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.472s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:12:09 user nova-compute[74743]: DEBUG nova.compute.manager [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Start building networks asynchronously for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 17:12:09 user nova-compute[74743]: DEBUG nova.compute.manager [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Allocating IP information in the background. {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 17:12:09 user nova-compute[74743]: DEBUG nova.network.neutron [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] allocate_for_instance() {{(pid=74743) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 17:12:09 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 17:12:09 user nova-compute[74743]: DEBUG nova.compute.manager [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Start building block device mappings for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 17:12:09 user nova-compute[74743]: DEBUG nova.policy [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '89ce0d4bf7234c348b9b1a8979609c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a956c4d6e4304d34872ecf989279c886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74743) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 17:12:09 user nova-compute[74743]: INFO nova.virt.block_device [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Booting with volume 17045ea7-5355-44f9-8ac7-87f27257d685 at /dev/vda
Nov 18 17:12:09 user nova-compute[74743]: DEBUG os_brick.utils [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:12:09 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:09 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:09 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[741b7688-823e-4dfd-b425-9f18da5d986f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1116acd8874d\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:12:09 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:09 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:09 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8b9c99-39c2-4e66-b90e-dd0855168540]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:12:09 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:09 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:09 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6104ea-3167-4a25-912a-92b23384f451]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:12:09 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1ce7ed-49e8-4e46-97d8-083e2fcd6b4e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:12:09 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Running cmd (subprocess): nvme version {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:09 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] 'nvme version' failed. Not Retrying. {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:12:09 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.nvmeof [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] nvme not present on system {{(pid=74743) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 17:12:09 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:09 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:12:09 user nova-compute[74743]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 17:12:09 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[6770cbd9-e2bc-4efd-b198-c1f8e9b7a452]: (4, '') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:12:09 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74743) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 17:12:09 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 17:12:09 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] LIGHTOS: no hostnqn found. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 17:12:09 user nova-compute[74743]: DEBUG os_brick.utils [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1116acd8874d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:12:09 user nova-compute[74743]: DEBUG nova.virt.block_device [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Updating existing volume attachment record: d17bc761-7119-469a-8171-0af9a45994df {{(pid=74743) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 17:12:09 user nova-compute[74743]: DEBUG nova.network.neutron [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Successfully created port: 1c9871cc-eb56-4eef-8563-b12d5f69c1af {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:12:09 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:12:10 user nova-compute[74743]: DEBUG nova.network.neutron [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Successfully updated port: 1c9871cc-eb56-4eef-8563-b12d5f69c1af {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:12:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "refresh_cache-cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:12:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquired lock "refresh_cache-cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:12:10 user nova-compute[74743]: DEBUG nova.network.neutron [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:12:10 user nova-compute[74743]: DEBUG nova.compute.manager [req-c64c748b-a04a-4aa8-bd13-e9b33497bc0b req-38775f78-9770-48eb-b49d-99f4a5c50577 service nova] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Received event network-changed-1c9871cc-eb56-4eef-8563-b12d5f69c1af {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:12:10 user nova-compute[74743]: DEBUG nova.compute.manager [req-c64c748b-a04a-4aa8-bd13-e9b33497bc0b req-38775f78-9770-48eb-b49d-99f4a5c50577 service nova] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Refreshing instance network info cache due to event network-changed-1c9871cc-eb56-4eef-8563-b12d5f69c1af. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:12:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-c64c748b-a04a-4aa8-bd13-e9b33497bc0b req-38775f78-9770-48eb-b49d-99f4a5c50577 service nova] Acquiring lock "refresh_cache-cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:12:10 user nova-compute[74743]: DEBUG nova.network.neutron [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:12:10 user nova-compute[74743]: DEBUG nova.network.neutron [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Updating instance_info_cache with network_info: [{"id": "1c9871cc-eb56-4eef-8563-b12d5f69c1af", "address": "fa:16:3e:0d:f2:57", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c9871cc-eb", "ovs_interfaceid": "1c9871cc-eb56-4eef-8563-b12d5f69c1af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:12:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Releasing lock "refresh_cache-cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:12:10 user nova-compute[74743]: DEBUG nova.compute.manager [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Instance network_info: |[{"id": "1c9871cc-eb56-4eef-8563-b12d5f69c1af", "address": "fa:16:3e:0d:f2:57", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c9871cc-eb", "ovs_interfaceid": "1c9871cc-eb56-4eef-8563-b12d5f69c1af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 17:12:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-c64c748b-a04a-4aa8-bd13-e9b33497bc0b req-38775f78-9770-48eb-b49d-99f4a5c50577 service nova] Acquired lock "refresh_cache-cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:12:10 user nova-compute[74743]: DEBUG nova.network.neutron [req-c64c748b-a04a-4aa8-bd13-e9b33497bc0b req-38775f78-9770-48eb-b49d-99f4a5c50577 service nova] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Refreshing network info cache for port 1c9871cc-eb56-4eef-8563-b12d5f69c1af {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:12:11 user nova-compute[74743]: DEBUG nova.network.neutron [req-c64c748b-a04a-4aa8-bd13-e9b33497bc0b req-38775f78-9770-48eb-b49d-99f4a5c50577 service nova] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Updated VIF entry in instance network info cache for port 1c9871cc-eb56-4eef-8563-b12d5f69c1af. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:12:11 user nova-compute[74743]: DEBUG nova.network.neutron [req-c64c748b-a04a-4aa8-bd13-e9b33497bc0b req-38775f78-9770-48eb-b49d-99f4a5c50577 service nova] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Updating instance_info_cache with network_info: [{"id": "1c9871cc-eb56-4eef-8563-b12d5f69c1af", "address": "fa:16:3e:0d:f2:57", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c9871cc-eb", "ovs_interfaceid": "1c9871cc-eb56-4eef-8563-b12d5f69c1af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:12:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-c64c748b-a04a-4aa8-bd13-e9b33497bc0b req-38775f78-9770-48eb-b49d-99f4a5c50577 service nova] Releasing lock "refresh_cache-cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:12:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-187ef767-bda8-4965-ba35-8b678c680288 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquiring lock "a77117a2-748d-4a39-8db7-8b965a1725fc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:12:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-187ef767-bda8-4965-ba35-8b678c680288 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "a77117a2-748d-4a39-8db7-8b965a1725fc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:12:12 user nova-compute[74743]: INFO nova.compute.manager [None req-187ef767-bda8-4965-ba35-8b678c680288 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Detaching volume ec4a2b65-8e33-4a44-8961-7c0570cde14e
Nov 18 17:12:12 user nova-compute[74743]: INFO nova.virt.block_device [None req-187ef767-bda8-4965-ba35-8b678c680288 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Attempting to driver detach volume ec4a2b65-8e33-4a44-8961-7c0570cde14e from mountpoint /dev/vdb
Nov 18 17:12:12 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-187ef767-bda8-4965-ba35-8b678c680288 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Attempting to detach device vdb from instance a77117a2-748d-4a39-8db7-8b965a1725fc from the persistent domain config. {{(pid=74743) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 17:12:12 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-187ef767-bda8-4965-ba35-8b678c680288 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 17:12:12 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:12:12 user nova-compute[74743]:   <source dev="/dev/sdc"/>
Nov 18 17:12:12 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:12:12 user nova-compute[74743]:   <serial>ec4a2b65-8e33-4a44-8961-7c0570cde14e</serial>
Nov 18 17:12:12 user nova-compute[74743]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 18 17:12:12 user nova-compute[74743]: </disk>
Nov 18 17:12:12 user nova-compute[74743]:  {{(pid=74743) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 17:12:12 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-187ef767-bda8-4965-ba35-8b678c680288 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Successfully detached device vdb from instance a77117a2-748d-4a39-8db7-8b965a1725fc from the persistent domain config.
Nov 18 17:12:12 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-187ef767-bda8-4965-ba35-8b678c680288 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a77117a2-748d-4a39-8db7-8b965a1725fc from the live domain config. {{(pid=74743) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 17:12:12 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-187ef767-bda8-4965-ba35-8b678c680288 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 17:12:12 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:12:12 user nova-compute[74743]:   <source dev="/dev/sdc"/>
Nov 18 17:12:12 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:12:12 user nova-compute[74743]:   <serial>ec4a2b65-8e33-4a44-8961-7c0570cde14e</serial>
Nov 18 17:12:12 user nova-compute[74743]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 18 17:12:12 user nova-compute[74743]: </disk>
Nov 18 17:12:12 user nova-compute[74743]:  {{(pid=74743) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 17:12:12 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-187ef767-bda8-4965-ba35-8b678c680288 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a77117a2-748d-4a39-8db7-8b965a1725fc {{(pid=74743) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 17:12:13 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:12:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG nova.compute.manager [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Start spawning the instance on the hypervisor. {{(pid=74743) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Creating instance directory {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 17:12:15 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Creating image(s)
Nov 18 17:12:15 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Did not create local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Ensure instance console log exists: /opt/stack/data/nova/instances/cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Start _get_guest_xml network_info=[{"id": "1c9871cc-eb56-4eef-8563-b12d5f69c1af", "address": "fa:16:3e:0d:f2:57", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c9871cc-eb", "ovs_interfaceid": "1c9871cc-eb56-4eef-8563-b12d5f69c1af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': 'd17bc761-7119-469a-8171-0af9a45994df', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xjDQMAGp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4', 'attached_at': '', 'detached_at': '', 'volume_id': '17045ea7-5355-44f9-8ac7-87f27257d685', 'serial': '17045ea7-5355-44f9-8ac7-87f27257d685'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:12:15 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:12:15 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:12:15 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Calling os-brick to attach iSCSI Volume {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xjDQMAGp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:12:15 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:12:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:12:15 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:12:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:12:15 user nova-compute[74743]: INFO os_brick.initiator.connectors.iscsi [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 17:12:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 -p 172.16.0.220:3260 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0669f92-6c43-4631-95e7-333476d06ba2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 17:12:15 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 -p 172.16.0.220:3260 --interface default --op new {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32fbcfc-89c4-4124-9f28-dadd66259d2f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685] added\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685] added
Nov 18 17:12:15 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1d3231-cdc2-4916-8851-a9357246f966]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[abceebd8-c551-46b4-9279-9ba1bc25bc67]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xjDQMAGp {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xjDQMAGp" returned: 0 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7f440c-ffc7-48be-b303-06ef7a6a38c6]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xjDQMAGp'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[650663cc-8edb-42cb-941b-e2642b358a4a]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aefa01a-9ea2-4e0e-9682-cc3e84727494]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)
Nov 18 17:12:15 user nova-compute[74743]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e (non-flash)
Nov 18 17:12:15 user nova-compute[74743]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:12:15 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)
Nov 18 17:12:15 user nova-compute[74743]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e (non-flash)
Nov 18 17:12:15 user nova-compute[74743]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:12:15 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 -p 172.16.0.220:3260 --login {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[4afd49ee-b4af-4b55-97fe-a8284d290d59]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685, portal: 172.16.0.220,3260]
Nov 18 17:12:15 user nova-compute[74743]: Login to [iface: default, target: iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685, portal: 172.16.0.220,3260] successful.
Nov 18 17:12:15 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac1458a-f43c-40c1-bed2-a9a17bedab56]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[4714f70b-f7d3-40f7-999c-bd559bcf3c0a]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)
Nov 18 17:12:15 user nova-compute[74743]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e (non-flash)
Nov 18 17:12:15 user nova-compute[74743]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:12:15 user nova-compute[74743]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:12:15 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)
Nov 18 17:12:15 user nova-compute[74743]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e (non-flash)
Nov 18 17:12:15 user nova-compute[74743]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:12:15 user nova-compute[74743]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:12:15 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Connected to 172.16.0.220:3260 {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] HCTL ('36', '-', '-', 0) found on session 29 with lun 0 {{(pid=74743) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74743) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c53698-ec5b-43d6-9d7b-a94aeef28ff2]: (4, ('- - 0', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Searching for a device in session 29 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:12:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xjDQMAGp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 17:12:16 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:12:16 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23366333930643134', 'path': '/dev/sde'} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:12:16 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366333930643134', 'path': '/dev/sde'} {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 17:12:16 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:12:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1445401306',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1445401306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1445401306',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHuq53pFbJtFz2jLBrgr31qm5IYMFOfEyVT5+EF0v8zWR9lFsevHQBdkqCfpEpuAGPGeldy+Lrg+ToUbY4nqpHL5H6Apayio2qHMA6Mh5/yr00ssL68q1cTaWMoErtqN8Q==',key_name='tempest-keypair-1644584425',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a956c4d6e4304d34872ecf989279c886',ramdisk_id='',reservation_id='r-1zmdkqrj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1373443944',owner_user_name='tempest-TestVolumeBootPattern-1373443944-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:12:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89ce0d4bf7234c348b9b1a8979609c7b',uuid=cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c9871cc-eb56-4eef-8563-b12d5f69c1af", "address": "fa:16:3e:0d:f2:57", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c9871cc-eb", "ovs_interfaceid": "1c9871cc-eb56-4eef-8563-b12d5f69c1af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:12:16 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Converting VIF {"id": "1c9871cc-eb56-4eef-8563-b12d5f69c1af", "address": "fa:16:3e:0d:f2:57", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c9871cc-eb", "ovs_interfaceid": "1c9871cc-eb56-4eef-8563-b12d5f69c1af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:12:16 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:f2:57,bridge_name='br-int',has_traffic_filtering=True,id=1c9871cc-eb56-4eef-8563-b12d5f69c1af,network=Network(fc55f18a-b779-4b04-8828-278ecd62211a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c9871cc-eb') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:12:16 user nova-compute[74743]: DEBUG nova.objects.instance [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lazy-loading 'pci_devices' on Instance uuid cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:12:16 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:12:16 user nova-compute[74743]:   <uuid>cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4</uuid>
Nov 18 17:12:16 user nova-compute[74743]:   <name>instance-0000001b</name>
Nov 18 17:12:16 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:12:16 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:12:16 user nova-compute[74743]:   <metadata>
Nov 18 17:12:16 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:12:16 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:12:16 user nova-compute[74743]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1445401306</nova:name>
Nov 18 17:12:16 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:12:15</nova:creationTime>
Nov 18 17:12:16 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:12:16 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:12:16 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:12:16 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:12:16 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:12:16 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:12:16 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:12:16 user nova-compute[74743]:       <nova:owner>
Nov 18 17:12:16 user nova-compute[74743]:         <nova:user uuid="89ce0d4bf7234c348b9b1a8979609c7b">tempest-TestVolumeBootPattern-1373443944-project-member</nova:user>
Nov 18 17:12:16 user nova-compute[74743]:         <nova:project uuid="a956c4d6e4304d34872ecf989279c886">tempest-TestVolumeBootPattern-1373443944</nova:project>
Nov 18 17:12:16 user nova-compute[74743]:       </nova:owner>
Nov 18 17:12:16 user nova-compute[74743]:       <nova:ports>
Nov 18 17:12:16 user nova-compute[74743]:         <nova:port uuid="1c9871cc-eb56-4eef-8563-b12d5f69c1af">
Nov 18 17:12:16 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 18 17:12:16 user nova-compute[74743]:         </nova:port>
Nov 18 17:12:16 user nova-compute[74743]:       </nova:ports>
Nov 18 17:12:16 user nova-compute[74743]:     </nova:instance>
Nov 18 17:12:16 user nova-compute[74743]:   </metadata>
Nov 18 17:12:16 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:12:16 user nova-compute[74743]:     <system>
Nov 18 17:12:16 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:12:16 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:12:16 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:12:16 user nova-compute[74743]:       <entry name="serial">cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4</entry>
Nov 18 17:12:16 user nova-compute[74743]:       <entry name="uuid">cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4</entry>
Nov 18 17:12:16 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:12:16 user nova-compute[74743]:     </system>
Nov 18 17:12:16 user nova-compute[74743]:   </sysinfo>
Nov 18 17:12:16 user nova-compute[74743]:   <os>
Nov 18 17:12:16 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:12:16 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:12:16 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:12:16 user nova-compute[74743]:   </os>
Nov 18 17:12:16 user nova-compute[74743]:   <features>
Nov 18 17:12:16 user nova-compute[74743]:     <acpi/>
Nov 18 17:12:16 user nova-compute[74743]:     <apic/>
Nov 18 17:12:16 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:12:16 user nova-compute[74743]:   </features>
Nov 18 17:12:16 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:12:16 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:12:16 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:12:16 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:12:16 user nova-compute[74743]:   </clock>
Nov 18 17:12:16 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:12:16 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:12:16 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:12:16 user nova-compute[74743]:   </cpu>
Nov 18 17:12:16 user nova-compute[74743]:   <devices>
Nov 18 17:12:16 user nova-compute[74743]:     <disk type="block" device="disk">
Nov 18 17:12:16 user nova-compute[74743]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:12:16 user nova-compute[74743]:       <source dev="/dev/sde"/>
Nov 18 17:12:16 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:12:16 user nova-compute[74743]:       <serial>17045ea7-5355-44f9-8ac7-87f27257d685</serial>
Nov 18 17:12:16 user nova-compute[74743]:     </disk>
Nov 18 17:12:16 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:12:16 user nova-compute[74743]:       <mac address="fa:16:3e:0d:f2:57"/>
Nov 18 17:12:16 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:12:16 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:12:16 user nova-compute[74743]:       <target dev="tap1c9871cc-eb"/>
Nov 18 17:12:16 user nova-compute[74743]:     </interface>
Nov 18 17:12:16 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:12:16 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4/console.log" append="off"/>
Nov 18 17:12:16 user nova-compute[74743]:     </serial>
Nov 18 17:12:16 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:12:16 user nova-compute[74743]:     <video>
Nov 18 17:12:16 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:12:16 user nova-compute[74743]:     </video>
Nov 18 17:12:16 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:12:16 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:12:16 user nova-compute[74743]:     </rng>
Nov 18 17:12:16 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:12:16 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:12:16 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:12:16 user nova-compute[74743]:     </memballoon>
Nov 18 17:12:16 user nova-compute[74743]:   </devices>
Nov 18 17:12:16 user nova-compute[74743]: </domain>
Nov 18 17:12:16 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:12:16 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:12:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1445401306',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1445401306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1445401306',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHuq53pFbJtFz2jLBrgr31qm5IYMFOfEyVT5+EF0v8zWR9lFsevHQBdkqCfpEpuAGPGeldy+Lrg+ToUbY4nqpHL5H6Apayio2qHMA6Mh5/yr00ssL68q1cTaWMoErtqN8Q==',key_name='tempest-keypair-1644584425',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a956c4d6e4304d34872ecf989279c886',ramdisk_id='',reservation_id='r-1zmdkqrj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1373443944',owner_user_name='tempest-TestVolumeBootPattern-1373443944-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:12:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89ce0d4bf7234c348b9b1a8979609c7b',uuid=cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c9871cc-eb56-4eef-8563-b12d5f69c1af", "address": "fa:16:3e:0d:f2:57", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c9871cc-eb", "ovs_interfaceid": "1c9871cc-eb56-4eef-8563-b12d5f69c1af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:12:16 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Converting VIF {"id": "1c9871cc-eb56-4eef-8563-b12d5f69c1af", "address": "fa:16:3e:0d:f2:57", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c9871cc-eb", "ovs_interfaceid": "1c9871cc-eb56-4eef-8563-b12d5f69c1af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:12:16 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:f2:57,bridge_name='br-int',has_traffic_filtering=True,id=1c9871cc-eb56-4eef-8563-b12d5f69c1af,network=Network(fc55f18a-b779-4b04-8828-278ecd62211a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c9871cc-eb') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:12:16 user nova-compute[74743]: DEBUG os_vif [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:f2:57,bridge_name='br-int',has_traffic_filtering=True,id=1c9871cc-eb56-4eef-8563-b12d5f69c1af,network=Network(fc55f18a-b779-4b04-8828-278ecd62211a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c9871cc-eb') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:12:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:12:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:12:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:12:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:12:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '336ec22e-a188-59bd-b62a-0030115082ad', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:12:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:12:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:12:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:12:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1c9871cc-eb, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:12:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1c9871cc-eb, col_values=(('qos', UUID('fd2c4a0f-ba78-4751-9f29-b10e6059c2b5')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:12:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1c9871cc-eb, col_values=(('external_ids', {'iface-id': '1c9871cc-eb56-4eef-8563-b12d5f69c1af', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:f2:57', 'vm-uuid': 'cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:12:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:12:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:12:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:12:16 user nova-compute[74743]: INFO os_vif [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:f2:57,bridge_name='br-int',has_traffic_filtering=True,id=1c9871cc-eb56-4eef-8563-b12d5f69c1af,network=Network(fc55f18a-b779-4b04-8828-278ecd62211a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c9871cc-eb')
Nov 18 17:12:16 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:12:16 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] No VIF found with MAC fa:16:3e:0d:f2:57, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:12:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:12:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:12:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:12:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-e3b0f729-b3a7-442a-a31b-1e4fc3985692 req-1e934bee-c03e-4d3d-b1f8-ad5d238308ea service nova] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Received event network-vif-plugged-1c9871cc-eb56-4eef-8563-b12d5f69c1af {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:12:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e3b0f729-b3a7-442a-a31b-1e4fc3985692 req-1e934bee-c03e-4d3d-b1f8-ad5d238308ea service nova] Acquiring lock "cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:12:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e3b0f729-b3a7-442a-a31b-1e4fc3985692 req-1e934bee-c03e-4d3d-b1f8-ad5d238308ea service nova] Lock "cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:12:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e3b0f729-b3a7-442a-a31b-1e4fc3985692 req-1e934bee-c03e-4d3d-b1f8-ad5d238308ea service nova] Lock "cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:12:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-e3b0f729-b3a7-442a-a31b-1e4fc3985692 req-1e934bee-c03e-4d3d-b1f8-ad5d238308ea service nova] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] No waiting events found dispatching network-vif-plugged-1c9871cc-eb56-4eef-8563-b12d5f69c1af {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:12:18 user nova-compute[74743]: WARNING nova.compute.manager [req-e3b0f729-b3a7-442a-a31b-1e4fc3985692 req-1e934bee-c03e-4d3d-b1f8-ad5d238308ea service nova] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Received unexpected event network-vif-plugged-1c9871cc-eb56-4eef-8563-b12d5f69c1af for instance with vm_state building and task_state spawning.
Nov 18 17:12:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:12:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:12:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:12:19 user nova-compute[74743]: DEBUG nova.compute.manager [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:12:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Guest created on hypervisor {{(pid=74743) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 17:12:19 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Instance spawned successfully.
Nov 18 17:12:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 17:12:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Found default for hw_cdrom_bus of ide {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:12:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Found default for hw_disk_bus of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:12:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Found default for hw_input_bus of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:12:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Found default for hw_pointer_model of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:12:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Found default for hw_video_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:12:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Found default for hw_vif_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:12:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:12:19 user nova-compute[74743]: INFO nova.compute.manager [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Took 4.90 seconds to spawn the instance on the hypervisor.
Nov 18 17:12:19 user nova-compute[74743]: DEBUG nova.compute.manager [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:12:20 user nova-compute[74743]: INFO nova.compute.manager [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Took 11.50 seconds to build instance.
Nov 18 17:12:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-44108973-4973-44f9-b059-49a8c7675ede tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.600s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:12:20 user nova-compute[74743]: DEBUG nova.compute.manager [req-31475c99-2e00-41b6-9773-28d019bf93f7 req-c96e4f91-a0aa-45cc-a6b7-f7f2234b0c70 service nova] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Received event network-vif-plugged-1c9871cc-eb56-4eef-8563-b12d5f69c1af {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:12:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-31475c99-2e00-41b6-9773-28d019bf93f7 req-c96e4f91-a0aa-45cc-a6b7-f7f2234b0c70 service nova] Acquiring lock "cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:12:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-31475c99-2e00-41b6-9773-28d019bf93f7 req-c96e4f91-a0aa-45cc-a6b7-f7f2234b0c70 service nova] Lock "cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:12:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-31475c99-2e00-41b6-9773-28d019bf93f7 req-c96e4f91-a0aa-45cc-a6b7-f7f2234b0c70 service nova] Lock "cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:12:20 user nova-compute[74743]: DEBUG nova.compute.manager [req-31475c99-2e00-41b6-9773-28d019bf93f7 req-c96e4f91-a0aa-45cc-a6b7-f7f2234b0c70 service nova] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] No waiting events found dispatching network-vif-plugged-1c9871cc-eb56-4eef-8563-b12d5f69c1af {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:12:20 user nova-compute[74743]: WARNING nova.compute.manager [req-31475c99-2e00-41b6-9773-28d019bf93f7 req-c96e4f91-a0aa-45cc-a6b7-f7f2234b0c70 service nova] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Received unexpected event network-vif-plugged-1c9871cc-eb56-4eef-8563-b12d5f69c1af for instance with vm_state active and task_state None.
Nov 18 17:12:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-478414df-95bc-4d93-8f16-a729fd895c0c tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Acquiring lock "2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-478414df-95bc-4d93-8f16-a729fd895c0c tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Lock "2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-478414df-95bc-4d93-8f16-a729fd895c0c tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Acquiring lock "2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-478414df-95bc-4d93-8f16-a729fd895c0c tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Lock "2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-478414df-95bc-4d93-8f16-a729fd895c0c tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Lock "2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:12:22 user nova-compute[74743]: INFO nova.compute.manager [None req-478414df-95bc-4d93-8f16-a729fd895c0c tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] Terminating instance
Nov 18 17:12:22 user nova-compute[74743]: DEBUG nova.compute.manager [None req-478414df-95bc-4d93-8f16-a729fd895c0c tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] Start destroying the instance on the hypervisor. {{(pid=74743) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:12:22 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-277fe3c9-e848-45ce-92f6-e715271f01dd tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f93bf0ac-ecc8-447d-b9c1-381d36cd3135 is timed out.
Nov 18 17:12:22 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-277fe3c9-e848-45ce-92f6-e715271f01dd tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Successfully detached device vdb from instance f93bf0ac-ecc8-447d-b9c1-381d36cd3135 from the live domain config.
Nov 18 17:12:22 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-277fe3c9-e848-45ce-92f6-e715271f01dd tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] calling os-brick to detach iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-277fe3c9-e848-45ce-92f6-e715271f01dd tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, {'target_iqn': 'iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ApUghBxk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:12:22 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-277fe3c9-e848-45ce-92f6-e715271f01dd tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:12:22 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-277fe3c9-e848-45ce-92f6-e715271f01dd tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-277fe3c9-e848-45ce-92f6-e715271f01dd tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ea3076-6ca4-4731-b64b-dec7e1b16d5c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-277fe3c9-e848-45ce-92f6-e715271f01dd tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 17:12:22 user nova-compute[74743]: No targets found.
Nov 18 17:12:22 user nova-compute[74743]: iSNS:
Nov 18 17:12:22 user nova-compute[74743]: No targets found.
Nov 18 17:12:22 user nova-compute[74743]: STATIC:
Nov 18 17:12:22 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685
Nov 18 17:12:22 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:12:22 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:12:22 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5
Nov 18 17:12:22 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:12:22 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:12:22 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e
Nov 18 17:12:22 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:12:22 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:12:22 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e
Nov 18 17:12:22 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:12:22 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:12:22 user nova-compute[74743]: FIRMWARE:
Nov 18 17:12:22 user nova-compute[74743]: No targets found.
Nov 18 17:12:22 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-277fe3c9-e848-45ce-92f6-e715271f01dd tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 17:12:22 user nova-compute[74743]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 17:12:22 user nova-compute[74743]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74743) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-277fe3c9-e848-45ce-92f6-e715271f01dd tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e', 0)] {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG nova.compute.manager [req-59bb7735-2a01-4017-ae7d-4cf16f6d2c4e req-6c4411a7-22fe-4efb-930d-1606f7516c86 service nova] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] Received event network-vif-unplugged-8e586810-21e7-43d2-80dc-66c83416b245 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-59bb7735-2a01-4017-ae7d-4cf16f6d2c4e req-6c4411a7-22fe-4efb-930d-1606f7516c86 service nova] Acquiring lock "2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-59bb7735-2a01-4017-ae7d-4cf16f6d2c4e req-6c4411a7-22fe-4efb-930d-1606f7516c86 service nova] Lock "2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-59bb7735-2a01-4017-ae7d-4cf16f6d2c4e req-6c4411a7-22fe-4efb-930d-1606f7516c86 service nova] Lock "2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG nova.compute.manager [req-59bb7735-2a01-4017-ae7d-4cf16f6d2c4e req-6c4411a7-22fe-4efb-930d-1606f7516c86 service nova] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] No waiting events found dispatching network-vif-unplugged-8e586810-21e7-43d2-80dc-66c83416b245 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG nova.compute.manager [req-59bb7735-2a01-4017-ae7d-4cf16f6d2c4e req-6c4411a7-22fe-4efb-930d-1606f7516c86 service nova] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] Received event network-vif-unplugged-8e586810-21e7-43d2-80dc-66c83416b245 for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[eddf387a-485c-427b-8d5d-dd1774a234a1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc254631-bcc0-42c7-ae08-c283c8840196]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-277fe3c9-e848-45ce-92f6-e715271f01dd tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)
Nov 18 17:12:22 user nova-compute[74743]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e (non-flash)
Nov 18 17:12:22 user nova-compute[74743]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:12:22 user nova-compute[74743]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:12:22 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-277fe3c9-e848-45ce-92f6-e715271f01dd tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)
Nov 18 17:12:22 user nova-compute[74743]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e (non-flash)
Nov 18 17:12:22 user nova-compute[74743]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:12:22 user nova-compute[74743]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:12:22 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-277fe3c9-e848-45ce-92f6-e715271f01dd tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb399591b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e'): ({'sdb'}, set())}) {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-277fe3c9-e848-45ce-92f6-e715271f01dd tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Removing single pathed devices sdb {{(pid=74743) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3aaf34-768c-4cd0-a913-abeccb0134b0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[994213bf-74c7-49d3-95f3-a4796cafd46c]: (4, ('ok\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-277fe3c9-e848-45ce-92f6-e715271f01dd tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Flushing IO for device /dev/sdb {{(pid=74743) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bcdffc9-44f4-4242-8dfa-98166fcb21bd]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-277fe3c9-e848-45ce-92f6-e715271f01dd tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74743) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae348fc2-3827-485f-ac2b-32c5f1e39346]: (4, ('1', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-277fe3c9-e848-45ce-92f6-e715271f01dd tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-277fe3c9-e848-45ce-92f6-e715271f01dd tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] SCSI volumes sdb have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-277fe3c9-e848-45ce-92f6-e715271f01dd tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e')] {{(pid=74743) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7e1442-bbbf-4a4f-9aa2-a49999a2b3db]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-277fe3c9-e848-45ce-92f6-e715271f01dd tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e -p 172.16.0.220:3260 --logout {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ebf630-f516-476a-afe8-df9e0b3be9cc]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-277fe3c9-e848-45ce-92f6-e715271f01dd tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e, portal: 172.16.0.220,3260]
Nov 18 17:12:22 user nova-compute[74743]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e, portal: 172.16.0.220,3260] successful.
Nov 18 17:12:22 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e -p 172.16.0.220:3260 --op delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbc1108-8470-4c44-a28c-c66012ea375e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[2116bd29-be47-4b1c-855c-ffef4f241ffa]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-277fe3c9-e848-45ce-92f6-e715271f01dd tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-277fe3c9-e848-45ce-92f6-e715271f01dd tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-277fe3c9-e848-45ce-92f6-e715271f01dd tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] <== disconnect_volume: return (353ms) None {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-277fe3c9-e848-45ce-92f6-e715271f01dd tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Disconnected iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 17:12:22 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] Instance destroyed successfully.
Nov 18 17:12:22 user nova-compute[74743]: DEBUG nova.objects.instance [None req-478414df-95bc-4d93-8f16-a729fd895c0c tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Lazy-loading 'resources' on Instance uuid 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-478414df-95bc-4d93-8f16-a729fd895c0c tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:10:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1163566358',display_name='tempest-ServersNegativeTestJSON-server-1163566358',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1163566358',id=23,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:10:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b57ac6e8f2384c6fb2bb4cbdeee429c0',ramdisk_id='',reservation_id='r-m3ql625q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-840944804',owner_user_name='tempest-ServersNegativeTestJSON-840944804-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:10:39Z,user_data=None,user_id='357f81ed0cae4dda9721d5ce81d23be5',uuid=2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e586810-21e7-43d2-80dc-66c83416b245", "address": "fa:16:3e:ee:61:55", "network": {"id": "13e0d3be-e4a3-4f20-8aac-1cf64be1e1b2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-853497736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b57ac6e8f2384c6fb2bb4cbdeee429c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e586810-21", "ovs_interfaceid": "8e586810-21e7-43d2-80dc-66c83416b245", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-478414df-95bc-4d93-8f16-a729fd895c0c tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Converting VIF {"id": "8e586810-21e7-43d2-80dc-66c83416b245", "address": "fa:16:3e:ee:61:55", "network": {"id": "13e0d3be-e4a3-4f20-8aac-1cf64be1e1b2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-853497736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b57ac6e8f2384c6fb2bb4cbdeee429c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e586810-21", "ovs_interfaceid": "8e586810-21e7-43d2-80dc-66c83416b245", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-478414df-95bc-4d93-8f16-a729fd895c0c tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:61:55,bridge_name='br-int',has_traffic_filtering=True,id=8e586810-21e7-43d2-80dc-66c83416b245,network=Network(13e0d3be-e4a3-4f20-8aac-1cf64be1e1b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e586810-21') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG os_vif [None req-478414df-95bc-4d93-8f16-a729fd895c0c tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:61:55,bridge_name='br-int',has_traffic_filtering=True,id=8e586810-21e7-43d2-80dc-66c83416b245,network=Network(13e0d3be-e4a3-4f20-8aac-1cf64be1e1b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e586810-21') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e586810-21, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2871696e-e4ca-4377-a949-c6f14e1f8f1f) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:12:22 user nova-compute[74743]: INFO os_vif [None req-478414df-95bc-4d93-8f16-a729fd895c0c tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:61:55,bridge_name='br-int',has_traffic_filtering=True,id=8e586810-21e7-43d2-80dc-66c83416b245,network=Network(13e0d3be-e4a3-4f20-8aac-1cf64be1e1b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e586810-21')
Nov 18 17:12:22 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-478414df-95bc-4d93-8f16-a729fd895c0c tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] Deleting instance files /opt/stack/data/nova/instances/2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4_del
Nov 18 17:12:22 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-478414df-95bc-4d93-8f16-a729fd895c0c tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] Deletion of /opt/stack/data/nova/instances/2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4_del complete
Nov 18 17:12:22 user nova-compute[74743]: INFO nova.compute.manager [None req-478414df-95bc-4d93-8f16-a729fd895c0c tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] Took 0.78 seconds to destroy the instance on the hypervisor.
Nov 18 17:12:22 user nova-compute[74743]: DEBUG oslo.service.loopingcall [None req-478414df-95bc-4d93-8f16-a729fd895c0c tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74743) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG nova.compute.manager [-] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] Deallocating network for instance {{(pid=74743) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 17:12:22 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] deallocate_for_instance() {{(pid=74743) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 17:12:23 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:12:23 user nova-compute[74743]: INFO nova.compute.manager [-] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] Took 0.44 seconds to deallocate network for instance.
Nov 18 17:12:23 user nova-compute[74743]: DEBUG nova.compute.manager [req-3cfac11f-763f-44d0-b4c2-44f5c0299423 req-bd5706fb-87a0-47a6-80e7-0c6e5203e51c service nova] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] Received event network-vif-deleted-8e586810-21e7-43d2-80dc-66c83416b245 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:12:23 user nova-compute[74743]: INFO nova.compute.manager [req-3cfac11f-763f-44d0-b4c2-44f5c0299423 req-bd5706fb-87a0-47a6-80e7-0c6e5203e51c service nova] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] Neutron deleted interface 8e586810-21e7-43d2-80dc-66c83416b245; detaching it from the instance and deleting it from the info cache
Nov 18 17:12:23 user nova-compute[74743]: DEBUG nova.network.neutron [req-3cfac11f-763f-44d0-b4c2-44f5c0299423 req-bd5706fb-87a0-47a6-80e7-0c6e5203e51c service nova] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:12:23 user nova-compute[74743]: DEBUG nova.compute.manager [req-3cfac11f-763f-44d0-b4c2-44f5c0299423 req-bd5706fb-87a0-47a6-80e7-0c6e5203e51c service nova] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] Detach interface failed, port_id=8e586810-21e7-43d2-80dc-66c83416b245, reason: Instance 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4 could not be found. {{(pid=74743) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 17:12:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-478414df-95bc-4d93-8f16-a729fd895c0c tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:12:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-478414df-95bc-4d93-8f16-a729fd895c0c tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:12:23 user nova-compute[74743]: DEBUG nova.objects.instance [None req-277fe3c9-e848-45ce-92f6-e715271f01dd tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lazy-loading 'flavor' on Instance uuid f93bf0ac-ecc8-447d-b9c1-381d36cd3135 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:12:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-277fe3c9-e848-45ce-92f6-e715271f01dd tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.770s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:12:23 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-478414df-95bc-4d93-8f16-a729fd895c0c tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:12:23 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-478414df-95bc-4d93-8f16-a729fd895c0c tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:12:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-478414df-95bc-4d93-8f16-a729fd895c0c tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.523s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:12:23 user nova-compute[74743]: INFO nova.scheduler.client.report [None req-478414df-95bc-4d93-8f16-a729fd895c0c tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Deleted allocations for instance 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4
Nov 18 17:12:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-478414df-95bc-4d93-8f16-a729fd895c0c tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Lock "2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.978s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:12:24 user nova-compute[74743]: DEBUG nova.compute.manager [req-5a2d64fb-074d-4e9b-85eb-ed43c4ea7aa0 req-320a650c-b200-4143-a332-0e850d8b5bde service nova] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] Received event network-vif-plugged-8e586810-21e7-43d2-80dc-66c83416b245 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:12:24 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-5a2d64fb-074d-4e9b-85eb-ed43c4ea7aa0 req-320a650c-b200-4143-a332-0e850d8b5bde service nova] Acquiring lock "2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:12:24 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-5a2d64fb-074d-4e9b-85eb-ed43c4ea7aa0 req-320a650c-b200-4143-a332-0e850d8b5bde service nova] Lock "2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:12:24 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-5a2d64fb-074d-4e9b-85eb-ed43c4ea7aa0 req-320a650c-b200-4143-a332-0e850d8b5bde service nova] Lock "2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:12:24 user nova-compute[74743]: DEBUG nova.compute.manager [req-5a2d64fb-074d-4e9b-85eb-ed43c4ea7aa0 req-320a650c-b200-4143-a332-0e850d8b5bde service nova] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] No waiting events found dispatching network-vif-plugged-8e586810-21e7-43d2-80dc-66c83416b245 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:12:24 user nova-compute[74743]: WARNING nova.compute.manager [req-5a2d64fb-074d-4e9b-85eb-ed43c4ea7aa0 req-320a650c-b200-4143-a332-0e850d8b5bde service nova] [instance: 2bdbf156-4e0a-47e0-8dd9-845c1fd59bd4] Received unexpected event network-vif-plugged-8e586810-21e7-43d2-80dc-66c83416b245 for instance with vm_state deleted and task_state None.
Nov 18 17:12:24 user nova-compute[74743]: DEBUG nova.compute.manager [None req-6e50d033-5cf6-40eb-9369-0944be570277 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:12:24 user nova-compute[74743]: INFO nova.compute.manager [None req-6e50d033-5cf6-40eb-9369-0944be570277 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] instance snapshotting
Nov 18 17:12:24 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-6e50d033-5cf6-40eb-9369-0944be570277 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Beginning live snapshot process
Nov 18 17:12:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-6e50d033-5cf6-40eb-9369-0944be570277 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json -f qcow2 {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:24 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:12:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-6e50d033-5cf6-40eb-9369-0944be570277 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json -f qcow2" returned: 0 in 0.180s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-6e50d033-5cf6-40eb-9369-0944be570277 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json -f qcow2 {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-6e50d033-5cf6-40eb-9369-0944be570277 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json -f qcow2" returned: 0 in 0.179s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-6e50d033-5cf6-40eb-9369-0944be570277 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-6e50d033-5cf6-40eb-9369-0944be570277 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.178s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-6e50d033-5cf6-40eb-9369-0944be570277 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpajj0w1ob/636d1536d5c149dbbfabb74e7329f1e0.delta 1073741824 {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-6e50d033-5cf6-40eb-9369-0944be570277 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpajj0w1ob/636d1536d5c149dbbfabb74e7329f1e0.delta 1073741824" returned: 0 in 0.051s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:25 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-6e50d033-5cf6-40eb-9369-0944be570277 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 18 17:12:26 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-6e50d033-5cf6-40eb-9369-0944be570277 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74743) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 17:12:26 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-6e50d033-5cf6-40eb-9369-0944be570277 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74743) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 17:12:26 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-6e50d033-5cf6-40eb-9369-0944be570277 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 18 17:12:26 user nova-compute[74743]: DEBUG nova.privsep.utils [None req-6e50d033-5cf6-40eb-9369-0944be570277 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74743) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 18 17:12:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-6e50d033-5cf6-40eb-9369-0944be570277 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpajj0w1ob/636d1536d5c149dbbfabb74e7329f1e0.delta /opt/stack/data/nova/instances/snapshots/tmpajj0w1ob/636d1536d5c149dbbfabb74e7329f1e0 {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-6e50d033-5cf6-40eb-9369-0944be570277 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpajj0w1ob/636d1536d5c149dbbfabb74e7329f1e0.delta /opt/stack/data/nova/instances/snapshots/tmpajj0w1ob/636d1536d5c149dbbfabb74e7329f1e0" returned: 0 in 0.550s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:27 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-6e50d033-5cf6-40eb-9369-0944be570277 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Snapshot extracted, beginning image upload
Nov 18 17:12:27 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:12:29 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-6e50d033-5cf6-40eb-9369-0944be570277 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Snapshot image upload complete
Nov 18 17:12:29 user nova-compute[74743]: INFO nova.compute.manager [None req-6e50d033-5cf6-40eb-9369-0944be570277 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Took 5.22 seconds to snapshot the instance on the hypervisor.
Nov 18 17:12:31 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:12:31 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:12:31 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Starting heal instance info cache {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 17:12:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "refresh_cache-a77117a2-748d-4a39-8db7-8b965a1725fc" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:12:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquired lock "refresh_cache-a77117a2-748d-4a39-8db7-8b965a1725fc" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:12:31 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Forcefully refreshing network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 17:12:31 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Updating instance_info_cache with network_info: [{"id": "22eb23ff-0df1-42e9-92c0-458497610ff9", "address": "fa:16:3e:b3:91:01", "network": {"id": "fd98f398-6576-449b-a737-887906eb6656", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668610993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb8f5850162c479b8d185e48c03be7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22eb23ff-0d", "ovs_interfaceid": "22eb23ff-0df1-42e9-92c0-458497610ff9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:12:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Releasing lock "refresh_cache-a77117a2-748d-4a39-8db7-8b965a1725fc" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:12:31 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Updated the network info_cache for instance {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 17:12:31 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:12:31 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:12:31 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:12:31 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:12:31 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:12:31 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:12:31 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74743) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 17:12:31 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:12:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:12:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:12:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:12:31 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Auditing locally available compute resources for user (node: user) {{(pid=74743) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f93bf0ac-ecc8-447d-b9c1-381d36cd3135/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f93bf0ac-ecc8-447d-b9c1-381d36cd3135/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f93bf0ac-ecc8-447d-b9c1-381d36cd3135/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f93bf0ac-ecc8-447d-b9c1-381d36cd3135/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:32 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-187ef767-bda8-4965-ba35-8b678c680288 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a77117a2-748d-4a39-8db7-8b965a1725fc is timed out.
Nov 18 17:12:32 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-187ef767-bda8-4965-ba35-8b678c680288 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Successfully detached device vdb from instance a77117a2-748d-4a39-8db7-8b965a1725fc from the live domain config.
Nov 18 17:12:32 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-187ef767-bda8-4965-ba35-8b678c680288 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] calling os-brick to detach iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-187ef767-bda8-4965-ba35-8b678c680288 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, {'target_iqn': 'iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ziSgfLDh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:12:32 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-187ef767-bda8-4965-ba35-8b678c680288 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:12:32 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-187ef767-bda8-4965-ba35-8b678c680288 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-187ef767-bda8-4965-ba35-8b678c680288 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fcbdcbf-580e-47c7-9ee8-75a3c8beea1e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-187ef767-bda8-4965-ba35-8b678c680288 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 17:12:32 user nova-compute[74743]: No targets found.
Nov 18 17:12:32 user nova-compute[74743]: iSNS:
Nov 18 17:12:32 user nova-compute[74743]: No targets found.
Nov 18 17:12:32 user nova-compute[74743]: STATIC:
Nov 18 17:12:32 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685
Nov 18 17:12:32 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:12:32 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:12:32 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5
Nov 18 17:12:32 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:12:32 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:12:32 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e
Nov 18 17:12:32 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:12:32 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:12:32 user nova-compute[74743]: FIRMWARE:
Nov 18 17:12:32 user nova-compute[74743]: No targets found.
Nov 18 17:12:32 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-187ef767-bda8-4965-ba35-8b678c680288 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 17:12:32 user nova-compute[74743]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 17:12:32 user nova-compute[74743]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74743) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-187ef767-bda8-4965-ba35-8b678c680288 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e', 0)] {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7850cf-9ba1-4755-ab22-26597f445096]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a764d7-e417-4c53-9fd0-dd33329cd685]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-187ef767-bda8-4965-ba35-8b678c680288 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)
Nov 18 17:12:32 user nova-compute[74743]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:12:32 user nova-compute[74743]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:12:32 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-187ef767-bda8-4965-ba35-8b678c680288 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e (non-flash)
Nov 18 17:12:32 user nova-compute[74743]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:12:32 user nova-compute[74743]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:12:32 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-187ef767-bda8-4965-ba35-8b678c680288 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb0833f9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e'): ({'sdc'}, set())}) {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-187ef767-bda8-4965-ba35-8b678c680288 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Removing single pathed devices sdc {{(pid=74743) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[92209f0a-5e9a-450d-bebb-a8b185e79cf4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c68effc-7dd3-4b8d-95b6-e71b80498d60]: (4, ('ok\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-187ef767-bda8-4965-ba35-8b678c680288 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Flushing IO for device /dev/sdc {{(pid=74743) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d475ae9a-2b75-46f1-a4cd-8a9faedfd747]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-187ef767-bda8-4965-ba35-8b678c680288 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74743) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.033s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b37a32f-db9d-4ff3-89d1-7606923ac1cf]: (4, ('1', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-187ef767-bda8-4965-ba35-8b678c680288 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-187ef767-bda8-4965-ba35-8b678c680288 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] SCSI volumes sdc have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-187ef767-bda8-4965-ba35-8b678c680288 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e')] {{(pid=74743) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6cdaa35-5650-4c18-950d-7981534425a7]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-187ef767-bda8-4965-ba35-8b678c680288 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e -p 172.16.0.220:3260 --logout {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79acd81-ce24-4f08-a21e-4b1244468dcc]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-187ef767-bda8-4965-ba35-8b678c680288 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e, portal: 172.16.0.220,3260]
Nov 18 17:12:32 user nova-compute[74743]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e, portal: 172.16.0.220,3260] successful.
Nov 18 17:12:32 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e -p 172.16.0.220:3260 --op delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec4a2b65-8e33-4a44-8961-7c0570cde14e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce701b02-cdb8-4509-acb5-af28d8cbc3bd]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-187ef767-bda8-4965-ba35-8b678c680288 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-187ef767-bda8-4965-ba35-8b678c680288 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-187ef767-bda8-4965-ba35-8b678c680288 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] <== disconnect_volume: return (375ms) None {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:12:32 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-187ef767-bda8-4965-ba35-8b678c680288 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Disconnected iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 17:12:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:33 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:12:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd467693-8b2d-4e3d-9b1a-7581c6ae6153/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd467693-8b2d-4e3d-9b1a-7581c6ae6153/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd467693-8b2d-4e3d-9b1a-7581c6ae6153/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd467693-8b2d-4e3d-9b1a-7581c6ae6153/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:33 user nova-compute[74743]: DEBUG nova.objects.instance [None req-187ef767-bda8-4965-ba35-8b678c680288 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lazy-loading 'flavor' on Instance uuid a77117a2-748d-4a39-8db7-8b965a1725fc {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:12:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-187ef767-bda8-4965-ba35-8b678c680288 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "a77117a2-748d-4a39-8db7-8b965a1725fc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.981s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:12:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad8aa2d-663c-4829-87f9-07959105ca68/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad8aa2d-663c-4829-87f9-07959105ca68/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad8aa2d-663c-4829-87f9-07959105ca68/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:12:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad8aa2d-663c-4829-87f9-07959105ca68/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77117a2-748d-4a39-8db7-8b965a1725fc/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77117a2-748d-4a39-8db7-8b965a1725fc/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77117a2-748d-4a39-8db7-8b965a1725fc/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77117a2-748d-4a39-8db7-8b965a1725fc/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/180f2f7e-9df5-480f-adde-d8e10ee14b07/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/180f2f7e-9df5-480f-adde-d8e10ee14b07/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/180f2f7e-9df5-480f-adde-d8e10ee14b07/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/180f2f7e-9df5-480f-adde-d8e10ee14b07/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5c74497-1d1c-48a0-9b0a-e7df2a41361c/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5c74497-1d1c-48a0-9b0a-e7df2a41361c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5c74497-1d1c-48a0-9b0a-e7df2a41361c/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5c74497-1d1c-48a0-9b0a-e7df2a41361c/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:36 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:12:36 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:12:36 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:12:36 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Hypervisor/Node resource view: name=user free_ram=7052MB free_disk=25.395023345947266GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74743) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 17:12:36 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:12:36 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:12:37 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Applying migration context for instance 49ebdd5a-824d-476a-bd10-3b891bbfe9e2 as it has an incoming, in-progress migration 5037668c-b927-4d04-8e21-0ec32794efcf. Migration status is finished {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 18 17:12:37 user nova-compute[74743]: INFO nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Updating resource usage from migration 5037668c-b927-4d04-8e21-0ec32794efcf
Nov 18 17:12:37 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 4cce1628-2dcb-40c7-abd4-6a327a432de3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:12:37 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance e9668e1c-1e8d-4dd7-8f58-d453db294557 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:12:37 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance c006a4ad-a8e2-4108-9af1-dec4dd53fcda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:12:37 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance a77117a2-748d-4a39-8db7-8b965a1725fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:12:37 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance c5c74497-1d1c-48a0-9b0a-e7df2a41361c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:12:37 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 0ad8aa2d-663c-4829-87f9-07959105ca68 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:12:37 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance f93bf0ac-ecc8-447d-b9c1-381d36cd3135 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:12:37 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance aefe3db1-b9bb-4cce-aa31-d0b6684ad791 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:12:37 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 180f2f7e-9df5-480f-adde-d8e10ee14b07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:12:37 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Migration 5037668c-b927-4d04-8e21-0ec32794efcf is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 18 17:12:37 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 49ebdd5a-824d-476a-bd10-3b891bbfe9e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:12:37 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance cd467693-8b2d-4e3d-9b1a-7581c6ae6153 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:12:37 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:12:37 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 17:12:37 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=31GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 17:12:37 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:12:37 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:12:37 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Compute_service record updated for user:user {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 17:12:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.590s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:12:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:12:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:12:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:12:42 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:12:43 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:12:44 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:12:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:12:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:12:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:12:51 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:12:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:12:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:12:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-86984e59-a271-43c4-bbfb-b3403e0deb4f tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Acquiring lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:12:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-86984e59-a271-43c4-bbfb-b3403e0deb4f tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:12:53 user nova-compute[74743]: DEBUG nova.objects.instance [None req-86984e59-a271-43c4-bbfb-b3403e0deb4f tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lazy-loading 'flavor' on Instance uuid f93bf0ac-ecc8-447d-b9c1-381d36cd3135 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:12:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-86984e59-a271-43c4-bbfb-b3403e0deb4f tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:12:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-86984e59-a271-43c4-bbfb-b3403e0deb4f tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Acquiring lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:12:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-86984e59-a271-43c4-bbfb-b3403e0deb4f tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:12:53 user nova-compute[74743]: INFO nova.compute.manager [None req-86984e59-a271-43c4-bbfb-b3403e0deb4f tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Attaching volume 9e292ebb-0e44-454c-9822-4ba1f5208ef2 to /dev/vdb
Nov 18 17:12:54 user nova-compute[74743]: DEBUG os_brick.utils [None req-86984e59-a271-43c4-bbfb-b3403e0deb4f tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:12:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:54 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7aca09f-0300-4897-bbec-a0033fb53c45]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1116acd8874d\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:12:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:54 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc4eb24-e01b-49c7-ab95-71582701efd3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:12:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:54 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2664d6-441d-4f53-9fd9-9ffd2ef795d1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:12:54 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b9cf70-8080-470c-a930-2dc19b537ffc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:12:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-86984e59-a271-43c4-bbfb-b3403e0deb4f tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Running cmd (subprocess): nvme version {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-86984e59-a271-43c4-bbfb-b3403e0deb4f tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] 'nvme version' failed. Not Retrying. {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:12:54 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.nvmeof [None req-86984e59-a271-43c4-bbfb-b3403e0deb4f tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] nvme not present on system {{(pid=74743) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 17:12:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:12:54 user nova-compute[74743]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 17:12:54 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba158e31-76ad-43f7-9a9a-ed31e35b0be6]: (4, '') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:12:54 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-86984e59-a271-43c4-bbfb-b3403e0deb4f tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74743) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 17:12:54 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-86984e59-a271-43c4-bbfb-b3403e0deb4f tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 17:12:54 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-86984e59-a271-43c4-bbfb-b3403e0deb4f tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] LIGHTOS: no hostnqn found. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 17:12:54 user nova-compute[74743]: DEBUG os_brick.utils [None req-86984e59-a271-43c4-bbfb-b3403e0deb4f tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1116acd8874d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:12:54 user nova-compute[74743]: DEBUG nova.virt.block_device [None req-86984e59-a271-43c4-bbfb-b3403e0deb4f tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Updating existing volume attachment record: 10438957-8f39-46b8-b9e5-90866826093b {{(pid=74743) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 17:12:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:12:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Acquiring lock "f41ad39c-15fd-42e2-9ad6-ed5cd25e25de" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:12:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "f41ad39c-15fd-42e2-9ad6-ed5cd25e25de" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:12:56 user nova-compute[74743]: DEBUG nova.compute.manager [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Starting instance... {{(pid=74743) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 17:12:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:12:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:12:56 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74743) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 17:12:56 user nova-compute[74743]: INFO nova.compute.claims [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Claim successful on node user
Nov 18 17:12:57 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:12:57 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:12:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.551s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:12:57 user nova-compute[74743]: DEBUG nova.compute.manager [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Start building networks asynchronously for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 17:12:57 user nova-compute[74743]: DEBUG nova.compute.manager [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Allocating IP information in the background. {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 17:12:57 user nova-compute[74743]: DEBUG nova.network.neutron [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] allocate_for_instance() {{(pid=74743) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 17:12:57 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 17:12:57 user nova-compute[74743]: DEBUG nova.compute.manager [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Start building block device mappings for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 17:12:57 user nova-compute[74743]: DEBUG nova.policy [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '18483ad6106b4d95afbbed450d625b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a17803c613c4ef299c797bba85c1a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74743) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 17:12:57 user nova-compute[74743]: DEBUG nova.compute.manager [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Start spawning the instance on the hypervisor. {{(pid=74743) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 17:12:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Creating instance directory {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 17:12:57 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Creating image(s)
Nov 18 17:12:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Acquiring lock "/opt/stack/data/nova/instances/f41ad39c-15fd-42e2-9ad6-ed5cd25e25de/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:12:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "/opt/stack/data/nova/instances/f41ad39c-15fd-42e2-9ad6-ed5cd25e25de/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:12:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "/opt/stack/data/nova/instances/f41ad39c-15fd-42e2-9ad6-ed5cd25e25de/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:12:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.187s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Acquiring lock "c188b3a997bfafa42fa341f9dcc326545681eed9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:12:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:12:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.176s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/f41ad39c-15fd-42e2-9ad6-ed5cd25e25de/disk 1073741824 {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:12:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/f41ad39c-15fd-42e2-9ad6-ed5cd25e25de/disk 1073741824" returned: 0 in 0.056s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:12:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:57 user nova-compute[74743]: DEBUG nova.network.neutron [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Successfully created port: 3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5 {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:12:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.178s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:57 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f41ad39c-15fd-42e2-9ad6-ed5cd25e25de/disk. size=1073741824 {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 17:12:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ad39c-15fd-42e2-9ad6-ed5cd25e25de/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ad39c-15fd-42e2-9ad6-ed5cd25e25de/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Cannot resize image /opt/stack/data/nova/instances/f41ad39c-15fd-42e2-9ad6-ed5cd25e25de/disk to a smaller size. {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Created local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Ensure instance console log exists: /opt/stack/data/nova/instances/f41ad39c-15fd-42e2-9ad6-ed5cd25e25de/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG nova.network.neutron [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Successfully updated port: 3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5 {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Acquiring lock "refresh_cache-f41ad39c-15fd-42e2-9ad6-ed5cd25e25de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Acquired lock "refresh_cache-f41ad39c-15fd-42e2-9ad6-ed5cd25e25de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG nova.network.neutron [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG nova.compute.manager [req-434e67e5-444a-4dea-8e00-a42495706706 req-97bdbf08-3e1d-4238-b0d4-ee89eee750f3 service nova] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Received event network-changed-3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG nova.compute.manager [req-434e67e5-444a-4dea-8e00-a42495706706 req-97bdbf08-3e1d-4238-b0d4-ee89eee750f3 service nova] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Refreshing instance network info cache due to event network-changed-3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-434e67e5-444a-4dea-8e00-a42495706706 req-97bdbf08-3e1d-4238-b0d4-ee89eee750f3 service nova] Acquiring lock "refresh_cache-f41ad39c-15fd-42e2-9ad6-ed5cd25e25de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG nova.network.neutron [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG nova.network.neutron [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Updating instance_info_cache with network_info: [{"id": "3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5", "address": "fa:16:3e:0e:63:d2", "network": {"id": "e1c28f74-c9c1-4eb3-931e-003332ff6243", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-453481916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a17803c613c4ef299c797bba85c1a4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d1781f8-f4", "ovs_interfaceid": "3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Releasing lock "refresh_cache-f41ad39c-15fd-42e2-9ad6-ed5cd25e25de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG nova.compute.manager [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Instance network_info: |[{"id": "3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5", "address": "fa:16:3e:0e:63:d2", "network": {"id": "e1c28f74-c9c1-4eb3-931e-003332ff6243", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-453481916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a17803c613c4ef299c797bba85c1a4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d1781f8-f4", "ovs_interfaceid": "3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-434e67e5-444a-4dea-8e00-a42495706706 req-97bdbf08-3e1d-4238-b0d4-ee89eee750f3 service nova] Acquired lock "refresh_cache-f41ad39c-15fd-42e2-9ad6-ed5cd25e25de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG nova.network.neutron [req-434e67e5-444a-4dea-8e00-a42495706706 req-97bdbf08-3e1d-4238-b0d4-ee89eee750f3 service nova] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Refreshing network info cache for port 3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Start _get_guest_xml network_info=[{"id": "3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5", "address": "fa:16:3e:0e:63:d2", "network": {"id": "e1c28f74-c9c1-4eb3-931e-003332ff6243", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-453481916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a17803c613c4ef299c797bba85c1a4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d1781f8-f4", "ovs_interfaceid": "3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '9536f6cf-95c4-40e2-864a-09a91525678a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:12:58 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:12:58 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:12:58 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:12:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1872287329',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1872287329',id=28,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFeAf5pe/SM9rbt1HiXBv/Qy4kx4IdHwG3fexElEhkBcZPfKQFDg+/NTyRMqyRqYDaJEZ/lV9IRH0FTea8siiY9i8r4fxRG+ACR/2qEf8DIIhRuTvTaRMqurC/OE1FYk5Q==',key_name='tempest-keypair-257871102',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a17803c613c4ef299c797bba85c1a4b',ramdisk_id='',reservation_id='r-wl7d2o6y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-13499029',owner_user_name='tempest-AttachVolumeShelveTestJSON-13499029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:12:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18483ad6106b4d95afbbed450d625b53',uuid=f41ad39c-15fd-42e2-9ad6-ed5cd25e25de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5", "address": "fa:16:3e:0e:63:d2", "network": {"id": "e1c28f74-c9c1-4eb3-931e-003332ff6243", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-453481916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a17803c613c4ef299c797bba85c1a4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d1781f8-f4", "ovs_interfaceid": "3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Converting VIF {"id": "3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5", "address": "fa:16:3e:0e:63:d2", "network": {"id": "e1c28f74-c9c1-4eb3-931e-003332ff6243", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-453481916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a17803c613c4ef299c797bba85c1a4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d1781f8-f4", "ovs_interfaceid": "3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:63:d2,bridge_name='br-int',has_traffic_filtering=True,id=3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5,network=Network(e1c28f74-c9c1-4eb3-931e-003332ff6243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d1781f8-f4') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG nova.objects.instance [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lazy-loading 'pci_devices' on Instance uuid f41ad39c-15fd-42e2-9ad6-ed5cd25e25de {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:12:58 user nova-compute[74743]:   <uuid>f41ad39c-15fd-42e2-9ad6-ed5cd25e25de</uuid>
Nov 18 17:12:58 user nova-compute[74743]:   <name>instance-0000001c</name>
Nov 18 17:12:58 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:12:58 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:12:58 user nova-compute[74743]:   <metadata>
Nov 18 17:12:58 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:12:58 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:12:58 user nova-compute[74743]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1872287329</nova:name>
Nov 18 17:12:58 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:12:58</nova:creationTime>
Nov 18 17:12:58 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:12:58 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:12:58 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:12:58 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:12:58 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:12:58 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:12:58 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:12:58 user nova-compute[74743]:       <nova:owner>
Nov 18 17:12:58 user nova-compute[74743]:         <nova:user uuid="18483ad6106b4d95afbbed450d625b53">tempest-AttachVolumeShelveTestJSON-13499029-project-member</nova:user>
Nov 18 17:12:58 user nova-compute[74743]:         <nova:project uuid="0a17803c613c4ef299c797bba85c1a4b">tempest-AttachVolumeShelveTestJSON-13499029</nova:project>
Nov 18 17:12:58 user nova-compute[74743]:       </nova:owner>
Nov 18 17:12:58 user nova-compute[74743]:       <nova:root type="image" uuid="9536f6cf-95c4-40e2-864a-09a91525678a"/>
Nov 18 17:12:58 user nova-compute[74743]:       <nova:ports>
Nov 18 17:12:58 user nova-compute[74743]:         <nova:port uuid="3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5">
Nov 18 17:12:58 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 18 17:12:58 user nova-compute[74743]:         </nova:port>
Nov 18 17:12:58 user nova-compute[74743]:       </nova:ports>
Nov 18 17:12:58 user nova-compute[74743]:     </nova:instance>
Nov 18 17:12:58 user nova-compute[74743]:   </metadata>
Nov 18 17:12:58 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:12:58 user nova-compute[74743]:     <system>
Nov 18 17:12:58 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:12:58 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:12:58 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:12:58 user nova-compute[74743]:       <entry name="serial">f41ad39c-15fd-42e2-9ad6-ed5cd25e25de</entry>
Nov 18 17:12:58 user nova-compute[74743]:       <entry name="uuid">f41ad39c-15fd-42e2-9ad6-ed5cd25e25de</entry>
Nov 18 17:12:58 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:12:58 user nova-compute[74743]:     </system>
Nov 18 17:12:58 user nova-compute[74743]:   </sysinfo>
Nov 18 17:12:58 user nova-compute[74743]:   <os>
Nov 18 17:12:58 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:12:58 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:12:58 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:12:58 user nova-compute[74743]:   </os>
Nov 18 17:12:58 user nova-compute[74743]:   <features>
Nov 18 17:12:58 user nova-compute[74743]:     <acpi/>
Nov 18 17:12:58 user nova-compute[74743]:     <apic/>
Nov 18 17:12:58 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:12:58 user nova-compute[74743]:   </features>
Nov 18 17:12:58 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:12:58 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:12:58 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:12:58 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:12:58 user nova-compute[74743]:   </clock>
Nov 18 17:12:58 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:12:58 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:12:58 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:12:58 user nova-compute[74743]:   </cpu>
Nov 18 17:12:58 user nova-compute[74743]:   <devices>
Nov 18 17:12:58 user nova-compute[74743]:     <disk type="file" device="disk">
Nov 18 17:12:58 user nova-compute[74743]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 17:12:58 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/f41ad39c-15fd-42e2-9ad6-ed5cd25e25de/disk"/>
Nov 18 17:12:58 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:12:58 user nova-compute[74743]:     </disk>
Nov 18 17:12:58 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:12:58 user nova-compute[74743]:       <mac address="fa:16:3e:0e:63:d2"/>
Nov 18 17:12:58 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:12:58 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:12:58 user nova-compute[74743]:       <target dev="tap3d1781f8-f4"/>
Nov 18 17:12:58 user nova-compute[74743]:     </interface>
Nov 18 17:12:58 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:12:58 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/f41ad39c-15fd-42e2-9ad6-ed5cd25e25de/console.log" append="off"/>
Nov 18 17:12:58 user nova-compute[74743]:     </serial>
Nov 18 17:12:58 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:12:58 user nova-compute[74743]:     <video>
Nov 18 17:12:58 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:12:58 user nova-compute[74743]:     </video>
Nov 18 17:12:58 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:12:58 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:12:58 user nova-compute[74743]:     </rng>
Nov 18 17:12:58 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:12:58 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:12:58 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:12:58 user nova-compute[74743]:     </memballoon>
Nov 18 17:12:58 user nova-compute[74743]:   </devices>
Nov 18 17:12:58 user nova-compute[74743]: </domain>
Nov 18 17:12:58 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:12:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1872287329',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1872287329',id=28,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFeAf5pe/SM9rbt1HiXBv/Qy4kx4IdHwG3fexElEhkBcZPfKQFDg+/NTyRMqyRqYDaJEZ/lV9IRH0FTea8siiY9i8r4fxRG+ACR/2qEf8DIIhRuTvTaRMqurC/OE1FYk5Q==',key_name='tempest-keypair-257871102',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a17803c613c4ef299c797bba85c1a4b',ramdisk_id='',reservation_id='r-wl7d2o6y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-13499029',owner_user_name='tempest-AttachVolumeShelveTestJSON-13499029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:12:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18483ad6106b4d95afbbed450d625b53',uuid=f41ad39c-15fd-42e2-9ad6-ed5cd25e25de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5", "address": "fa:16:3e:0e:63:d2", "network": {"id": "e1c28f74-c9c1-4eb3-931e-003332ff6243", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-453481916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a17803c613c4ef299c797bba85c1a4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d1781f8-f4", "ovs_interfaceid": "3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Converting VIF {"id": "3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5", "address": "fa:16:3e:0e:63:d2", "network": {"id": "e1c28f74-c9c1-4eb3-931e-003332ff6243", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-453481916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a17803c613c4ef299c797bba85c1a4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d1781f8-f4", "ovs_interfaceid": "3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:63:d2,bridge_name='br-int',has_traffic_filtering=True,id=3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5,network=Network(e1c28f74-c9c1-4eb3-931e-003332ff6243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d1781f8-f4') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG os_vif [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:63:d2,bridge_name='br-int',has_traffic_filtering=True,id=3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5,network=Network(e1c28f74-c9c1-4eb3-931e-003332ff6243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d1781f8-f4') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '686f8c75-c186-5bf3-8707-00febd53366b', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d1781f8-f4, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3d1781f8-f4, col_values=(('qos', UUID('307e1a94-787b-4cf4-8682-ad6551eb4e4f')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3d1781f8-f4, col_values=(('external_ids', {'iface-id': '3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:63:d2', 'vm-uuid': 'f41ad39c-15fd-42e2-9ad6-ed5cd25e25de'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:12:58 user nova-compute[74743]: INFO os_vif [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:63:d2,bridge_name='br-int',has_traffic_filtering=True,id=3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5,network=Network(e1c28f74-c9c1-4eb3-931e-003332ff6243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d1781f8-f4')
Nov 18 17:12:58 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:12:58 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] No VIF found with MAC fa:16:3e:0e:63:d2, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:12:59 user nova-compute[74743]: DEBUG nova.network.neutron [req-434e67e5-444a-4dea-8e00-a42495706706 req-97bdbf08-3e1d-4238-b0d4-ee89eee750f3 service nova] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Updated VIF entry in instance network info cache for port 3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:12:59 user nova-compute[74743]: DEBUG nova.network.neutron [req-434e67e5-444a-4dea-8e00-a42495706706 req-97bdbf08-3e1d-4238-b0d4-ee89eee750f3 service nova] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Updating instance_info_cache with network_info: [{"id": "3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5", "address": "fa:16:3e:0e:63:d2", "network": {"id": "e1c28f74-c9c1-4eb3-931e-003332ff6243", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-453481916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a17803c613c4ef299c797bba85c1a4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d1781f8-f4", "ovs_interfaceid": "3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:12:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-434e67e5-444a-4dea-8e00-a42495706706 req-97bdbf08-3e1d-4238-b0d4-ee89eee750f3 service nova] Releasing lock "refresh_cache-f41ad39c-15fd-42e2-9ad6-ed5cd25e25de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:12:59 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86984e59-a271-43c4-bbfb-b3403e0deb4f tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Calling os-brick to attach iSCSI Volume {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 17:12:59 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-86984e59-a271-43c4-bbfb-b3403e0deb4f tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9e292ebb-0e44-454c-9822-4ba1f5208ef2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HmsLjSYZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:12:59 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-86984e59-a271-43c4-bbfb-b3403e0deb4f tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:12:59 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-86984e59-a271-43c4-bbfb-b3403e0deb4f tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:12:59 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-86984e59-a271-43c4-bbfb-b3403e0deb4f tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:12:59 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-86984e59-a271-43c4-bbfb-b3403e0deb4f tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:12:59 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-86984e59-a271-43c4-bbfb-b3403e0deb4f tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e292ebb-0e44-454c-9822-4ba1f5208ef2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:12:59 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-86984e59-a271-43c4-bbfb-b3403e0deb4f tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e292ebb-0e44-454c-9822-4ba1f5208ef2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:12:59 user nova-compute[74743]: INFO os_brick.initiator.connectors.iscsi [None req-86984e59-a271-43c4-bbfb-b3403e0deb4f tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 17:12:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e292ebb-0e44-454c-9822-4ba1f5208ef2 -p 172.16.0.220:3260 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e292ebb-0e44-454c-9822-4ba1f5208ef2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:59 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75a4545-b308-490c-92ba-c9abbfecb282]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:12:59 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-86984e59-a271-43c4-bbfb-b3403e0deb4f tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 17:12:59 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:12:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e292ebb-0e44-454c-9822-4ba1f5208ef2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e292ebb-0e44-454c-9822-4ba1f5208ef2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:59 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[e340270d-00f4-4265-a1df-ac189af4ca20]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e292ebb-0e44-454c-9822-4ba1f5208ef2] added\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:12:59 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-86984e59-a271-43c4-bbfb-b3403e0deb4f tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e292ebb-0e44-454c-9822-4ba1f5208ef2] added
Nov 18 17:12:59 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:12:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e292ebb-0e44-454c-9822-4ba1f5208ef2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e292ebb-0e44-454c-9822-4ba1f5208ef2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:59 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5efc96-7fc8-4b3d-a530-32cb1da8e365]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:12:59 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-86984e59-a271-43c4-bbfb-b3403e0deb4f tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:12:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e292ebb-0e44-454c-9822-4ba1f5208ef2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e292ebb-0e44-454c-9822-4ba1f5208ef2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:59 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7fd6a2-fa60-482f-acd0-5171b18b30c6]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:12:59 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-86984e59-a271-43c4-bbfb-b3403e0deb4f tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:12:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e292ebb-0e44-454c-9822-4ba1f5208ef2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HmsLjSYZ {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e292ebb-0e44-454c-9822-4ba1f5208ef2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HmsLjSYZ" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:59 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d144f53b-93ff-446c-9123-4be611e901ef]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:12:59 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-86984e59-a271-43c4-bbfb-b3403e0deb4f tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HmsLjSYZ'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:12:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e292ebb-0e44-454c-9822-4ba1f5208ef2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e292ebb-0e44-454c-9822-4ba1f5208ef2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:59 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5c2aa2-5c95-4f49-b5d5-84bc58fed1b7]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:12:59 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-86984e59-a271-43c4-bbfb-b3403e0deb4f tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:12:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:59 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[592fb3be-6946-4b99-9c5b-3fb8e0b4051e]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:12:59 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-86984e59-a271-43c4-bbfb-b3403e0deb4f tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:12:59 user nova-compute[74743]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:12:59 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:12:59 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-86984e59-a271-43c4-bbfb-b3403e0deb4f tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:12:59 user nova-compute[74743]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:12:59 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:12:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e292ebb-0e44-454c-9822-4ba1f5208ef2 -p 172.16.0.220:3260 --login {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e292ebb-0e44-454c-9822-4ba1f5208ef2 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:59 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6962cad-a5b1-4bb4-9a5b-0ce13d6ec5af]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e292ebb-0e44-454c-9822-4ba1f5208ef2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9e292ebb-0e44-454c-9822-4ba1f5208ef2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:12:59 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-86984e59-a271-43c4-bbfb-b3403e0deb4f tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e292ebb-0e44-454c-9822-4ba1f5208ef2, portal: 172.16.0.220,3260]
Nov 18 17:12:59 user nova-compute[74743]: Login to [iface: default, target: iqn.2010-10.org.openstack:9e292ebb-0e44-454c-9822-4ba1f5208ef2, portal: 172.16.0.220,3260] successful.
Nov 18 17:12:59 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:12:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e292ebb-0e44-454c-9822-4ba1f5208ef2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:59 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:12:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e292ebb-0e44-454c-9822-4ba1f5208ef2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:59 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccdda996-8c9c-4cc1-8df8-d4fe231fc464]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:12:59 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-86984e59-a271-43c4-bbfb-b3403e0deb4f tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:12:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:59 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7e499d-3ad7-43a1-8240-8212b1b0ba93]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e292ebb-0e44-454c-9822-4ba1f5208ef2 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:12:59 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-86984e59-a271-43c4-bbfb-b3403e0deb4f tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:12:59 user nova-compute[74743]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:12:59 user nova-compute[74743]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e292ebb-0e44-454c-9822-4ba1f5208ef2 (non-flash)
Nov 18 17:12:59 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:12:59 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-86984e59-a271-43c4-bbfb-b3403e0deb4f tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:12:59 user nova-compute[74743]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:12:59 user nova-compute[74743]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e292ebb-0e44-454c-9822-4ba1f5208ef2 (non-flash)
Nov 18 17:12:59 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:12:59 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-86984e59-a271-43c4-bbfb-b3403e0deb4f tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e292ebb-0e44-454c-9822-4ba1f5208ef2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:12:59 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-86984e59-a271-43c4-bbfb-b3403e0deb4f tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Connected to 172.16.0.220:3260 {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 17:12:59 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-86984e59-a271-43c4-bbfb-b3403e0deb4f tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] HCTL ('33', '-', '-', 0) found on session 30 with lun 0 {{(pid=74743) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 17:12:59 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-86984e59-a271-43c4-bbfb-b3403e0deb4f tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74743) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 17:12:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:12:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:12:59 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc64cd2f-43f9-437c-9524-6a7d5d42f5ab]: (4, ('- - 0', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:00 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-86984e59-a271-43c4-bbfb-b3403e0deb4f tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: None {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:13:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:00 user nova-compute[74743]: DEBUG nova.compute.manager [req-58fb1c0d-43b7-4079-b3e8-8db5c36cf6dd req-e0a91a42-c276-44d6-b22c-7f5662451e90 service nova] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Received event network-vif-plugged-3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:13:00 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-58fb1c0d-43b7-4079-b3e8-8db5c36cf6dd req-e0a91a42-c276-44d6-b22c-7f5662451e90 service nova] Acquiring lock "f41ad39c-15fd-42e2-9ad6-ed5cd25e25de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:13:00 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-58fb1c0d-43b7-4079-b3e8-8db5c36cf6dd req-e0a91a42-c276-44d6-b22c-7f5662451e90 service nova] Lock "f41ad39c-15fd-42e2-9ad6-ed5cd25e25de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:13:00 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-58fb1c0d-43b7-4079-b3e8-8db5c36cf6dd req-e0a91a42-c276-44d6-b22c-7f5662451e90 service nova] Lock "f41ad39c-15fd-42e2-9ad6-ed5cd25e25de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:13:00 user nova-compute[74743]: DEBUG nova.compute.manager [req-58fb1c0d-43b7-4079-b3e8-8db5c36cf6dd req-e0a91a42-c276-44d6-b22c-7f5662451e90 service nova] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] No waiting events found dispatching network-vif-plugged-3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:13:00 user nova-compute[74743]: WARNING nova.compute.manager [req-58fb1c0d-43b7-4079-b3e8-8db5c36cf6dd req-e0a91a42-c276-44d6-b22c-7f5662451e90 service nova] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Received unexpected event network-vif-plugged-3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5 for instance with vm_state building and task_state spawning.
Nov 18 17:13:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:01 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-86984e59-a271-43c4-bbfb-b3403e0deb4f tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:13:01 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-86984e59-a271-43c4-bbfb-b3403e0deb4f tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9e292ebb-0e44-454c-9822-4ba1f5208ef2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HmsLjSYZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 17:13:01 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-86984e59-a271-43c4-bbfb-b3403e0deb4f tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:13:01 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-86984e59-a271-43c4-bbfb-b3403e0deb4f tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23933386339373238', 'path': '/dev/sdb'} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:13:01 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86984e59-a271-43c4-bbfb-b3403e0deb4f tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933386339373238', 'path': '/dev/sdb'} {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 17:13:01 user nova-compute[74743]: DEBUG nova.objects.instance [None req-86984e59-a271-43c4-bbfb-b3403e0deb4f tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lazy-loading 'flavor' on Instance uuid f93bf0ac-ecc8-447d-b9c1-381d36cd3135 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:13:01 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-86984e59-a271-43c4-bbfb-b3403e0deb4f tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 17:13:01 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:13:01 user nova-compute[74743]:   <source dev="/dev/sdb"/>
Nov 18 17:13:01 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:13:01 user nova-compute[74743]:   <serial>9e292ebb-0e44-454c-9822-4ba1f5208ef2</serial>
Nov 18 17:13:01 user nova-compute[74743]: </disk>
Nov 18 17:13:01 user nova-compute[74743]:  {{(pid=74743) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 17:13:01 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-86984e59-a271-43c4-bbfb-b3403e0deb4f tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:13:01 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-86984e59-a271-43c4-bbfb-b3403e0deb4f tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:13:01 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-86984e59-a271-43c4-bbfb-b3403e0deb4f tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] No VIF found with MAC fa:16:3e:f3:91:b0, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:13:01 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-86984e59-a271-43c4-bbfb-b3403e0deb4f tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.603s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:13:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-846eab41-dad1-417b-be76-cd983fbc522e tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquiring lock "a77117a2-748d-4a39-8db7-8b965a1725fc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:13:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-846eab41-dad1-417b-be76-cd983fbc522e tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "a77117a2-748d-4a39-8db7-8b965a1725fc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:13:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-846eab41-dad1-417b-be76-cd983fbc522e tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquiring lock "a77117a2-748d-4a39-8db7-8b965a1725fc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:13:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-846eab41-dad1-417b-be76-cd983fbc522e tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "a77117a2-748d-4a39-8db7-8b965a1725fc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:13:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-846eab41-dad1-417b-be76-cd983fbc522e tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "a77117a2-748d-4a39-8db7-8b965a1725fc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:13:02 user nova-compute[74743]: INFO nova.compute.manager [None req-846eab41-dad1-417b-be76-cd983fbc522e tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Terminating instance
Nov 18 17:13:02 user nova-compute[74743]: DEBUG nova.compute.manager [None req-846eab41-dad1-417b-be76-cd983fbc522e tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Start destroying the instance on the hypervisor. {{(pid=74743) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 17:13:02 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:02 user nova-compute[74743]: DEBUG nova.compute.manager [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:13:02 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Guest created on hypervisor {{(pid=74743) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 17:13:02 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:02 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Instance spawned successfully.
Nov 18 17:13:02 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 17:13:02 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Found default for hw_cdrom_bus of ide {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:13:02 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Found default for hw_disk_bus of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:13:02 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Found default for hw_input_bus of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:13:02 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Found default for hw_pointer_model of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:13:02 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Found default for hw_video_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:13:02 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Found default for hw_vif_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:13:02 user nova-compute[74743]: INFO nova.compute.manager [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Took 5.22 seconds to spawn the instance on the hypervisor.
Nov 18 17:13:02 user nova-compute[74743]: DEBUG nova.compute.manager [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:13:02 user nova-compute[74743]: DEBUG nova.compute.manager [req-fdefd4c6-b4ca-428b-a19c-53058d0dbfc6 req-2c745d6d-8ae9-4801-a692-d560ea3f445b service nova] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Received event network-vif-plugged-3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:13:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-fdefd4c6-b4ca-428b-a19c-53058d0dbfc6 req-2c745d6d-8ae9-4801-a692-d560ea3f445b service nova] Acquiring lock "f41ad39c-15fd-42e2-9ad6-ed5cd25e25de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:13:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-fdefd4c6-b4ca-428b-a19c-53058d0dbfc6 req-2c745d6d-8ae9-4801-a692-d560ea3f445b service nova] Lock "f41ad39c-15fd-42e2-9ad6-ed5cd25e25de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:13:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-fdefd4c6-b4ca-428b-a19c-53058d0dbfc6 req-2c745d6d-8ae9-4801-a692-d560ea3f445b service nova] Lock "f41ad39c-15fd-42e2-9ad6-ed5cd25e25de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:13:02 user nova-compute[74743]: DEBUG nova.compute.manager [req-fdefd4c6-b4ca-428b-a19c-53058d0dbfc6 req-2c745d6d-8ae9-4801-a692-d560ea3f445b service nova] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] No waiting events found dispatching network-vif-plugged-3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:13:02 user nova-compute[74743]: WARNING nova.compute.manager [req-fdefd4c6-b4ca-428b-a19c-53058d0dbfc6 req-2c745d6d-8ae9-4801-a692-d560ea3f445b service nova] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Received unexpected event network-vif-plugged-3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5 for instance with vm_state building and task_state spawning.
Nov 18 17:13:02 user nova-compute[74743]: INFO nova.compute.manager [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Took 6.15 seconds to build instance.
Nov 18 17:13:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-0f6eb8f8-355a-4d93-881c-d5c2bac4de6e tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "f41ad39c-15fd-42e2-9ad6-ed5cd25e25de" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.256s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:13:02 user nova-compute[74743]: DEBUG nova.compute.manager [req-5cfe6351-5030-4010-93de-ab40847036b1 req-f9a5fd6e-9e19-4701-a031-c560ef82f0e1 service nova] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Received event network-vif-unplugged-22eb23ff-0df1-42e9-92c0-458497610ff9 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:13:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-5cfe6351-5030-4010-93de-ab40847036b1 req-f9a5fd6e-9e19-4701-a031-c560ef82f0e1 service nova] Acquiring lock "a77117a2-748d-4a39-8db7-8b965a1725fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:13:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-5cfe6351-5030-4010-93de-ab40847036b1 req-f9a5fd6e-9e19-4701-a031-c560ef82f0e1 service nova] Lock "a77117a2-748d-4a39-8db7-8b965a1725fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:13:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-5cfe6351-5030-4010-93de-ab40847036b1 req-f9a5fd6e-9e19-4701-a031-c560ef82f0e1 service nova] Lock "a77117a2-748d-4a39-8db7-8b965a1725fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:13:02 user nova-compute[74743]: DEBUG nova.compute.manager [req-5cfe6351-5030-4010-93de-ab40847036b1 req-f9a5fd6e-9e19-4701-a031-c560ef82f0e1 service nova] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] No waiting events found dispatching network-vif-unplugged-22eb23ff-0df1-42e9-92c0-458497610ff9 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:13:02 user nova-compute[74743]: DEBUG nova.compute.manager [req-5cfe6351-5030-4010-93de-ab40847036b1 req-f9a5fd6e-9e19-4701-a031-c560ef82f0e1 service nova] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Received event network-vif-unplugged-22eb23ff-0df1-42e9-92c0-458497610ff9 for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:13:02 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:02 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:03 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Instance destroyed successfully.
Nov 18 17:13:03 user nova-compute[74743]: DEBUG nova.objects.instance [None req-846eab41-dad1-417b-be76-cd983fbc522e tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lazy-loading 'resources' on Instance uuid a77117a2-748d-4a39-8db7-8b965a1725fc {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:13:03 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-846eab41-dad1-417b-be76-cd983fbc522e tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-18T17:07:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-196576409',display_name='tempest-ServerActionsTestOtherA-server-927938606',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-196576409',id=15,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJ9kBQV92QaO3NUQbsdxDa+z/O1R04nUATEUKPjnEHL9HBfHVAhzij3/MW2rTF8MFDQnt9uJ84+7PkWlYtClUm5BR319p/vhy/LOgQaMQorogb0O8y32fF069JI6jSm2g==',key_name='tempest-keypair-524527226',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:09:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fb8f5850162c479b8d185e48c03be7d3',ramdisk_id='',reservation_id='r-hahsjukq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-128885625',owner_user_name='tempest-ServerActionsTestOtherA-128885625-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:09:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce3e4cef47114a7c9327db639460d923',uuid=a77117a2-748d-4a39-8db7-8b965a1725fc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22eb23ff-0df1-42e9-92c0-458497610ff9", "address": "fa:16:3e:b3:91:01", "network": {"id": "fd98f398-6576-449b-a737-887906eb6656", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668610993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb8f5850162c479b8d185e48c03be7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22eb23ff-0d", "ovs_interfaceid": "22eb23ff-0df1-42e9-92c0-458497610ff9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:13:03 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-846eab41-dad1-417b-be76-cd983fbc522e tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Converting VIF {"id": "22eb23ff-0df1-42e9-92c0-458497610ff9", "address": "fa:16:3e:b3:91:01", "network": {"id": "fd98f398-6576-449b-a737-887906eb6656", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668610993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb8f5850162c479b8d185e48c03be7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22eb23ff-0d", "ovs_interfaceid": "22eb23ff-0df1-42e9-92c0-458497610ff9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:13:03 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-846eab41-dad1-417b-be76-cd983fbc522e tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:91:01,bridge_name='br-int',has_traffic_filtering=True,id=22eb23ff-0df1-42e9-92c0-458497610ff9,network=Network(fd98f398-6576-449b-a737-887906eb6656),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22eb23ff-0d') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:13:03 user nova-compute[74743]: DEBUG os_vif [None req-846eab41-dad1-417b-be76-cd983fbc522e tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:91:01,bridge_name='br-int',has_traffic_filtering=True,id=22eb23ff-0df1-42e9-92c0-458497610ff9,network=Network(fd98f398-6576-449b-a737-887906eb6656),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22eb23ff-0d') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:13:03 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:03 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22eb23ff-0d, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:13:03 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:03 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:13:03 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:03 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3c30a295-064e-4ffc-8467-df322bb077bb) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:13:03 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:03 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:13:03 user nova-compute[74743]: INFO os_vif [None req-846eab41-dad1-417b-be76-cd983fbc522e tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:91:01,bridge_name='br-int',has_traffic_filtering=True,id=22eb23ff-0df1-42e9-92c0-458497610ff9,network=Network(fd98f398-6576-449b-a737-887906eb6656),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22eb23ff-0d')
Nov 18 17:13:03 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-846eab41-dad1-417b-be76-cd983fbc522e tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Deleting instance files /opt/stack/data/nova/instances/a77117a2-748d-4a39-8db7-8b965a1725fc_del
Nov 18 17:13:03 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-846eab41-dad1-417b-be76-cd983fbc522e tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Deletion of /opt/stack/data/nova/instances/a77117a2-748d-4a39-8db7-8b965a1725fc_del complete
Nov 18 17:13:03 user nova-compute[74743]: INFO nova.compute.manager [None req-846eab41-dad1-417b-be76-cd983fbc522e tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 18 17:13:03 user nova-compute[74743]: DEBUG oslo.service.loopingcall [None req-846eab41-dad1-417b-be76-cd983fbc522e tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74743) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 17:13:03 user nova-compute[74743]: DEBUG nova.compute.manager [-] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Deallocating network for instance {{(pid=74743) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 17:13:03 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] deallocate_for_instance() {{(pid=74743) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 17:13:03 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:13:03 user nova-compute[74743]: INFO nova.compute.manager [-] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Took 0.73 seconds to deallocate network for instance.
Nov 18 17:13:03 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-846eab41-dad1-417b-be76-cd983fbc522e tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:13:03 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-846eab41-dad1-417b-be76-cd983fbc522e tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:13:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4c54e212-df02-4a84-83f0-c8d96ec64f97 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Acquiring lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:13:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4c54e212-df02-4a84-83f0-c8d96ec64f97 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:13:04 user nova-compute[74743]: INFO nova.compute.manager [None req-4c54e212-df02-4a84-83f0-c8d96ec64f97 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Detaching volume 9e292ebb-0e44-454c-9822-4ba1f5208ef2
Nov 18 17:13:04 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-846eab41-dad1-417b-be76-cd983fbc522e tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:13:04 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-846eab41-dad1-417b-be76-cd983fbc522e tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:13:04 user nova-compute[74743]: INFO nova.virt.block_device [None req-4c54e212-df02-4a84-83f0-c8d96ec64f97 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Attempting to driver detach volume 9e292ebb-0e44-454c-9822-4ba1f5208ef2 from mountpoint /dev/vdb
Nov 18 17:13:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-846eab41-dad1-417b-be76-cd983fbc522e tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.446s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:13:04 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-4c54e212-df02-4a84-83f0-c8d96ec64f97 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Attempting to detach device vdb from instance f93bf0ac-ecc8-447d-b9c1-381d36cd3135 from the persistent domain config. {{(pid=74743) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 17:13:04 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-4c54e212-df02-4a84-83f0-c8d96ec64f97 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 17:13:04 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:13:04 user nova-compute[74743]:   <source dev="/dev/sdb"/>
Nov 18 17:13:04 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:13:04 user nova-compute[74743]:   <serial>9e292ebb-0e44-454c-9822-4ba1f5208ef2</serial>
Nov 18 17:13:04 user nova-compute[74743]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 17:13:04 user nova-compute[74743]: </disk>
Nov 18 17:13:04 user nova-compute[74743]:  {{(pid=74743) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 17:13:04 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-4c54e212-df02-4a84-83f0-c8d96ec64f97 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Successfully detached device vdb from instance f93bf0ac-ecc8-447d-b9c1-381d36cd3135 from the persistent domain config.
Nov 18 17:13:04 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-4c54e212-df02-4a84-83f0-c8d96ec64f97 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f93bf0ac-ecc8-447d-b9c1-381d36cd3135 from the live domain config. {{(pid=74743) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 17:13:04 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-4c54e212-df02-4a84-83f0-c8d96ec64f97 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 17:13:04 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:13:04 user nova-compute[74743]:   <source dev="/dev/sdb"/>
Nov 18 17:13:04 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:13:04 user nova-compute[74743]:   <serial>9e292ebb-0e44-454c-9822-4ba1f5208ef2</serial>
Nov 18 17:13:04 user nova-compute[74743]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 17:13:04 user nova-compute[74743]: </disk>
Nov 18 17:13:04 user nova-compute[74743]:  {{(pid=74743) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 17:13:04 user nova-compute[74743]: INFO nova.scheduler.client.report [None req-846eab41-dad1-417b-be76-cd983fbc522e tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Deleted allocations for instance a77117a2-748d-4a39-8db7-8b965a1725fc
Nov 18 17:13:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-846eab41-dad1-417b-be76-cd983fbc522e tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "a77117a2-748d-4a39-8db7-8b965a1725fc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.263s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:13:04 user nova-compute[74743]: DEBUG nova.compute.manager [req-917db297-912c-41ed-8b63-24fc2e09edf9 req-563d368d-cdbf-4229-9eef-6c1b10cb3496 service nova] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Received event network-vif-deleted-22eb23ff-0df1-42e9-92c0-458497610ff9 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:13:04 user nova-compute[74743]: DEBUG nova.compute.manager [req-97e8bcd9-a084-4ae8-b9f2-f58f57479535 req-26cd9470-a0bd-45cc-8ddf-fdcf3f63951a service nova] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Received event network-vif-plugged-22eb23ff-0df1-42e9-92c0-458497610ff9 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:13:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-97e8bcd9-a084-4ae8-b9f2-f58f57479535 req-26cd9470-a0bd-45cc-8ddf-fdcf3f63951a service nova] Acquiring lock "a77117a2-748d-4a39-8db7-8b965a1725fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:13:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-97e8bcd9-a084-4ae8-b9f2-f58f57479535 req-26cd9470-a0bd-45cc-8ddf-fdcf3f63951a service nova] Lock "a77117a2-748d-4a39-8db7-8b965a1725fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:13:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-97e8bcd9-a084-4ae8-b9f2-f58f57479535 req-26cd9470-a0bd-45cc-8ddf-fdcf3f63951a service nova] Lock "a77117a2-748d-4a39-8db7-8b965a1725fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:13:04 user nova-compute[74743]: DEBUG nova.compute.manager [req-97e8bcd9-a084-4ae8-b9f2-f58f57479535 req-26cd9470-a0bd-45cc-8ddf-fdcf3f63951a service nova] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] No waiting events found dispatching network-vif-plugged-22eb23ff-0df1-42e9-92c0-458497610ff9 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:13:04 user nova-compute[74743]: WARNING nova.compute.manager [req-97e8bcd9-a084-4ae8-b9f2-f58f57479535 req-26cd9470-a0bd-45cc-8ddf-fdcf3f63951a service nova] [instance: a77117a2-748d-4a39-8db7-8b965a1725fc] Received unexpected event network-vif-plugged-22eb23ff-0df1-42e9-92c0-458497610ff9 for instance with vm_state deleted and task_state None.
Nov 18 17:13:04 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-4c54e212-df02-4a84-83f0-c8d96ec64f97 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f93bf0ac-ecc8-447d-b9c1-381d36cd3135 {{(pid=74743) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 17:13:04 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:08 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:09 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3eaca054-2096-4ed1-859f-4047175ca8ce tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Acquiring lock "c5c74497-1d1c-48a0-9b0a-e7df2a41361c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:13:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3eaca054-2096-4ed1-859f-4047175ca8ce tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Lock "c5c74497-1d1c-48a0-9b0a-e7df2a41361c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:13:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3eaca054-2096-4ed1-859f-4047175ca8ce tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Acquiring lock "c5c74497-1d1c-48a0-9b0a-e7df2a41361c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:13:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3eaca054-2096-4ed1-859f-4047175ca8ce tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Lock "c5c74497-1d1c-48a0-9b0a-e7df2a41361c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:13:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3eaca054-2096-4ed1-859f-4047175ca8ce tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Lock "c5c74497-1d1c-48a0-9b0a-e7df2a41361c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:13:10 user nova-compute[74743]: INFO nova.compute.manager [None req-3eaca054-2096-4ed1-859f-4047175ca8ce tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Terminating instance
Nov 18 17:13:10 user nova-compute[74743]: DEBUG nova.compute.manager [None req-3eaca054-2096-4ed1-859f-4047175ca8ce tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Start destroying the instance on the hypervisor. {{(pid=74743) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 17:13:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:10 user nova-compute[74743]: DEBUG nova.compute.manager [req-1587fde8-3352-4dc0-b8c5-10b9a1829c0a req-ba9330a7-c938-4ba9-be10-7ef60feecae7 service nova] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Received event network-vif-unplugged-e5de62fd-2d58-469b-b981-e7519bb831b6 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:13:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-1587fde8-3352-4dc0-b8c5-10b9a1829c0a req-ba9330a7-c938-4ba9-be10-7ef60feecae7 service nova] Acquiring lock "c5c74497-1d1c-48a0-9b0a-e7df2a41361c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:13:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-1587fde8-3352-4dc0-b8c5-10b9a1829c0a req-ba9330a7-c938-4ba9-be10-7ef60feecae7 service nova] Lock "c5c74497-1d1c-48a0-9b0a-e7df2a41361c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:13:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-1587fde8-3352-4dc0-b8c5-10b9a1829c0a req-ba9330a7-c938-4ba9-be10-7ef60feecae7 service nova] Lock "c5c74497-1d1c-48a0-9b0a-e7df2a41361c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:13:10 user nova-compute[74743]: DEBUG nova.compute.manager [req-1587fde8-3352-4dc0-b8c5-10b9a1829c0a req-ba9330a7-c938-4ba9-be10-7ef60feecae7 service nova] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] No waiting events found dispatching network-vif-unplugged-e5de62fd-2d58-469b-b981-e7519bb831b6 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:13:10 user nova-compute[74743]: DEBUG nova.compute.manager [req-1587fde8-3352-4dc0-b8c5-10b9a1829c0a req-ba9330a7-c938-4ba9-be10-7ef60feecae7 service nova] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Received event network-vif-unplugged-e5de62fd-2d58-469b-b981-e7519bb831b6 for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:13:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:11 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Instance destroyed successfully.
Nov 18 17:13:11 user nova-compute[74743]: DEBUG nova.objects.instance [None req-3eaca054-2096-4ed1-859f-4047175ca8ce tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Lazy-loading 'resources' on Instance uuid c5c74497-1d1c-48a0-9b0a-e7df2a41361c {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:13:11 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-3eaca054-2096-4ed1-859f-4047175ca8ce tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:08:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-615708399',display_name='tempest-TestServerVolumeAttachmentScenario-server-615708399',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-615708399',id=17,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRn/q/1K03eVQo/nKnZ9mXzuizMJEKNhpl/MCWvBkLc+qgNJuFktUTYI6Jm4ZALbuPl09Fhvt7ENy/pbfjHmtWKL+ZIoWQqU76dMhjBJ4P4evdsovtzZfcG35cL4ZWCfA==',key_name='tempest-keypair-1928572282',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:08:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72c1b4501efb42a482d0faf10fa1ff2b',ramdisk_id='',reservation_id='r-zm4acbdi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-155768243',owner_user_name='tempest-TestServerVolumeAttachmentScenario-155768243-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:08:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5fa5e5c1b2548b5bb3b6edc4f8d6139',uuid=c5c74497-1d1c-48a0-9b0a-e7df2a41361c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e5de62fd-2d58-469b-b981-e7519bb831b6", "address": "fa:16:3e:45:6a:b6", "network": {"id": "878a81f7-c3ef-4b3b-8074-52d119d989b4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1839718683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c1b4501efb42a482d0faf10fa1ff2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5de62fd-2d", "ovs_interfaceid": "e5de62fd-2d58-469b-b981-e7519bb831b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:13:11 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-3eaca054-2096-4ed1-859f-4047175ca8ce tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Converting VIF {"id": "e5de62fd-2d58-469b-b981-e7519bb831b6", "address": "fa:16:3e:45:6a:b6", "network": {"id": "878a81f7-c3ef-4b3b-8074-52d119d989b4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1839718683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c1b4501efb42a482d0faf10fa1ff2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5de62fd-2d", "ovs_interfaceid": "e5de62fd-2d58-469b-b981-e7519bb831b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:13:11 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-3eaca054-2096-4ed1-859f-4047175ca8ce tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:6a:b6,bridge_name='br-int',has_traffic_filtering=True,id=e5de62fd-2d58-469b-b981-e7519bb831b6,network=Network(878a81f7-c3ef-4b3b-8074-52d119d989b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5de62fd-2d') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:13:11 user nova-compute[74743]: DEBUG os_vif [None req-3eaca054-2096-4ed1-859f-4047175ca8ce tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:6a:b6,bridge_name='br-int',has_traffic_filtering=True,id=e5de62fd-2d58-469b-b981-e7519bb831b6,network=Network(878a81f7-c3ef-4b3b-8074-52d119d989b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5de62fd-2d') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:13:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape5de62fd-2d, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:13:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:13:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=09fcfabc-d195-4cc6-b217-66c23f98660e) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:13:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:11 user nova-compute[74743]: INFO os_vif [None req-3eaca054-2096-4ed1-859f-4047175ca8ce tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:6a:b6,bridge_name='br-int',has_traffic_filtering=True,id=e5de62fd-2d58-469b-b981-e7519bb831b6,network=Network(878a81f7-c3ef-4b3b-8074-52d119d989b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5de62fd-2d')
Nov 18 17:13:11 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-3eaca054-2096-4ed1-859f-4047175ca8ce tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Deleting instance files /opt/stack/data/nova/instances/c5c74497-1d1c-48a0-9b0a-e7df2a41361c_del
Nov 18 17:13:11 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-3eaca054-2096-4ed1-859f-4047175ca8ce tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Deletion of /opt/stack/data/nova/instances/c5c74497-1d1c-48a0-9b0a-e7df2a41361c_del complete
Nov 18 17:13:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:11 user nova-compute[74743]: INFO nova.compute.manager [None req-3eaca054-2096-4ed1-859f-4047175ca8ce tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 18 17:13:11 user nova-compute[74743]: DEBUG oslo.service.loopingcall [None req-3eaca054-2096-4ed1-859f-4047175ca8ce tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74743) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 17:13:11 user nova-compute[74743]: DEBUG nova.compute.manager [-] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Deallocating network for instance {{(pid=74743) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 17:13:11 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] deallocate_for_instance() {{(pid=74743) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 17:13:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:12 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:13:12 user nova-compute[74743]: INFO nova.compute.manager [-] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Took 1.02 seconds to deallocate network for instance.
Nov 18 17:13:12 user nova-compute[74743]: DEBUG nova.compute.manager [req-a05917d5-d009-43d6-a1a0-bd21349e3969 req-037ef393-9fb9-45ed-aa13-46a3bacf61e1 service nova] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Received event network-vif-deleted-e5de62fd-2d58-469b-b981-e7519bb831b6 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:13:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3eaca054-2096-4ed1-859f-4047175ca8ce tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:13:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3eaca054-2096-4ed1-859f-4047175ca8ce tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:13:12 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-3eaca054-2096-4ed1-859f-4047175ca8ce tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:13:12 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-3eaca054-2096-4ed1-859f-4047175ca8ce tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:13:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3eaca054-2096-4ed1-859f-4047175ca8ce tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.407s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:13:12 user nova-compute[74743]: INFO nova.scheduler.client.report [None req-3eaca054-2096-4ed1-859f-4047175ca8ce tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Deleted allocations for instance c5c74497-1d1c-48a0-9b0a-e7df2a41361c
Nov 18 17:13:12 user nova-compute[74743]: DEBUG nova.compute.manager [req-d6900819-4751-4f71-89f8-49b8c0495212 req-fb0df531-c900-4ce9-832e-bf95502e1154 service nova] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Received event network-vif-plugged-e5de62fd-2d58-469b-b981-e7519bb831b6 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:13:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d6900819-4751-4f71-89f8-49b8c0495212 req-fb0df531-c900-4ce9-832e-bf95502e1154 service nova] Acquiring lock "c5c74497-1d1c-48a0-9b0a-e7df2a41361c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:13:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d6900819-4751-4f71-89f8-49b8c0495212 req-fb0df531-c900-4ce9-832e-bf95502e1154 service nova] Lock "c5c74497-1d1c-48a0-9b0a-e7df2a41361c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:13:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d6900819-4751-4f71-89f8-49b8c0495212 req-fb0df531-c900-4ce9-832e-bf95502e1154 service nova] Lock "c5c74497-1d1c-48a0-9b0a-e7df2a41361c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:13:12 user nova-compute[74743]: DEBUG nova.compute.manager [req-d6900819-4751-4f71-89f8-49b8c0495212 req-fb0df531-c900-4ce9-832e-bf95502e1154 service nova] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] No waiting events found dispatching network-vif-plugged-e5de62fd-2d58-469b-b981-e7519bb831b6 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:13:12 user nova-compute[74743]: WARNING nova.compute.manager [req-d6900819-4751-4f71-89f8-49b8c0495212 req-fb0df531-c900-4ce9-832e-bf95502e1154 service nova] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Received unexpected event network-vif-plugged-e5de62fd-2d58-469b-b981-e7519bb831b6 for instance with vm_state deleted and task_state None.
Nov 18 17:13:12 user nova-compute[74743]: DEBUG nova.compute.manager [req-d6900819-4751-4f71-89f8-49b8c0495212 req-fb0df531-c900-4ce9-832e-bf95502e1154 service nova] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Received event network-vif-plugged-e5de62fd-2d58-469b-b981-e7519bb831b6 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:13:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d6900819-4751-4f71-89f8-49b8c0495212 req-fb0df531-c900-4ce9-832e-bf95502e1154 service nova] Acquiring lock "c5c74497-1d1c-48a0-9b0a-e7df2a41361c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:13:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d6900819-4751-4f71-89f8-49b8c0495212 req-fb0df531-c900-4ce9-832e-bf95502e1154 service nova] Lock "c5c74497-1d1c-48a0-9b0a-e7df2a41361c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:13:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d6900819-4751-4f71-89f8-49b8c0495212 req-fb0df531-c900-4ce9-832e-bf95502e1154 service nova] Lock "c5c74497-1d1c-48a0-9b0a-e7df2a41361c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:13:12 user nova-compute[74743]: DEBUG nova.compute.manager [req-d6900819-4751-4f71-89f8-49b8c0495212 req-fb0df531-c900-4ce9-832e-bf95502e1154 service nova] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] No waiting events found dispatching network-vif-plugged-e5de62fd-2d58-469b-b981-e7519bb831b6 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:13:12 user nova-compute[74743]: WARNING nova.compute.manager [req-d6900819-4751-4f71-89f8-49b8c0495212 req-fb0df531-c900-4ce9-832e-bf95502e1154 service nova] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Received unexpected event network-vif-plugged-e5de62fd-2d58-469b-b981-e7519bb831b6 for instance with vm_state deleted and task_state None.
Nov 18 17:13:12 user nova-compute[74743]: DEBUG nova.compute.manager [req-d6900819-4751-4f71-89f8-49b8c0495212 req-fb0df531-c900-4ce9-832e-bf95502e1154 service nova] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Received event network-vif-plugged-e5de62fd-2d58-469b-b981-e7519bb831b6 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:13:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d6900819-4751-4f71-89f8-49b8c0495212 req-fb0df531-c900-4ce9-832e-bf95502e1154 service nova] Acquiring lock "c5c74497-1d1c-48a0-9b0a-e7df2a41361c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:13:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d6900819-4751-4f71-89f8-49b8c0495212 req-fb0df531-c900-4ce9-832e-bf95502e1154 service nova] Lock "c5c74497-1d1c-48a0-9b0a-e7df2a41361c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:13:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d6900819-4751-4f71-89f8-49b8c0495212 req-fb0df531-c900-4ce9-832e-bf95502e1154 service nova] Lock "c5c74497-1d1c-48a0-9b0a-e7df2a41361c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:13:12 user nova-compute[74743]: DEBUG nova.compute.manager [req-d6900819-4751-4f71-89f8-49b8c0495212 req-fb0df531-c900-4ce9-832e-bf95502e1154 service nova] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] No waiting events found dispatching network-vif-plugged-e5de62fd-2d58-469b-b981-e7519bb831b6 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:13:12 user nova-compute[74743]: WARNING nova.compute.manager [req-d6900819-4751-4f71-89f8-49b8c0495212 req-fb0df531-c900-4ce9-832e-bf95502e1154 service nova] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Received unexpected event network-vif-plugged-e5de62fd-2d58-469b-b981-e7519bb831b6 for instance with vm_state deleted and task_state None.
Nov 18 17:13:12 user nova-compute[74743]: DEBUG nova.compute.manager [req-d6900819-4751-4f71-89f8-49b8c0495212 req-fb0df531-c900-4ce9-832e-bf95502e1154 service nova] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Received event network-vif-unplugged-e5de62fd-2d58-469b-b981-e7519bb831b6 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:13:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d6900819-4751-4f71-89f8-49b8c0495212 req-fb0df531-c900-4ce9-832e-bf95502e1154 service nova] Acquiring lock "c5c74497-1d1c-48a0-9b0a-e7df2a41361c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:13:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d6900819-4751-4f71-89f8-49b8c0495212 req-fb0df531-c900-4ce9-832e-bf95502e1154 service nova] Lock "c5c74497-1d1c-48a0-9b0a-e7df2a41361c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:13:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d6900819-4751-4f71-89f8-49b8c0495212 req-fb0df531-c900-4ce9-832e-bf95502e1154 service nova] Lock "c5c74497-1d1c-48a0-9b0a-e7df2a41361c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:13:12 user nova-compute[74743]: DEBUG nova.compute.manager [req-d6900819-4751-4f71-89f8-49b8c0495212 req-fb0df531-c900-4ce9-832e-bf95502e1154 service nova] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] No waiting events found dispatching network-vif-unplugged-e5de62fd-2d58-469b-b981-e7519bb831b6 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:13:12 user nova-compute[74743]: WARNING nova.compute.manager [req-d6900819-4751-4f71-89f8-49b8c0495212 req-fb0df531-c900-4ce9-832e-bf95502e1154 service nova] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Received unexpected event network-vif-unplugged-e5de62fd-2d58-469b-b981-e7519bb831b6 for instance with vm_state deleted and task_state None.
Nov 18 17:13:12 user nova-compute[74743]: DEBUG nova.compute.manager [req-d6900819-4751-4f71-89f8-49b8c0495212 req-fb0df531-c900-4ce9-832e-bf95502e1154 service nova] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Received event network-vif-plugged-e5de62fd-2d58-469b-b981-e7519bb831b6 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:13:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d6900819-4751-4f71-89f8-49b8c0495212 req-fb0df531-c900-4ce9-832e-bf95502e1154 service nova] Acquiring lock "c5c74497-1d1c-48a0-9b0a-e7df2a41361c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:13:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d6900819-4751-4f71-89f8-49b8c0495212 req-fb0df531-c900-4ce9-832e-bf95502e1154 service nova] Lock "c5c74497-1d1c-48a0-9b0a-e7df2a41361c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:13:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d6900819-4751-4f71-89f8-49b8c0495212 req-fb0df531-c900-4ce9-832e-bf95502e1154 service nova] Lock "c5c74497-1d1c-48a0-9b0a-e7df2a41361c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:13:12 user nova-compute[74743]: DEBUG nova.compute.manager [req-d6900819-4751-4f71-89f8-49b8c0495212 req-fb0df531-c900-4ce9-832e-bf95502e1154 service nova] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] No waiting events found dispatching network-vif-plugged-e5de62fd-2d58-469b-b981-e7519bb831b6 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:13:12 user nova-compute[74743]: WARNING nova.compute.manager [req-d6900819-4751-4f71-89f8-49b8c0495212 req-fb0df531-c900-4ce9-832e-bf95502e1154 service nova] [instance: c5c74497-1d1c-48a0-9b0a-e7df2a41361c] Received unexpected event network-vif-plugged-e5de62fd-2d58-469b-b981-e7519bb831b6 for instance with vm_state deleted and task_state None.
Nov 18 17:13:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3eaca054-2096-4ed1-859f-4047175ca8ce tempest-TestServerVolumeAttachmentScenario-155768243 tempest-TestServerVolumeAttachmentScenario-155768243-project-member] Lock "c5c74497-1d1c-48a0-9b0a-e7df2a41361c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.487s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:13:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:24 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-4c54e212-df02-4a84-83f0-c8d96ec64f97 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f93bf0ac-ecc8-447d-b9c1-381d36cd3135 is timed out.
Nov 18 17:13:24 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-4c54e212-df02-4a84-83f0-c8d96ec64f97 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Successfully detached device vdb from instance f93bf0ac-ecc8-447d-b9c1-381d36cd3135 from the live domain config.
Nov 18 17:13:24 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c54e212-df02-4a84-83f0-c8d96ec64f97 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] calling os-brick to detach iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 17:13:24 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c54e212-df02-4a84-83f0-c8d96ec64f97 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, {'target_iqn': 'iqn.2010-10.org.openstack:9e292ebb-0e44-454c-9822-4ba1f5208ef2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HmsLjSYZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:13:24 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-4c54e212-df02-4a84-83f0-c8d96ec64f97 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:13:24 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-4c54e212-df02-4a84-83f0-c8d96ec64f97 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:13:24 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-4c54e212-df02-4a84-83f0-c8d96ec64f97 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:13:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:24 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ec20c5-cb5e-4af9-88cd-639165866f03]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e292ebb-0e44-454c-9822-4ba1f5208ef2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:24 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c54e212-df02-4a84-83f0-c8d96ec64f97 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 17:13:24 user nova-compute[74743]: No targets found.
Nov 18 17:13:24 user nova-compute[74743]: iSNS:
Nov 18 17:13:24 user nova-compute[74743]: No targets found.
Nov 18 17:13:24 user nova-compute[74743]: STATIC:
Nov 18 17:13:24 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685
Nov 18 17:13:24 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:13:24 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:13:24 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:9e292ebb-0e44-454c-9822-4ba1f5208ef2
Nov 18 17:13:24 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:13:24 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:13:24 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5
Nov 18 17:13:24 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:13:24 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:13:24 user nova-compute[74743]: FIRMWARE:
Nov 18 17:13:24 user nova-compute[74743]: No targets found.
Nov 18 17:13:24 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:13:24 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c54e212-df02-4a84-83f0-c8d96ec64f97 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 17:13:24 user nova-compute[74743]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 17:13:24 user nova-compute[74743]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74743) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 17:13:24 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c54e212-df02-4a84-83f0-c8d96ec64f97 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e292ebb-0e44-454c-9822-4ba1f5208ef2', 0)] {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 17:13:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:24 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:24 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3dc3f95-ca67-4b6e-8457-00c29c2656b9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e292ebb-0e44-454c-9822-4ba1f5208ef2\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:24 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c8c909-51dd-4b8f-ba60-00502c680633]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e292ebb-0e44-454c-9822-4ba1f5208ef2 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:24 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c54e212-df02-4a84-83f0-c8d96ec64f97 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:13:24 user nova-compute[74743]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:13:24 user nova-compute[74743]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e292ebb-0e44-454c-9822-4ba1f5208ef2 (non-flash)
Nov 18 17:13:24 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:13:24 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c54e212-df02-4a84-83f0-c8d96ec64f97 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:13:24 user nova-compute[74743]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:13:24 user nova-compute[74743]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e292ebb-0e44-454c-9822-4ba1f5208ef2 (non-flash)
Nov 18 17:13:24 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:13:24 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c54e212-df02-4a84-83f0-c8d96ec64f97 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb08364040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e292ebb-0e44-454c-9822-4ba1f5208ef2'): ({'sdb'}, set())}) {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 17:13:24 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-4c54e212-df02-4a84-83f0-c8d96ec64f97 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Removing single pathed devices sdb {{(pid=74743) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 17:13:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:25 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[138a96b6-a65e-4e05-829c-39a954536ceb]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:25 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40a0516-f110-4fc0-9b36-70cad32009fd]: (4, ('ok\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:25 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-4c54e212-df02-4a84-83f0-c8d96ec64f97 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Flushing IO for device /dev/sdb {{(pid=74743) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 17:13:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:25 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df54b5b-87e5-4129-b69b-191f029c0357]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:25 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-4c54e212-df02-4a84-83f0-c8d96ec64f97 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74743) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 17:13:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:25 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6669a1b-c3e0-45f5-91b3-e2db7f5240ad]: (4, ('1', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:25 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-4c54e212-df02-4a84-83f0-c8d96ec64f97 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 17:13:25 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-4c54e212-df02-4a84-83f0-c8d96ec64f97 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] SCSI volumes sdb have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 17:13:25 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c54e212-df02-4a84-83f0-c8d96ec64f97 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e292ebb-0e44-454c-9822-4ba1f5208ef2')] {{(pid=74743) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 17:13:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e292ebb-0e44-454c-9822-4ba1f5208ef2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e292ebb-0e44-454c-9822-4ba1f5208ef2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:25 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe36ec3-3969-4377-9aea-a6d6b0380bd0]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:25 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c54e212-df02-4a84-83f0-c8d96ec64f97 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:13:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e292ebb-0e44-454c-9822-4ba1f5208ef2 -p 172.16.0.220:3260 --logout {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e292ebb-0e44-454c-9822-4ba1f5208ef2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:25 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ecf2008-65b8-4d88-9d6a-24db5abee26c]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:9e292ebb-0e44-454c-9822-4ba1f5208ef2, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:9e292ebb-0e44-454c-9822-4ba1f5208ef2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:25 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c54e212-df02-4a84-83f0-c8d96ec64f97 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:9e292ebb-0e44-454c-9822-4ba1f5208ef2, portal: 172.16.0.220,3260]
Nov 18 17:13:25 user nova-compute[74743]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:9e292ebb-0e44-454c-9822-4ba1f5208ef2, portal: 172.16.0.220,3260] successful.
Nov 18 17:13:25 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:13:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e292ebb-0e44-454c-9822-4ba1f5208ef2 -p 172.16.0.220:3260 --op delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e292ebb-0e44-454c-9822-4ba1f5208ef2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:25 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0173afbf-45ec-4e29-a9db-7958935fbaf5]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:25 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c54e212-df02-4a84-83f0-c8d96ec64f97 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:13:25 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-4c54e212-df02-4a84-83f0-c8d96ec64f97 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:13:25 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c54e212-df02-4a84-83f0-c8d96ec64f97 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] <== disconnect_volume: return (298ms) None {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:13:25 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c54e212-df02-4a84-83f0-c8d96ec64f97 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Disconnected iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 17:13:26 user nova-compute[74743]: DEBUG nova.objects.instance [None req-4c54e212-df02-4a84-83f0-c8d96ec64f97 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lazy-loading 'flavor' on Instance uuid f93bf0ac-ecc8-447d-b9c1-381d36cd3135 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:13:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4c54e212-df02-4a84-83f0-c8d96ec64f97 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.774s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:13:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:27 user nova-compute[74743]: DEBUG nova.compute.manager [req-fef7e03a-c14c-4eeb-a6eb-84ba88272ae2 req-22271c67-44dd-4af9-88a4-445a6ce0d3a2 service nova] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Received event network-changed-ba661621-6683-462f-ba90-5de9da77c1a3 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:13:27 user nova-compute[74743]: DEBUG nova.compute.manager [req-fef7e03a-c14c-4eeb-a6eb-84ba88272ae2 req-22271c67-44dd-4af9-88a4-445a6ce0d3a2 service nova] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Refreshing instance network info cache due to event network-changed-ba661621-6683-462f-ba90-5de9da77c1a3. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:13:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-fef7e03a-c14c-4eeb-a6eb-84ba88272ae2 req-22271c67-44dd-4af9-88a4-445a6ce0d3a2 service nova] Acquiring lock "refresh_cache-180f2f7e-9df5-480f-adde-d8e10ee14b07" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:13:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-fef7e03a-c14c-4eeb-a6eb-84ba88272ae2 req-22271c67-44dd-4af9-88a4-445a6ce0d3a2 service nova] Acquired lock "refresh_cache-180f2f7e-9df5-480f-adde-d8e10ee14b07" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:13:27 user nova-compute[74743]: DEBUG nova.network.neutron [req-fef7e03a-c14c-4eeb-a6eb-84ba88272ae2 req-22271c67-44dd-4af9-88a4-445a6ce0d3a2 service nova] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Refreshing network info cache for port ba661621-6683-462f-ba90-5de9da77c1a3 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:13:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e6e2cf6a-0fbd-47b7-b2b6-bd590650247e tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Acquiring lock "180f2f7e-9df5-480f-adde-d8e10ee14b07" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:13:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e6e2cf6a-0fbd-47b7-b2b6-bd590650247e tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "180f2f7e-9df5-480f-adde-d8e10ee14b07" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:13:27 user nova-compute[74743]: DEBUG nova.objects.instance [None req-e6e2cf6a-0fbd-47b7-b2b6-bd590650247e tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lazy-loading 'flavor' on Instance uuid 180f2f7e-9df5-480f-adde-d8e10ee14b07 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:13:27 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-e6e2cf6a-0fbd-47b7-b2b6-bd590650247e tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Ignoring supplied device name: /dev/vdb
Nov 18 17:13:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e6e2cf6a-0fbd-47b7-b2b6-bd590650247e tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "180f2f7e-9df5-480f-adde-d8e10ee14b07" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:13:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e6e2cf6a-0fbd-47b7-b2b6-bd590650247e tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Acquiring lock "180f2f7e-9df5-480f-adde-d8e10ee14b07" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:13:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e6e2cf6a-0fbd-47b7-b2b6-bd590650247e tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "180f2f7e-9df5-480f-adde-d8e10ee14b07" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:13:28 user nova-compute[74743]: INFO nova.compute.manager [None req-e6e2cf6a-0fbd-47b7-b2b6-bd590650247e tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Attaching volume 9f0ecae7-9091-4cb2-8758-d5f683dd3686 to /dev/vdb
Nov 18 17:13:28 user nova-compute[74743]: DEBUG nova.network.neutron [req-fef7e03a-c14c-4eeb-a6eb-84ba88272ae2 req-22271c67-44dd-4af9-88a4-445a6ce0d3a2 service nova] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Updated VIF entry in instance network info cache for port ba661621-6683-462f-ba90-5de9da77c1a3. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:13:28 user nova-compute[74743]: DEBUG nova.network.neutron [req-fef7e03a-c14c-4eeb-a6eb-84ba88272ae2 req-22271c67-44dd-4af9-88a4-445a6ce0d3a2 service nova] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Updating instance_info_cache with network_info: [{"id": "ba661621-6683-462f-ba90-5de9da77c1a3", "address": "fa:16:3e:4a:ca:b3", "network": {"id": "2588909e-8504-407d-bc7b-5d1f3d978395", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1712970821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468d0e7ff32423091ecc55d82deba1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba661621-66", "ovs_interfaceid": "ba661621-6683-462f-ba90-5de9da77c1a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:13:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-fef7e03a-c14c-4eeb-a6eb-84ba88272ae2 req-22271c67-44dd-4af9-88a4-445a6ce0d3a2 service nova] Releasing lock "refresh_cache-180f2f7e-9df5-480f-adde-d8e10ee14b07" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:13:28 user nova-compute[74743]: DEBUG os_brick.utils [None req-e6e2cf6a-0fbd-47b7-b2b6-bd590650247e tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:13:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:28 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f2d90f-3729-4201-b831-37eac5991760]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1116acd8874d\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:28 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8bbbbe-363f-4052-a06f-bde051e6ed3d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:28 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce7914c-7a01-457b-aa64-408fb3e31350]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:28 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[73354523-cfc8-470f-9c98-405ef658412a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-e6e2cf6a-0fbd-47b7-b2b6-bd590650247e tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Running cmd (subprocess): nvme version {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-e6e2cf6a-0fbd-47b7-b2b6-bd590650247e tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] 'nvme version' failed. Not Retrying. {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:13:28 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e6e2cf6a-0fbd-47b7-b2b6-bd590650247e tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] nvme not present on system {{(pid=74743) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 17:13:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:13:28 user nova-compute[74743]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 17:13:28 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d485cce6-6bae-4be1-8cfd-334b426eb876]: (4, '') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:28 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-e6e2cf6a-0fbd-47b7-b2b6-bd590650247e tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74743) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 17:13:28 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-e6e2cf6a-0fbd-47b7-b2b6-bd590650247e tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 17:13:28 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-e6e2cf6a-0fbd-47b7-b2b6-bd590650247e tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] LIGHTOS: no hostnqn found. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 17:13:28 user nova-compute[74743]: DEBUG os_brick.utils [None req-e6e2cf6a-0fbd-47b7-b2b6-bd590650247e tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1116acd8874d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:13:28 user nova-compute[74743]: DEBUG nova.virt.block_device [None req-e6e2cf6a-0fbd-47b7-b2b6-bd590650247e tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Updating existing volume attachment record: c99c9932-d9f0-4ad8-8f30-a8934ff02541 {{(pid=74743) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 17:13:28 user nova-compute[74743]: DEBUG nova.network.neutron [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Port c66ef239-8068-4eff-807a-830d5f3d0dba binding to destination host user is already ACTIVE {{(pid=74743) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 18 17:13:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Acquiring lock "refresh_cache-49ebdd5a-824d-476a-bd10-3b891bbfe9e2" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:13:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Acquired lock "refresh_cache-49ebdd5a-824d-476a-bd10-3b891bbfe9e2" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:13:28 user nova-compute[74743]: DEBUG nova.network.neutron [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:13:29 user nova-compute[74743]: DEBUG nova.network.neutron [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Updating instance_info_cache with network_info: [{"id": "c66ef239-8068-4eff-807a-830d5f3d0dba", "address": "fa:16:3e:f3:3d:ca", "network": {"id": "79046ec4-e7a8-4b7d-8607-3205067366b6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1734449136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8955c5a052b34bde997f9db74d302edb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66ef239-80", "ovs_interfaceid": "c66ef239-8068-4eff-807a-830d5f3d0dba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:13:29 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Releasing lock "refresh_cache-49ebdd5a-824d-476a-bd10-3b891bbfe9e2" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:13:29 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Creating tmpfile /opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/tmpv3zhh7nq to verify with other compute node that the instance is on the same shared storage. {{(pid=74743) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 18 17:13:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:29 user nova-compute[74743]: DEBUG nova.compute.manager [req-8f94d0a6-dcba-40fe-b0ea-263078fd1f71 req-99267950-9b75-4ec7-acbf-92379793f65b service nova] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Received event network-vif-unplugged-c66ef239-8068-4eff-807a-830d5f3d0dba {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:13:29 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-8f94d0a6-dcba-40fe-b0ea-263078fd1f71 req-99267950-9b75-4ec7-acbf-92379793f65b service nova] Acquiring lock "49ebdd5a-824d-476a-bd10-3b891bbfe9e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:13:29 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-8f94d0a6-dcba-40fe-b0ea-263078fd1f71 req-99267950-9b75-4ec7-acbf-92379793f65b service nova] Lock "49ebdd5a-824d-476a-bd10-3b891bbfe9e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:13:29 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-8f94d0a6-dcba-40fe-b0ea-263078fd1f71 req-99267950-9b75-4ec7-acbf-92379793f65b service nova] Lock "49ebdd5a-824d-476a-bd10-3b891bbfe9e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:13:29 user nova-compute[74743]: DEBUG nova.compute.manager [req-8f94d0a6-dcba-40fe-b0ea-263078fd1f71 req-99267950-9b75-4ec7-acbf-92379793f65b service nova] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] No waiting events found dispatching network-vif-unplugged-c66ef239-8068-4eff-807a-830d5f3d0dba {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:13:29 user nova-compute[74743]: WARNING nova.compute.manager [req-8f94d0a6-dcba-40fe-b0ea-263078fd1f71 req-99267950-9b75-4ec7-acbf-92379793f65b service nova] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Received unexpected event network-vif-unplugged-c66ef239-8068-4eff-807a-830d5f3d0dba for instance with vm_state resized and task_state resize_reverting.
Nov 18 17:13:29 user nova-compute[74743]: DEBUG nova.compute.manager [req-8f94d0a6-dcba-40fe-b0ea-263078fd1f71 req-99267950-9b75-4ec7-acbf-92379793f65b service nova] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Received event network-vif-plugged-c66ef239-8068-4eff-807a-830d5f3d0dba {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:13:29 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-8f94d0a6-dcba-40fe-b0ea-263078fd1f71 req-99267950-9b75-4ec7-acbf-92379793f65b service nova] Acquiring lock "49ebdd5a-824d-476a-bd10-3b891bbfe9e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:13:29 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-8f94d0a6-dcba-40fe-b0ea-263078fd1f71 req-99267950-9b75-4ec7-acbf-92379793f65b service nova] Lock "49ebdd5a-824d-476a-bd10-3b891bbfe9e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:13:29 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-8f94d0a6-dcba-40fe-b0ea-263078fd1f71 req-99267950-9b75-4ec7-acbf-92379793f65b service nova] Lock "49ebdd5a-824d-476a-bd10-3b891bbfe9e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:13:29 user nova-compute[74743]: DEBUG nova.compute.manager [req-8f94d0a6-dcba-40fe-b0ea-263078fd1f71 req-99267950-9b75-4ec7-acbf-92379793f65b service nova] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] No waiting events found dispatching network-vif-plugged-c66ef239-8068-4eff-807a-830d5f3d0dba {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:13:29 user nova-compute[74743]: WARNING nova.compute.manager [req-8f94d0a6-dcba-40fe-b0ea-263078fd1f71 req-99267950-9b75-4ec7-acbf-92379793f65b service nova] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Received unexpected event network-vif-plugged-c66ef239-8068-4eff-807a-830d5f3d0dba for instance with vm_state resized and task_state resize_reverting.
Nov 18 17:13:29 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Instance destroyed successfully.
Nov 18 17:13:29 user nova-compute[74743]: DEBUG nova.objects.instance [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Lazy-loading 'resources' on Instance uuid 49ebdd5a-824d-476a-bd10-3b891bbfe9e2 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:13:29 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:07:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-761441758',display_name='tempest-ServerActionsTestOtherB-server-761441758',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-761441758',id=16,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHSxRrGlHxDyqlCOq0hy6p31kUDSaQIxafGDavUpZ/Ka4RS6tIfzT5avp8Ymkenpc8OEHVquoqpPuZPk62jn4N2SagQ88JWrrx/6+VzSF8w9eq7GAvBHe/3/xNVOBksa4g==',key_name='tempest-keypair-1267949685',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:11:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8955c5a052b34bde997f9db74d302edb',ramdisk_id='',reservation_id='r-ewenialm',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2984948',owner_user_name='tempest-ServerActionsTestOtherB-2984948-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:11:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c37b5fe2f7d74cab894eef0f41c6a5ed',uuid=49ebdd5a-824d-476a-bd10-3b891bbfe9e2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "c66ef239-8068-4eff-807a-830d5f3d0dba", "address": "fa:16:3e:f3:3d:ca", "network": {"id": "79046ec4-e7a8-4b7d-8607-3205067366b6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1734449136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8955c5a052b34bde997f9db74d302edb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66ef239-80", "ovs_interfaceid": "c66ef239-8068-4eff-807a-830d5f3d0dba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:13:29 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Converting VIF {"id": "c66ef239-8068-4eff-807a-830d5f3d0dba", "address": "fa:16:3e:f3:3d:ca", "network": {"id": "79046ec4-e7a8-4b7d-8607-3205067366b6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1734449136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8955c5a052b34bde997f9db74d302edb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66ef239-80", "ovs_interfaceid": "c66ef239-8068-4eff-807a-830d5f3d0dba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:13:29 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:3d:ca,bridge_name='br-int',has_traffic_filtering=True,id=c66ef239-8068-4eff-807a-830d5f3d0dba,network=Network(79046ec4-e7a8-4b7d-8607-3205067366b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66ef239-80') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:13:29 user nova-compute[74743]: DEBUG os_vif [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:3d:ca,bridge_name='br-int',has_traffic_filtering=True,id=c66ef239-8068-4eff-807a-830d5f3d0dba,network=Network(79046ec4-e7a8-4b7d-8607-3205067366b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66ef239-80') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:13:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc66ef239-80, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:13:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9de8e832-af92-4a41-8c41-69e7987ab84a) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:13:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:29 user nova-compute[74743]: INFO os_vif [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:3d:ca,bridge_name='br-int',has_traffic_filtering=True,id=c66ef239-8068-4eff-807a-830d5f3d0dba,network=Network(79046ec4-e7a8-4b7d-8607-3205067366b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66ef239-80')
Nov 18 17:13:29 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] calling os-brick to detach iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 17:13:29 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, {'target_iqn': 'iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RWDmrpXN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:13:29 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:13:29 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:13:29 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:13:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:29 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3abc33c-9343-4996-bed5-ee9a82f49f9f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:29 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 17:13:29 user nova-compute[74743]: No targets found.
Nov 18 17:13:29 user nova-compute[74743]: iSNS:
Nov 18 17:13:29 user nova-compute[74743]: No targets found.
Nov 18 17:13:29 user nova-compute[74743]: STATIC:
Nov 18 17:13:29 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685
Nov 18 17:13:29 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:13:29 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:13:29 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5
Nov 18 17:13:29 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:13:29 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:13:29 user nova-compute[74743]: FIRMWARE:
Nov 18 17:13:29 user nova-compute[74743]: No targets found.
Nov 18 17:13:29 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:13:29 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 17:13:29 user nova-compute[74743]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 17:13:29 user nova-compute[74743]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74743) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 17:13:29 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5', 0)] {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 17:13:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:29 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[67781ebd-3659-4601-90b4-d8543662adc6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:29 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[9667f918-f91a-41a2-a675-a1619cf8d9d0]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:29 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:13:29 user nova-compute[74743]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:13:29 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:13:29 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:13:29 user nova-compute[74743]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:13:29 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:13:29 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb083e9750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5'): ({'sdd'}, set())}) {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 17:13:29 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Removing single pathed devices sdd {{(pid=74743) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 17:13:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:29 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[defc69e0-fa0f-418d-bf68-78b02391753b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:30 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4f2ee4-99f9-4d5f-b14f-354ae721f72b]: (4, ('ok\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:30 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Flushing IO for device /dev/sdd {{(pid=74743) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 17:13:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:30 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[743ce3e9-8977-42b9-9a48-306bd9d20bed]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:30 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74743) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 17:13:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.033s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:30 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f23fdde-8f82-44a0-9931-96a6f09c9acf]: (4, ('1', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:30 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 17:13:30 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] SCSI volumes sdd have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 17:13:30 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5')] {{(pid=74743) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 17:13:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:30 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13730b2-5011-4afa-8b79-ef3a863d347f]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:30 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:13:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --logout {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:30 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac1acde-9001-466a-9759-fe8317a4b934]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:30 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5, portal: 172.16.0.220,3260]
Nov 18 17:13:30 user nova-compute[74743]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5, portal: 172.16.0.220,3260] successful.
Nov 18 17:13:30 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:13:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --op delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:30 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e17c8ed-81f3-405d-9ab1-cf11065dbe4f]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:30 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:13:30 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:13:30 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] <== disconnect_volume: return (283ms) None {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:13:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Disconnected iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 17:13:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:13:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:13:31 user nova-compute[74743]: DEBUG nova.objects.instance [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Lazy-loading 'migration_context' on Instance uuid 49ebdd5a-824d-476a-bd10-3b891bbfe9e2 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:13:31 user nova-compute[74743]: DEBUG nova.objects.base [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Object Instance<49ebdd5a-824d-476a-bd10-3b891bbfe9e2> lazy-loaded attributes: resources,migration_context {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:13:31 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:13:31 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:13:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.598s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:13:31 user nova-compute[74743]: INFO nova.compute.manager [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Swapping old allocation on dict_keys(['30e4d58a-2a6d-4032-8d01-e33007f4b2c8']) held by migration 5037668c-b927-4d04-8e21-0ec32794efcf for instance
Nov 18 17:13:31 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Overwriting current allocation {'allocations': {'30e4d58a-2a6d-4032-8d01-e33007f4b2c8': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 32}}, 'project_id': '8955c5a052b34bde997f9db74d302edb', 'user_id': 'c37b5fe2f7d74cab894eef0f41c6a5ed', 'consumer_generation': 1} on consumer 49ebdd5a-824d-476a-bd10-3b891bbfe9e2 {{(pid=74743) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 18 17:13:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Acquiring lock "refresh_cache-49ebdd5a-824d-476a-bd10-3b891bbfe9e2" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:13:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Acquired lock "refresh_cache-49ebdd5a-824d-476a-bd10-3b891bbfe9e2" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:13:31 user nova-compute[74743]: DEBUG nova.network.neutron [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:13:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquiring lock "f649143e-f7db-475a-bbe5-d5e7316caac3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:13:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "f649143e-f7db-475a-bbe5-d5e7316caac3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:13:32 user nova-compute[74743]: DEBUG nova.compute.manager [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Starting instance... {{(pid=74743) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 17:13:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:13:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:13:32 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74743) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 17:13:32 user nova-compute[74743]: INFO nova.compute.claims [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Claim successful on node user
Nov 18 17:13:32 user nova-compute[74743]: DEBUG nova.network.neutron [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Updating instance_info_cache with network_info: [{"id": "c66ef239-8068-4eff-807a-830d5f3d0dba", "address": "fa:16:3e:f3:3d:ca", "network": {"id": "79046ec4-e7a8-4b7d-8607-3205067366b6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1734449136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8955c5a052b34bde997f9db74d302edb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66ef239-80", "ovs_interfaceid": "c66ef239-8068-4eff-807a-830d5f3d0dba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:13:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Releasing lock "refresh_cache-49ebdd5a-824d-476a-bd10-3b891bbfe9e2" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:13:32 user nova-compute[74743]: DEBUG os_brick.utils [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:13:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:32 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b995ed8f-fb4e-4414-9c62-057d379fadaa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1116acd8874d\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:32 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d56c93e-bd3c-4d09-801a-b0b561364dc9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:32 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[dacbb0fb-9a00-4b3c-9dc0-97e26a6eba1f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:32 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7feee74-40e1-4435-9cc6-009817012750]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Running cmd (subprocess): nvme version {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] 'nvme version' failed. Not Retrying. {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:13:32 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] nvme not present on system {{(pid=74743) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 17:13:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:13:32 user nova-compute[74743]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 17:13:32 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32f4d85-7bcf-4923-ba8d-006fa1b824e9]: (4, '') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:32 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74743) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 17:13:32 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 17:13:32 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] LIGHTOS: no hostnqn found. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 17:13:32 user nova-compute[74743]: DEBUG os_brick.utils [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1116acd8874d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:13:32 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:13:32 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:13:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.502s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:13:32 user nova-compute[74743]: DEBUG nova.compute.manager [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Start building networks asynchronously for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 17:13:32 user nova-compute[74743]: DEBUG nova.compute.manager [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Allocating IP information in the background. {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 17:13:32 user nova-compute[74743]: DEBUG nova.network.neutron [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] allocate_for_instance() {{(pid=74743) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 17:13:32 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 17:13:32 user nova-compute[74743]: DEBUG nova.compute.manager [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Start building block device mappings for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 17:13:32 user nova-compute[74743]: DEBUG nova.policy [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5639bd2666534fdca04d0958dcdc9f54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0fda74575d488a94e2dcfdc016598c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74743) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 17:13:32 user nova-compute[74743]: INFO nova.virt.block_device [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Booting with blank volume at /dev/vda
Nov 18 17:13:33 user nova-compute[74743]: DEBUG nova.network.neutron [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Successfully created port: 494b363a-ab2e-4efc-9331-d2b303860a08 {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:13:33 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:13:33 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:13:33 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:13:33 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Starting heal instance info cache {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 17:13:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "refresh_cache-49ebdd5a-824d-476a-bd10-3b891bbfe9e2" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:13:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquired lock "refresh_cache-49ebdd5a-824d-476a-bd10-3b891bbfe9e2" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:13:33 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Forcefully refreshing network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6e2cf6a-0fbd-47b7-b2b6-bd590650247e tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Calling os-brick to attach iSCSI Volume {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6e2cf6a-0fbd-47b7-b2b6-bd590650247e tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mtMefBUJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:13:34 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-e6e2cf6a-0fbd-47b7-b2b6-bd590650247e tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:13:34 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-e6e2cf6a-0fbd-47b7-b2b6-bd590650247e tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-e6e2cf6a-0fbd-47b7-b2b6-bd590650247e tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:13:34 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-e6e2cf6a-0fbd-47b7-b2b6-bd590650247e tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:13:34 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-e6e2cf6a-0fbd-47b7-b2b6-bd590650247e tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-e6e2cf6a-0fbd-47b7-b2b6-bd590650247e tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:13:34 user nova-compute[74743]: INFO os_brick.initiator.connectors.iscsi [None req-e6e2cf6a-0fbd-47b7-b2b6-bd590650247e tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686 -p 172.16.0.220:3260 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65b668a-916b-476e-aa8f-205e59cb2465]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6e2cf6a-0fbd-47b7-b2b6-bd590650247e tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 17:13:34 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686 -p 172.16.0.220:3260 --interface default --op new {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7d94f9-aa41-45e9-905d-1aa56110942a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686] added\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6e2cf6a-0fbd-47b7-b2b6-bd590650247e tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686] added
Nov 18 17:13:34 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd05a257-6636-4367-8b0c-863ca5d1edb3]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6e2cf6a-0fbd-47b7-b2b6-bd590650247e tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[6618377a-5310-4708-8167-45cdcd454f43]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6e2cf6a-0fbd-47b7-b2b6-bd590650247e tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mtMefBUJ {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mtMefBUJ" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5f9c8b-c2d2-4c64-8acc-3f3261878603]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6e2cf6a-0fbd-47b7-b2b6-bd590650247e tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mtMefBUJ'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf7d2fd-a3d6-4caf-9e6d-26aefbe6925d]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6e2cf6a-0fbd-47b7-b2b6-bd590650247e tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG nova.network.neutron [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Successfully updated port: 494b363a-ab2e-4efc-9331-d2b303860a08 {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG nova.compute.manager [req-7429dd03-6568-414e-82f8-945c26f00420 req-48f40337-e560-43ee-a0ae-2b47878c948f service nova] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Received event network-changed-106be5e5-0143-4ab2-8e1f-30b2e46c5753 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG nova.compute.manager [req-7429dd03-6568-414e-82f8-945c26f00420 req-48f40337-e560-43ee-a0ae-2b47878c948f service nova] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Refreshing instance network info cache due to event network-changed-106be5e5-0143-4ab2-8e1f-30b2e46c5753. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-7429dd03-6568-414e-82f8-945c26f00420 req-48f40337-e560-43ee-a0ae-2b47878c948f service nova] Acquiring lock "refresh_cache-cd467693-8b2d-4e3d-9b1a-7581c6ae6153" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-7429dd03-6568-414e-82f8-945c26f00420 req-48f40337-e560-43ee-a0ae-2b47878c948f service nova] Acquired lock "refresh_cache-cd467693-8b2d-4e3d-9b1a-7581c6ae6153" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG nova.network.neutron [req-7429dd03-6568-414e-82f8-945c26f00420 req-48f40337-e560-43ee-a0ae-2b47878c948f service nova] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Refreshing network info cache for port 106be5e5-0143-4ab2-8e1f-30b2e46c5753 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[066b2c20-8a33-4bde-9d49-884e6515d85f]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6e2cf6a-0fbd-47b7-b2b6-bd590650247e tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:13:34 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6e2cf6a-0fbd-47b7-b2b6-bd590650247e tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:13:34 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquiring lock "refresh_cache-f649143e-f7db-475a-bbe5-d5e7316caac3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquired lock "refresh_cache-f649143e-f7db-475a-bbe5-d5e7316caac3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG nova.network.neutron [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686 -p 172.16.0.220:3260 --login {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG nova.compute.manager [req-3d35c051-bc33-45c9-b1a6-c2a042d2965e req-e27ba242-1f2d-4f0e-bdee-062b29a956c8 service nova] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Received event network-changed-494b363a-ab2e-4efc-9331-d2b303860a08 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG nova.compute.manager [req-3d35c051-bc33-45c9-b1a6-c2a042d2965e req-e27ba242-1f2d-4f0e-bdee-062b29a956c8 service nova] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Refreshing instance network info cache due to event network-changed-494b363a-ab2e-4efc-9331-d2b303860a08. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3d35c051-bc33-45c9-b1a6-c2a042d2965e req-e27ba242-1f2d-4f0e-bdee-062b29a956c8 service nova] Acquiring lock "refresh_cache-f649143e-f7db-475a-bbe5-d5e7316caac3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Updating instance_info_cache with network_info: [{"id": "c66ef239-8068-4eff-807a-830d5f3d0dba", "address": "fa:16:3e:f3:3d:ca", "network": {"id": "79046ec4-e7a8-4b7d-8607-3205067366b6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1734449136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8955c5a052b34bde997f9db74d302edb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66ef239-80", "ovs_interfaceid": "c66ef239-8068-4eff-807a-830d5f3d0dba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46f1d16-8f6a-41ed-8a14-d39a1ac38a91]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6e2cf6a-0fbd-47b7-b2b6-bd590650247e tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686, portal: 172.16.0.220,3260]
Nov 18 17:13:34 user nova-compute[74743]: Login to [iface: default, target: iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686, portal: 172.16.0.220,3260] successful.
Nov 18 17:13:34 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Releasing lock "refresh_cache-49ebdd5a-824d-476a-bd10-3b891bbfe9e2" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Updated the network info_cache for instance {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74743) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec470e1-386f-4ec9-9ae1-0db6658258be]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6e2cf6a-0fbd-47b7-b2b6-bd590650247e tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG nova.network.neutron [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Auditing locally available compute resources for user (node: user) {{(pid=74743) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-994c4533-f659-4f1d-94fc-ac65f0b56e74 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Acquiring lock "cd467693-8b2d-4e3d-9b1a-7581c6ae6153" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-994c4533-f659-4f1d-94fc-ac65f0b56e74 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "cd467693-8b2d-4e3d-9b1a-7581c6ae6153" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc61727e-af75-4c04-8322-bc7b8ca2fc66]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6e2cf6a-0fbd-47b7-b2b6-bd590650247e tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:13:34 user nova-compute[74743]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686 (non-flash)
Nov 18 17:13:34 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6e2cf6a-0fbd-47b7-b2b6-bd590650247e tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:13:34 user nova-compute[74743]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686 (non-flash)
Nov 18 17:13:34 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-e6e2cf6a-0fbd-47b7-b2b6-bd590650247e tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6e2cf6a-0fbd-47b7-b2b6-bd590650247e tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Connected to 172.16.0.220:3260 {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-e6e2cf6a-0fbd-47b7-b2b6-bd590650247e tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] HCTL ('33', '-', '-', 0) found on session 31 with lun 0 {{(pid=74743) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-e6e2cf6a-0fbd-47b7-b2b6-bd590650247e tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74743) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG nova.objects.instance [None req-994c4533-f659-4f1d-94fc-ac65f0b56e74 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lazy-loading 'flavor' on Instance uuid cd467693-8b2d-4e3d-9b1a-7581c6ae6153 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f7ff90-ff2b-4e57-8152-dd4f0f8afccf]: (4, ('- - 0', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-e6e2cf6a-0fbd-47b7-b2b6-bd590650247e tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: None {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-994c4533-f659-4f1d-94fc-ac65f0b56e74 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "cd467693-8b2d-4e3d-9b1a-7581c6ae6153" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f93bf0ac-ecc8-447d-b9c1-381d36cd3135/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG nova.network.neutron [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Updating instance_info_cache with network_info: [{"id": "494b363a-ab2e-4efc-9331-d2b303860a08", "address": "fa:16:3e:e7:77:41", "network": {"id": "1bbf6aff-4048-4212-a716-d0628575bfd0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc0fda74575d488a94e2dcfdc016598c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494b363a-ab", "ovs_interfaceid": "494b363a-ab2e-4efc-9331-d2b303860a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-994c4533-f659-4f1d-94fc-ac65f0b56e74 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Acquiring lock "cd467693-8b2d-4e3d-9b1a-7581c6ae6153" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-994c4533-f659-4f1d-94fc-ac65f0b56e74 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "cd467693-8b2d-4e3d-9b1a-7581c6ae6153" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:13:34 user nova-compute[74743]: INFO nova.compute.manager [None req-994c4533-f659-4f1d-94fc-ac65f0b56e74 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Attaching volume c6cb318e-112e-4815-b5c7-c5517b17acc5 to /dev/vdb
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Releasing lock "refresh_cache-f649143e-f7db-475a-bbe5-d5e7316caac3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG nova.compute.manager [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Instance network_info: |[{"id": "494b363a-ab2e-4efc-9331-d2b303860a08", "address": "fa:16:3e:e7:77:41", "network": {"id": "1bbf6aff-4048-4212-a716-d0628575bfd0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc0fda74575d488a94e2dcfdc016598c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494b363a-ab", "ovs_interfaceid": "494b363a-ab2e-4efc-9331-d2b303860a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3d35c051-bc33-45c9-b1a6-c2a042d2965e req-e27ba242-1f2d-4f0e-bdee-062b29a956c8 service nova] Acquired lock "refresh_cache-f649143e-f7db-475a-bbe5-d5e7316caac3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG nova.network.neutron [req-3d35c051-bc33-45c9-b1a6-c2a042d2965e req-e27ba242-1f2d-4f0e-bdee-062b29a956c8 service nova] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Refreshing network info cache for port 494b363a-ab2e-4efc-9331-d2b303860a08 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG os_brick.utils [None req-994c4533-f659-4f1d-94fc-ac65f0b56e74 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdef4802-a3d9-4239-af3d-f7cc47c9a8e1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1116acd8874d\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[c384398c-013c-4de9-ac1b-5a7ea894b7ac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG nova.network.neutron [req-7429dd03-6568-414e-82f8-945c26f00420 req-48f40337-e560-43ee-a0ae-2b47878c948f service nova] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Updated VIF entry in instance network info cache for port 106be5e5-0143-4ab2-8e1f-30b2e46c5753. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG nova.network.neutron [req-7429dd03-6568-414e-82f8-945c26f00420 req-48f40337-e560-43ee-a0ae-2b47878c948f service nova] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Updating instance_info_cache with network_info: [{"id": "106be5e5-0143-4ab2-8e1f-30b2e46c5753", "address": "fa:16:3e:35:df:4c", "network": {"id": "252343cc-f379-471d-a2c9-99b9a60ebcb4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25c06dc8e7be46229750b8e283622c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106be5e5-01", "ovs_interfaceid": "106be5e5-0143-4ab2-8e1f-30b2e46c5753", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f93bf0ac-ecc8-447d-b9c1-381d36cd3135/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f93bf0ac-ecc8-447d-b9c1-381d36cd3135/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a570a165-5d69-4826-b4a6-f374f6fe7a89]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-7429dd03-6568-414e-82f8-945c26f00420 req-48f40337-e560-43ee-a0ae-2b47878c948f service nova] Releasing lock "refresh_cache-cd467693-8b2d-4e3d-9b1a-7581c6ae6153" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[254f9264-8cd0-4f8b-a9a7-b822e12ba006]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-994c4533-f659-4f1d-94fc-ac65f0b56e74 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Running cmd (subprocess): nvme version {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-994c4533-f659-4f1d-94fc-ac65f0b56e74 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] 'nvme version' failed. Not Retrying. {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.nvmeof [None req-994c4533-f659-4f1d-94fc-ac65f0b56e74 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] nvme not present on system {{(pid=74743) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:13:34 user nova-compute[74743]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[4415decd-0307-480f-8f15-68f6cf8275d5]: (4, '') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-994c4533-f659-4f1d-94fc-ac65f0b56e74 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74743) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-994c4533-f659-4f1d-94fc-ac65f0b56e74 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-994c4533-f659-4f1d-94fc-ac65f0b56e74 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] LIGHTOS: no hostnqn found. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG os_brick.utils [None req-994c4533-f659-4f1d-94fc-ac65f0b56e74 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] <== get_connector_properties: return (168ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1116acd8874d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG nova.virt.block_device [None req-994c4533-f659-4f1d-94fc-ac65f0b56e74 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Updating existing volume attachment record: 97ade9b0-f14c-43e0-aa91-5f5b4b9661d0 {{(pid=74743) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f93bf0ac-ecc8-447d-b9c1-381d36cd3135/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:35 user nova-compute[74743]: DEBUG nova.network.neutron [req-3d35c051-bc33-45c9-b1a6-c2a042d2965e req-e27ba242-1f2d-4f0e-bdee-062b29a956c8 service nova] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Updated VIF entry in instance network info cache for port 494b363a-ab2e-4efc-9331-d2b303860a08. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:13:35 user nova-compute[74743]: DEBUG nova.network.neutron [req-3d35c051-bc33-45c9-b1a6-c2a042d2965e req-e27ba242-1f2d-4f0e-bdee-062b29a956c8 service nova] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Updating instance_info_cache with network_info: [{"id": "494b363a-ab2e-4efc-9331-d2b303860a08", "address": "fa:16:3e:e7:77:41", "network": {"id": "1bbf6aff-4048-4212-a716-d0628575bfd0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc0fda74575d488a94e2dcfdc016598c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494b363a-ab", "ovs_interfaceid": "494b363a-ab2e-4efc-9331-d2b303860a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:13:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3d35c051-bc33-45c9-b1a6-c2a042d2965e req-e27ba242-1f2d-4f0e-bdee-062b29a956c8 service nova] Releasing lock "refresh_cache-f649143e-f7db-475a-bbe5-d5e7316caac3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:13:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:35 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-e6e2cf6a-0fbd-47b7-b2b6-bd590650247e tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:13:35 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6e2cf6a-0fbd-47b7-b2b6-bd590650247e tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mtMefBUJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 17:13:35 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-e6e2cf6a-0fbd-47b7-b2b6-bd590650247e tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:13:35 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6e2cf6a-0fbd-47b7-b2b6-bd590650247e tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23236366234643832', 'path': '/dev/sdb'} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:13:35 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6e2cf6a-0fbd-47b7-b2b6-bd590650247e tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236366234643832', 'path': '/dev/sdb'} {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 17:13:35 user nova-compute[74743]: DEBUG nova.objects.instance [None req-e6e2cf6a-0fbd-47b7-b2b6-bd590650247e tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lazy-loading 'flavor' on Instance uuid 180f2f7e-9df5-480f-adde-d8e10ee14b07 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:13:35 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-e6e2cf6a-0fbd-47b7-b2b6-bd590650247e tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 17:13:35 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:13:35 user nova-compute[74743]:   <source dev="/dev/sdb"/>
Nov 18 17:13:35 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:13:35 user nova-compute[74743]:   <serial>9f0ecae7-9091-4cb2-8758-d5f683dd3686</serial>
Nov 18 17:13:35 user nova-compute[74743]: </disk>
Nov 18 17:13:35 user nova-compute[74743]:  {{(pid=74743) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 17:13:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd467693-8b2d-4e3d-9b1a-7581c6ae6153/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd467693-8b2d-4e3d-9b1a-7581c6ae6153/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd467693-8b2d-4e3d-9b1a-7581c6ae6153/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:35 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-e6e2cf6a-0fbd-47b7-b2b6-bd590650247e tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:13:35 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-e6e2cf6a-0fbd-47b7-b2b6-bd590650247e tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:13:35 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-e6e2cf6a-0fbd-47b7-b2b6-bd590650247e tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] No VIF found with MAC fa:16:3e:4a:ca:b3, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:13:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd467693-8b2d-4e3d-9b1a-7581c6ae6153/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:36 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e6e2cf6a-0fbd-47b7-b2b6-bd590650247e tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "180f2f7e-9df5-480f-adde-d8e10ee14b07" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.054s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:13:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad8aa2d-663c-4829-87f9-07959105ca68/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:37 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad8aa2d-663c-4829-87f9-07959105ca68/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:37 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad8aa2d-663c-4829-87f9-07959105ca68/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:37 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad8aa2d-663c-4829-87f9-07959105ca68/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:37 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:37 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:37 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:37 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:37 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/180f2f7e-9df5-480f-adde-d8e10ee14b07/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:37 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/180f2f7e-9df5-480f-adde-d8e10ee14b07/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:37 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/180f2f7e-9df5-480f-adde-d8e10ee14b07/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/180f2f7e-9df5-480f-adde-d8e10ee14b07/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:38 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:13:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ad39c-15fd-42e2-9ad6-ed5cd25e25de/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ad39c-15fd-42e2-9ad6-ed5cd25e25de/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ad39c-15fd-42e2-9ad6-ed5cd25e25de/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ad39c-15fd-42e2-9ad6-ed5cd25e25de/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:38 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:13:38 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:13:38 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Hypervisor/Node resource view: name=user free_ram=7350MB free_disk=25.410137176513672GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74743) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 17:13:38 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:13:38 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:13:38 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Starting finish_revert_migration {{(pid=74743) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 18 17:13:38 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Start _get_guest_xml network_info=[{"id": "c66ef239-8068-4eff-807a-830d5f3d0dba", "address": "fa:16:3e:f3:3d:ca", "network": {"id": "79046ec4-e7a8-4b7d-8607-3205067366b6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1734449136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8955c5a052b34bde997f9db74d302edb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66ef239-80", "ovs_interfaceid": "c66ef239-8068-4eff-807a-830d5f3d0dba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '9536f6cf-95c4-40e2-864a-09a91525678a'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'boot_index': None, 'mount_device': '/dev/vdb', 'attachment_id': '55b0ac91-3dd2-49dd-babe-388a3a647e45', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RWDmrpXN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '49ebdd5a-824d-476a-bd10-3b891bbfe9e2', 'attached_at': '2023-11-18T17:13:38.000000', 'detached_at': '', 'volume_id': '37e6161c-f450-4fe5-910c-e369f18f48d5', 'serial': '37e6161c-f450-4fe5-910c-e369f18f48d5'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:13:38 user nova-compute[74743]: DEBUG os_brick.utils [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:13:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:38 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:13:38 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:13:38 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:13:38 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:13:38 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:13:38 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:13:38 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:13:38 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:13:38 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:13:38 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:13:38 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:13:38 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:13:38 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:13:38 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:13:38 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:13:38 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:13:38 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:13:38 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:13:38 user nova-compute[74743]: DEBUG nova.objects.instance [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Lazy-loading 'vcpu_model' on Instance uuid 49ebdd5a-824d-476a-bd10-3b891bbfe9e2 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:13:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:38 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a480249b-58df-4028-b21f-4af31fad5198]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1116acd8874d\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Calling os-brick to attach iSCSI Volume {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RWDmrpXN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:13:39 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:13:39 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:13:39 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:13:39 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:13:39 user nova-compute[74743]: INFO os_brick.initiator.connectors.iscsi [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 17:13:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9e803e-8d57-4328-a6a4-61e61817dd67]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbcd169-d509-461c-afbd-18ecf1b9e0dc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 17:13:39 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e34dc5c-bed2-40e8-96d3-1d0153166040]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fa8dc2-1516-4176-8562-0213fde612a6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Running cmd (subprocess): nvme version {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] 'nvme version' failed. Not Retrying. {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[29684de6-04e2-4550-8a26-481be13e6a6e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5] added\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] nvme not present on system {{(pid=74743) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5] added
Nov 18 17:13:39 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 4cce1628-2dcb-40c7-abd4-6a327a432de3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance e9668e1c-1e8d-4dd7-8f58-d453db294557 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance c006a4ad-a8e2-4108-9af1-dec4dd53fcda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 0ad8aa2d-663c-4829-87f9-07959105ca68 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance f93bf0ac-ecc8-447d-b9c1-381d36cd3135 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance aefe3db1-b9bb-4cce-aa31-d0b6684ad791 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 180f2f7e-9df5-480f-adde-d8e10ee14b07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 49ebdd5a-824d-476a-bd10-3b891bbfe9e2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance cd467693-8b2d-4e3d-9b1a-7581c6ae6153 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance f41ad39c-15fd-42e2-9ad6-ed5cd25e25de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance f649143e-f7db-475a-bbe5-d5e7316caac3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:13:39 user nova-compute[74743]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 17:13:39 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2e5fd0-c469-45bf-b13f-751abb723196]: (4, '') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74743) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] LIGHTOS: no hostnqn found. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG os_brick.utils [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] <== get_connector_properties: return (172ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1116acd8874d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG nova.virt.block_device [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Updating existing volume attachment record: 72ff9250-7c23-463d-98c0-19a363c42940 {{(pid=74743) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[768d9c93-7f96-4538-aa7b-51cae4cbfefa]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[08df6233-0170-4c09-ae51-f916a8b94cf3]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RWDmrpXN {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RWDmrpXN" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2c73a7-a43c-4016-aff1-8edb2cccd80f]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RWDmrpXN'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[89819f34-7f3b-4aea-9ee5-34bd110a13c0]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[09423a34-af98-4d0f-b4da-5395da5803ef]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:13:39 user nova-compute[74743]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686 (non-flash)
Nov 18 17:13:39 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:13:39 user nova-compute[74743]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686 (non-flash)
Nov 18 17:13:39 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --login {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97ea10d-d1c2-4686-bb10-8ffede46fcbe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5, portal: 172.16.0.220,3260]
Nov 18 17:13:39 user nova-compute[74743]: Login to [iface: default, target: iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5, portal: 172.16.0.220,3260] successful.
Nov 18 17:13:39 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9b0228-eec8-424b-a297-b38d6f83a48d]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53bd349-f1a5-4a73-98e5-aa9c973a3f07]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:13:39 user nova-compute[74743]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686 (non-flash)
Nov 18 17:13:39 user nova-compute[74743]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:13:39 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:13:39 user nova-compute[74743]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686 (non-flash)
Nov 18 17:13:39 user nova-compute[74743]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:13:39 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.357s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Connected to 172.16.0.220:3260 {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] HCTL ('34', '-', '-', 0) found on session 32 with lun 0 {{(pid=74743) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74743) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2bf2214-0d25-4537-8ae6-5dc2db3a2f75]: (4, ('- - 0', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RWDmrpXN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Compute_service record updated for user:user {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.666s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.403s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] <== connect_volume: return (1404ms) {'type': 'block', 'scsi_wwn': '23961366339306534', 'path': '/dev/sdc'} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961366339306534', 'path': '/dev/sdc'} {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:07:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-761441758',display_name='tempest-ServerActionsTestOtherB-server-761441758',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-761441758',id=16,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHSxRrGlHxDyqlCOq0hy6p31kUDSaQIxafGDavUpZ/Ka4RS6tIfzT5avp8Ymkenpc8OEHVquoqpPuZPk62jn4N2SagQ88JWrrx/6+VzSF8w9eq7GAvBHe/3/xNVOBksa4g==',key_name='tempest-keypair-1267949685',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:11:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8955c5a052b34bde997f9db74d302edb',ramdisk_id='',reservation_id='r-ewenialm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2984948',owner_user_name='tempest-ServerActionsTestOtherB-2984948-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:13:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c37b5fe2f7d74cab894eef0f41c6a5ed',uuid=49ebdd5a-824d-476a-bd10-3b891bbfe9e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "c66ef239-8068-4eff-807a-830d5f3d0dba", "address": "fa:16:3e:f3:3d:ca", "network": {"id": "79046ec4-e7a8-4b7d-8607-3205067366b6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1734449136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8955c5a052b34bde997f9db74d302edb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66ef239-80", "ovs_interfaceid": "c66ef239-8068-4eff-807a-830d5f3d0dba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Converting VIF {"id": "c66ef239-8068-4eff-807a-830d5f3d0dba", "address": "fa:16:3e:f3:3d:ca", "network": {"id": "79046ec4-e7a8-4b7d-8607-3205067366b6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1734449136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8955c5a052b34bde997f9db74d302edb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66ef239-80", "ovs_interfaceid": "c66ef239-8068-4eff-807a-830d5f3d0dba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:3d:ca,bridge_name='br-int',has_traffic_filtering=True,id=c66ef239-8068-4eff-807a-830d5f3d0dba,network=Network(79046ec4-e7a8-4b7d-8607-3205067366b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66ef239-80') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:13:40 user nova-compute[74743]:   <uuid>49ebdd5a-824d-476a-bd10-3b891bbfe9e2</uuid>
Nov 18 17:13:40 user nova-compute[74743]:   <name>instance-00000010</name>
Nov 18 17:13:40 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:13:40 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:13:40 user nova-compute[74743]:   <metadata>
Nov 18 17:13:40 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:13:40 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:13:40 user nova-compute[74743]:       <nova:name>tempest-ServerActionsTestOtherB-server-761441758</nova:name>
Nov 18 17:13:40 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:13:38</nova:creationTime>
Nov 18 17:13:40 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:13:40 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:13:40 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:13:40 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:13:40 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:13:40 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:13:40 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:13:40 user nova-compute[74743]:       <nova:owner>
Nov 18 17:13:40 user nova-compute[74743]:         <nova:user uuid="c37b5fe2f7d74cab894eef0f41c6a5ed">tempest-ServerActionsTestOtherB-2984948-project-member</nova:user>
Nov 18 17:13:40 user nova-compute[74743]:         <nova:project uuid="8955c5a052b34bde997f9db74d302edb">tempest-ServerActionsTestOtherB-2984948</nova:project>
Nov 18 17:13:40 user nova-compute[74743]:       </nova:owner>
Nov 18 17:13:40 user nova-compute[74743]:       <nova:root type="image" uuid="9536f6cf-95c4-40e2-864a-09a91525678a"/>
Nov 18 17:13:40 user nova-compute[74743]:       <nova:ports>
Nov 18 17:13:40 user nova-compute[74743]:         <nova:port uuid="c66ef239-8068-4eff-807a-830d5f3d0dba">
Nov 18 17:13:40 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 18 17:13:40 user nova-compute[74743]:         </nova:port>
Nov 18 17:13:40 user nova-compute[74743]:       </nova:ports>
Nov 18 17:13:40 user nova-compute[74743]:     </nova:instance>
Nov 18 17:13:40 user nova-compute[74743]:   </metadata>
Nov 18 17:13:40 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:13:40 user nova-compute[74743]:     <system>
Nov 18 17:13:40 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:13:40 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:13:40 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:13:40 user nova-compute[74743]:       <entry name="serial">49ebdd5a-824d-476a-bd10-3b891bbfe9e2</entry>
Nov 18 17:13:40 user nova-compute[74743]:       <entry name="uuid">49ebdd5a-824d-476a-bd10-3b891bbfe9e2</entry>
Nov 18 17:13:40 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:13:40 user nova-compute[74743]:     </system>
Nov 18 17:13:40 user nova-compute[74743]:   </sysinfo>
Nov 18 17:13:40 user nova-compute[74743]:   <os>
Nov 18 17:13:40 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:13:40 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:13:40 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:13:40 user nova-compute[74743]:   </os>
Nov 18 17:13:40 user nova-compute[74743]:   <features>
Nov 18 17:13:40 user nova-compute[74743]:     <acpi/>
Nov 18 17:13:40 user nova-compute[74743]:     <apic/>
Nov 18 17:13:40 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:13:40 user nova-compute[74743]:   </features>
Nov 18 17:13:40 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:13:40 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:13:40 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:13:40 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:13:40 user nova-compute[74743]:   </clock>
Nov 18 17:13:40 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:13:40 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:13:40 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:13:40 user nova-compute[74743]:   </cpu>
Nov 18 17:13:40 user nova-compute[74743]:   <devices>
Nov 18 17:13:40 user nova-compute[74743]:     <disk type="file" device="disk">
Nov 18 17:13:40 user nova-compute[74743]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 17:13:40 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/disk"/>
Nov 18 17:13:40 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:13:40 user nova-compute[74743]:     </disk>
Nov 18 17:13:40 user nova-compute[74743]:     <disk type="block" device="disk">
Nov 18 17:13:40 user nova-compute[74743]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:13:40 user nova-compute[74743]:       <source dev="/dev/sdc"/>
Nov 18 17:13:40 user nova-compute[74743]:       <target dev="vdb" bus="virtio"/>
Nov 18 17:13:40 user nova-compute[74743]:       <serial>37e6161c-f450-4fe5-910c-e369f18f48d5</serial>
Nov 18 17:13:40 user nova-compute[74743]:     </disk>
Nov 18 17:13:40 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:13:40 user nova-compute[74743]:       <mac address="fa:16:3e:f3:3d:ca"/>
Nov 18 17:13:40 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:13:40 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:13:40 user nova-compute[74743]:       <target dev="tapc66ef239-80"/>
Nov 18 17:13:40 user nova-compute[74743]:     </interface>
Nov 18 17:13:40 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:13:40 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/console.log" append="off"/>
Nov 18 17:13:40 user nova-compute[74743]:     </serial>
Nov 18 17:13:40 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:13:40 user nova-compute[74743]:     <video>
Nov 18 17:13:40 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:13:40 user nova-compute[74743]:     </video>
Nov 18 17:13:40 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:13:40 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:13:40 user nova-compute[74743]:     </rng>
Nov 18 17:13:40 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:13:40 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:13:40 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:13:40 user nova-compute[74743]:     </memballoon>
Nov 18 17:13:40 user nova-compute[74743]:   </devices>
Nov 18 17:13:40 user nova-compute[74743]: </domain>
Nov 18 17:13:40 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:07:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-761441758',display_name='tempest-ServerActionsTestOtherB-server-761441758',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-761441758',id=16,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHSxRrGlHxDyqlCOq0hy6p31kUDSaQIxafGDavUpZ/Ka4RS6tIfzT5avp8Ymkenpc8OEHVquoqpPuZPk62jn4N2SagQ88JWrrx/6+VzSF8w9eq7GAvBHe/3/xNVOBksa4g==',key_name='tempest-keypair-1267949685',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:11:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8955c5a052b34bde997f9db74d302edb',ramdisk_id='',reservation_id='r-ewenialm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2984948',owner_user_name='tempest-ServerActionsTestOtherB-2984948-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:13:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c37b5fe2f7d74cab894eef0f41c6a5ed',uuid=49ebdd5a-824d-476a-bd10-3b891bbfe9e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "c66ef239-8068-4eff-807a-830d5f3d0dba", "address": "fa:16:3e:f3:3d:ca", "network": {"id": "79046ec4-e7a8-4b7d-8607-3205067366b6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1734449136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8955c5a052b34bde997f9db74d302edb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66ef239-80", "ovs_interfaceid": "c66ef239-8068-4eff-807a-830d5f3d0dba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Converting VIF {"id": "c66ef239-8068-4eff-807a-830d5f3d0dba", "address": "fa:16:3e:f3:3d:ca", "network": {"id": "79046ec4-e7a8-4b7d-8607-3205067366b6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1734449136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8955c5a052b34bde997f9db74d302edb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66ef239-80", "ovs_interfaceid": "c66ef239-8068-4eff-807a-830d5f3d0dba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:3d:ca,bridge_name='br-int',has_traffic_filtering=True,id=c66ef239-8068-4eff-807a-830d5f3d0dba,network=Network(79046ec4-e7a8-4b7d-8607-3205067366b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66ef239-80') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG os_vif [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:3d:ca,bridge_name='br-int',has_traffic_filtering=True,id=c66ef239-8068-4eff-807a-830d5f3d0dba,network=Network(79046ec4-e7a8-4b7d-8607-3205067366b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66ef239-80') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd9453b78-1231-55b7-b004-020385db604d', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc66ef239-80, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc66ef239-80, col_values=(('qos', UUID('9708b643-7ec3-4d79-b575-ffdad0a98805')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc66ef239-80, col_values=(('external_ids', {'iface-id': 'c66ef239-8068-4eff-807a-830d5f3d0dba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:3d:ca', 'vm-uuid': '49ebdd5a-824d-476a-bd10-3b891bbfe9e2'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:40 user nova-compute[74743]: INFO os_vif [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:3d:ca,bridge_name='br-int',has_traffic_filtering=True,id=c66ef239-8068-4eff-807a-830d5f3d0dba,network=Network(79046ec4-e7a8-4b7d-8607-3205067366b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66ef239-80')
Nov 18 17:13:40 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-994c4533-f659-4f1d-94fc-ac65f0b56e74 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Calling os-brick to attach iSCSI Volume {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-994c4533-f659-4f1d-94fc-ac65f0b56e74 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'guixaBhK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:13:40 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-994c4533-f659-4f1d-94fc-ac65f0b56e74 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:13:40 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-994c4533-f659-4f1d-94fc-ac65f0b56e74 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-994c4533-f659-4f1d-94fc-ac65f0b56e74 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:13:40 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-994c4533-f659-4f1d-94fc-ac65f0b56e74 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:13:40 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-994c4533-f659-4f1d-94fc-ac65f0b56e74 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-994c4533-f659-4f1d-94fc-ac65f0b56e74 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:13:40 user nova-compute[74743]: INFO os_brick.initiator.connectors.iscsi [None req-994c4533-f659-4f1d-94fc-ac65f0b56e74 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 17:13:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 -p 172.16.0.220:3260 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[545a83ba-cc6f-4307-a8fc-16e158099119]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-994c4533-f659-4f1d-94fc-ac65f0b56e74 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 17:13:40 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b63312d-0c45-4a47-8748-1972f26ea8a9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5] added\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-994c4533-f659-4f1d-94fc-ac65f0b56e74 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5] added
Nov 18 17:13:40 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a092d9a1-5598-4922-b19b-6f7c4b45aca7]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-994c4533-f659-4f1d-94fc-ac65f0b56e74 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56c5ace-bda9-49c1-af12-0c44ba202a49]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-994c4533-f659-4f1d-94fc-ac65f0b56e74 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v guixaBhK {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v guixaBhK" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b9d83d-b9cd-4a47-9e1a-b465c8f791ce]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-994c4533-f659-4f1d-94fc-ac65f0b56e74 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'guixaBhK'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b312fc-025c-4156-80a4-c3f0c9500287]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-994c4533-f659-4f1d-94fc-ac65f0b56e74 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d33126-de6a-468c-8f25-59a0a8fd54c9]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-994c4533-f659-4f1d-94fc-ac65f0b56e74 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:13:40 user nova-compute[74743]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686 (non-flash)
Nov 18 17:13:40 user nova-compute[74743]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:13:40 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-994c4533-f659-4f1d-94fc-ac65f0b56e74 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:13:40 user nova-compute[74743]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686 (non-flash)
Nov 18 17:13:40 user nova-compute[74743]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:13:40 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 -p 172.16.0.220:3260 --login {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[2990ba86-5e0a-437d-9ca3-92c057f6ad31]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-994c4533-f659-4f1d-94fc-ac65f0b56e74 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5, portal: 172.16.0.220,3260]
Nov 18 17:13:40 user nova-compute[74743]: Login to [iface: default, target: iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5, portal: 172.16.0.220,3260] successful.
Nov 18 17:13:40 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:13:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:41 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba46eef6-7510-4df8-bc78-5dbeaf62b7fe]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-994c4533-f659-4f1d-94fc-ac65f0b56e74 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:13:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:41 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7bf378-ff4e-4741-93f2-a9b18e0b9fac]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-994c4533-f659-4f1d-94fc-ac65f0b56e74 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:13:41 user nova-compute[74743]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686 (non-flash)
Nov 18 17:13:41 user nova-compute[74743]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:13:41 user nova-compute[74743]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)
Nov 18 17:13:41 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:13:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-994c4533-f659-4f1d-94fc-ac65f0b56e74 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:13:41 user nova-compute[74743]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686 (non-flash)
Nov 18 17:13:41 user nova-compute[74743]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:13:41 user nova-compute[74743]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)
Nov 18 17:13:41 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:13:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-994c4533-f659-4f1d-94fc-ac65f0b56e74 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:13:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-994c4533-f659-4f1d-94fc-ac65f0b56e74 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Connected to 172.16.0.220:3260 {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 17:13:41 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-994c4533-f659-4f1d-94fc-ac65f0b56e74 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] HCTL ('35', '-', '-', 0) found on session 33 with lun 0 {{(pid=74743) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 17:13:41 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-994c4533-f659-4f1d-94fc-ac65f0b56e74 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74743) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 17:13:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:41 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c808131-b2f5-4fb3-9cbc-e9cb29ae2eb3]: (4, ('- - 0', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:41 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-994c4533-f659-4f1d-94fc-ac65f0b56e74 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:13:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-994c4533-f659-4f1d-94fc-ac65f0b56e74 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'guixaBhK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 17:13:41 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:41 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:41 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:42 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-994c4533-f659-4f1d-94fc-ac65f0b56e74 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:13:42 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-994c4533-f659-4f1d-94fc-ac65f0b56e74 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '26363306237333934', 'path': '/dev/sdd'} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:13:42 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-994c4533-f659-4f1d-94fc-ac65f0b56e74 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363306237333934', 'path': '/dev/sdd'} {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 17:13:42 user nova-compute[74743]: DEBUG nova.objects.instance [None req-994c4533-f659-4f1d-94fc-ac65f0b56e74 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lazy-loading 'flavor' on Instance uuid cd467693-8b2d-4e3d-9b1a-7581c6ae6153 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:13:42 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-994c4533-f659-4f1d-94fc-ac65f0b56e74 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 17:13:42 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:13:42 user nova-compute[74743]:   <source dev="/dev/sdd"/>
Nov 18 17:13:42 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:13:42 user nova-compute[74743]:   <serial>c6cb318e-112e-4815-b5c7-c5517b17acc5</serial>
Nov 18 17:13:42 user nova-compute[74743]: </disk>
Nov 18 17:13:42 user nova-compute[74743]:  {{(pid=74743) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 17:13:42 user nova-compute[74743]: DEBUG nova.compute.manager [req-67322ab8-6d30-4075-a7b5-b9aac9ce933f req-6ce5a366-8ae1-4726-9c7f-cb948e180a5d service nova] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Received event network-vif-plugged-c66ef239-8068-4eff-807a-830d5f3d0dba {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:13:42 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-67322ab8-6d30-4075-a7b5-b9aac9ce933f req-6ce5a366-8ae1-4726-9c7f-cb948e180a5d service nova] Acquiring lock "49ebdd5a-824d-476a-bd10-3b891bbfe9e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:13:42 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-67322ab8-6d30-4075-a7b5-b9aac9ce933f req-6ce5a366-8ae1-4726-9c7f-cb948e180a5d service nova] Lock "49ebdd5a-824d-476a-bd10-3b891bbfe9e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:13:42 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-67322ab8-6d30-4075-a7b5-b9aac9ce933f req-6ce5a366-8ae1-4726-9c7f-cb948e180a5d service nova] Lock "49ebdd5a-824d-476a-bd10-3b891bbfe9e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:13:42 user nova-compute[74743]: DEBUG nova.compute.manager [req-67322ab8-6d30-4075-a7b5-b9aac9ce933f req-6ce5a366-8ae1-4726-9c7f-cb948e180a5d service nova] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] No waiting events found dispatching network-vif-plugged-c66ef239-8068-4eff-807a-830d5f3d0dba {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:13:42 user nova-compute[74743]: WARNING nova.compute.manager [req-67322ab8-6d30-4075-a7b5-b9aac9ce933f req-6ce5a366-8ae1-4726-9c7f-cb948e180a5d service nova] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Received unexpected event network-vif-plugged-c66ef239-8068-4eff-807a-830d5f3d0dba for instance with vm_state resized and task_state resize_reverting.
Nov 18 17:13:42 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:42 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:42 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:42 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:42 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:42 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-994c4533-f659-4f1d-94fc-ac65f0b56e74 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:13:42 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-994c4533-f659-4f1d-94fc-ac65f0b56e74 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:13:42 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-994c4533-f659-4f1d-94fc-ac65f0b56e74 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] No VIF found with MAC fa:16:3e:35:df:4c, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:13:42 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-994c4533-f659-4f1d-94fc-ac65f0b56e74 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "cd467693-8b2d-4e3d-9b1a-7581c6ae6153" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.147s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:13:43 user nova-compute[74743]: INFO nova.compute.manager [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Rescuing
Nov 18 17:13:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Acquiring lock "refresh_cache-cd467693-8b2d-4e3d-9b1a-7581c6ae6153" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:13:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Acquired lock "refresh_cache-cd467693-8b2d-4e3d-9b1a-7581c6ae6153" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:13:43 user nova-compute[74743]: DEBUG nova.network.neutron [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:13:44 user nova-compute[74743]: DEBUG nova.compute.manager [req-d6e6349d-7991-44d7-bd23-be0406f96a68 req-3b08a880-a9c8-4ce8-b2ca-ce3be0dcf6ad service nova] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Received event network-vif-plugged-c66ef239-8068-4eff-807a-830d5f3d0dba {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:13:44 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d6e6349d-7991-44d7-bd23-be0406f96a68 req-3b08a880-a9c8-4ce8-b2ca-ce3be0dcf6ad service nova] Acquiring lock "49ebdd5a-824d-476a-bd10-3b891bbfe9e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:13:44 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d6e6349d-7991-44d7-bd23-be0406f96a68 req-3b08a880-a9c8-4ce8-b2ca-ce3be0dcf6ad service nova] Lock "49ebdd5a-824d-476a-bd10-3b891bbfe9e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:13:44 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d6e6349d-7991-44d7-bd23-be0406f96a68 req-3b08a880-a9c8-4ce8-b2ca-ce3be0dcf6ad service nova] Lock "49ebdd5a-824d-476a-bd10-3b891bbfe9e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:13:44 user nova-compute[74743]: DEBUG nova.compute.manager [req-d6e6349d-7991-44d7-bd23-be0406f96a68 req-3b08a880-a9c8-4ce8-b2ca-ce3be0dcf6ad service nova] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] No waiting events found dispatching network-vif-plugged-c66ef239-8068-4eff-807a-830d5f3d0dba {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:13:44 user nova-compute[74743]: WARNING nova.compute.manager [req-d6e6349d-7991-44d7-bd23-be0406f96a68 req-3b08a880-a9c8-4ce8-b2ca-ce3be0dcf6ad service nova] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Received unexpected event network-vif-plugged-c66ef239-8068-4eff-807a-830d5f3d0dba for instance with vm_state resized and task_state resize_reverting.
Nov 18 17:13:44 user nova-compute[74743]: DEBUG nova.network.neutron [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Updating instance_info_cache with network_info: [{"id": "106be5e5-0143-4ab2-8e1f-30b2e46c5753", "address": "fa:16:3e:35:df:4c", "network": {"id": "252343cc-f379-471d-a2c9-99b9a60ebcb4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25c06dc8e7be46229750b8e283622c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106be5e5-01", "ovs_interfaceid": "106be5e5-0143-4ab2-8e1f-30b2e46c5753", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:13:44 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Releasing lock "refresh_cache-cd467693-8b2d-4e3d-9b1a-7581c6ae6153" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:13:44 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:44 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:44 user nova-compute[74743]: DEBUG nova.compute.manager [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:13:44 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Instance running successfully.
Nov 18 17:13:44 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] finish_revert_migration finished successfully. {{(pid=74743) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 18 17:13:44 user nova-compute[74743]: DEBUG nova.compute.manager [req-826bdb3b-ea35-400c-b25d-2326e4c86064 req-75679fc4-ecf5-425a-8256-b812599bc149 service nova] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Received event network-vif-unplugged-106be5e5-0143-4ab2-8e1f-30b2e46c5753 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:13:44 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-826bdb3b-ea35-400c-b25d-2326e4c86064 req-75679fc4-ecf5-425a-8256-b812599bc149 service nova] Acquiring lock "cd467693-8b2d-4e3d-9b1a-7581c6ae6153-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:13:44 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-826bdb3b-ea35-400c-b25d-2326e4c86064 req-75679fc4-ecf5-425a-8256-b812599bc149 service nova] Lock "cd467693-8b2d-4e3d-9b1a-7581c6ae6153-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:13:44 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-826bdb3b-ea35-400c-b25d-2326e4c86064 req-75679fc4-ecf5-425a-8256-b812599bc149 service nova] Lock "cd467693-8b2d-4e3d-9b1a-7581c6ae6153-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:13:44 user nova-compute[74743]: DEBUG nova.compute.manager [req-826bdb3b-ea35-400c-b25d-2326e4c86064 req-75679fc4-ecf5-425a-8256-b812599bc149 service nova] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] No waiting events found dispatching network-vif-unplugged-106be5e5-0143-4ab2-8e1f-30b2e46c5753 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:13:44 user nova-compute[74743]: WARNING nova.compute.manager [req-826bdb3b-ea35-400c-b25d-2326e4c86064 req-75679fc4-ecf5-425a-8256-b812599bc149 service nova] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Received unexpected event network-vif-unplugged-106be5e5-0143-4ab2-8e1f-30b2e46c5753 for instance with vm_state active and task_state rescuing.
Nov 18 17:13:44 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:44 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:45 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:45 user nova-compute[74743]: INFO nova.compute.manager [None req-2ea8fb73-4646-450f-87af-b3448ae9d8dd tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Updating instance to original state: 'active'
Nov 18 17:13:45 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Instance destroyed successfully.
Nov 18 17:13:45 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Attempting rescue
Nov 18 17:13:45 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74743) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 18 17:13:45 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Instance directory exists: not creating {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 18 17:13:45 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Creating image(s)
Nov 18 17:13:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Acquiring lock "/opt/stack/data/nova/instances/cd467693-8b2d-4e3d-9b1a-7581c6ae6153/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:13:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "/opt/stack/data/nova/instances/cd467693-8b2d-4e3d-9b1a-7581c6ae6153/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:13:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "/opt/stack/data/nova/instances/cd467693-8b2d-4e3d-9b1a-7581c6ae6153/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:13:45 user nova-compute[74743]: DEBUG nova.objects.instance [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lazy-loading 'trusted_certs' on Instance uuid cd467693-8b2d-4e3d-9b1a-7581c6ae6153 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:13:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Acquiring lock "c188b3a997bfafa42fa341f9dcc326545681eed9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:13:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:13:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:45 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.204s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/cd467693-8b2d-4e3d-9b1a-7581c6ae6153/disk.rescue {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:45 user nova-compute[74743]: DEBUG nova.compute.manager [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Start spawning the instance on the hypervisor. {{(pid=74743) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 17:13:45 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Creating instance directory {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 17:13:45 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Creating image(s)
Nov 18 17:13:45 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Did not create local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 18 17:13:45 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Ensure instance console log exists: /opt/stack/data/nova/instances/f649143e-f7db-475a-bbe5-d5e7316caac3/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:13:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:13:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:13:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:13:45 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Start _get_guest_xml network_info=[{"id": "494b363a-ab2e-4efc-9331-d2b303860a08", "address": "fa:16:3e:e7:77:41", "network": {"id": "1bbf6aff-4048-4212-a716-d0628575bfd0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc0fda74575d488a94e2dcfdc016598c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494b363a-ab", "ovs_interfaceid": "494b363a-ab2e-4efc-9331-d2b303860a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '72ff9250-7c23-463d-98c0-19a363c42940', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nPaDyYBm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f649143e-f7db-475a-bbe5-d5e7316caac3', 'attached_at': '', 'detached_at': '', 'volume_id': 'bc44e0d3-d7fa-4591-8c0d-47dc457d0127', 'serial': 'bc44e0d3-d7fa-4591-8c0d-47dc457d0127'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:13:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/cd467693-8b2d-4e3d-9b1a-7581c6ae6153/disk.rescue" returned: 0 in 0.061s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG nova.objects.instance [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lazy-loading 'migration_context' on Instance uuid cd467693-8b2d-4e3d-9b1a-7581c6ae6153 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:13:46 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:13:46 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:13:46 user nova-compute[74743]: DEBUG nova.objects.base [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Object Instance<cd467693-8b2d-4e3d-9b1a-7581c6ae6153> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Created local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Start _get_guest_xml network_info=[{"id": "106be5e5-0143-4ab2-8e1f-30b2e46c5753", "address": "fa:16:3e:35:df:4c", "network": {"id": "252343cc-f379-471d-a2c9-99b9a60ebcb4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "vif_mac": "fa:16:3e:35:df:4c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25c06dc8e7be46229750b8e283622c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106be5e5-01", "ovs_interfaceid": "106be5e5-0143-4ab2-8e1f-30b2e46c5753", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '9536f6cf-95c4-40e2-864a-09a91525678a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG nova.objects.instance [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lazy-loading 'resources' on Instance uuid cd467693-8b2d-4e3d-9b1a-7581c6ae6153 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Calling os-brick to attach iSCSI Volume {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nPaDyYBm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:13:46 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:13:46 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:13:46 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:13:46 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:13:46 user nova-compute[74743]: INFO os_brick.initiator.connectors.iscsi [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 17:13:46 user nova-compute[74743]: DEBUG nova.objects.base [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Object Instance<cd467693-8b2d-4e3d-9b1a-7581c6ae6153> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG nova.objects.instance [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lazy-loading 'numa_topology' on Instance uuid cd467693-8b2d-4e3d-9b1a-7581c6ae6153 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 -p 172.16.0.220:3260 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG nova.objects.base [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Object Instance<cd467693-8b2d-4e3d-9b1a-7581c6ae6153> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca0c69d-d1da-459d-a0a9-7fa0611ab76f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:46 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:13:46 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:13:46 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 17:13:46 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 -p 172.16.0.220:3260 --interface default --op new {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG nova.objects.instance [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lazy-loading 'vcpu_model' on Instance uuid cd467693-8b2d-4e3d-9b1a-7581c6ae6153 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c00a556-8f3a-4606-9457-4c4b6d0a2399]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127] added\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127] added
Nov 18 17:13:46 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG nova.objects.base [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Object Instance<cd467693-8b2d-4e3d-9b1a-7581c6ae6153> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:11:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1273732704',display_name='tempest-ServerRescueNegativeTestJSON-server-1273732704',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1273732704',id=26,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5i5YEzixtVxmS2iOjWM8/2naGXJ4Q5v/0QysXM2kLdJlCMCc++QaAgvj846YeFr6GNwkzyQptK6eTbco8N4N7YhM2ZbtBzmmRMtT6vYLz0rUMuGW/QGr33NXVcCB2opA==',key_name='tempest-keypair-2052404341',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:11:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='25c06dc8e7be46229750b8e283622c9b',ramdisk_id='',reservation_id='r-uxhicdwp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-732707405',owner_user_name='tempest-ServerRescueNegativeTestJSON-732707405-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:11:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1470478a455242f9ad92eaf95dc6a2f4',uuid=cd467693-8b2d-4e3d-9b1a-7581c6ae6153,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "106be5e5-0143-4ab2-8e1f-30b2e46c5753", "address": "fa:16:3e:35:df:4c", "network": {"id": "252343cc-f379-471d-a2c9-99b9a60ebcb4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "vif_mac": "fa:16:3e:35:df:4c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25c06dc8e7be46229750b8e283622c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106be5e5-01", "ovs_interfaceid": "106be5e5-0143-4ab2-8e1f-30b2e46c5753", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Converting VIF {"id": "106be5e5-0143-4ab2-8e1f-30b2e46c5753", "address": "fa:16:3e:35:df:4c", "network": {"id": "252343cc-f379-471d-a2c9-99b9a60ebcb4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "vif_mac": "fa:16:3e:35:df:4c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25c06dc8e7be46229750b8e283622c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106be5e5-01", "ovs_interfaceid": "106be5e5-0143-4ab2-8e1f-30b2e46c5753", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:df:4c,bridge_name='br-int',has_traffic_filtering=True,id=106be5e5-0143-4ab2-8e1f-30b2e46c5753,network=Network(252343cc-f379-471d-a2c9-99b9a60ebcb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap106be5e5-01') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG nova.objects.instance [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lazy-loading 'pci_devices' on Instance uuid cd467693-8b2d-4e3d-9b1a-7581c6ae6153 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e93376-4d93-41a6-8f24-e276fe354f47]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG nova.objects.base [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Object Instance<cd467693-8b2d-4e3d-9b1a-7581c6ae6153> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:13:46 user nova-compute[74743]:   <uuid>cd467693-8b2d-4e3d-9b1a-7581c6ae6153</uuid>
Nov 18 17:13:46 user nova-compute[74743]:   <name>instance-0000001a</name>
Nov 18 17:13:46 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:13:46 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:13:46 user nova-compute[74743]:   <metadata>
Nov 18 17:13:46 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:13:46 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:13:46 user nova-compute[74743]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1273732704</nova:name>
Nov 18 17:13:46 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:13:46</nova:creationTime>
Nov 18 17:13:46 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:13:46 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:13:46 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:13:46 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:13:46 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:13:46 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:13:46 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:13:46 user nova-compute[74743]:       <nova:owner>
Nov 18 17:13:46 user nova-compute[74743]:         <nova:user uuid="1470478a455242f9ad92eaf95dc6a2f4">tempest-ServerRescueNegativeTestJSON-732707405-project-member</nova:user>
Nov 18 17:13:46 user nova-compute[74743]:         <nova:project uuid="25c06dc8e7be46229750b8e283622c9b">tempest-ServerRescueNegativeTestJSON-732707405</nova:project>
Nov 18 17:13:46 user nova-compute[74743]:       </nova:owner>
Nov 18 17:13:46 user nova-compute[74743]:       <nova:root type="image" uuid="9536f6cf-95c4-40e2-864a-09a91525678a"/>
Nov 18 17:13:46 user nova-compute[74743]:       <nova:ports>
Nov 18 17:13:46 user nova-compute[74743]:         <nova:port uuid="106be5e5-0143-4ab2-8e1f-30b2e46c5753">
Nov 18 17:13:46 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 18 17:13:46 user nova-compute[74743]:         </nova:port>
Nov 18 17:13:46 user nova-compute[74743]:       </nova:ports>
Nov 18 17:13:46 user nova-compute[74743]:     </nova:instance>
Nov 18 17:13:46 user nova-compute[74743]:   </metadata>
Nov 18 17:13:46 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:13:46 user nova-compute[74743]:     <system>
Nov 18 17:13:46 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:13:46 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:13:46 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:13:46 user nova-compute[74743]:       <entry name="serial">cd467693-8b2d-4e3d-9b1a-7581c6ae6153</entry>
Nov 18 17:13:46 user nova-compute[74743]:       <entry name="uuid">cd467693-8b2d-4e3d-9b1a-7581c6ae6153</entry>
Nov 18 17:13:46 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:13:46 user nova-compute[74743]:     </system>
Nov 18 17:13:46 user nova-compute[74743]:   </sysinfo>
Nov 18 17:13:46 user nova-compute[74743]:   <os>
Nov 18 17:13:46 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:13:46 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:13:46 user nova-compute[74743]:   </os>
Nov 18 17:13:46 user nova-compute[74743]:   <features>
Nov 18 17:13:46 user nova-compute[74743]:     <acpi/>
Nov 18 17:13:46 user nova-compute[74743]:     <apic/>
Nov 18 17:13:46 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:13:46 user nova-compute[74743]:   </features>
Nov 18 17:13:46 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:13:46 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:13:46 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:13:46 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:13:46 user nova-compute[74743]:   </clock>
Nov 18 17:13:46 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:13:46 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:13:46 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:13:46 user nova-compute[74743]:   </cpu>
Nov 18 17:13:46 user nova-compute[74743]:   <devices>
Nov 18 17:13:46 user nova-compute[74743]:     <disk type="file" device="disk">
Nov 18 17:13:46 user nova-compute[74743]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 17:13:46 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/cd467693-8b2d-4e3d-9b1a-7581c6ae6153/disk.rescue"/>
Nov 18 17:13:46 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:13:46 user nova-compute[74743]:     </disk>
Nov 18 17:13:46 user nova-compute[74743]:     <disk type="file" device="disk">
Nov 18 17:13:46 user nova-compute[74743]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 17:13:46 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/cd467693-8b2d-4e3d-9b1a-7581c6ae6153/disk"/>
Nov 18 17:13:46 user nova-compute[74743]:       <target dev="vdb" bus="virtio"/>
Nov 18 17:13:46 user nova-compute[74743]:     </disk>
Nov 18 17:13:46 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:13:46 user nova-compute[74743]:       <mac address="fa:16:3e:35:df:4c"/>
Nov 18 17:13:46 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:13:46 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:13:46 user nova-compute[74743]:       <target dev="tap106be5e5-01"/>
Nov 18 17:13:46 user nova-compute[74743]:     </interface>
Nov 18 17:13:46 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:13:46 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/cd467693-8b2d-4e3d-9b1a-7581c6ae6153/console.log" append="off"/>
Nov 18 17:13:46 user nova-compute[74743]:     </serial>
Nov 18 17:13:46 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:13:46 user nova-compute[74743]:     <video>
Nov 18 17:13:46 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:13:46 user nova-compute[74743]:     </video>
Nov 18 17:13:46 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:13:46 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:13:46 user nova-compute[74743]:     </rng>
Nov 18 17:13:46 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:13:46 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:13:46 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:13:46 user nova-compute[74743]:     </memballoon>
Nov 18 17:13:46 user nova-compute[74743]:   </devices>
Nov 18 17:13:46 user nova-compute[74743]: </domain>
Nov 18 17:13:46 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d5765c-48fa-4fd5-8a18-3ea60d6a60f3]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:13:46 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Instance destroyed successfully.
Nov 18 17:13:46 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nPaDyYBm {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nPaDyYBm" returned: 0 in 0.024s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b8c4b0-ac84-4fff-93cd-1794dd3da023]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nPaDyYBm'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[00534119-b709-472a-a683-514d48afbec5]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] No VIF found with MAC fa:16:3e:35:df:4c, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d289f8d-a04f-4c2a-ae4c-d13c489e493c]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:13:46 user nova-compute[74743]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686 (non-flash)
Nov 18 17:13:46 user nova-compute[74743]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:13:46 user nova-compute[74743]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)
Nov 18 17:13:46 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:13:46 user nova-compute[74743]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686 (non-flash)
Nov 18 17:13:46 user nova-compute[74743]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:13:46 user nova-compute[74743]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)
Nov 18 17:13:46 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 -p 172.16.0.220:3260 --login {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a38864-fc7d-443e-acbf-1ba0d80b43e1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127, portal: 172.16.0.220,3260]
Nov 18 17:13:46 user nova-compute[74743]: Login to [iface: default, target: iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127, portal: 172.16.0.220,3260] successful.
Nov 18 17:13:46 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[e966f553-1eb7-4900-a36f-63467e49dc54]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc80a87-5bfd-4e56-bdf6-6a5ea1319736]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:13:46 user nova-compute[74743]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686 (non-flash)
Nov 18 17:13:46 user nova-compute[74743]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:13:46 user nova-compute[74743]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)
Nov 18 17:13:46 user nova-compute[74743]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:13:46 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:13:46 user nova-compute[74743]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686 (non-flash)
Nov 18 17:13:46 user nova-compute[74743]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:13:46 user nova-compute[74743]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)
Nov 18 17:13:46 user nova-compute[74743]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:13:46 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Connected to 172.16.0.220:3260 {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] HCTL ('37', '-', '-', 0) found on session 34 with lun 0 {{(pid=74743) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74743) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43cf48c-8c64-4b78-98c5-673cfdc19312]: (4, ('- - 0', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Searching for a device in session 34 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nPaDyYBm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG nova.compute.manager [req-37b75f6e-6726-4110-b241-877cb0a2c91a req-37734089-4675-4438-b97b-45b1f51c62ac service nova] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Received event network-vif-plugged-106be5e5-0143-4ab2-8e1f-30b2e46c5753 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-37b75f6e-6726-4110-b241-877cb0a2c91a req-37734089-4675-4438-b97b-45b1f51c62ac service nova] Acquiring lock "cd467693-8b2d-4e3d-9b1a-7581c6ae6153-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-37b75f6e-6726-4110-b241-877cb0a2c91a req-37734089-4675-4438-b97b-45b1f51c62ac service nova] Lock "cd467693-8b2d-4e3d-9b1a-7581c6ae6153-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-37b75f6e-6726-4110-b241-877cb0a2c91a req-37734089-4675-4438-b97b-45b1f51c62ac service nova] Lock "cd467693-8b2d-4e3d-9b1a-7581c6ae6153-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:13:46 user nova-compute[74743]: DEBUG nova.compute.manager [req-37b75f6e-6726-4110-b241-877cb0a2c91a req-37734089-4675-4438-b97b-45b1f51c62ac service nova] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] No waiting events found dispatching network-vif-plugged-106be5e5-0143-4ab2-8e1f-30b2e46c5753 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:13:46 user nova-compute[74743]: WARNING nova.compute.manager [req-37b75f6e-6726-4110-b241-877cb0a2c91a req-37734089-4675-4438-b97b-45b1f51c62ac service nova] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Received unexpected event network-vif-plugged-106be5e5-0143-4ab2-8e1f-30b2e46c5753 for instance with vm_state active and task_state rescuing.
Nov 18 17:13:47 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:13:47 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23830653134343535', 'path': '/dev/sdf'} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:13:47 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830653134343535', 'path': '/dev/sdf'} {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 17:13:47 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:13:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-813639784',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-813639784',id=29,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc0fda74575d488a94e2dcfdc016598c',ramdisk_id='',reservation_id='r-i2jtfef2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-633893051',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:13:33Z,user_data=None,user_id='5639bd2666534fdca04d0958dcdc9f54',uuid=f649143e-f7db-475a-bbe5-d5e7316caac3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "494b363a-ab2e-4efc-9331-d2b303860a08", "address": "fa:16:3e:e7:77:41", "network": {"id": "1bbf6aff-4048-4212-a716-d0628575bfd0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc0fda74575d488a94e2dcfdc016598c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494b363a-ab", "ovs_interfaceid": "494b363a-ab2e-4efc-9331-d2b303860a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:13:47 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Converting VIF {"id": "494b363a-ab2e-4efc-9331-d2b303860a08", "address": "fa:16:3e:e7:77:41", "network": {"id": "1bbf6aff-4048-4212-a716-d0628575bfd0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc0fda74575d488a94e2dcfdc016598c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494b363a-ab", "ovs_interfaceid": "494b363a-ab2e-4efc-9331-d2b303860a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:13:47 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:77:41,bridge_name='br-int',has_traffic_filtering=True,id=494b363a-ab2e-4efc-9331-d2b303860a08,network=Network(1bbf6aff-4048-4212-a716-d0628575bfd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap494b363a-ab') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:13:47 user nova-compute[74743]: DEBUG nova.objects.instance [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lazy-loading 'pci_devices' on Instance uuid f649143e-f7db-475a-bbe5-d5e7316caac3 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:13:47 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:13:47 user nova-compute[74743]:   <uuid>f649143e-f7db-475a-bbe5-d5e7316caac3</uuid>
Nov 18 17:13:47 user nova-compute[74743]:   <name>instance-0000001d</name>
Nov 18 17:13:47 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:13:47 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:13:47 user nova-compute[74743]:   <metadata>
Nov 18 17:13:47 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:13:47 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:13:47 user nova-compute[74743]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-813639784</nova:name>
Nov 18 17:13:47 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:13:46</nova:creationTime>
Nov 18 17:13:47 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:13:47 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:13:47 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:13:47 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:13:47 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:13:47 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:13:47 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:13:47 user nova-compute[74743]:       <nova:owner>
Nov 18 17:13:47 user nova-compute[74743]:         <nova:user uuid="5639bd2666534fdca04d0958dcdc9f54">tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member</nova:user>
Nov 18 17:13:47 user nova-compute[74743]:         <nova:project uuid="bc0fda74575d488a94e2dcfdc016598c">tempest-ServerBootFromVolumeStableRescueTest-633893051</nova:project>
Nov 18 17:13:47 user nova-compute[74743]:       </nova:owner>
Nov 18 17:13:47 user nova-compute[74743]:       <nova:root type="image" uuid="9536f6cf-95c4-40e2-864a-09a91525678a"/>
Nov 18 17:13:47 user nova-compute[74743]:       <nova:ports>
Nov 18 17:13:47 user nova-compute[74743]:         <nova:port uuid="494b363a-ab2e-4efc-9331-d2b303860a08">
Nov 18 17:13:47 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 18 17:13:47 user nova-compute[74743]:         </nova:port>
Nov 18 17:13:47 user nova-compute[74743]:       </nova:ports>
Nov 18 17:13:47 user nova-compute[74743]:     </nova:instance>
Nov 18 17:13:47 user nova-compute[74743]:   </metadata>
Nov 18 17:13:47 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:13:47 user nova-compute[74743]:     <system>
Nov 18 17:13:47 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:13:47 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:13:47 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:13:47 user nova-compute[74743]:       <entry name="serial">f649143e-f7db-475a-bbe5-d5e7316caac3</entry>
Nov 18 17:13:47 user nova-compute[74743]:       <entry name="uuid">f649143e-f7db-475a-bbe5-d5e7316caac3</entry>
Nov 18 17:13:47 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:13:47 user nova-compute[74743]:     </system>
Nov 18 17:13:47 user nova-compute[74743]:   </sysinfo>
Nov 18 17:13:47 user nova-compute[74743]:   <os>
Nov 18 17:13:47 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:13:47 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:13:47 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:13:47 user nova-compute[74743]:   </os>
Nov 18 17:13:47 user nova-compute[74743]:   <features>
Nov 18 17:13:47 user nova-compute[74743]:     <acpi/>
Nov 18 17:13:47 user nova-compute[74743]:     <apic/>
Nov 18 17:13:47 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:13:47 user nova-compute[74743]:   </features>
Nov 18 17:13:47 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:13:47 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:13:47 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:13:47 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:13:47 user nova-compute[74743]:   </clock>
Nov 18 17:13:47 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:13:47 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:13:47 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:13:47 user nova-compute[74743]:   </cpu>
Nov 18 17:13:47 user nova-compute[74743]:   <devices>
Nov 18 17:13:47 user nova-compute[74743]:     <disk type="block" device="disk">
Nov 18 17:13:47 user nova-compute[74743]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:13:47 user nova-compute[74743]:       <source dev="/dev/sdf"/>
Nov 18 17:13:47 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:13:47 user nova-compute[74743]:       <serial>bc44e0d3-d7fa-4591-8c0d-47dc457d0127</serial>
Nov 18 17:13:47 user nova-compute[74743]:     </disk>
Nov 18 17:13:47 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:13:47 user nova-compute[74743]:       <mac address="fa:16:3e:e7:77:41"/>
Nov 18 17:13:47 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:13:47 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:13:47 user nova-compute[74743]:       <target dev="tap494b363a-ab"/>
Nov 18 17:13:47 user nova-compute[74743]:     </interface>
Nov 18 17:13:47 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:13:47 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/f649143e-f7db-475a-bbe5-d5e7316caac3/console.log" append="off"/>
Nov 18 17:13:47 user nova-compute[74743]:     </serial>
Nov 18 17:13:47 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:13:47 user nova-compute[74743]:     <video>
Nov 18 17:13:47 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:13:47 user nova-compute[74743]:     </video>
Nov 18 17:13:47 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:13:47 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:13:47 user nova-compute[74743]:     </rng>
Nov 18 17:13:47 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:13:47 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:13:47 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:13:47 user nova-compute[74743]:     </memballoon>
Nov 18 17:13:47 user nova-compute[74743]:   </devices>
Nov 18 17:13:47 user nova-compute[74743]: </domain>
Nov 18 17:13:47 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:13:47 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:13:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-813639784',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-813639784',id=29,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc0fda74575d488a94e2dcfdc016598c',ramdisk_id='',reservation_id='r-i2jtfef2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-633893051',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:13:33Z,user_data=None,user_id='5639bd2666534fdca04d0958dcdc9f54',uuid=f649143e-f7db-475a-bbe5-d5e7316caac3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "494b363a-ab2e-4efc-9331-d2b303860a08", "address": "fa:16:3e:e7:77:41", "network": {"id": "1bbf6aff-4048-4212-a716-d0628575bfd0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc0fda74575d488a94e2dcfdc016598c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494b363a-ab", "ovs_interfaceid": "494b363a-ab2e-4efc-9331-d2b303860a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:13:47 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Converting VIF {"id": "494b363a-ab2e-4efc-9331-d2b303860a08", "address": "fa:16:3e:e7:77:41", "network": {"id": "1bbf6aff-4048-4212-a716-d0628575bfd0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc0fda74575d488a94e2dcfdc016598c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494b363a-ab", "ovs_interfaceid": "494b363a-ab2e-4efc-9331-d2b303860a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:13:47 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:77:41,bridge_name='br-int',has_traffic_filtering=True,id=494b363a-ab2e-4efc-9331-d2b303860a08,network=Network(1bbf6aff-4048-4212-a716-d0628575bfd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap494b363a-ab') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:13:47 user nova-compute[74743]: DEBUG os_vif [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:77:41,bridge_name='br-int',has_traffic_filtering=True,id=494b363a-ab2e-4efc-9331-d2b303860a08,network=Network(1bbf6aff-4048-4212-a716-d0628575bfd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap494b363a-ab') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:13:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:13:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:13:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '157f13ef-a870-5193-a8a0-df7c60ba919c', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:13:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:13:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap494b363a-ab, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:13:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap494b363a-ab, col_values=(('qos', UUID('3117f89c-23d2-4d3c-b7c3-4683c329df59')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:13:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap494b363a-ab, col_values=(('external_ids', {'iface-id': '494b363a-ab2e-4efc-9331-d2b303860a08', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:77:41', 'vm-uuid': 'f649143e-f7db-475a-bbe5-d5e7316caac3'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:13:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:13:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:47 user nova-compute[74743]: INFO os_vif [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:77:41,bridge_name='br-int',has_traffic_filtering=True,id=494b363a-ab2e-4efc-9331-d2b303860a08,network=Network(1bbf6aff-4048-4212-a716-d0628575bfd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap494b363a-ab')
Nov 18 17:13:47 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:13:47 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] No VIF found with MAC fa:16:3e:e7:77:41, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:13:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:49 user nova-compute[74743]: DEBUG nova.compute.manager [req-8ad9b3d7-11bb-4eec-bda2-387523b406a4 req-71e7fdaa-e0b3-41e3-92a8-8e5c8ab86279 service nova] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Received event network-vif-plugged-106be5e5-0143-4ab2-8e1f-30b2e46c5753 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:13:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-8ad9b3d7-11bb-4eec-bda2-387523b406a4 req-71e7fdaa-e0b3-41e3-92a8-8e5c8ab86279 service nova] Acquiring lock "cd467693-8b2d-4e3d-9b1a-7581c6ae6153-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:13:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-8ad9b3d7-11bb-4eec-bda2-387523b406a4 req-71e7fdaa-e0b3-41e3-92a8-8e5c8ab86279 service nova] Lock "cd467693-8b2d-4e3d-9b1a-7581c6ae6153-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:13:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-8ad9b3d7-11bb-4eec-bda2-387523b406a4 req-71e7fdaa-e0b3-41e3-92a8-8e5c8ab86279 service nova] Lock "cd467693-8b2d-4e3d-9b1a-7581c6ae6153-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:13:49 user nova-compute[74743]: DEBUG nova.compute.manager [req-8ad9b3d7-11bb-4eec-bda2-387523b406a4 req-71e7fdaa-e0b3-41e3-92a8-8e5c8ab86279 service nova] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] No waiting events found dispatching network-vif-plugged-106be5e5-0143-4ab2-8e1f-30b2e46c5753 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:13:49 user nova-compute[74743]: WARNING nova.compute.manager [req-8ad9b3d7-11bb-4eec-bda2-387523b406a4 req-71e7fdaa-e0b3-41e3-92a8-8e5c8ab86279 service nova] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Received unexpected event network-vif-plugged-106be5e5-0143-4ab2-8e1f-30b2e46c5753 for instance with vm_state active and task_state rescuing.
Nov 18 17:13:49 user nova-compute[74743]: DEBUG nova.compute.manager [req-8ad9b3d7-11bb-4eec-bda2-387523b406a4 req-71e7fdaa-e0b3-41e3-92a8-8e5c8ab86279 service nova] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Received event network-vif-plugged-106be5e5-0143-4ab2-8e1f-30b2e46c5753 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:13:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-8ad9b3d7-11bb-4eec-bda2-387523b406a4 req-71e7fdaa-e0b3-41e3-92a8-8e5c8ab86279 service nova] Acquiring lock "cd467693-8b2d-4e3d-9b1a-7581c6ae6153-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:13:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-8ad9b3d7-11bb-4eec-bda2-387523b406a4 req-71e7fdaa-e0b3-41e3-92a8-8e5c8ab86279 service nova] Lock "cd467693-8b2d-4e3d-9b1a-7581c6ae6153-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:13:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-8ad9b3d7-11bb-4eec-bda2-387523b406a4 req-71e7fdaa-e0b3-41e3-92a8-8e5c8ab86279 service nova] Lock "cd467693-8b2d-4e3d-9b1a-7581c6ae6153-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:13:49 user nova-compute[74743]: DEBUG nova.compute.manager [req-8ad9b3d7-11bb-4eec-bda2-387523b406a4 req-71e7fdaa-e0b3-41e3-92a8-8e5c8ab86279 service nova] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] No waiting events found dispatching network-vif-plugged-106be5e5-0143-4ab2-8e1f-30b2e46c5753 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:13:49 user nova-compute[74743]: WARNING nova.compute.manager [req-8ad9b3d7-11bb-4eec-bda2-387523b406a4 req-71e7fdaa-e0b3-41e3-92a8-8e5c8ab86279 service nova] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Received unexpected event network-vif-plugged-106be5e5-0143-4ab2-8e1f-30b2e46c5753 for instance with vm_state active and task_state rescuing.
Nov 18 17:13:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-36bf14aa-8502-45f1-9944-947bb9d275c0 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Acquiring lock "180f2f7e-9df5-480f-adde-d8e10ee14b07" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:13:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-36bf14aa-8502-45f1-9944-947bb9d275c0 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "180f2f7e-9df5-480f-adde-d8e10ee14b07" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:13:49 user nova-compute[74743]: INFO nova.compute.manager [None req-36bf14aa-8502-45f1-9944-947bb9d275c0 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Detaching volume 9f0ecae7-9091-4cb2-8758-d5f683dd3686
Nov 18 17:13:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ccb0f585-3f12-4eae-8f2d-7e48fc034060 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Acquiring lock "180f2f7e-9df5-480f-adde-d8e10ee14b07" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:13:49 user nova-compute[74743]: INFO nova.virt.block_device [None req-36bf14aa-8502-45f1-9944-947bb9d275c0 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Attempting to driver detach volume 9f0ecae7-9091-4cb2-8758-d5f683dd3686 from mountpoint /dev/vdb
Nov 18 17:13:49 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-36bf14aa-8502-45f1-9944-947bb9d275c0 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Attempting to detach device vdb from instance 180f2f7e-9df5-480f-adde-d8e10ee14b07 from the persistent domain config. {{(pid=74743) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 17:13:49 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-36bf14aa-8502-45f1-9944-947bb9d275c0 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 17:13:49 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:13:49 user nova-compute[74743]:   <source dev="/dev/sdb"/>
Nov 18 17:13:49 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:13:49 user nova-compute[74743]:   <serial>9f0ecae7-9091-4cb2-8758-d5f683dd3686</serial>
Nov 18 17:13:49 user nova-compute[74743]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 17:13:49 user nova-compute[74743]: </disk>
Nov 18 17:13:49 user nova-compute[74743]:  {{(pid=74743) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 17:13:49 user nova-compute[74743]: DEBUG nova.compute.manager [req-5061a1d3-5bf3-44b0-a9b6-95f16db70ef4 req-48003157-0171-41bd-9fa6-e0b62019431f service nova] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Received event network-vif-plugged-494b363a-ab2e-4efc-9331-d2b303860a08 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:13:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-5061a1d3-5bf3-44b0-a9b6-95f16db70ef4 req-48003157-0171-41bd-9fa6-e0b62019431f service nova] Acquiring lock "f649143e-f7db-475a-bbe5-d5e7316caac3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:13:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-5061a1d3-5bf3-44b0-a9b6-95f16db70ef4 req-48003157-0171-41bd-9fa6-e0b62019431f service nova] Lock "f649143e-f7db-475a-bbe5-d5e7316caac3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:13:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-5061a1d3-5bf3-44b0-a9b6-95f16db70ef4 req-48003157-0171-41bd-9fa6-e0b62019431f service nova] Lock "f649143e-f7db-475a-bbe5-d5e7316caac3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:13:49 user nova-compute[74743]: DEBUG nova.compute.manager [req-5061a1d3-5bf3-44b0-a9b6-95f16db70ef4 req-48003157-0171-41bd-9fa6-e0b62019431f service nova] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] No waiting events found dispatching network-vif-plugged-494b363a-ab2e-4efc-9331-d2b303860a08 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:13:49 user nova-compute[74743]: WARNING nova.compute.manager [req-5061a1d3-5bf3-44b0-a9b6-95f16db70ef4 req-48003157-0171-41bd-9fa6-e0b62019431f service nova] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Received unexpected event network-vif-plugged-494b363a-ab2e-4efc-9331-d2b303860a08 for instance with vm_state building and task_state spawning.
Nov 18 17:13:49 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-36bf14aa-8502-45f1-9944-947bb9d275c0 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Successfully detached device vdb from instance 180f2f7e-9df5-480f-adde-d8e10ee14b07 from the persistent domain config.
Nov 18 17:13:49 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-36bf14aa-8502-45f1-9944-947bb9d275c0 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 180f2f7e-9df5-480f-adde-d8e10ee14b07 from the live domain config. {{(pid=74743) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 17:13:49 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-36bf14aa-8502-45f1-9944-947bb9d275c0 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 17:13:49 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:13:49 user nova-compute[74743]:   <source dev="/dev/sdb"/>
Nov 18 17:13:49 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:13:49 user nova-compute[74743]:   <serial>9f0ecae7-9091-4cb2-8758-d5f683dd3686</serial>
Nov 18 17:13:49 user nova-compute[74743]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 17:13:49 user nova-compute[74743]: </disk>
Nov 18 17:13:49 user nova-compute[74743]:  {{(pid=74743) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 17:13:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:50 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-36bf14aa-8502-45f1-9944-947bb9d275c0 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 180f2f7e-9df5-480f-adde-d8e10ee14b07 {{(pid=74743) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 17:13:51 user nova-compute[74743]: DEBUG nova.compute.manager [None req-14bc8957-9a6c-4e6b-a2c1-9c7187d01dbb tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:13:51 user nova-compute[74743]: DEBUG nova.compute.manager [req-7a1c58b2-5975-4406-b0be-b6fbff01f61d req-084cf138-bb1d-4f5c-93fe-6bf72b84d0f4 service nova] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Received event network-vif-plugged-494b363a-ab2e-4efc-9331-d2b303860a08 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:13:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-7a1c58b2-5975-4406-b0be-b6fbff01f61d req-084cf138-bb1d-4f5c-93fe-6bf72b84d0f4 service nova] Acquiring lock "f649143e-f7db-475a-bbe5-d5e7316caac3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:13:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-7a1c58b2-5975-4406-b0be-b6fbff01f61d req-084cf138-bb1d-4f5c-93fe-6bf72b84d0f4 service nova] Lock "f649143e-f7db-475a-bbe5-d5e7316caac3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:13:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-7a1c58b2-5975-4406-b0be-b6fbff01f61d req-084cf138-bb1d-4f5c-93fe-6bf72b84d0f4 service nova] Lock "f649143e-f7db-475a-bbe5-d5e7316caac3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:13:51 user nova-compute[74743]: DEBUG nova.compute.manager [req-7a1c58b2-5975-4406-b0be-b6fbff01f61d req-084cf138-bb1d-4f5c-93fe-6bf72b84d0f4 service nova] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] No waiting events found dispatching network-vif-plugged-494b363a-ab2e-4efc-9331-d2b303860a08 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:13:51 user nova-compute[74743]: WARNING nova.compute.manager [req-7a1c58b2-5975-4406-b0be-b6fbff01f61d req-084cf138-bb1d-4f5c-93fe-6bf72b84d0f4 service nova] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Received unexpected event network-vif-plugged-494b363a-ab2e-4efc-9331-d2b303860a08 for instance with vm_state building and task_state spawning.
Nov 18 17:13:51 user nova-compute[74743]: DEBUG nova.compute.manager [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:13:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Guest created on hypervisor {{(pid=74743) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 17:13:51 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Instance spawned successfully.
Nov 18 17:13:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 17:13:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Found default for hw_cdrom_bus of ide {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:13:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Found default for hw_disk_bus of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:13:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Found default for hw_input_bus of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:13:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Found default for hw_pointer_model of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:13:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Found default for hw_video_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:13:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Found default for hw_vif_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:13:52 user nova-compute[74743]: INFO nova.compute.manager [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Took 6.16 seconds to spawn the instance on the hypervisor.
Nov 18 17:13:52 user nova-compute[74743]: DEBUG nova.compute.manager [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:13:52 user nova-compute[74743]: INFO nova.compute.manager [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Took 19.96 seconds to build instance.
Nov 18 17:13:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8225564d-d6b4-496b-8a94-26ee98c9d4af tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "f649143e-f7db-475a-bbe5-d5e7316caac3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.067s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:13:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-00a1424c-21b0-497e-9ced-784dc3aa8eb2 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Acquiring lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:13:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-00a1424c-21b0-497e-9ced-784dc3aa8eb2 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:13:56 user nova-compute[74743]: DEBUG nova.objects.instance [None req-00a1424c-21b0-497e-9ced-784dc3aa8eb2 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lazy-loading 'flavor' on Instance uuid f93bf0ac-ecc8-447d-b9c1-381d36cd3135 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:13:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-00a1424c-21b0-497e-9ced-784dc3aa8eb2 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:13:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-00a1424c-21b0-497e-9ced-784dc3aa8eb2 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Acquiring lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:13:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-00a1424c-21b0-497e-9ced-784dc3aa8eb2 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:13:56 user nova-compute[74743]: INFO nova.compute.manager [None req-00a1424c-21b0-497e-9ced-784dc3aa8eb2 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Attaching volume 017a6353-4fd9-401f-b77e-da049415730f to /dev/vdb
Nov 18 17:13:56 user nova-compute[74743]: DEBUG os_brick.utils [None req-00a1424c-21b0-497e-9ced-784dc3aa8eb2 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:13:56 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:56 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:56 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[9980f328-a0e5-4ce0-80a4-22bc03390f42]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1116acd8874d\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:56 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:56 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:56 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[29907358-b389-4ab9-ac1c-a80813f599ac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:56 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:56 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:13:56 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[159faaa4-87d2-45b5-9ccf-a0f0ac325dc3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:56 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f22909-e2f0-483f-af19-d316aea12a48]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:56 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-00a1424c-21b0-497e-9ced-784dc3aa8eb2 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Running cmd (subprocess): nvme version {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:56 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-00a1424c-21b0-497e-9ced-784dc3aa8eb2 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] 'nvme version' failed. Not Retrying. {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:13:56 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.nvmeof [None req-00a1424c-21b0-497e-9ced-784dc3aa8eb2 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] nvme not present on system {{(pid=74743) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 17:13:56 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:13:56 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:13:56 user nova-compute[74743]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 17:13:56 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7bb9cb-f72d-4d4a-bbb1-7ec6cde92579]: (4, '') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:13:56 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-00a1424c-21b0-497e-9ced-784dc3aa8eb2 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74743) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 17:13:56 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-00a1424c-21b0-497e-9ced-784dc3aa8eb2 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 17:13:56 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-00a1424c-21b0-497e-9ced-784dc3aa8eb2 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] LIGHTOS: no hostnqn found. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 17:13:56 user nova-compute[74743]: DEBUG os_brick.utils [None req-00a1424c-21b0-497e-9ced-784dc3aa8eb2 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1116acd8874d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:13:56 user nova-compute[74743]: DEBUG nova.virt.block_device [None req-00a1424c-21b0-497e-9ced-784dc3aa8eb2 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Updating existing volume attachment record: 18f238f7-faf5-4bba-839e-f3a2625fec0d {{(pid=74743) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 17:13:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:13:59 user nova-compute[74743]: DEBUG nova.compute.manager [req-3cf1a075-0d6f-4296-a33e-45c03592c0fa req-a7d27ef5-9738-421a-858a-c95b9ef60507 service nova] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Received event network-changed-1c9871cc-eb56-4eef-8563-b12d5f69c1af {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:13:59 user nova-compute[74743]: DEBUG nova.compute.manager [req-3cf1a075-0d6f-4296-a33e-45c03592c0fa req-a7d27ef5-9738-421a-858a-c95b9ef60507 service nova] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Refreshing instance network info cache due to event network-changed-1c9871cc-eb56-4eef-8563-b12d5f69c1af. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:13:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3cf1a075-0d6f-4296-a33e-45c03592c0fa req-a7d27ef5-9738-421a-858a-c95b9ef60507 service nova] Acquiring lock "refresh_cache-cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:13:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3cf1a075-0d6f-4296-a33e-45c03592c0fa req-a7d27ef5-9738-421a-858a-c95b9ef60507 service nova] Acquired lock "refresh_cache-cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:13:59 user nova-compute[74743]: DEBUG nova.network.neutron [req-3cf1a075-0d6f-4296-a33e-45c03592c0fa req-a7d27ef5-9738-421a-858a-c95b9ef60507 service nova] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Refreshing network info cache for port 1c9871cc-eb56-4eef-8563-b12d5f69c1af {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:13:59 user nova-compute[74743]: DEBUG nova.network.neutron [req-3cf1a075-0d6f-4296-a33e-45c03592c0fa req-a7d27ef5-9738-421a-858a-c95b9ef60507 service nova] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Updated VIF entry in instance network info cache for port 1c9871cc-eb56-4eef-8563-b12d5f69c1af. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:13:59 user nova-compute[74743]: DEBUG nova.network.neutron [req-3cf1a075-0d6f-4296-a33e-45c03592c0fa req-a7d27ef5-9738-421a-858a-c95b9ef60507 service nova] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Updating instance_info_cache with network_info: [{"id": "1c9871cc-eb56-4eef-8563-b12d5f69c1af", "address": "fa:16:3e:0d:f2:57", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c9871cc-eb", "ovs_interfaceid": "1c9871cc-eb56-4eef-8563-b12d5f69c1af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:13:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3cf1a075-0d6f-4296-a33e-45c03592c0fa req-a7d27ef5-9738-421a-858a-c95b9ef60507 service nova] Releasing lock "refresh_cache-cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:13:59 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:14:02 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:14:02 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00a1424c-21b0-497e-9ced-784dc3aa8eb2 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Calling os-brick to attach iSCSI Volume {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 17:14:02 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a1424c-21b0-497e-9ced-784dc3aa8eb2 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UGHQcanR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:14:02 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-00a1424c-21b0-497e-9ced-784dc3aa8eb2 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:14:02 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-00a1424c-21b0-497e-9ced-784dc3aa8eb2 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:14:02 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-00a1424c-21b0-497e-9ced-784dc3aa8eb2 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:14:02 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-00a1424c-21b0-497e-9ced-784dc3aa8eb2 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:14:02 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-00a1424c-21b0-497e-9ced-784dc3aa8eb2 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:14:02 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-00a1424c-21b0-497e-9ced-784dc3aa8eb2 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:14:02 user nova-compute[74743]: INFO os_brick.initiator.connectors.iscsi [None req-00a1424c-21b0-497e-9ced-784dc3aa8eb2 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 17:14:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f -p 172.16.0.220:3260 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:02 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[f559c54f-2492-4a01-b272-03aedd89dd94]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:14:02 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a1424c-21b0-497e-9ced-784dc3aa8eb2 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 17:14:02 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:14:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f -p 172.16.0.220:3260 --interface default --op new {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:02 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b074409-c17c-486b-a33c-8decdda5e815]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f] added\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:14:02 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a1424c-21b0-497e-9ced-784dc3aa8eb2 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f] added
Nov 18 17:14:02 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:14:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:02 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0f0ea7-23ca-4d89-a824-c39363c1858e]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:14:02 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a1424c-21b0-497e-9ced-784dc3aa8eb2 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:14:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:02 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40e4526-ef8f-4e01-afa4-0a8b3580fd3d]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:14:02 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a1424c-21b0-497e-9ced-784dc3aa8eb2 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:14:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UGHQcanR {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UGHQcanR" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:02 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[2485098f-a299-4d40-bc04-f75a70fb2019]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:14:02 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a1424c-21b0-497e-9ced-784dc3aa8eb2 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UGHQcanR'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:14:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:02 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57ff89b-e016-4b15-a74b-0a46249a673b]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:14:02 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a1424c-21b0-497e-9ced-784dc3aa8eb2 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:14:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:02 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa02ee9-c687-40c7-af67-be6d1629425a]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:14:02 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a1424c-21b0-497e-9ced-784dc3aa8eb2 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:14:02 user nova-compute[74743]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686 (non-flash)
Nov 18 17:14:02 user nova-compute[74743]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:14:02 user nova-compute[74743]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)
Nov 18 17:14:02 user nova-compute[74743]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:14:02 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:14:02 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a1424c-21b0-497e-9ced-784dc3aa8eb2 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:14:02 user nova-compute[74743]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686 (non-flash)
Nov 18 17:14:02 user nova-compute[74743]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:14:02 user nova-compute[74743]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)
Nov 18 17:14:02 user nova-compute[74743]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:14:02 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:14:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f -p 172.16.0.220:3260 --login {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:03 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:03 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[767e15a9-e166-4add-8e34-7f3687c64fd2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:14:03 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a1424c-21b0-497e-9ced-784dc3aa8eb2 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f, portal: 172.16.0.220,3260]
Nov 18 17:14:03 user nova-compute[74743]: Login to [iface: default, target: iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f, portal: 172.16.0.220,3260] successful.
Nov 18 17:14:03 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:14:03 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:03 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:03 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8cdb07-7d24-4503-91d6-633713458287]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:14:03 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a1424c-21b0-497e-9ced-784dc3aa8eb2 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:14:03 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:03 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:03 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c21ce59-433a-4a53-a9ff-210d2421acc4]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:14:03 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a1424c-21b0-497e-9ced-784dc3aa8eb2 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:14:03 user nova-compute[74743]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686 (non-flash)
Nov 18 17:14:03 user nova-compute[74743]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:14:03 user nova-compute[74743]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)
Nov 18 17:14:03 user nova-compute[74743]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:14:03 user nova-compute[74743]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f (non-flash)
Nov 18 17:14:03 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:14:03 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a1424c-21b0-497e-9ced-784dc3aa8eb2 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:14:03 user nova-compute[74743]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686 (non-flash)
Nov 18 17:14:03 user nova-compute[74743]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:14:03 user nova-compute[74743]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)
Nov 18 17:14:03 user nova-compute[74743]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:14:03 user nova-compute[74743]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f (non-flash)
Nov 18 17:14:03 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:14:03 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-00a1424c-21b0-497e-9ced-784dc3aa8eb2 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:14:03 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a1424c-21b0-497e-9ced-784dc3aa8eb2 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Connected to 172.16.0.220:3260 {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 17:14:03 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-00a1424c-21b0-497e-9ced-784dc3aa8eb2 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] HCTL ('38', '-', '-', 0) found on session 35 with lun 0 {{(pid=74743) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 17:14:03 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-00a1424c-21b0-497e-9ced-784dc3aa8eb2 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74743) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 17:14:03 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:03 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:03 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af73ae4-698d-47af-945c-9e17b02b4b86]: (4, ('- - 0', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:14:03 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-00a1424c-21b0-497e-9ced-784dc3aa8eb2 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Searching for a device in session 35 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:14:03 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a1424c-21b0-497e-9ced-784dc3aa8eb2 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UGHQcanR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 17:14:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-00a1424c-21b0-497e-9ced-784dc3aa8eb2 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:14:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a1424c-21b0-497e-9ced-784dc3aa8eb2 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '23636616630396363', 'path': '/dev/sdg'} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:14:04 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00a1424c-21b0-497e-9ced-784dc3aa8eb2 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636616630396363', 'path': '/dev/sdg'} {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 17:14:04 user nova-compute[74743]: DEBUG nova.objects.instance [None req-00a1424c-21b0-497e-9ced-784dc3aa8eb2 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lazy-loading 'flavor' on Instance uuid f93bf0ac-ecc8-447d-b9c1-381d36cd3135 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:14:04 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-00a1424c-21b0-497e-9ced-784dc3aa8eb2 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 17:14:04 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:14:04 user nova-compute[74743]:   <source dev="/dev/sdg"/>
Nov 18 17:14:04 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:14:04 user nova-compute[74743]:   <serial>017a6353-4fd9-401f-b77e-da049415730f</serial>
Nov 18 17:14:04 user nova-compute[74743]: </disk>
Nov 18 17:14:04 user nova-compute[74743]:  {{(pid=74743) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 17:14:04 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-00a1424c-21b0-497e-9ced-784dc3aa8eb2 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:14:04 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-00a1424c-21b0-497e-9ced-784dc3aa8eb2 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:14:04 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-00a1424c-21b0-497e-9ced-784dc3aa8eb2 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] No VIF found with MAC fa:16:3e:f3:91:b0, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:14:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-00a1424c-21b0-497e-9ced-784dc3aa8eb2 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.291s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:14:04 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:14:05 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "637e2b9b-9777-487f-8131-bdfcd520b2cf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:14:05 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "637e2b9b-9777-487f-8131-bdfcd520b2cf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:14:05 user nova-compute[74743]: DEBUG nova.compute.manager [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Starting instance... {{(pid=74743) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 17:14:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:14:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:14:06 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74743) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 17:14:06 user nova-compute[74743]: INFO nova.compute.claims [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Claim successful on node user
Nov 18 17:14:06 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:14:06 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:14:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.527s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:14:06 user nova-compute[74743]: DEBUG nova.compute.manager [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Start building networks asynchronously for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 17:14:06 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 17:14:06 user nova-compute[74743]: DEBUG nova.compute.manager [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Allocating IP information in the background. {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 17:14:06 user nova-compute[74743]: DEBUG nova.network.neutron [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] allocate_for_instance() {{(pid=74743) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 17:14:06 user nova-compute[74743]: DEBUG nova.compute.manager [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Start building block device mappings for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 17:14:06 user nova-compute[74743]: INFO nova.virt.block_device [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Booting with volume snapshot 93b24cba-4a16-4b4e-8092-1c26dede0aaf at /dev/vda
Nov 18 17:14:06 user nova-compute[74743]: DEBUG nova.policy [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '89ce0d4bf7234c348b9b1a8979609c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a956c4d6e4304d34872ecf989279c886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74743) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 17:14:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e7af77d6-a3f2-4053-bfce-5443951fb51c tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Acquiring lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:14:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e7af77d6-a3f2-4053-bfce-5443951fb51c tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:14:07 user nova-compute[74743]: INFO nova.compute.manager [None req-e7af77d6-a3f2-4053-bfce-5443951fb51c tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Detaching volume 017a6353-4fd9-401f-b77e-da049415730f
Nov 18 17:14:07 user nova-compute[74743]: INFO nova.virt.block_device [None req-e7af77d6-a3f2-4053-bfce-5443951fb51c tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Attempting to driver detach volume 017a6353-4fd9-401f-b77e-da049415730f from mountpoint /dev/vdb
Nov 18 17:14:07 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-e7af77d6-a3f2-4053-bfce-5443951fb51c tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Attempting to detach device vdb from instance f93bf0ac-ecc8-447d-b9c1-381d36cd3135 from the persistent domain config. {{(pid=74743) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 17:14:07 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-e7af77d6-a3f2-4053-bfce-5443951fb51c tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 17:14:07 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:14:07 user nova-compute[74743]:   <source dev="/dev/sdg"/>
Nov 18 17:14:07 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:14:07 user nova-compute[74743]:   <serial>017a6353-4fd9-401f-b77e-da049415730f</serial>
Nov 18 17:14:07 user nova-compute[74743]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 17:14:07 user nova-compute[74743]: </disk>
Nov 18 17:14:07 user nova-compute[74743]:  {{(pid=74743) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 17:14:07 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-e7af77d6-a3f2-4053-bfce-5443951fb51c tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Successfully detached device vdb from instance f93bf0ac-ecc8-447d-b9c1-381d36cd3135 from the persistent domain config.
Nov 18 17:14:07 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-e7af77d6-a3f2-4053-bfce-5443951fb51c tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f93bf0ac-ecc8-447d-b9c1-381d36cd3135 from the live domain config. {{(pid=74743) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 17:14:07 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-e7af77d6-a3f2-4053-bfce-5443951fb51c tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 17:14:07 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:14:07 user nova-compute[74743]:   <source dev="/dev/sdg"/>
Nov 18 17:14:07 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:14:07 user nova-compute[74743]:   <serial>017a6353-4fd9-401f-b77e-da049415730f</serial>
Nov 18 17:14:07 user nova-compute[74743]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 17:14:07 user nova-compute[74743]: </disk>
Nov 18 17:14:07 user nova-compute[74743]:  {{(pid=74743) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 17:14:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:14:07 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-e7af77d6-a3f2-4053-bfce-5443951fb51c tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f93bf0ac-ecc8-447d-b9c1-381d36cd3135 {{(pid=74743) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 17:14:07 user nova-compute[74743]: DEBUG nova.network.neutron [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Successfully created port: 516dfceb-fc7a-43ad-b874-1eb33cc0f525 {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:14:08 user nova-compute[74743]: DEBUG nova.network.neutron [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Successfully updated port: 516dfceb-fc7a-43ad-b874-1eb33cc0f525 {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:14:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "refresh_cache-637e2b9b-9777-487f-8131-bdfcd520b2cf" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:14:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquired lock "refresh_cache-637e2b9b-9777-487f-8131-bdfcd520b2cf" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:14:08 user nova-compute[74743]: DEBUG nova.network.neutron [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:14:08 user nova-compute[74743]: DEBUG nova.compute.manager [req-79c650f8-aeac-4f5f-8ac0-f64777a0de82 req-b7a3b5b7-a858-4dfd-8655-1e5bd9e07890 service nova] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Received event network-changed-516dfceb-fc7a-43ad-b874-1eb33cc0f525 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:14:08 user nova-compute[74743]: DEBUG nova.compute.manager [req-79c650f8-aeac-4f5f-8ac0-f64777a0de82 req-b7a3b5b7-a858-4dfd-8655-1e5bd9e07890 service nova] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Refreshing instance network info cache due to event network-changed-516dfceb-fc7a-43ad-b874-1eb33cc0f525. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:14:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-79c650f8-aeac-4f5f-8ac0-f64777a0de82 req-b7a3b5b7-a858-4dfd-8655-1e5bd9e07890 service nova] Acquiring lock "refresh_cache-637e2b9b-9777-487f-8131-bdfcd520b2cf" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:14:08 user nova-compute[74743]: DEBUG nova.network.neutron [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:14:09 user nova-compute[74743]: DEBUG nova.network.neutron [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Updating instance_info_cache with network_info: [{"id": "516dfceb-fc7a-43ad-b874-1eb33cc0f525", "address": "fa:16:3e:82:84:7a", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap516dfceb-fc", "ovs_interfaceid": "516dfceb-fc7a-43ad-b874-1eb33cc0f525", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:14:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Releasing lock "refresh_cache-637e2b9b-9777-487f-8131-bdfcd520b2cf" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:14:09 user nova-compute[74743]: DEBUG nova.compute.manager [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Instance network_info: |[{"id": "516dfceb-fc7a-43ad-b874-1eb33cc0f525", "address": "fa:16:3e:82:84:7a", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap516dfceb-fc", "ovs_interfaceid": "516dfceb-fc7a-43ad-b874-1eb33cc0f525", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 17:14:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-79c650f8-aeac-4f5f-8ac0-f64777a0de82 req-b7a3b5b7-a858-4dfd-8655-1e5bd9e07890 service nova] Acquired lock "refresh_cache-637e2b9b-9777-487f-8131-bdfcd520b2cf" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:14:09 user nova-compute[74743]: DEBUG nova.network.neutron [req-79c650f8-aeac-4f5f-8ac0-f64777a0de82 req-b7a3b5b7-a858-4dfd-8655-1e5bd9e07890 service nova] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Refreshing network info cache for port 516dfceb-fc7a-43ad-b874-1eb33cc0f525 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:14:09 user nova-compute[74743]: DEBUG nova.network.neutron [req-79c650f8-aeac-4f5f-8ac0-f64777a0de82 req-b7a3b5b7-a858-4dfd-8655-1e5bd9e07890 service nova] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Updated VIF entry in instance network info cache for port 516dfceb-fc7a-43ad-b874-1eb33cc0f525. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:14:09 user nova-compute[74743]: DEBUG nova.network.neutron [req-79c650f8-aeac-4f5f-8ac0-f64777a0de82 req-b7a3b5b7-a858-4dfd-8655-1e5bd9e07890 service nova] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Updating instance_info_cache with network_info: [{"id": "516dfceb-fc7a-43ad-b874-1eb33cc0f525", "address": "fa:16:3e:82:84:7a", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap516dfceb-fc", "ovs_interfaceid": "516dfceb-fc7a-43ad-b874-1eb33cc0f525", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:14:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-79c650f8-aeac-4f5f-8ac0-f64777a0de82 req-b7a3b5b7-a858-4dfd-8655-1e5bd9e07890 service nova] Releasing lock "refresh_cache-637e2b9b-9777-487f-8131-bdfcd520b2cf" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:14:09 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:14:10 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-36bf14aa-8502-45f1-9944-947bb9d275c0 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 180f2f7e-9df5-480f-adde-d8e10ee14b07 is timed out.
Nov 18 17:14:10 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-36bf14aa-8502-45f1-9944-947bb9d275c0 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Successfully detached device vdb from instance 180f2f7e-9df5-480f-adde-d8e10ee14b07 from the live domain config.
Nov 18 17:14:10 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36bf14aa-8502-45f1-9944-947bb9d275c0 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] calling os-brick to detach iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 17:14:10 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36bf14aa-8502-45f1-9944-947bb9d275c0 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, {'target_iqn': 'iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mtMefBUJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:14:10 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-36bf14aa-8502-45f1-9944-947bb9d275c0 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:14:10 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-36bf14aa-8502-45f1-9944-947bb9d275c0 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:14:10 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-36bf14aa-8502-45f1-9944-947bb9d275c0 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:14:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:10 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f65d56-20ee-44fb-8a9f-14152ce43c64]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:14:10 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36bf14aa-8502-45f1-9944-947bb9d275c0 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 17:14:10 user nova-compute[74743]: No targets found.
Nov 18 17:14:10 user nova-compute[74743]: iSNS:
Nov 18 17:14:10 user nova-compute[74743]: No targets found.
Nov 18 17:14:10 user nova-compute[74743]: STATIC:
Nov 18 17:14:10 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5
Nov 18 17:14:10 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:14:10 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:14:10 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127
Nov 18 17:14:10 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:14:10 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:14:10 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686
Nov 18 17:14:10 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:14:10 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:14:10 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685
Nov 18 17:14:10 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:14:10 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:14:10 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5
Nov 18 17:14:10 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:14:10 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:14:10 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f
Nov 18 17:14:10 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:14:10 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:14:10 user nova-compute[74743]: FIRMWARE:
Nov 18 17:14:10 user nova-compute[74743]: No targets found.
Nov 18 17:14:10 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:14:10 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36bf14aa-8502-45f1-9944-947bb9d275c0 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 17:14:10 user nova-compute[74743]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 17:14:10 user nova-compute[74743]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74743) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 17:14:10 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36bf14aa-8502-45f1-9944-947bb9d275c0 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686', 0)] {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 17:14:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:10 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e08813f-6946-481a-8f38-4ef3b8dd2d0e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:14:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:10 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[62035073-0ea9-4fb5-87aa-7cdd78abc84e]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:14:10 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36bf14aa-8502-45f1-9944-947bb9d275c0 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:14:10 user nova-compute[74743]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686 (non-flash)
Nov 18 17:14:10 user nova-compute[74743]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:14:10 user nova-compute[74743]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)
Nov 18 17:14:10 user nova-compute[74743]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:14:10 user nova-compute[74743]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f (non-flash)
Nov 18 17:14:10 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:14:10 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36bf14aa-8502-45f1-9944-947bb9d275c0 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:14:10 user nova-compute[74743]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686 (non-flash)
Nov 18 17:14:10 user nova-compute[74743]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:14:10 user nova-compute[74743]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)
Nov 18 17:14:10 user nova-compute[74743]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:14:10 user nova-compute[74743]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f (non-flash)
Nov 18 17:14:10 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:14:10 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36bf14aa-8502-45f1-9944-947bb9d275c0 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb282f32e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686'): ({'sdb'}, set())}) {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 17:14:10 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-36bf14aa-8502-45f1-9944-947bb9d275c0 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Removing single pathed devices sdb {{(pid=74743) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 17:14:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:10 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdfa525a-09bd-4761-8fe9-fa66d4dedecb]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:14:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:10 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e37c3c-4451-42d5-b817-9d3d16624caf]: (4, ('ok\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:14:10 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-36bf14aa-8502-45f1-9944-947bb9d275c0 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Flushing IO for device /dev/sdb {{(pid=74743) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 17:14:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:10 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e6272f-d2a6-4db6-bfa3-3d60a6d65d9e]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:14:10 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-36bf14aa-8502-45f1-9944-947bb9d275c0 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74743) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 17:14:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:10 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd95524-5a8b-492f-936c-2e78a1d66f0a]: (4, ('1', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:14:10 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-36bf14aa-8502-45f1-9944-947bb9d275c0 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 17:14:10 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-36bf14aa-8502-45f1-9944-947bb9d275c0 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] SCSI volumes sdb have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 17:14:10 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36bf14aa-8502-45f1-9944-947bb9d275c0 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686')] {{(pid=74743) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 17:14:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:10 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5edad8-9766-4d55-9a98-7c278a98f8ef]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:14:10 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36bf14aa-8502-45f1-9944-947bb9d275c0 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:14:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686 -p 172.16.0.220:3260 --logout {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:10 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[750271f3-21a9-4dc3-b98e-c98fc053727e]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:14:10 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36bf14aa-8502-45f1-9944-947bb9d275c0 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686, portal: 172.16.0.220,3260]
Nov 18 17:14:10 user nova-compute[74743]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686, portal: 172.16.0.220,3260] successful.
Nov 18 17:14:10 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:14:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686 -p 172.16.0.220:3260 --op delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:10 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef14b19d-547d-4258-b1ed-32c9a06ac131]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:14:10 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36bf14aa-8502-45f1-9944-947bb9d275c0 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:14:10 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-36bf14aa-8502-45f1-9944-947bb9d275c0 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:14:10 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-36bf14aa-8502-45f1-9944-947bb9d275c0 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] <== disconnect_volume: return (301ms) None {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:14:10 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36bf14aa-8502-45f1-9944-947bb9d275c0 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Disconnected iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 17:14:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:14:11 user nova-compute[74743]: DEBUG nova.objects.instance [None req-36bf14aa-8502-45f1-9944-947bb9d275c0 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lazy-loading 'flavor' on Instance uuid 180f2f7e-9df5-480f-adde-d8e10ee14b07 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:14:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-36bf14aa-8502-45f1-9944-947bb9d275c0 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "180f2f7e-9df5-480f-adde-d8e10ee14b07" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.793s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:14:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ccb0f585-3f12-4eae-8f2d-7e48fc034060 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "180f2f7e-9df5-480f-adde-d8e10ee14b07" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.669s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:14:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ccb0f585-3f12-4eae-8f2d-7e48fc034060 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Acquiring lock "180f2f7e-9df5-480f-adde-d8e10ee14b07-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:14:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ccb0f585-3f12-4eae-8f2d-7e48fc034060 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "180f2f7e-9df5-480f-adde-d8e10ee14b07-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:14:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ccb0f585-3f12-4eae-8f2d-7e48fc034060 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "180f2f7e-9df5-480f-adde-d8e10ee14b07-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:14:11 user nova-compute[74743]: INFO nova.compute.manager [None req-ccb0f585-3f12-4eae-8f2d-7e48fc034060 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Terminating instance
Nov 18 17:14:11 user nova-compute[74743]: DEBUG nova.compute.manager [None req-ccb0f585-3f12-4eae-8f2d-7e48fc034060 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Start destroying the instance on the hypervisor. {{(pid=74743) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 17:14:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:14:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:14:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:14:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:14:11 user nova-compute[74743]: DEBUG nova.compute.manager [req-59edcc87-2fc2-4f42-8f0e-dce02d7b90ae req-e814f2f3-235f-4d76-932f-a96c03fad827 service nova] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Received event network-vif-unplugged-ba661621-6683-462f-ba90-5de9da77c1a3 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:14:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-59edcc87-2fc2-4f42-8f0e-dce02d7b90ae req-e814f2f3-235f-4d76-932f-a96c03fad827 service nova] Acquiring lock "180f2f7e-9df5-480f-adde-d8e10ee14b07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:14:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-59edcc87-2fc2-4f42-8f0e-dce02d7b90ae req-e814f2f3-235f-4d76-932f-a96c03fad827 service nova] Lock "180f2f7e-9df5-480f-adde-d8e10ee14b07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:14:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-59edcc87-2fc2-4f42-8f0e-dce02d7b90ae req-e814f2f3-235f-4d76-932f-a96c03fad827 service nova] Lock "180f2f7e-9df5-480f-adde-d8e10ee14b07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:14:11 user nova-compute[74743]: DEBUG nova.compute.manager [req-59edcc87-2fc2-4f42-8f0e-dce02d7b90ae req-e814f2f3-235f-4d76-932f-a96c03fad827 service nova] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] No waiting events found dispatching network-vif-unplugged-ba661621-6683-462f-ba90-5de9da77c1a3 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:14:11 user nova-compute[74743]: DEBUG nova.compute.manager [req-59edcc87-2fc2-4f42-8f0e-dce02d7b90ae req-e814f2f3-235f-4d76-932f-a96c03fad827 service nova] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Received event network-vif-unplugged-ba661621-6683-462f-ba90-5de9da77c1a3 for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:14:11 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:14:11 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Cleaning up deleted instances {{(pid=74743) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 18 17:14:11 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] There are 0 instances to clean {{(pid=74743) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 18 17:14:11 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Instance destroyed successfully.
Nov 18 17:14:11 user nova-compute[74743]: DEBUG nova.objects.instance [None req-ccb0f585-3f12-4eae-8f2d-7e48fc034060 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lazy-loading 'resources' on Instance uuid 180f2f7e-9df5-480f-adde-d8e10ee14b07 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:14:11 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-ccb0f585-3f12-4eae-8f2d-7e48fc034060 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:11:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-734211408',display_name='tempest-VolumesSnapshotTestJSON-instance-734211408',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-734211408',id=25,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlAxUA0RbCbI8SGx7xgkWEg4DLVYjb03OqLFipKjYIXFH34rBAR7hCH4LKdisTnMhSc91fec7waeCXYKiCo05BCIDtkfDC18gGGtJJui/2LUNRPFqxQSGXhkQMXSnh55Q==',key_name='tempest-keypair-849319058',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:11:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4468d0e7ff32423091ecc55d82deba1c',ramdisk_id='',reservation_id='r-mg9uhpwj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1394839673',owner_user_name='tempest-VolumesSnapshotTestJSON-1394839673-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:11:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='351aa457efdc463b95a4c837d26cd23f',uuid=180f2f7e-9df5-480f-adde-d8e10ee14b07,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba661621-6683-462f-ba90-5de9da77c1a3", "address": "fa:16:3e:4a:ca:b3", "network": {"id": "2588909e-8504-407d-bc7b-5d1f3d978395", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1712970821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468d0e7ff32423091ecc55d82deba1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba661621-66", "ovs_interfaceid": "ba661621-6683-462f-ba90-5de9da77c1a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:14:11 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-ccb0f585-3f12-4eae-8f2d-7e48fc034060 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Converting VIF {"id": "ba661621-6683-462f-ba90-5de9da77c1a3", "address": "fa:16:3e:4a:ca:b3", "network": {"id": "2588909e-8504-407d-bc7b-5d1f3d978395", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1712970821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4468d0e7ff32423091ecc55d82deba1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba661621-66", "ovs_interfaceid": "ba661621-6683-462f-ba90-5de9da77c1a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:14:11 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-ccb0f585-3f12-4eae-8f2d-7e48fc034060 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:ca:b3,bridge_name='br-int',has_traffic_filtering=True,id=ba661621-6683-462f-ba90-5de9da77c1a3,network=Network(2588909e-8504-407d-bc7b-5d1f3d978395),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba661621-66') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:14:11 user nova-compute[74743]: DEBUG os_vif [None req-ccb0f585-3f12-4eae-8f2d-7e48fc034060 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:ca:b3,bridge_name='br-int',has_traffic_filtering=True,id=ba661621-6683-462f-ba90-5de9da77c1a3,network=Network(2588909e-8504-407d-bc7b-5d1f3d978395),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba661621-66') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:14:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:14:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba661621-66, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:14:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:14:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:14:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:14:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7a7a5e03-a0e1-4e8e-bb25-39cd68464bfd) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:14:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:14:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:14:11 user nova-compute[74743]: INFO os_vif [None req-ccb0f585-3f12-4eae-8f2d-7e48fc034060 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:ca:b3,bridge_name='br-int',has_traffic_filtering=True,id=ba661621-6683-462f-ba90-5de9da77c1a3,network=Network(2588909e-8504-407d-bc7b-5d1f3d978395),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba661621-66')
Nov 18 17:14:11 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccb0f585-3f12-4eae-8f2d-7e48fc034060 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] calling os-brick to detach iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 17:14:11 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb0f585-3f12-4eae-8f2d-7e48fc034060 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, {'target_iqn': 'iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mtMefBUJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:14:11 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-ccb0f585-3f12-4eae-8f2d-7e48fc034060 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:14:11 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-ccb0f585-3f12-4eae-8f2d-7e48fc034060 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:14:11 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-ccb0f585-3f12-4eae-8f2d-7e48fc034060 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:14:11 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:11 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:11 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12b1e67-bc32-460f-8e64-fd6586c6db11]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:14:11 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb0f585-3f12-4eae-8f2d-7e48fc034060 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 17:14:11 user nova-compute[74743]: No targets found.
Nov 18 17:14:11 user nova-compute[74743]: iSNS:
Nov 18 17:14:11 user nova-compute[74743]: No targets found.
Nov 18 17:14:11 user nova-compute[74743]: STATIC:
Nov 18 17:14:11 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5
Nov 18 17:14:11 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:14:11 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:14:11 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127
Nov 18 17:14:11 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:14:11 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:14:11 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685
Nov 18 17:14:11 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:14:11 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:14:11 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5
Nov 18 17:14:11 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:14:11 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:14:11 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f
Nov 18 17:14:11 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:14:11 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:14:11 user nova-compute[74743]: FIRMWARE:
Nov 18 17:14:11 user nova-compute[74743]: No targets found.
Nov 18 17:14:11 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:14:11 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb0f585-3f12-4eae-8f2d-7e48fc034060 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 17:14:11 user nova-compute[74743]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 17:14:11 user nova-compute[74743]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74743) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 17:14:11 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb0f585-3f12-4eae-8f2d-7e48fc034060 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f0ecae7-9091-4cb2-8758-d5f683dd3686', 0)] {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 17:14:11 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:11 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:11 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82d0d24-a84e-466a-b782-758efaf5fedd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:14:11 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:11 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:11 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f3a59e-af8d-40b9-84a1-03e1e1edbca0]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:14:11 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb0f585-3f12-4eae-8f2d-7e48fc034060 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:14:11 user nova-compute[74743]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:14:11 user nova-compute[74743]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)
Nov 18 17:14:11 user nova-compute[74743]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:14:11 user nova-compute[74743]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f (non-flash)
Nov 18 17:14:11 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:14:11 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb0f585-3f12-4eae-8f2d-7e48fc034060 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:14:11 user nova-compute[74743]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:14:11 user nova-compute[74743]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)
Nov 18 17:14:11 user nova-compute[74743]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:14:11 user nova-compute[74743]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f (non-flash)
Nov 18 17:14:11 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:14:11 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb0f585-3f12-4eae-8f2d-7e48fc034060 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb28446dd0>, {}) {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 17:14:11 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb0f585-3f12-4eae-8f2d-7e48fc034060 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Disconnecting from: [] {{(pid=74743) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 17:14:11 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-ccb0f585-3f12-4eae-8f2d-7e48fc034060 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.073s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:14:11 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb0f585-3f12-4eae-8f2d-7e48fc034060 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] <== disconnect_volume: return (74ms) None {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:14:11 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccb0f585-3f12-4eae-8f2d-7e48fc034060 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Disconnected iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 17:14:11 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-ccb0f585-3f12-4eae-8f2d-7e48fc034060 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Deleting instance files /opt/stack/data/nova/instances/180f2f7e-9df5-480f-adde-d8e10ee14b07_del
Nov 18 17:14:11 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-ccb0f585-3f12-4eae-8f2d-7e48fc034060 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Deletion of /opt/stack/data/nova/instances/180f2f7e-9df5-480f-adde-d8e10ee14b07_del complete
Nov 18 17:14:12 user nova-compute[74743]: INFO nova.compute.manager [None req-ccb0f585-3f12-4eae-8f2d-7e48fc034060 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 18 17:14:12 user nova-compute[74743]: DEBUG oslo.service.loopingcall [None req-ccb0f585-3f12-4eae-8f2d-7e48fc034060 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74743) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 17:14:12 user nova-compute[74743]: DEBUG nova.compute.manager [-] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Deallocating network for instance {{(pid=74743) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 17:14:12 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] deallocate_for_instance() {{(pid=74743) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 17:14:12 user nova-compute[74743]: DEBUG os_brick.utils [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:14:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:12 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77925f8-7377-42fc-9803-d45531caa1c3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1116acd8874d\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:14:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:12 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[2734b240-90f7-494d-9a7a-27db2dbb2db9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:14:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:12 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[1834e8ee-23d5-442b-9bbe-d2d4294ea5ea]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:14:12 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee2ada5-74ee-42bc-8563-0ced7147484c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:14:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Running cmd (subprocess): nvme version {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] 'nvme version' failed. Not Retrying. {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:14:12 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.nvmeof [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] nvme not present on system {{(pid=74743) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 17:14:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:14:12 user nova-compute[74743]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 17:14:12 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[685681b6-92a6-4722-9e42-a6763bd49bf6]: (4, '') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:14:12 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74743) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 17:14:12 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 17:14:12 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] LIGHTOS: no hostnqn found. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 17:14:12 user nova-compute[74743]: DEBUG os_brick.utils [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1116acd8874d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:14:12 user nova-compute[74743]: DEBUG nova.virt.block_device [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Updating existing volume attachment record: 7afcb69c-8b34-4beb-9c7c-3e8516a7c356 {{(pid=74743) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 17:14:12 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:14:13 user nova-compute[74743]: DEBUG nova.compute.manager [req-e8152314-d6bd-4b8e-ac45-42d8549a7276 req-b54693cb-6d5d-4c52-8743-4f8f3cfb1dd4 service nova] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Received event network-vif-deleted-ba661621-6683-462f-ba90-5de9da77c1a3 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:14:13 user nova-compute[74743]: INFO nova.compute.manager [req-e8152314-d6bd-4b8e-ac45-42d8549a7276 req-b54693cb-6d5d-4c52-8743-4f8f3cfb1dd4 service nova] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Neutron deleted interface ba661621-6683-462f-ba90-5de9da77c1a3; detaching it from the instance and deleting it from the info cache
Nov 18 17:14:13 user nova-compute[74743]: DEBUG nova.network.neutron [req-e8152314-d6bd-4b8e-ac45-42d8549a7276 req-b54693cb-6d5d-4c52-8743-4f8f3cfb1dd4 service nova] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:14:13 user nova-compute[74743]: INFO nova.compute.manager [-] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Took 0.96 seconds to deallocate network for instance.
Nov 18 17:14:13 user nova-compute[74743]: DEBUG nova.compute.manager [req-e8152314-d6bd-4b8e-ac45-42d8549a7276 req-b54693cb-6d5d-4c52-8743-4f8f3cfb1dd4 service nova] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Detach interface failed, port_id=ba661621-6683-462f-ba90-5de9da77c1a3, reason: Instance 180f2f7e-9df5-480f-adde-d8e10ee14b07 could not be found. {{(pid=74743) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 17:14:13 user nova-compute[74743]: WARNING nova.volume.cinder [None req-ccb0f585-3f12-4eae-8f2d-7e48fc034060 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Attachment c99c9932-d9f0-4ad8-8f30-a8934ff02541 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = c99c9932-d9f0-4ad8-8f30-a8934ff02541. (HTTP 404) (Request-ID: req-ea4b923f-6ac1-4671-9b7a-95d12f6c65db)
Nov 18 17:14:13 user nova-compute[74743]: INFO nova.compute.manager [None req-ccb0f585-3f12-4eae-8f2d-7e48fc034060 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Took 0.03 seconds to detach 1 volumes for instance.
Nov 18 17:14:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ccb0f585-3f12-4eae-8f2d-7e48fc034060 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:14:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ccb0f585-3f12-4eae-8f2d-7e48fc034060 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:14:13 user nova-compute[74743]: DEBUG nova.compute.manager [req-6b69be90-9d79-4490-a778-1aff32ad6fc0 req-23d5fdd3-24dd-4adf-980a-440379c12761 service nova] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Received event network-vif-plugged-ba661621-6683-462f-ba90-5de9da77c1a3 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:14:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-6b69be90-9d79-4490-a778-1aff32ad6fc0 req-23d5fdd3-24dd-4adf-980a-440379c12761 service nova] Acquiring lock "180f2f7e-9df5-480f-adde-d8e10ee14b07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:14:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-6b69be90-9d79-4490-a778-1aff32ad6fc0 req-23d5fdd3-24dd-4adf-980a-440379c12761 service nova] Lock "180f2f7e-9df5-480f-adde-d8e10ee14b07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:14:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-6b69be90-9d79-4490-a778-1aff32ad6fc0 req-23d5fdd3-24dd-4adf-980a-440379c12761 service nova] Lock "180f2f7e-9df5-480f-adde-d8e10ee14b07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:14:13 user nova-compute[74743]: DEBUG nova.compute.manager [req-6b69be90-9d79-4490-a778-1aff32ad6fc0 req-23d5fdd3-24dd-4adf-980a-440379c12761 service nova] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] No waiting events found dispatching network-vif-plugged-ba661621-6683-462f-ba90-5de9da77c1a3 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:14:13 user nova-compute[74743]: WARNING nova.compute.manager [req-6b69be90-9d79-4490-a778-1aff32ad6fc0 req-23d5fdd3-24dd-4adf-980a-440379c12761 service nova] [instance: 180f2f7e-9df5-480f-adde-d8e10ee14b07] Received unexpected event network-vif-plugged-ba661621-6683-462f-ba90-5de9da77c1a3 for instance with vm_state deleted and task_state None.
Nov 18 17:14:13 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:14:13 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-ccb0f585-3f12-4eae-8f2d-7e48fc034060 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:14:13 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-ccb0f585-3f12-4eae-8f2d-7e48fc034060 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:14:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ccb0f585-3f12-4eae-8f2d-7e48fc034060 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.514s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:14:13 user nova-compute[74743]: INFO nova.scheduler.client.report [None req-ccb0f585-3f12-4eae-8f2d-7e48fc034060 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Deleted allocations for instance 180f2f7e-9df5-480f-adde-d8e10ee14b07
Nov 18 17:14:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ccb0f585-3f12-4eae-8f2d-7e48fc034060 tempest-VolumesSnapshotTestJSON-1394839673 tempest-VolumesSnapshotTestJSON-1394839673-project-member] Lock "180f2f7e-9df5-480f-adde-d8e10ee14b07" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.669s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:14:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:14:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG nova.compute.manager [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Start spawning the instance on the hypervisor. {{(pid=74743) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Creating instance directory {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 17:14:18 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Creating image(s)
Nov 18 17:14:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Did not create local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Ensure instance console log exists: /opt/stack/data/nova/instances/637e2b9b-9777-487f-8131-bdfcd520b2cf/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Start _get_guest_xml network_info=[{"id": "516dfceb-fc7a-43ad-b874-1eb33cc0f525", "address": "fa:16:3e:82:84:7a", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap516dfceb-fc", "ovs_interfaceid": "516dfceb-fc7a-43ad-b874-1eb33cc0f525", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-18T17:14:01Z,direct_url=<?>,disk_format='qcow2',id=5181ad90-8e75-4121-94bf-097b312f8116,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1061678240',owner='a956c4d6e4304d34872ecf989279c886',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-18T17:14:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '7afcb69c-8b34-4beb-9c7c-3e8516a7c356', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZilkWBbT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '637e2b9b-9777-487f-8131-bdfcd520b2cf', 'attached_at': '', 'detached_at': '', 'volume_id': '859c2504-cec5-4bc7-a314-365fe200485f', 'serial': '859c2504-cec5-4bc7-a314-365fe200485f'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:14:18 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:14:18 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:14:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-18T17:14:01Z,direct_url=<?>,disk_format='qcow2',id=5181ad90-8e75-4121-94bf-097b312f8116,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1061678240',owner='a956c4d6e4304d34872ecf989279c886',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-18T17:14:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Calling os-brick to attach iSCSI Volume {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZilkWBbT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:14:18 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:14:18 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:14:18 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:14:18 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:14:18 user nova-compute[74743]: INFO os_brick.initiator.connectors.iscsi [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 17:14:18 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f -p 172.16.0.220:3260 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a0817e-6bf7-4f48-8a85-a383e065c4f8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 17:14:18 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f -p 172.16.0.220:3260 --interface default --op new {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[274bac2d-e7cc-48df-817f-028972173556]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f] added\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f] added
Nov 18 17:14:18 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb17884a-6901-4afc-b96f-7bdb19ae68d9]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d0c27b-4320-4cba-94ce-b73da9e82efd]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZilkWBbT {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZilkWBbT" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26eae65-f488-4f0a-b2d0-ca89b3dbba40]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZilkWBbT'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ad5bd5-4477-4aaa-8b90-d65675f40afe]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[32273d86-6039-48d5-a7f2-815d31f6f232]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:14:18 user nova-compute[74743]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:14:18 user nova-compute[74743]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)
Nov 18 17:14:18 user nova-compute[74743]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:14:18 user nova-compute[74743]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f (non-flash)
Nov 18 17:14:18 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:14:18 user nova-compute[74743]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:14:18 user nova-compute[74743]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)
Nov 18 17:14:18 user nova-compute[74743]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:14:18 user nova-compute[74743]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f (non-flash)
Nov 18 17:14:18 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f -p 172.16.0.220:3260 --login {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe25854-f15e-44bb-9062-1d1c7ee32e7c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f, portal: 172.16.0.220,3260]
Nov 18 17:14:18 user nova-compute[74743]: Login to [iface: default, target: iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f, portal: 172.16.0.220,3260] successful.
Nov 18 17:14:18 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[afab1205-7a76-4a9b-9b82-d1c6e1120013]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3fcac3-6c03-4687-b195-18c20911a683]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:14:18 user nova-compute[74743]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:14:18 user nova-compute[74743]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)
Nov 18 17:14:18 user nova-compute[74743]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:14:18 user nova-compute[74743]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f (non-flash)
Nov 18 17:14:18 user nova-compute[74743]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f (non-flash)
Nov 18 17:14:18 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:14:18 user nova-compute[74743]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:14:18 user nova-compute[74743]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)
Nov 18 17:14:18 user nova-compute[74743]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:14:18 user nova-compute[74743]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f (non-flash)
Nov 18 17:14:18 user nova-compute[74743]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f (non-flash)
Nov 18 17:14:18 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Connected to 172.16.0.220:3260 {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] HCTL ('33', '-', '-', 0) found on session 36 with lun 0 {{(pid=74743) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74743) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[527735a3-cdc0-4c23-a5ce-8c40ab977c66]: (4, ('- - 0', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:14:18 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: None {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:14:19 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:14:19 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZilkWBbT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 17:14:19 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:14:19 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23233623463363938', 'path': '/dev/sdb'} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:14:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233623463363938', 'path': '/dev/sdb'} {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 17:14:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:14:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-647896724',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-647896724',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-647896724',id=30,image_ref='5181ad90-8e75-4121-94bf-097b312f8116',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9sY+e7+bXx7xx657lpp9T9wkaGY6OdXVIAxHFvlWLceFpLKLkG6qJH1tRzTNXnc4vahxl8bKQIP4LMaCexomCLKj7UapHmG4YvWAj0rqepU94udslF0FrvLYpXl+MIqw==',key_name='tempest-keypair-1816661825',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a956c4d6e4304d34872ecf989279c886',ramdisk_id='',reservation_id='r-usntrsyc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1373443944',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1373443944-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1373443944',owner_user_name='tempest-TestVolumeBootPattern-1373443944-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:14:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89ce0d4bf7234c348b9b1a8979609c7b',uuid=637e2b9b-9777-487f-8131-bdfcd520b2cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "516dfceb-fc7a-43ad-b874-1eb33cc0f525", "address": "fa:16:3e:82:84:7a", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap516dfceb-fc", "ovs_interfaceid": "516dfceb-fc7a-43ad-b874-1eb33cc0f525", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:14:19 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Converting VIF {"id": "516dfceb-fc7a-43ad-b874-1eb33cc0f525", "address": "fa:16:3e:82:84:7a", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap516dfceb-fc", "ovs_interfaceid": "516dfceb-fc7a-43ad-b874-1eb33cc0f525", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:14:19 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:84:7a,bridge_name='br-int',has_traffic_filtering=True,id=516dfceb-fc7a-43ad-b874-1eb33cc0f525,network=Network(fc55f18a-b779-4b04-8828-278ecd62211a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap516dfceb-fc') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:14:19 user nova-compute[74743]: DEBUG nova.objects.instance [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lazy-loading 'pci_devices' on Instance uuid 637e2b9b-9777-487f-8131-bdfcd520b2cf {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:14:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:14:19 user nova-compute[74743]:   <uuid>637e2b9b-9777-487f-8131-bdfcd520b2cf</uuid>
Nov 18 17:14:19 user nova-compute[74743]:   <name>instance-0000001e</name>
Nov 18 17:14:19 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:14:19 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:14:19 user nova-compute[74743]:   <metadata>
Nov 18 17:14:19 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:14:19 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:14:19 user nova-compute[74743]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-647896724</nova:name>
Nov 18 17:14:19 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:14:18</nova:creationTime>
Nov 18 17:14:19 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:14:19 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:14:19 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:14:19 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:14:19 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:14:19 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:14:19 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:14:19 user nova-compute[74743]:       <nova:owner>
Nov 18 17:14:19 user nova-compute[74743]:         <nova:user uuid="89ce0d4bf7234c348b9b1a8979609c7b">tempest-TestVolumeBootPattern-1373443944-project-member</nova:user>
Nov 18 17:14:19 user nova-compute[74743]:         <nova:project uuid="a956c4d6e4304d34872ecf989279c886">tempest-TestVolumeBootPattern-1373443944</nova:project>
Nov 18 17:14:19 user nova-compute[74743]:       </nova:owner>
Nov 18 17:14:19 user nova-compute[74743]:       <nova:root type="image" uuid="5181ad90-8e75-4121-94bf-097b312f8116"/>
Nov 18 17:14:19 user nova-compute[74743]:       <nova:ports>
Nov 18 17:14:19 user nova-compute[74743]:         <nova:port uuid="516dfceb-fc7a-43ad-b874-1eb33cc0f525">
Nov 18 17:14:19 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 18 17:14:19 user nova-compute[74743]:         </nova:port>
Nov 18 17:14:19 user nova-compute[74743]:       </nova:ports>
Nov 18 17:14:19 user nova-compute[74743]:     </nova:instance>
Nov 18 17:14:19 user nova-compute[74743]:   </metadata>
Nov 18 17:14:19 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:14:19 user nova-compute[74743]:     <system>
Nov 18 17:14:19 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:14:19 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:14:19 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:14:19 user nova-compute[74743]:       <entry name="serial">637e2b9b-9777-487f-8131-bdfcd520b2cf</entry>
Nov 18 17:14:19 user nova-compute[74743]:       <entry name="uuid">637e2b9b-9777-487f-8131-bdfcd520b2cf</entry>
Nov 18 17:14:19 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:14:19 user nova-compute[74743]:     </system>
Nov 18 17:14:19 user nova-compute[74743]:   </sysinfo>
Nov 18 17:14:19 user nova-compute[74743]:   <os>
Nov 18 17:14:19 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:14:19 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:14:19 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:14:19 user nova-compute[74743]:   </os>
Nov 18 17:14:19 user nova-compute[74743]:   <features>
Nov 18 17:14:19 user nova-compute[74743]:     <acpi/>
Nov 18 17:14:19 user nova-compute[74743]:     <apic/>
Nov 18 17:14:19 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:14:19 user nova-compute[74743]:   </features>
Nov 18 17:14:19 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:14:19 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:14:19 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:14:19 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:14:19 user nova-compute[74743]:   </clock>
Nov 18 17:14:19 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:14:19 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:14:19 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:14:19 user nova-compute[74743]:   </cpu>
Nov 18 17:14:19 user nova-compute[74743]:   <devices>
Nov 18 17:14:19 user nova-compute[74743]:     <disk type="block" device="disk">
Nov 18 17:14:19 user nova-compute[74743]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:14:19 user nova-compute[74743]:       <source dev="/dev/sdb"/>
Nov 18 17:14:19 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:14:19 user nova-compute[74743]:       <serial>859c2504-cec5-4bc7-a314-365fe200485f</serial>
Nov 18 17:14:19 user nova-compute[74743]:     </disk>
Nov 18 17:14:19 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:14:19 user nova-compute[74743]:       <mac address="fa:16:3e:82:84:7a"/>
Nov 18 17:14:19 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:14:19 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:14:19 user nova-compute[74743]:       <target dev="tap516dfceb-fc"/>
Nov 18 17:14:19 user nova-compute[74743]:     </interface>
Nov 18 17:14:19 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:14:19 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/637e2b9b-9777-487f-8131-bdfcd520b2cf/console.log" append="off"/>
Nov 18 17:14:19 user nova-compute[74743]:     </serial>
Nov 18 17:14:19 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:14:19 user nova-compute[74743]:     <video>
Nov 18 17:14:19 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:14:19 user nova-compute[74743]:     </video>
Nov 18 17:14:19 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:14:19 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:14:19 user nova-compute[74743]:     </rng>
Nov 18 17:14:19 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:14:19 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:14:19 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:14:19 user nova-compute[74743]:     </memballoon>
Nov 18 17:14:19 user nova-compute[74743]:   </devices>
Nov 18 17:14:19 user nova-compute[74743]: </domain>
Nov 18 17:14:19 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:14:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:14:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-647896724',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-647896724',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-647896724',id=30,image_ref='5181ad90-8e75-4121-94bf-097b312f8116',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9sY+e7+bXx7xx657lpp9T9wkaGY6OdXVIAxHFvlWLceFpLKLkG6qJH1tRzTNXnc4vahxl8bKQIP4LMaCexomCLKj7UapHmG4YvWAj0rqepU94udslF0FrvLYpXl+MIqw==',key_name='tempest-keypair-1816661825',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a956c4d6e4304d34872ecf989279c886',ramdisk_id='',reservation_id='r-usntrsyc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1373443944',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1373443944-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1373443944',owner_user_name='tempest-TestVolumeBootPattern-1373443944-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:14:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89ce0d4bf7234c348b9b1a8979609c7b',uuid=637e2b9b-9777-487f-8131-bdfcd520b2cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "516dfceb-fc7a-43ad-b874-1eb33cc0f525", "address": "fa:16:3e:82:84:7a", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap516dfceb-fc", "ovs_interfaceid": "516dfceb-fc7a-43ad-b874-1eb33cc0f525", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:14:19 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Converting VIF {"id": "516dfceb-fc7a-43ad-b874-1eb33cc0f525", "address": "fa:16:3e:82:84:7a", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap516dfceb-fc", "ovs_interfaceid": "516dfceb-fc7a-43ad-b874-1eb33cc0f525", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:14:19 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:84:7a,bridge_name='br-int',has_traffic_filtering=True,id=516dfceb-fc7a-43ad-b874-1eb33cc0f525,network=Network(fc55f18a-b779-4b04-8828-278ecd62211a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap516dfceb-fc') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:14:19 user nova-compute[74743]: DEBUG os_vif [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:84:7a,bridge_name='br-int',has_traffic_filtering=True,id=516dfceb-fc7a-43ad-b874-1eb33cc0f525,network=Network(fc55f18a-b779-4b04-8828-278ecd62211a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap516dfceb-fc') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:14:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:14:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:14:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:14:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:14:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8ace586a-ebd9-5e57-94e6-6d55ee837d57', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:14:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:14:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:14:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap516dfceb-fc, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:14:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap516dfceb-fc, col_values=(('qos', UUID('cb888ec3-0a82-45b4-b9fb-9caa4b722490')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:14:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap516dfceb-fc, col_values=(('external_ids', {'iface-id': '516dfceb-fc7a-43ad-b874-1eb33cc0f525', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:84:7a', 'vm-uuid': '637e2b9b-9777-487f-8131-bdfcd520b2cf'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:14:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:14:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:14:19 user nova-compute[74743]: INFO os_vif [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:84:7a,bridge_name='br-int',has_traffic_filtering=True,id=516dfceb-fc7a-43ad-b874-1eb33cc0f525,network=Network(fc55f18a-b779-4b04-8828-278ecd62211a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap516dfceb-fc')
Nov 18 17:14:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:14:20 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:14:20 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] No VIF found with MAC fa:16:3e:82:84:7a, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:14:20 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:14:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:14:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:14:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:14:21 user nova-compute[74743]: DEBUG nova.compute.manager [req-3ba973a4-7216-43bf-a6f9-f8b22fd482cb req-869e9d93-4e7e-4a76-b45a-6342257d5080 service nova] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Received event network-vif-plugged-516dfceb-fc7a-43ad-b874-1eb33cc0f525 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:14:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3ba973a4-7216-43bf-a6f9-f8b22fd482cb req-869e9d93-4e7e-4a76-b45a-6342257d5080 service nova] Acquiring lock "637e2b9b-9777-487f-8131-bdfcd520b2cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:14:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3ba973a4-7216-43bf-a6f9-f8b22fd482cb req-869e9d93-4e7e-4a76-b45a-6342257d5080 service nova] Lock "637e2b9b-9777-487f-8131-bdfcd520b2cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:14:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3ba973a4-7216-43bf-a6f9-f8b22fd482cb req-869e9d93-4e7e-4a76-b45a-6342257d5080 service nova] Lock "637e2b9b-9777-487f-8131-bdfcd520b2cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:14:21 user nova-compute[74743]: DEBUG nova.compute.manager [req-3ba973a4-7216-43bf-a6f9-f8b22fd482cb req-869e9d93-4e7e-4a76-b45a-6342257d5080 service nova] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] No waiting events found dispatching network-vif-plugged-516dfceb-fc7a-43ad-b874-1eb33cc0f525 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:14:21 user nova-compute[74743]: WARNING nova.compute.manager [req-3ba973a4-7216-43bf-a6f9-f8b22fd482cb req-869e9d93-4e7e-4a76-b45a-6342257d5080 service nova] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Received unexpected event network-vif-plugged-516dfceb-fc7a-43ad-b874-1eb33cc0f525 for instance with vm_state building and task_state spawning.
Nov 18 17:14:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:14:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:14:22 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:14:22 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74743) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 17:14:23 user nova-compute[74743]: DEBUG nova.compute.manager [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:14:23 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Guest created on hypervisor {{(pid=74743) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 17:14:23 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Instance spawned successfully.
Nov 18 17:14:23 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 17:14:23 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Found default for hw_input_bus of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:14:23 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Found default for hw_pointer_model of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:14:23 user nova-compute[74743]: INFO nova.compute.manager [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Took 4.87 seconds to spawn the instance on the hypervisor.
Nov 18 17:14:23 user nova-compute[74743]: DEBUG nova.compute.manager [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:14:23 user nova-compute[74743]: INFO nova.compute.manager [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Took 17.40 seconds to build instance.
Nov 18 17:14:23 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:14:23 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Starting heal instance info cache {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 17:14:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-221c4a37-5846-4847-bf64-5748327625c3 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "637e2b9b-9777-487f-8131-bdfcd520b2cf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.514s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:14:23 user nova-compute[74743]: DEBUG nova.compute.manager [req-708cb0bf-4dae-4529-ac6b-b4eb04166c91 req-52cf31aa-2632-4d89-a8e9-74fd8f338196 service nova] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Received event network-vif-plugged-516dfceb-fc7a-43ad-b874-1eb33cc0f525 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:14:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-708cb0bf-4dae-4529-ac6b-b4eb04166c91 req-52cf31aa-2632-4d89-a8e9-74fd8f338196 service nova] Acquiring lock "637e2b9b-9777-487f-8131-bdfcd520b2cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:14:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-708cb0bf-4dae-4529-ac6b-b4eb04166c91 req-52cf31aa-2632-4d89-a8e9-74fd8f338196 service nova] Lock "637e2b9b-9777-487f-8131-bdfcd520b2cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:14:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-708cb0bf-4dae-4529-ac6b-b4eb04166c91 req-52cf31aa-2632-4d89-a8e9-74fd8f338196 service nova] Lock "637e2b9b-9777-487f-8131-bdfcd520b2cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:14:23 user nova-compute[74743]: DEBUG nova.compute.manager [req-708cb0bf-4dae-4529-ac6b-b4eb04166c91 req-52cf31aa-2632-4d89-a8e9-74fd8f338196 service nova] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] No waiting events found dispatching network-vif-plugged-516dfceb-fc7a-43ad-b874-1eb33cc0f525 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:14:23 user nova-compute[74743]: WARNING nova.compute.manager [req-708cb0bf-4dae-4529-ac6b-b4eb04166c91 req-52cf31aa-2632-4d89-a8e9-74fd8f338196 service nova] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Received unexpected event network-vif-plugged-516dfceb-fc7a-43ad-b874-1eb33cc0f525 for instance with vm_state active and task_state None.
Nov 18 17:14:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "refresh_cache-0ad8aa2d-663c-4829-87f9-07959105ca68" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:14:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquired lock "refresh_cache-0ad8aa2d-663c-4829-87f9-07959105ca68" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:14:23 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] Forcefully refreshing network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 17:14:24 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] Updating instance_info_cache with network_info: [{"id": "f8b70f64-c72b-4d3b-be6a-6e401ce15011", "address": "fa:16:3e:30:37:84", "network": {"id": "13e0d3be-e4a3-4f20-8aac-1cf64be1e1b2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-853497736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b57ac6e8f2384c6fb2bb4cbdeee429c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8b70f64-c7", "ovs_interfaceid": "f8b70f64-c72b-4d3b-be6a-6e401ce15011", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:14:24 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Releasing lock "refresh_cache-0ad8aa2d-663c-4829-87f9-07959105ca68" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:14:24 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] Updated the network info_cache for instance {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 17:14:24 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:14:24 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:14:24 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:14:25 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:14:25 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:14:26 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:14:26 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:14:27 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:14:27 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:14:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:14:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:14:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:14:27 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Auditing locally available compute resources for user (node: user) {{(pid=74743) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 17:14:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f93bf0ac-ecc8-447d-b9c1-381d36cd3135/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:27 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-e7af77d6-a3f2-4053-bfce-5443951fb51c tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f93bf0ac-ecc8-447d-b9c1-381d36cd3135 is timed out.
Nov 18 17:14:27 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-e7af77d6-a3f2-4053-bfce-5443951fb51c tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Successfully detached device vdb from instance f93bf0ac-ecc8-447d-b9c1-381d36cd3135 from the live domain config.
Nov 18 17:14:27 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7af77d6-a3f2-4053-bfce-5443951fb51c tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] calling os-brick to detach iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 17:14:27 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7af77d6-a3f2-4053-bfce-5443951fb51c tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, {'target_iqn': 'iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UGHQcanR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:14:27 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-e7af77d6-a3f2-4053-bfce-5443951fb51c tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:14:27 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-e7af77d6-a3f2-4053-bfce-5443951fb51c tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:14:27 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-e7af77d6-a3f2-4053-bfce-5443951fb51c tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:14:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:27 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d30c07-6694-4a89-a1c6-84e7ed11ca06]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:14:27 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7af77d6-a3f2-4053-bfce-5443951fb51c tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 17:14:27 user nova-compute[74743]: No targets found.
Nov 18 17:14:27 user nova-compute[74743]: iSNS:
Nov 18 17:14:27 user nova-compute[74743]: No targets found.
Nov 18 17:14:27 user nova-compute[74743]: STATIC:
Nov 18 17:14:27 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5
Nov 18 17:14:27 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:14:27 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:14:27 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127
Nov 18 17:14:27 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:14:27 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:14:27 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685
Nov 18 17:14:27 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:14:27 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:14:27 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5
Nov 18 17:14:27 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:14:27 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:14:27 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f
Nov 18 17:14:27 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:14:27 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:14:27 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f
Nov 18 17:14:27 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:14:27 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:14:27 user nova-compute[74743]: FIRMWARE:
Nov 18 17:14:27 user nova-compute[74743]: No targets found.
Nov 18 17:14:27 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:14:27 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7af77d6-a3f2-4053-bfce-5443951fb51c tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 17:14:27 user nova-compute[74743]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 17:14:27 user nova-compute[74743]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74743) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 17:14:27 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7af77d6-a3f2-4053-bfce-5443951fb51c tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f', 0)] {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 17:14:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:27 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[97419e72-a79a-4d8c-84ea-eaecff4afb77]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:14:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f93bf0ac-ecc8-447d-b9c1-381d36cd3135/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f93bf0ac-ecc8-447d-b9c1-381d36cd3135/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:27 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f5af8d-b477-4e24-b583-dfba626bb04b]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:14:27 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7af77d6-a3f2-4053-bfce-5443951fb51c tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:14:27 user nova-compute[74743]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:14:27 user nova-compute[74743]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)
Nov 18 17:14:27 user nova-compute[74743]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:14:27 user nova-compute[74743]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f (non-flash)
Nov 18 17:14:27 user nova-compute[74743]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f (non-flash)
Nov 18 17:14:27 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:14:27 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7af77d6-a3f2-4053-bfce-5443951fb51c tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:14:27 user nova-compute[74743]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:14:27 user nova-compute[74743]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)
Nov 18 17:14:27 user nova-compute[74743]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:14:27 user nova-compute[74743]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f (non-flash)
Nov 18 17:14:27 user nova-compute[74743]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f (non-flash)
Nov 18 17:14:27 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:14:27 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7af77d6-a3f2-4053-bfce-5443951fb51c tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb281ba710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f'): ({'sdg'}, set())}) {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 17:14:27 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-e7af77d6-a3f2-4053-bfce-5443951fb51c tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Removing single pathed devices sdg {{(pid=74743) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 17:14:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:27 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca28c0ab-925e-4529-931d-dd745943ed3a]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:14:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:27 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[037c3fef-d0eb-4278-88fe-b376eeed20fe]: (4, ('ok\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:14:27 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-e7af77d6-a3f2-4053-bfce-5443951fb51c tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Flushing IO for device /dev/sdg {{(pid=74743) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 17:14:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:27 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[70040763-c20c-4331-9c08-7b97d1586bc7]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:14:27 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-e7af77d6-a3f2-4053-bfce-5443951fb51c tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74743) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 17:14:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.049s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:28 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c66c35-9e28-437d-a394-9cf78e31828a]: (4, ('1', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:14:28 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-e7af77d6-a3f2-4053-bfce-5443951fb51c tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 17:14:28 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-e7af77d6-a3f2-4053-bfce-5443951fb51c tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] SCSI volumes sdg have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 17:14:28 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7af77d6-a3f2-4053-bfce-5443951fb51c tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f')] {{(pid=74743) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 17:14:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:28 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01fcdd4-fda9-4078-aca1-9129d836561c]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:14:28 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7af77d6-a3f2-4053-bfce-5443951fb51c tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:14:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f -p 172.16.0.220:3260 --logout {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f93bf0ac-ecc8-447d-b9c1-381d36cd3135/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:28 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:14:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:28 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbab9db-5dad-4311-96bc-174c50fb30a3]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:14:28 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7af77d6-a3f2-4053-bfce-5443951fb51c tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f, portal: 172.16.0.220,3260]
Nov 18 17:14:28 user nova-compute[74743]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f, portal: 172.16.0.220,3260] successful.
Nov 18 17:14:28 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:14:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f -p 172.16.0.220:3260 --op delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:017a6353-4fd9-401f-b77e-da049415730f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:28 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[3168db31-c735-4fe1-93a0-a816e01b00a9]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:14:28 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7af77d6-a3f2-4053-bfce-5443951fb51c tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:14:28 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-e7af77d6-a3f2-4053-bfce-5443951fb51c tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:14:28 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7af77d6-a3f2-4053-bfce-5443951fb51c tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] <== disconnect_volume: return (351ms) None {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:14:28 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7af77d6-a3f2-4053-bfce-5443951fb51c tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Disconnected iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 17:14:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:28 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:28 user nova-compute[74743]: DEBUG nova.objects.instance [None req-e7af77d6-a3f2-4053-bfce-5443951fb51c tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lazy-loading 'flavor' on Instance uuid f93bf0ac-ecc8-447d-b9c1-381d36cd3135 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:14:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:29 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e7af77d6-a3f2-4053-bfce-5443951fb51c tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.073s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:14:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:29 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:14:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd467693-8b2d-4e3d-9b1a-7581c6ae6153/disk.rescue --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd467693-8b2d-4e3d-9b1a-7581c6ae6153/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd467693-8b2d-4e3d-9b1a-7581c6ae6153/disk.rescue --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd467693-8b2d-4e3d-9b1a-7581c6ae6153/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:29 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /opt/stack/data/nova/instances/cd467693-8b2d-4e3d-9b1a-7581c6ae6153/disk (vdb) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:14:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:14:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad8aa2d-663c-4829-87f9-07959105ca68/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad8aa2d-663c-4829-87f9-07959105ca68/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad8aa2d-663c-4829-87f9-07959105ca68/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad8aa2d-663c-4829-87f9-07959105ca68/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:31 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:14:31 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:14:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ad39c-15fd-42e2-9ad6-ed5cd25e25de/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ad39c-15fd-42e2-9ad6-ed5cd25e25de/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ad39c-15fd-42e2-9ad6-ed5cd25e25de/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ad39c-15fd-42e2-9ad6-ed5cd25e25de/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:31 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:14:31 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:14:31 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Hypervisor/Node resource view: name=user free_ram=7363MB free_disk=25.45852279663086GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74743) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 17:14:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:14:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:14:32 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 4cce1628-2dcb-40c7-abd4-6a327a432de3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:14:32 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance e9668e1c-1e8d-4dd7-8f58-d453db294557 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:14:32 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance c006a4ad-a8e2-4108-9af1-dec4dd53fcda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:14:32 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 0ad8aa2d-663c-4829-87f9-07959105ca68 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:14:32 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance f93bf0ac-ecc8-447d-b9c1-381d36cd3135 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:14:32 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance aefe3db1-b9bb-4cce-aa31-d0b6684ad791 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:14:32 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 49ebdd5a-824d-476a-bd10-3b891bbfe9e2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:14:32 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance cd467693-8b2d-4e3d-9b1a-7581c6ae6153 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:14:32 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:14:32 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance f41ad39c-15fd-42e2-9ad6-ed5cd25e25de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:14:32 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance f649143e-f7db-475a-bbe5-d5e7316caac3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:14:32 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 637e2b9b-9777-487f-8131-bdfcd520b2cf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:14:32 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 17:14:32 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 17:14:32 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Refreshing inventories for resource provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 18 17:14:32 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Updating ProviderTree inventory for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 18 17:14:32 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Updating inventory in ProviderTree for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 18 17:14:32 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Refreshing aggregate associations for resource provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8, aggregates: None {{(pid=74743) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 18 17:14:32 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Refreshing trait associations for resource provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=74743) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 18 17:14:32 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:14:32 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:14:32 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Compute_service record updated for user:user {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 17:14:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.810s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:14:32 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:14:32 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Cleaning up deleted instances with incomplete migration  {{(pid=74743) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 18 17:14:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:14:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:14:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74743) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 17:14:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:14:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:14:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:14:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:14:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:14:40 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:14:44 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:14:45 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:14:47 user nova-compute[74743]: DEBUG nova.compute.manager [req-d4f120fd-1861-4eab-a369-cbed0933550d req-cf91a874-b50e-42d2-ab6f-e663374f13de service nova] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Received event network-changed-3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:14:47 user nova-compute[74743]: DEBUG nova.compute.manager [req-d4f120fd-1861-4eab-a369-cbed0933550d req-cf91a874-b50e-42d2-ab6f-e663374f13de service nova] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Refreshing instance network info cache due to event network-changed-3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:14:47 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d4f120fd-1861-4eab-a369-cbed0933550d req-cf91a874-b50e-42d2-ab6f-e663374f13de service nova] Acquiring lock "refresh_cache-f41ad39c-15fd-42e2-9ad6-ed5cd25e25de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:14:47 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d4f120fd-1861-4eab-a369-cbed0933550d req-cf91a874-b50e-42d2-ab6f-e663374f13de service nova] Acquired lock "refresh_cache-f41ad39c-15fd-42e2-9ad6-ed5cd25e25de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:14:47 user nova-compute[74743]: DEBUG nova.network.neutron [req-d4f120fd-1861-4eab-a369-cbed0933550d req-cf91a874-b50e-42d2-ab6f-e663374f13de service nova] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Refreshing network info cache for port 3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:14:47 user nova-compute[74743]: DEBUG nova.network.neutron [req-d4f120fd-1861-4eab-a369-cbed0933550d req-cf91a874-b50e-42d2-ab6f-e663374f13de service nova] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Updated VIF entry in instance network info cache for port 3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:14:47 user nova-compute[74743]: DEBUG nova.network.neutron [req-d4f120fd-1861-4eab-a369-cbed0933550d req-cf91a874-b50e-42d2-ab6f-e663374f13de service nova] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Updating instance_info_cache with network_info: [{"id": "3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5", "address": "fa:16:3e:0e:63:d2", "network": {"id": "e1c28f74-c9c1-4eb3-931e-003332ff6243", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-453481916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a17803c613c4ef299c797bba85c1a4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d1781f8-f4", "ovs_interfaceid": "3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:14:47 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d4f120fd-1861-4eab-a369-cbed0933550d req-cf91a874-b50e-42d2-ab6f-e663374f13de service nova] Releasing lock "refresh_cache-f41ad39c-15fd-42e2-9ad6-ed5cd25e25de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:14:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:14:50 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:14:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a34c6d19-ac22-4ed8-9e1e-3b5554a3c4a7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Acquiring lock "f41ad39c-15fd-42e2-9ad6-ed5cd25e25de" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:14:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a34c6d19-ac22-4ed8-9e1e-3b5554a3c4a7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "f41ad39c-15fd-42e2-9ad6-ed5cd25e25de" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:14:51 user nova-compute[74743]: INFO nova.compute.manager [None req-a34c6d19-ac22-4ed8-9e1e-3b5554a3c4a7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Shelving
Nov 18 17:14:51 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:14:51 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:14:51 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:14:51 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:14:51 user nova-compute[74743]: DEBUG nova.compute.manager [req-49f6f211-6e2d-48a6-a213-a101d9ab9aa9 req-f177aaca-f45a-434b-8909-bdec0288a6c8 service nova] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Received event network-vif-unplugged-3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:14:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-49f6f211-6e2d-48a6-a213-a101d9ab9aa9 req-f177aaca-f45a-434b-8909-bdec0288a6c8 service nova] Acquiring lock "f41ad39c-15fd-42e2-9ad6-ed5cd25e25de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:14:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-49f6f211-6e2d-48a6-a213-a101d9ab9aa9 req-f177aaca-f45a-434b-8909-bdec0288a6c8 service nova] Lock "f41ad39c-15fd-42e2-9ad6-ed5cd25e25de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:14:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-49f6f211-6e2d-48a6-a213-a101d9ab9aa9 req-f177aaca-f45a-434b-8909-bdec0288a6c8 service nova] Lock "f41ad39c-15fd-42e2-9ad6-ed5cd25e25de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:14:51 user nova-compute[74743]: DEBUG nova.compute.manager [req-49f6f211-6e2d-48a6-a213-a101d9ab9aa9 req-f177aaca-f45a-434b-8909-bdec0288a6c8 service nova] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] No waiting events found dispatching network-vif-unplugged-3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:14:51 user nova-compute[74743]: WARNING nova.compute.manager [req-49f6f211-6e2d-48a6-a213-a101d9ab9aa9 req-f177aaca-f45a-434b-8909-bdec0288a6c8 service nova] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Received unexpected event network-vif-unplugged-3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5 for instance with vm_state active and task_state shelving.
Nov 18 17:14:51 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:14:51 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Instance destroyed successfully.
Nov 18 17:14:51 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-a34c6d19-ac22-4ed8-9e1e-3b5554a3c4a7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Beginning cold snapshot process
Nov 18 17:14:52 user nova-compute[74743]: DEBUG nova.privsep.utils [None req-a34c6d19-ac22-4ed8-9e1e-3b5554a3c4a7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74743) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 18 17:14:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-a34c6d19-ac22-4ed8-9e1e-3b5554a3c4a7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f41ad39c-15fd-42e2-9ad6-ed5cd25e25de/disk /opt/stack/data/nova/instances/snapshots/tmp4o56vz50/3a3724631da1457e80714384801c06d5 {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-a34c6d19-ac22-4ed8-9e1e-3b5554a3c4a7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f41ad39c-15fd-42e2-9ad6-ed5cd25e25de/disk /opt/stack/data/nova/instances/snapshots/tmp4o56vz50/3a3724631da1457e80714384801c06d5" returned: 0 in 0.759s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:52 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-a34c6d19-ac22-4ed8-9e1e-3b5554a3c4a7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Snapshot extracted, beginning image upload
Nov 18 17:14:53 user nova-compute[74743]: DEBUG nova.compute.manager [req-f80ec8b7-a79b-4315-a3a6-6e7ddd67fcd0 req-09dfa679-f005-4e66-b913-ea261d5a61f5 service nova] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Received event network-vif-plugged-3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:14:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f80ec8b7-a79b-4315-a3a6-6e7ddd67fcd0 req-09dfa679-f005-4e66-b913-ea261d5a61f5 service nova] Acquiring lock "f41ad39c-15fd-42e2-9ad6-ed5cd25e25de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:14:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f80ec8b7-a79b-4315-a3a6-6e7ddd67fcd0 req-09dfa679-f005-4e66-b913-ea261d5a61f5 service nova] Lock "f41ad39c-15fd-42e2-9ad6-ed5cd25e25de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:14:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f80ec8b7-a79b-4315-a3a6-6e7ddd67fcd0 req-09dfa679-f005-4e66-b913-ea261d5a61f5 service nova] Lock "f41ad39c-15fd-42e2-9ad6-ed5cd25e25de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:14:53 user nova-compute[74743]: DEBUG nova.compute.manager [req-f80ec8b7-a79b-4315-a3a6-6e7ddd67fcd0 req-09dfa679-f005-4e66-b913-ea261d5a61f5 service nova] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] No waiting events found dispatching network-vif-plugged-3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:14:53 user nova-compute[74743]: WARNING nova.compute.manager [req-f80ec8b7-a79b-4315-a3a6-6e7ddd67fcd0 req-09dfa679-f005-4e66-b913-ea261d5a61f5 service nova] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Received unexpected event network-vif-plugged-3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5 for instance with vm_state active and task_state shelving_image_uploading.
Nov 18 17:14:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:14:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:14:55 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-a34c6d19-ac22-4ed8-9e1e-3b5554a3c4a7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Snapshot image upload complete
Nov 18 17:14:55 user nova-compute[74743]: DEBUG nova.compute.manager [None req-a34c6d19-ac22-4ed8-9e1e-3b5554a3c4a7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:14:55 user nova-compute[74743]: INFO nova.compute.manager [None req-a34c6d19-ac22-4ed8-9e1e-3b5554a3c4a7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Shelve offloading
Nov 18 17:14:55 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Instance destroyed successfully.
Nov 18 17:14:55 user nova-compute[74743]: DEBUG nova.compute.manager [None req-a34c6d19-ac22-4ed8-9e1e-3b5554a3c4a7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:14:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a34c6d19-ac22-4ed8-9e1e-3b5554a3c4a7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Acquiring lock "refresh_cache-f41ad39c-15fd-42e2-9ad6-ed5cd25e25de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:14:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a34c6d19-ac22-4ed8-9e1e-3b5554a3c4a7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Acquired lock "refresh_cache-f41ad39c-15fd-42e2-9ad6-ed5cd25e25de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:14:55 user nova-compute[74743]: DEBUG nova.network.neutron [None req-a34c6d19-ac22-4ed8-9e1e-3b5554a3c4a7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:14:56 user nova-compute[74743]: DEBUG nova.network.neutron [None req-a34c6d19-ac22-4ed8-9e1e-3b5554a3c4a7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Updating instance_info_cache with network_info: [{"id": "3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5", "address": "fa:16:3e:0e:63:d2", "network": {"id": "e1c28f74-c9c1-4eb3-931e-003332ff6243", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-453481916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a17803c613c4ef299c797bba85c1a4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d1781f8-f4", "ovs_interfaceid": "3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:14:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a34c6d19-ac22-4ed8-9e1e-3b5554a3c4a7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Releasing lock "refresh_cache-f41ad39c-15fd-42e2-9ad6-ed5cd25e25de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:14:56 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Instance destroyed successfully.
Nov 18 17:14:56 user nova-compute[74743]: DEBUG nova.objects.instance [None req-a34c6d19-ac22-4ed8-9e1e-3b5554a3c4a7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lazy-loading 'resources' on Instance uuid f41ad39c-15fd-42e2-9ad6-ed5cd25e25de {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:14:56 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-a34c6d19-ac22-4ed8-9e1e-3b5554a3c4a7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:12:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1872287329',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1872287329',id=28,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFeAf5pe/SM9rbt1HiXBv/Qy4kx4IdHwG3fexElEhkBcZPfKQFDg+/NTyRMqyRqYDaJEZ/lV9IRH0FTea8siiY9i8r4fxRG+ACR/2qEf8DIIhRuTvTaRMqurC/OE1FYk5Q==',key_name='tempest-keypair-257871102',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:13:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0a17803c613c4ef299c797bba85c1a4b',ramdisk_id='',reservation_id='r-wl7d2o6y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-13499029',owner_user_name='tempest-AttachVolumeShelveTestJSON-13499029-project-member',shelved_at='2023-11-18T17:14:55.344413',shelved_host='user',shelved_image_id='6ae32e7e-3eda-4c8a-98d7-fea879469db4'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:14:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18483ad6106b4d95afbbed450d625b53',uuid=f41ad39c-15fd-42e2-9ad6-ed5cd25e25de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5", "address": "fa:16:3e:0e:63:d2", "network": {"id": "e1c28f74-c9c1-4eb3-931e-003332ff6243", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-453481916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a17803c613c4ef299c797bba85c1a4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d1781f8-f4", "ovs_interfaceid": "3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:14:56 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-a34c6d19-ac22-4ed8-9e1e-3b5554a3c4a7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Converting VIF {"id": "3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5", "address": "fa:16:3e:0e:63:d2", "network": {"id": "e1c28f74-c9c1-4eb3-931e-003332ff6243", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-453481916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a17803c613c4ef299c797bba85c1a4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d1781f8-f4", "ovs_interfaceid": "3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:14:56 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-a34c6d19-ac22-4ed8-9e1e-3b5554a3c4a7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:63:d2,bridge_name='br-int',has_traffic_filtering=True,id=3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5,network=Network(e1c28f74-c9c1-4eb3-931e-003332ff6243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d1781f8-f4') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:14:56 user nova-compute[74743]: DEBUG os_vif [None req-a34c6d19-ac22-4ed8-9e1e-3b5554a3c4a7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:63:d2,bridge_name='br-int',has_traffic_filtering=True,id=3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5,network=Network(e1c28f74-c9c1-4eb3-931e-003332ff6243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d1781f8-f4') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:14:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:14:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d1781f8-f4, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:14:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:14:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:14:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:14:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=307e1a94-787b-4cf4-8682-ad6551eb4e4f) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:14:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:14:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:14:56 user nova-compute[74743]: INFO os_vif [None req-a34c6d19-ac22-4ed8-9e1e-3b5554a3c4a7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:63:d2,bridge_name='br-int',has_traffic_filtering=True,id=3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5,network=Network(e1c28f74-c9c1-4eb3-931e-003332ff6243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d1781f8-f4')
Nov 18 17:14:56 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-a34c6d19-ac22-4ed8-9e1e-3b5554a3c4a7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Deleting instance files /opt/stack/data/nova/instances/f41ad39c-15fd-42e2-9ad6-ed5cd25e25de_del
Nov 18 17:14:56 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-a34c6d19-ac22-4ed8-9e1e-3b5554a3c4a7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Deletion of /opt/stack/data/nova/instances/f41ad39c-15fd-42e2-9ad6-ed5cd25e25de_del complete
Nov 18 17:14:56 user nova-compute[74743]: DEBUG nova.compute.manager [req-99848ec0-1bc1-4ce2-b5ac-c162f0aab21b req-dcf73fa5-2104-4c0a-9903-823b03823927 service nova] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Received event network-changed-3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:14:56 user nova-compute[74743]: DEBUG nova.compute.manager [req-99848ec0-1bc1-4ce2-b5ac-c162f0aab21b req-dcf73fa5-2104-4c0a-9903-823b03823927 service nova] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Refreshing instance network info cache due to event network-changed-3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:14:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-99848ec0-1bc1-4ce2-b5ac-c162f0aab21b req-dcf73fa5-2104-4c0a-9903-823b03823927 service nova] Acquiring lock "refresh_cache-f41ad39c-15fd-42e2-9ad6-ed5cd25e25de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:14:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-99848ec0-1bc1-4ce2-b5ac-c162f0aab21b req-dcf73fa5-2104-4c0a-9903-823b03823927 service nova] Acquired lock "refresh_cache-f41ad39c-15fd-42e2-9ad6-ed5cd25e25de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:14:56 user nova-compute[74743]: DEBUG nova.network.neutron [req-99848ec0-1bc1-4ce2-b5ac-c162f0aab21b req-dcf73fa5-2104-4c0a-9903-823b03823927 service nova] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Refreshing network info cache for port 3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:14:56 user nova-compute[74743]: INFO nova.scheduler.client.report [None req-a34c6d19-ac22-4ed8-9e1e-3b5554a3c4a7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Deleted allocations for instance f41ad39c-15fd-42e2-9ad6-ed5cd25e25de
Nov 18 17:14:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a34c6d19-ac22-4ed8-9e1e-3b5554a3c4a7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:14:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a34c6d19-ac22-4ed8-9e1e-3b5554a3c4a7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:14:56 user nova-compute[74743]: DEBUG nova.objects.instance [None req-a34c6d19-ac22-4ed8-9e1e-3b5554a3c4a7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lazy-loading 'numa_topology' on Instance uuid f41ad39c-15fd-42e2-9ad6-ed5cd25e25de {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:14:56 user nova-compute[74743]: DEBUG nova.objects.base [None req-a34c6d19-ac22-4ed8-9e1e-3b5554a3c4a7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Object Instance<f41ad39c-15fd-42e2-9ad6-ed5cd25e25de> lazy-loaded attributes: resources,numa_topology {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:14:57 user nova-compute[74743]: DEBUG nova.network.neutron [req-99848ec0-1bc1-4ce2-b5ac-c162f0aab21b req-dcf73fa5-2104-4c0a-9903-823b03823927 service nova] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Updated VIF entry in instance network info cache for port 3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:14:57 user nova-compute[74743]: DEBUG nova.network.neutron [req-99848ec0-1bc1-4ce2-b5ac-c162f0aab21b req-dcf73fa5-2104-4c0a-9903-823b03823927 service nova] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Updating instance_info_cache with network_info: [{"id": "3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5", "address": "fa:16:3e:0e:63:d2", "network": {"id": "e1c28f74-c9c1-4eb3-931e-003332ff6243", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-453481916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a17803c613c4ef299c797bba85c1a4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap3d1781f8-f4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:14:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-99848ec0-1bc1-4ce2-b5ac-c162f0aab21b req-dcf73fa5-2104-4c0a-9903-823b03823927 service nova] Releasing lock "refresh_cache-f41ad39c-15fd-42e2-9ad6-ed5cd25e25de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:14:57 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-a34c6d19-ac22-4ed8-9e1e-3b5554a3c4a7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:14:57 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-a34c6d19-ac22-4ed8-9e1e-3b5554a3c4a7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:14:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a34c6d19-ac22-4ed8-9e1e-3b5554a3c4a7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.426s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:14:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a34c6d19-ac22-4ed8-9e1e-3b5554a3c4a7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "f41ad39c-15fd-42e2-9ad6-ed5cd25e25de" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.215s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:14:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-87f8e4d1-a2af-4f17-a8f2-6ec573b233bc tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Acquiring lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:14:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-87f8e4d1-a2af-4f17-a8f2-6ec573b233bc tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:14:59 user nova-compute[74743]: DEBUG nova.objects.instance [None req-87f8e4d1-a2af-4f17-a8f2-6ec573b233bc tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lazy-loading 'flavor' on Instance uuid f93bf0ac-ecc8-447d-b9c1-381d36cd3135 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:14:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-87f8e4d1-a2af-4f17-a8f2-6ec573b233bc tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:14:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-87f8e4d1-a2af-4f17-a8f2-6ec573b233bc tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Acquiring lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:14:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-87f8e4d1-a2af-4f17-a8f2-6ec573b233bc tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:14:59 user nova-compute[74743]: INFO nova.compute.manager [None req-87f8e4d1-a2af-4f17-a8f2-6ec573b233bc tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Attaching volume ff3050e6-8384-4346-b140-9a09acdda1f9 to /dev/vdb
Nov 18 17:14:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquiring lock "69d78ecf-740d-492a-be5b-ffd064e36f00" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:14:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "69d78ecf-740d-492a-be5b-ffd064e36f00" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:14:59 user nova-compute[74743]: DEBUG os_brick.utils [None req-87f8e4d1-a2af-4f17-a8f2-6ec573b233bc tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:14:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:59 user nova-compute[74743]: DEBUG nova.compute.manager [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Starting instance... {{(pid=74743) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 17:14:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:59 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b429d074-aeb9-4a1a-b110-311ace09d0d9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1116acd8874d\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:14:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:59 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda70cb2-74b0-48a7-977a-d9ff995c2de9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:14:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:14:59 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ceae40-e95e-4949-a9fe-3a448687ea09]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:14:59 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[66bb4ce5-9ef8-4dff-88c2-c65500aa24a5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:14:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-87f8e4d1-a2af-4f17-a8f2-6ec573b233bc tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Running cmd (subprocess): nvme version {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-87f8e4d1-a2af-4f17-a8f2-6ec573b233bc tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] 'nvme version' failed. Not Retrying. {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:14:59 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.nvmeof [None req-87f8e4d1-a2af-4f17-a8f2-6ec573b233bc tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] nvme not present on system {{(pid=74743) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 17:14:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:14:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:14:59 user nova-compute[74743]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 17:14:59 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3405716-377e-4957-9575-0be203446467]: (4, '') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:14:59 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-87f8e4d1-a2af-4f17-a8f2-6ec573b233bc tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74743) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 17:14:59 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-87f8e4d1-a2af-4f17-a8f2-6ec573b233bc tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 17:14:59 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-87f8e4d1-a2af-4f17-a8f2-6ec573b233bc tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] LIGHTOS: no hostnqn found. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 17:14:59 user nova-compute[74743]: DEBUG os_brick.utils [None req-87f8e4d1-a2af-4f17-a8f2-6ec573b233bc tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1116acd8874d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:14:59 user nova-compute[74743]: DEBUG nova.virt.block_device [None req-87f8e4d1-a2af-4f17-a8f2-6ec573b233bc tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Updating existing volume attachment record: 5acb612c-ca72-4816-9a97-5c7f5b2456cd {{(pid=74743) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 17:14:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:14:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:14:59 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74743) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 17:14:59 user nova-compute[74743]: INFO nova.compute.claims [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Claim successful on node user
Nov 18 17:15:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:00 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:15:00 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:15:00 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.727s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:15:00 user nova-compute[74743]: DEBUG nova.compute.manager [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Start building networks asynchronously for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 17:15:00 user nova-compute[74743]: DEBUG nova.compute.manager [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Allocating IP information in the background. {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 17:15:00 user nova-compute[74743]: DEBUG nova.network.neutron [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] allocate_for_instance() {{(pid=74743) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 17:15:00 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 17:15:00 user nova-compute[74743]: DEBUG nova.compute.manager [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Start building block device mappings for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 17:15:00 user nova-compute[74743]: DEBUG nova.policy [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ce3e4cef47114a7c9327db639460d923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8f5850162c479b8d185e48c03be7d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74743) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 17:15:00 user nova-compute[74743]: INFO nova.virt.block_device [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Booting with volume c12dbe72-19df-4534-bbb2-53dbc61fd87f at /dev/vda
Nov 18 17:15:00 user nova-compute[74743]: DEBUG os_brick.utils [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:15:00 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:00 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:00 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9537a21-e70d-4b2d-ab8d-64e63d37ce4f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1116acd8874d\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:15:00 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:00 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:00 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[366f0112-3b86-42a5-8dbc-e566dc8a94df]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:15:00 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:00 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:00 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b65c69-5560-4108-b173-30f032278c89]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:15:00 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab9ee60-5281-4a1d-b37c-06fdcdaeeee5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:15:00 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Running cmd (subprocess): nvme version {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:00 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] 'nvme version' failed. Not Retrying. {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:15:00 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.nvmeof [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] nvme not present on system {{(pid=74743) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 17:15:00 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:00 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:15:00 user nova-compute[74743]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 17:15:00 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28aec70-5254-4729-bef6-3ab1c9322e8c]: (4, '') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:15:00 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74743) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 17:15:00 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 17:15:00 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] LIGHTOS: no hostnqn found. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 17:15:00 user nova-compute[74743]: DEBUG os_brick.utils [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1116acd8874d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:15:00 user nova-compute[74743]: DEBUG nova.virt.block_device [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Updating existing volume attachment record: b7adf087-6230-4bc7-baf4-c59789772073 {{(pid=74743) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 17:15:01 user nova-compute[74743]: DEBUG nova.network.neutron [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Successfully created port: 4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8 {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:15:01 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:01 user nova-compute[74743]: DEBUG nova.network.neutron [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Successfully updated port: 4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8 {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:15:01 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquiring lock "refresh_cache-69d78ecf-740d-492a-be5b-ffd064e36f00" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:15:01 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquired lock "refresh_cache-69d78ecf-740d-492a-be5b-ffd064e36f00" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:15:01 user nova-compute[74743]: DEBUG nova.network.neutron [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:15:01 user nova-compute[74743]: DEBUG nova.compute.manager [req-5ad3a0d7-b4f1-48f9-bfce-dc6696d86246 req-6f3c2232-e510-408b-92e5-36ee8d640e53 service nova] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Received event network-changed-4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:15:01 user nova-compute[74743]: DEBUG nova.compute.manager [req-5ad3a0d7-b4f1-48f9-bfce-dc6696d86246 req-6f3c2232-e510-408b-92e5-36ee8d640e53 service nova] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Refreshing instance network info cache due to event network-changed-4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:15:01 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-5ad3a0d7-b4f1-48f9-bfce-dc6696d86246 req-6f3c2232-e510-408b-92e5-36ee8d640e53 service nova] Acquiring lock "refresh_cache-69d78ecf-740d-492a-be5b-ffd064e36f00" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:15:01 user nova-compute[74743]: DEBUG nova.network.neutron [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:15:02 user nova-compute[74743]: DEBUG nova.network.neutron [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Updating instance_info_cache with network_info: [{"id": "4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8", "address": "fa:16:3e:93:d9:fc", "network": {"id": "fd98f398-6576-449b-a737-887906eb6656", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668610993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb8f5850162c479b8d185e48c03be7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd5a403-19", "ovs_interfaceid": "4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:15:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Releasing lock "refresh_cache-69d78ecf-740d-492a-be5b-ffd064e36f00" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:15:02 user nova-compute[74743]: DEBUG nova.compute.manager [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Instance network_info: |[{"id": "4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8", "address": "fa:16:3e:93:d9:fc", "network": {"id": "fd98f398-6576-449b-a737-887906eb6656", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668610993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb8f5850162c479b8d185e48c03be7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd5a403-19", "ovs_interfaceid": "4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 17:15:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-5ad3a0d7-b4f1-48f9-bfce-dc6696d86246 req-6f3c2232-e510-408b-92e5-36ee8d640e53 service nova] Acquired lock "refresh_cache-69d78ecf-740d-492a-be5b-ffd064e36f00" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:15:02 user nova-compute[74743]: DEBUG nova.network.neutron [req-5ad3a0d7-b4f1-48f9-bfce-dc6696d86246 req-6f3c2232-e510-408b-92e5-36ee8d640e53 service nova] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Refreshing network info cache for port 4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:15:02 user nova-compute[74743]: DEBUG nova.network.neutron [req-5ad3a0d7-b4f1-48f9-bfce-dc6696d86246 req-6f3c2232-e510-408b-92e5-36ee8d640e53 service nova] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Updated VIF entry in instance network info cache for port 4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:15:02 user nova-compute[74743]: DEBUG nova.network.neutron [req-5ad3a0d7-b4f1-48f9-bfce-dc6696d86246 req-6f3c2232-e510-408b-92e5-36ee8d640e53 service nova] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Updating instance_info_cache with network_info: [{"id": "4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8", "address": "fa:16:3e:93:d9:fc", "network": {"id": "fd98f398-6576-449b-a737-887906eb6656", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668610993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb8f5850162c479b8d185e48c03be7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd5a403-19", "ovs_interfaceid": "4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:15:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-5ad3a0d7-b4f1-48f9-bfce-dc6696d86246 req-6f3c2232-e510-408b-92e5-36ee8d640e53 service nova] Releasing lock "refresh_cache-69d78ecf-740d-492a-be5b-ffd064e36f00" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:15:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:05 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87f8e4d1-a2af-4f17-a8f2-6ec573b233bc tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Calling os-brick to attach iSCSI Volume {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 17:15:05 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f8e4d1-a2af-4f17-a8f2-6ec573b233bc tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UhApbaKo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:15:05 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-87f8e4d1-a2af-4f17-a8f2-6ec573b233bc tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:15:05 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-87f8e4d1-a2af-4f17-a8f2-6ec573b233bc tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:15:05 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-87f8e4d1-a2af-4f17-a8f2-6ec573b233bc tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:15:05 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-87f8e4d1-a2af-4f17-a8f2-6ec573b233bc tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:15:05 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-87f8e4d1-a2af-4f17-a8f2-6ec573b233bc tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:15:05 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-87f8e4d1-a2af-4f17-a8f2-6ec573b233bc tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:15:05 user nova-compute[74743]: INFO os_brick.initiator.connectors.iscsi [None req-87f8e4d1-a2af-4f17-a8f2-6ec573b233bc tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 17:15:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9 -p 172.16.0.220:3260 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:05 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf575b1-b68b-483e-a637-f801d3d41e34]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:15:05 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f8e4d1-a2af-4f17-a8f2-6ec573b233bc tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 17:15:05 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:15:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:05 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dce3f40-031b-4e3b-8d61-acb20c3424c3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9] added\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:15:05 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f8e4d1-a2af-4f17-a8f2-6ec573b233bc tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9] added
Nov 18 17:15:05 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:15:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:05 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da0c5c5-be37-49c5-9444-6cfb5f4050f4]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:15:05 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f8e4d1-a2af-4f17-a8f2-6ec573b233bc tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:15:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:05 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2603b1-4e09-4026-b402-e802b0f86eae]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:15:05 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f8e4d1-a2af-4f17-a8f2-6ec573b233bc tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:15:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UhApbaKo {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UhApbaKo" returned: 0 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:05 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae961cd5-40ec-4dfc-a58e-f34b1d57342a]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:15:05 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f8e4d1-a2af-4f17-a8f2-6ec573b233bc tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UhApbaKo'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:15:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:05 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6e286d-7237-4cdc-806c-1c5ddbda190b]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:15:05 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f8e4d1-a2af-4f17-a8f2-6ec573b233bc tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:15:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:05 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[f297480f-db1d-45d3-b7d0-becf870ad901]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:15:05 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f8e4d1-a2af-4f17-a8f2-6ec573b233bc tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:15:05 user nova-compute[74743]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:15:05 user nova-compute[74743]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)
Nov 18 17:15:05 user nova-compute[74743]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:15:05 user nova-compute[74743]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f (non-flash)
Nov 18 17:15:05 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:15:05 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f8e4d1-a2af-4f17-a8f2-6ec573b233bc tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:15:05 user nova-compute[74743]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:15:05 user nova-compute[74743]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)
Nov 18 17:15:05 user nova-compute[74743]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:15:05 user nova-compute[74743]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f (non-flash)
Nov 18 17:15:05 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:15:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9 -p 172.16.0.220:3260 --login {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:05 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0586fdaf-25d9-4c18-993f-92f00fb80d72]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:15:05 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f8e4d1-a2af-4f17-a8f2-6ec573b233bc tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9, portal: 172.16.0.220,3260]
Nov 18 17:15:05 user nova-compute[74743]: Login to [iface: default, target: iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9, portal: 172.16.0.220,3260] successful.
Nov 18 17:15:05 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:15:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:05 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[641789b4-5686-444d-8686-43d061a3d5ec]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:15:05 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f8e4d1-a2af-4f17-a8f2-6ec573b233bc tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:15:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:05 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44f84e3-8007-45ea-9579-c43c239b6c79]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:15:05 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f8e4d1-a2af-4f17-a8f2-6ec573b233bc tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:15:05 user nova-compute[74743]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:15:05 user nova-compute[74743]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)
Nov 18 17:15:05 user nova-compute[74743]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:15:05 user nova-compute[74743]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f (non-flash)
Nov 18 17:15:05 user nova-compute[74743]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9 (non-flash)
Nov 18 17:15:05 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:15:05 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f8e4d1-a2af-4f17-a8f2-6ec573b233bc tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:15:05 user nova-compute[74743]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:15:05 user nova-compute[74743]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)
Nov 18 17:15:05 user nova-compute[74743]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:15:05 user nova-compute[74743]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f (non-flash)
Nov 18 17:15:05 user nova-compute[74743]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9 (non-flash)
Nov 18 17:15:05 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:15:05 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-87f8e4d1-a2af-4f17-a8f2-6ec573b233bc tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:15:05 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f8e4d1-a2af-4f17-a8f2-6ec573b233bc tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Connected to 172.16.0.220:3260 {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 17:15:05 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-87f8e4d1-a2af-4f17-a8f2-6ec573b233bc tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] HCTL ('38', '-', '-', 0) found on session 37 with lun 0 {{(pid=74743) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 17:15:05 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-87f8e4d1-a2af-4f17-a8f2-6ec573b233bc tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74743) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 17:15:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:05 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e90549e-3b3f-4605-acc1-d252ae74e782]: (4, ('- - 0', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:15:05 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-87f8e4d1-a2af-4f17-a8f2-6ec573b233bc tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Searching for a device in session 37 and hctl ['38', '*', '*', 0] yield: None {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG nova.compute.manager [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Start spawning the instance on the hypervisor. {{(pid=74743) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Creating instance directory {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 17:15:06 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Creating image(s)
Nov 18 17:15:06 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Did not create local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Ensure instance console log exists: /opt/stack/data/nova/instances/69d78ecf-740d-492a-be5b-ffd064e36f00/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Start _get_guest_xml network_info=[{"id": "4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8", "address": "fa:16:3e:93:d9:fc", "network": {"id": "fd98f398-6576-449b-a737-887906eb6656", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668610993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb8f5850162c479b8d185e48c03be7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd5a403-19", "ovs_interfaceid": "4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': 'b7adf087-6230-4bc7-baf4-c59789772073', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xBLIUkZY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '69d78ecf-740d-492a-be5b-ffd064e36f00', 'attached_at': '', 'detached_at': '', 'volume_id': 'c12dbe72-19df-4534-bbb2-53dbc61fd87f', 'serial': 'c12dbe72-19df-4534-bbb2-53dbc61fd87f'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:15:06 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:15:06 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:15:06 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Calling os-brick to attach iSCSI Volume {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xBLIUkZY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:15:06 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:15:06 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-87f8e4d1-a2af-4f17-a8f2-6ec573b233bc tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Searching for a device in session 37 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f8e4d1-a2af-4f17-a8f2-6ec573b233bc tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UhApbaKo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-87f8e4d1-a2af-4f17-a8f2-6ec573b233bc tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f8e4d1-a2af-4f17-a8f2-6ec573b233bc tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '26361316134373462', 'path': '/dev/sdg'} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87f8e4d1-a2af-4f17-a8f2-6ec573b233bc tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361316134373462', 'path': '/dev/sdg'} {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.131s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:15:06 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:15:06 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:15:06 user nova-compute[74743]: INFO os_brick.initiator.connectors.iscsi [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 17:15:06 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f -p 172.16.0.220:3260 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG nova.objects.instance [None req-87f8e4d1-a2af-4f17-a8f2-6ec573b233bc tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lazy-loading 'flavor' on Instance uuid f93bf0ac-ecc8-447d-b9c1-381d36cd3135 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbafb12-e952-4049-8749-3a66f25ed92d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 17:15:06 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f -p 172.16.0.220:3260 --interface default --op new {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-87f8e4d1-a2af-4f17-a8f2-6ec573b233bc tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 17:15:06 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:15:06 user nova-compute[74743]:   <source dev="/dev/sdg"/>
Nov 18 17:15:06 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:15:06 user nova-compute[74743]:   <serial>ff3050e6-8384-4346-b140-9a09acdda1f9</serial>
Nov 18 17:15:06 user nova-compute[74743]: </disk>
Nov 18 17:15:06 user nova-compute[74743]:  {{(pid=74743) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a332d5-bb48-4b3a-9d76-fee8456bf3e1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f] added\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f] added
Nov 18 17:15:06 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8137165-8c25-4422-8c3a-0420d3ebf85c]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0935a29a-dc35-4952-8d32-5de72fe1e767]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xBLIUkZY {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xBLIUkZY" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[9969bb06-efae-40ca-afac-441c749edf3b]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xBLIUkZY'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5e2a55-7ea0-40b4-922b-2135e1c3152f]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4f2327-527e-42fe-a9d0-fb8de77f633c]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:15:06 user nova-compute[74743]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:15:06 user nova-compute[74743]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)
Nov 18 17:15:06 user nova-compute[74743]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:15:06 user nova-compute[74743]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f (non-flash)
Nov 18 17:15:06 user nova-compute[74743]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9 (non-flash)
Nov 18 17:15:06 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:15:06 user nova-compute[74743]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:15:06 user nova-compute[74743]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)
Nov 18 17:15:06 user nova-compute[74743]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:15:06 user nova-compute[74743]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f (non-flash)
Nov 18 17:15:06 user nova-compute[74743]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9 (non-flash)
Nov 18 17:15:06 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:15:06 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f -p 172.16.0.220:3260 --login {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:07 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:07 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c71778-c934-4e71-8b6b-52ee08be4bdc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:15:07 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f, portal: 172.16.0.220,3260]
Nov 18 17:15:07 user nova-compute[74743]: Login to [iface: default, target: iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f, portal: 172.16.0.220,3260] successful.
Nov 18 17:15:07 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:15:07 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:07 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:07 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f685930-bd08-4b58-8d2a-ba9390595def]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:15:07 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:15:07 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:07 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:07 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b20ccf-134a-4ab2-9f81-d8b49f304329]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:15:07 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:15:07 user nova-compute[74743]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:15:07 user nova-compute[74743]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)
Nov 18 17:15:07 user nova-compute[74743]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:15:07 user nova-compute[74743]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f (non-flash)
Nov 18 17:15:07 user nova-compute[74743]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9 (non-flash)
Nov 18 17:15:07 user nova-compute[74743]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)
Nov 18 17:15:07 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:15:07 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:15:07 user nova-compute[74743]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:15:07 user nova-compute[74743]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)
Nov 18 17:15:07 user nova-compute[74743]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:15:07 user nova-compute[74743]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f (non-flash)
Nov 18 17:15:07 user nova-compute[74743]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9 (non-flash)
Nov 18 17:15:07 user nova-compute[74743]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)
Nov 18 17:15:07 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:15:07 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:15:07 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Connected to 172.16.0.220:3260 {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 17:15:07 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] HCTL ('39', '-', '-', 0) found on session 38 with lun 0 {{(pid=74743) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 17:15:07 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74743) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 17:15:07 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:07 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:07 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[029a49ad-ce72-4b17-a264-8e7247763bc0]: (4, ('- - 0', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:15:07 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Searching for a device in session 38 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:15:07 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xBLIUkZY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 17:15:07 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-87f8e4d1-a2af-4f17-a8f2-6ec573b233bc tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:15:07 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-87f8e4d1-a2af-4f17-a8f2-6ec573b233bc tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:15:07 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-87f8e4d1-a2af-4f17-a8f2-6ec573b233bc tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] No VIF found with MAC fa:16:3e:f3:91:b0, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:15:07 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-87f8e4d1-a2af-4f17-a8f2-6ec573b233bc tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.973s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:15:08 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:15:08 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] <== connect_volume: return (1465ms) {'type': 'block', 'scsi_wwn': '23939376165633061', 'path': '/dev/sdh'} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:15:08 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939376165633061', 'path': '/dev/sdh'} {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 17:15:08 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:14:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-403226732',display_name='tempest-ServerActionsTestOtherA-server-403226732',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-403226732',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEVphqV0ovLOhWV5c4OtZaZAghiX4KqdCUzcXRNxI8zWTbqX3YOGnG7iLQKSTFxu3amDks//fytVOc70uGuSKqNKUeaE/kY0CmyGU71j0ZYQPWjJeA0I0UUP+FZUS4MWQ==',key_name='tempest-keypair-1212996543',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb8f5850162c479b8d185e48c03be7d3',ramdisk_id='',reservation_id='r-elyg0ort',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-128885625',owner_user_name='tempest-ServerActionsTestOtherA-128885625-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:15:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce3e4cef47114a7c9327db639460d923',uuid=69d78ecf-740d-492a-be5b-ffd064e36f00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8", "address": "fa:16:3e:93:d9:fc", "network": {"id": "fd98f398-6576-449b-a737-887906eb6656", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668610993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb8f5850162c479b8d185e48c03be7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd5a403-19", "ovs_interfaceid": "4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:15:08 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Converting VIF {"id": "4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8", "address": "fa:16:3e:93:d9:fc", "network": {"id": "fd98f398-6576-449b-a737-887906eb6656", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668610993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb8f5850162c479b8d185e48c03be7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd5a403-19", "ovs_interfaceid": "4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:15:08 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:d9:fc,bridge_name='br-int',has_traffic_filtering=True,id=4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8,network=Network(fd98f398-6576-449b-a737-887906eb6656),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cd5a403-19') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:15:08 user nova-compute[74743]: DEBUG nova.objects.instance [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lazy-loading 'pci_devices' on Instance uuid 69d78ecf-740d-492a-be5b-ffd064e36f00 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:15:08 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:15:08 user nova-compute[74743]:   <uuid>69d78ecf-740d-492a-be5b-ffd064e36f00</uuid>
Nov 18 17:15:08 user nova-compute[74743]:   <name>instance-0000001f</name>
Nov 18 17:15:08 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:15:08 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:15:08 user nova-compute[74743]:   <metadata>
Nov 18 17:15:08 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:15:08 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:15:08 user nova-compute[74743]:       <nova:name>tempest-ServerActionsTestOtherA-server-403226732</nova:name>
Nov 18 17:15:08 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:15:06</nova:creationTime>
Nov 18 17:15:08 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:15:08 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:15:08 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:15:08 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:15:08 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:15:08 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:15:08 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:15:08 user nova-compute[74743]:       <nova:owner>
Nov 18 17:15:08 user nova-compute[74743]:         <nova:user uuid="ce3e4cef47114a7c9327db639460d923">tempest-ServerActionsTestOtherA-128885625-project-member</nova:user>
Nov 18 17:15:08 user nova-compute[74743]:         <nova:project uuid="fb8f5850162c479b8d185e48c03be7d3">tempest-ServerActionsTestOtherA-128885625</nova:project>
Nov 18 17:15:08 user nova-compute[74743]:       </nova:owner>
Nov 18 17:15:08 user nova-compute[74743]:       <nova:ports>
Nov 18 17:15:08 user nova-compute[74743]:         <nova:port uuid="4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8">
Nov 18 17:15:08 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 18 17:15:08 user nova-compute[74743]:         </nova:port>
Nov 18 17:15:08 user nova-compute[74743]:       </nova:ports>
Nov 18 17:15:08 user nova-compute[74743]:     </nova:instance>
Nov 18 17:15:08 user nova-compute[74743]:   </metadata>
Nov 18 17:15:08 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:15:08 user nova-compute[74743]:     <system>
Nov 18 17:15:08 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:15:08 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:15:08 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:15:08 user nova-compute[74743]:       <entry name="serial">69d78ecf-740d-492a-be5b-ffd064e36f00</entry>
Nov 18 17:15:08 user nova-compute[74743]:       <entry name="uuid">69d78ecf-740d-492a-be5b-ffd064e36f00</entry>
Nov 18 17:15:08 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:15:08 user nova-compute[74743]:     </system>
Nov 18 17:15:08 user nova-compute[74743]:   </sysinfo>
Nov 18 17:15:08 user nova-compute[74743]:   <os>
Nov 18 17:15:08 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:15:08 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:15:08 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:15:08 user nova-compute[74743]:   </os>
Nov 18 17:15:08 user nova-compute[74743]:   <features>
Nov 18 17:15:08 user nova-compute[74743]:     <acpi/>
Nov 18 17:15:08 user nova-compute[74743]:     <apic/>
Nov 18 17:15:08 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:15:08 user nova-compute[74743]:   </features>
Nov 18 17:15:08 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:15:08 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:15:08 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:15:08 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:15:08 user nova-compute[74743]:   </clock>
Nov 18 17:15:08 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:15:08 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:15:08 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:15:08 user nova-compute[74743]:   </cpu>
Nov 18 17:15:08 user nova-compute[74743]:   <devices>
Nov 18 17:15:08 user nova-compute[74743]:     <disk type="block" device="disk">
Nov 18 17:15:08 user nova-compute[74743]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:15:08 user nova-compute[74743]:       <source dev="/dev/sdh"/>
Nov 18 17:15:08 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:15:08 user nova-compute[74743]:       <serial>c12dbe72-19df-4534-bbb2-53dbc61fd87f</serial>
Nov 18 17:15:08 user nova-compute[74743]:     </disk>
Nov 18 17:15:08 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:15:08 user nova-compute[74743]:       <mac address="fa:16:3e:93:d9:fc"/>
Nov 18 17:15:08 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:15:08 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:15:08 user nova-compute[74743]:       <target dev="tap4cd5a403-19"/>
Nov 18 17:15:08 user nova-compute[74743]:     </interface>
Nov 18 17:15:08 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:15:08 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/69d78ecf-740d-492a-be5b-ffd064e36f00/console.log" append="off"/>
Nov 18 17:15:08 user nova-compute[74743]:     </serial>
Nov 18 17:15:08 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:15:08 user nova-compute[74743]:     <video>
Nov 18 17:15:08 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:15:08 user nova-compute[74743]:     </video>
Nov 18 17:15:08 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:15:08 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:15:08 user nova-compute[74743]:     </rng>
Nov 18 17:15:08 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:15:08 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:15:08 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:15:08 user nova-compute[74743]:     </memballoon>
Nov 18 17:15:08 user nova-compute[74743]:   </devices>
Nov 18 17:15:08 user nova-compute[74743]: </domain>
Nov 18 17:15:08 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:15:08 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:14:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-403226732',display_name='tempest-ServerActionsTestOtherA-server-403226732',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-403226732',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEVphqV0ovLOhWV5c4OtZaZAghiX4KqdCUzcXRNxI8zWTbqX3YOGnG7iLQKSTFxu3amDks//fytVOc70uGuSKqNKUeaE/kY0CmyGU71j0ZYQPWjJeA0I0UUP+FZUS4MWQ==',key_name='tempest-keypair-1212996543',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb8f5850162c479b8d185e48c03be7d3',ramdisk_id='',reservation_id='r-elyg0ort',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-128885625',owner_user_name='tempest-ServerActionsTestOtherA-128885625-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:15:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce3e4cef47114a7c9327db639460d923',uuid=69d78ecf-740d-492a-be5b-ffd064e36f00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8", "address": "fa:16:3e:93:d9:fc", "network": {"id": "fd98f398-6576-449b-a737-887906eb6656", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668610993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb8f5850162c479b8d185e48c03be7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd5a403-19", "ovs_interfaceid": "4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:15:08 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Converting VIF {"id": "4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8", "address": "fa:16:3e:93:d9:fc", "network": {"id": "fd98f398-6576-449b-a737-887906eb6656", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668610993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb8f5850162c479b8d185e48c03be7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd5a403-19", "ovs_interfaceid": "4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:15:08 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:d9:fc,bridge_name='br-int',has_traffic_filtering=True,id=4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8,network=Network(fd98f398-6576-449b-a737-887906eb6656),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cd5a403-19') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:15:08 user nova-compute[74743]: DEBUG os_vif [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:d9:fc,bridge_name='br-int',has_traffic_filtering=True,id=4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8,network=Network(fd98f398-6576-449b-a737-887906eb6656),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cd5a403-19') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:15:08 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:08 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:15:08 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:15:08 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:08 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3395deaa-b35f-515b-a29a-e0edb16fc50f', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:15:08 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:08 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:08 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:08 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4cd5a403-19, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:15:08 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4cd5a403-19, col_values=(('qos', UUID('7c41fc91-2726-4f7f-8fa6-cc3dec9a5c10')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:15:08 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4cd5a403-19, col_values=(('external_ids', {'iface-id': '4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:d9:fc', 'vm-uuid': '69d78ecf-740d-492a-be5b-ffd064e36f00'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:15:08 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:08 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:15:08 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:08 user nova-compute[74743]: INFO os_vif [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:d9:fc,bridge_name='br-int',has_traffic_filtering=True,id=4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8,network=Network(fd98f398-6576-449b-a737-887906eb6656),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cd5a403-19')
Nov 18 17:15:08 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:15:08 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] No VIF found with MAC fa:16:3e:93:d9:fc, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:15:09 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:09 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:09 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:09 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:09 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:09 user nova-compute[74743]: DEBUG nova.compute.manager [req-cf668a0f-1019-4131-9a87-67ba7cc218b7 req-113e25ed-3019-4a68-ba7e-dba484895f0e service nova] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Received event network-vif-plugged-4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:15:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-cf668a0f-1019-4131-9a87-67ba7cc218b7 req-113e25ed-3019-4a68-ba7e-dba484895f0e service nova] Acquiring lock "69d78ecf-740d-492a-be5b-ffd064e36f00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:15:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-cf668a0f-1019-4131-9a87-67ba7cc218b7 req-113e25ed-3019-4a68-ba7e-dba484895f0e service nova] Lock "69d78ecf-740d-492a-be5b-ffd064e36f00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:15:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-cf668a0f-1019-4131-9a87-67ba7cc218b7 req-113e25ed-3019-4a68-ba7e-dba484895f0e service nova] Lock "69d78ecf-740d-492a-be5b-ffd064e36f00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:15:09 user nova-compute[74743]: DEBUG nova.compute.manager [req-cf668a0f-1019-4131-9a87-67ba7cc218b7 req-113e25ed-3019-4a68-ba7e-dba484895f0e service nova] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] No waiting events found dispatching network-vif-plugged-4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:15:09 user nova-compute[74743]: WARNING nova.compute.manager [req-cf668a0f-1019-4131-9a87-67ba7cc218b7 req-113e25ed-3019-4a68-ba7e-dba484895f0e service nova] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Received unexpected event network-vif-plugged-4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8 for instance with vm_state building and task_state spawning.
Nov 18 17:15:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-1711e274-8dc1-4dd5-a108-a6780c181924 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Acquiring lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:15:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-1711e274-8dc1-4dd5-a108-a6780c181924 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:15:09 user nova-compute[74743]: INFO nova.compute.manager [None req-1711e274-8dc1-4dd5-a108-a6780c181924 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Detaching volume ff3050e6-8384-4346-b140-9a09acdda1f9
Nov 18 17:15:09 user nova-compute[74743]: INFO nova.virt.block_device [None req-1711e274-8dc1-4dd5-a108-a6780c181924 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Attempting to driver detach volume ff3050e6-8384-4346-b140-9a09acdda1f9 from mountpoint /dev/vdb
Nov 18 17:15:09 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-1711e274-8dc1-4dd5-a108-a6780c181924 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Attempting to detach device vdb from instance f93bf0ac-ecc8-447d-b9c1-381d36cd3135 from the persistent domain config. {{(pid=74743) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 17:15:09 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-1711e274-8dc1-4dd5-a108-a6780c181924 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 17:15:09 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:15:09 user nova-compute[74743]:   <source dev="/dev/sdg"/>
Nov 18 17:15:09 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:15:09 user nova-compute[74743]:   <serial>ff3050e6-8384-4346-b140-9a09acdda1f9</serial>
Nov 18 17:15:09 user nova-compute[74743]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 17:15:09 user nova-compute[74743]: </disk>
Nov 18 17:15:09 user nova-compute[74743]:  {{(pid=74743) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 17:15:09 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-1711e274-8dc1-4dd5-a108-a6780c181924 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Successfully detached device vdb from instance f93bf0ac-ecc8-447d-b9c1-381d36cd3135 from the persistent domain config.
Nov 18 17:15:09 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-1711e274-8dc1-4dd5-a108-a6780c181924 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f93bf0ac-ecc8-447d-b9c1-381d36cd3135 from the live domain config. {{(pid=74743) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 17:15:09 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-1711e274-8dc1-4dd5-a108-a6780c181924 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 17:15:09 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:15:09 user nova-compute[74743]:   <source dev="/dev/sdg"/>
Nov 18 17:15:09 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:15:09 user nova-compute[74743]:   <serial>ff3050e6-8384-4346-b140-9a09acdda1f9</serial>
Nov 18 17:15:09 user nova-compute[74743]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 17:15:09 user nova-compute[74743]: </disk>
Nov 18 17:15:09 user nova-compute[74743]:  {{(pid=74743) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 17:15:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:10 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-1711e274-8dc1-4dd5-a108-a6780c181924 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f93bf0ac-ecc8-447d-b9c1-381d36cd3135 {{(pid=74743) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 17:15:11 user nova-compute[74743]: DEBUG nova.compute.manager [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:15:11 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Guest created on hypervisor {{(pid=74743) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 17:15:11 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Instance spawned successfully.
Nov 18 17:15:11 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 17:15:11 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Found default for hw_cdrom_bus of ide {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:15:11 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Found default for hw_disk_bus of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:15:11 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Found default for hw_input_bus of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:15:11 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Found default for hw_pointer_model of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:15:11 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Found default for hw_video_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:15:11 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Found default for hw_vif_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:15:11 user nova-compute[74743]: INFO nova.compute.manager [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Took 5.17 seconds to spawn the instance on the hypervisor.
Nov 18 17:15:11 user nova-compute[74743]: DEBUG nova.compute.manager [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:15:11 user nova-compute[74743]: DEBUG nova.compute.manager [req-91596b7d-b09c-4b03-b606-362a93db4b10 req-45dbb853-d543-43b1-9d0e-b2bbc29633e4 service nova] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Received event network-vif-plugged-4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:15:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-91596b7d-b09c-4b03-b606-362a93db4b10 req-45dbb853-d543-43b1-9d0e-b2bbc29633e4 service nova] Acquiring lock "69d78ecf-740d-492a-be5b-ffd064e36f00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:15:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-91596b7d-b09c-4b03-b606-362a93db4b10 req-45dbb853-d543-43b1-9d0e-b2bbc29633e4 service nova] Lock "69d78ecf-740d-492a-be5b-ffd064e36f00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:15:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-91596b7d-b09c-4b03-b606-362a93db4b10 req-45dbb853-d543-43b1-9d0e-b2bbc29633e4 service nova] Lock "69d78ecf-740d-492a-be5b-ffd064e36f00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:15:11 user nova-compute[74743]: DEBUG nova.compute.manager [req-91596b7d-b09c-4b03-b606-362a93db4b10 req-45dbb853-d543-43b1-9d0e-b2bbc29633e4 service nova] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] No waiting events found dispatching network-vif-plugged-4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:15:11 user nova-compute[74743]: WARNING nova.compute.manager [req-91596b7d-b09c-4b03-b606-362a93db4b10 req-45dbb853-d543-43b1-9d0e-b2bbc29633e4 service nova] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Received unexpected event network-vif-plugged-4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8 for instance with vm_state building and task_state spawning.
Nov 18 17:15:11 user nova-compute[74743]: INFO nova.compute.manager [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Took 12.32 seconds to build instance.
Nov 18 17:15:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-94496bc5-92c4-4f39-81a6-0ee134c2c533 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "69d78ecf-740d-492a-be5b-ffd064e36f00" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.462s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:15:13 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:23 user nova-compute[74743]: INFO nova.compute.manager [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Rescuing
Nov 18 17:15:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquiring lock "refresh_cache-f649143e-f7db-475a-bbe5-d5e7316caac3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:15:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquired lock "refresh_cache-f649143e-f7db-475a-bbe5-d5e7316caac3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:15:23 user nova-compute[74743]: DEBUG nova.network.neutron [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:15:23 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:23 user nova-compute[74743]: DEBUG nova.network.neutron [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Updating instance_info_cache with network_info: [{"id": "494b363a-ab2e-4efc-9331-d2b303860a08", "address": "fa:16:3e:e7:77:41", "network": {"id": "1bbf6aff-4048-4212-a716-d0628575bfd0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc0fda74575d488a94e2dcfdc016598c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494b363a-ab", "ovs_interfaceid": "494b363a-ab2e-4efc-9331-d2b303860a08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:15:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Releasing lock "refresh_cache-f649143e-f7db-475a-bbe5-d5e7316caac3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:15:23 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:23 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:23 user nova-compute[74743]: DEBUG nova.compute.manager [req-078f7c0f-d2c7-4b94-a96c-bf40d37deca0 req-43b60b24-dee4-456b-b63d-828d29c97a7e service nova] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Received event network-vif-unplugged-494b363a-ab2e-4efc-9331-d2b303860a08 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:15:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-078f7c0f-d2c7-4b94-a96c-bf40d37deca0 req-43b60b24-dee4-456b-b63d-828d29c97a7e service nova] Acquiring lock "f649143e-f7db-475a-bbe5-d5e7316caac3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:15:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-078f7c0f-d2c7-4b94-a96c-bf40d37deca0 req-43b60b24-dee4-456b-b63d-828d29c97a7e service nova] Lock "f649143e-f7db-475a-bbe5-d5e7316caac3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:15:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-078f7c0f-d2c7-4b94-a96c-bf40d37deca0 req-43b60b24-dee4-456b-b63d-828d29c97a7e service nova] Lock "f649143e-f7db-475a-bbe5-d5e7316caac3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:15:23 user nova-compute[74743]: DEBUG nova.compute.manager [req-078f7c0f-d2c7-4b94-a96c-bf40d37deca0 req-43b60b24-dee4-456b-b63d-828d29c97a7e service nova] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] No waiting events found dispatching network-vif-unplugged-494b363a-ab2e-4efc-9331-d2b303860a08 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:15:23 user nova-compute[74743]: WARNING nova.compute.manager [req-078f7c0f-d2c7-4b94-a96c-bf40d37deca0 req-43b60b24-dee4-456b-b63d-828d29c97a7e service nova] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Received unexpected event network-vif-unplugged-494b363a-ab2e-4efc-9331-d2b303860a08 for instance with vm_state active and task_state rescuing.
Nov 18 17:15:23 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:23 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:24 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Instance destroyed successfully.
Nov 18 17:15:24 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Attempting a stable device rescue
Nov 18 17:15:24 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74743) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 18 17:15:24 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Instance directory exists: not creating {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 18 17:15:24 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Creating image(s)
Nov 18 17:15:24 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquiring lock "/opt/stack/data/nova/instances/f649143e-f7db-475a-bbe5-d5e7316caac3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:15:24 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "/opt/stack/data/nova/instances/f649143e-f7db-475a-bbe5-d5e7316caac3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:15:24 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "/opt/stack/data/nova/instances/f649143e-f7db-475a-bbe5-d5e7316caac3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:15:24 user nova-compute[74743]: DEBUG nova.objects.instance [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lazy-loading 'trusted_certs' on Instance uuid f649143e-f7db-475a-bbe5-d5e7316caac3 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:15:24 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquiring lock "8db625959abb54b8df31802a221ba4d162069606" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:15:24 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "8db625959abb54b8df31802a221ba4d162069606" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:15:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8db625959abb54b8df31802a221ba4d162069606.part --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8db625959abb54b8df31802a221ba4d162069606.part --force-share --output=json" returned: 0 in 0.183s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:25 user nova-compute[74743]: DEBUG nova.virt.images [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] cec7209b-7ecb-4437-a5e9-8c665791e24a was qcow2, converting to raw {{(pid=74743) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 18 17:15:25 user nova-compute[74743]: DEBUG nova.privsep.utils [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74743) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 18 17:15:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8db625959abb54b8df31802a221ba4d162069606.part /opt/stack/data/nova/instances/_base/8db625959abb54b8df31802a221ba4d162069606.converted {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:25 user nova-compute[74743]: DEBUG nova.compute.manager [req-aa656d32-7eee-45ab-8c4f-7bbe0bd69cd3 req-5d17e7c6-fe36-459f-a506-f0a1e80539d0 service nova] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Received event network-vif-plugged-494b363a-ab2e-4efc-9331-d2b303860a08 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:15:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-aa656d32-7eee-45ab-8c4f-7bbe0bd69cd3 req-5d17e7c6-fe36-459f-a506-f0a1e80539d0 service nova] Acquiring lock "f649143e-f7db-475a-bbe5-d5e7316caac3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:15:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-aa656d32-7eee-45ab-8c4f-7bbe0bd69cd3 req-5d17e7c6-fe36-459f-a506-f0a1e80539d0 service nova] Lock "f649143e-f7db-475a-bbe5-d5e7316caac3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:15:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-aa656d32-7eee-45ab-8c4f-7bbe0bd69cd3 req-5d17e7c6-fe36-459f-a506-f0a1e80539d0 service nova] Lock "f649143e-f7db-475a-bbe5-d5e7316caac3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:15:25 user nova-compute[74743]: DEBUG nova.compute.manager [req-aa656d32-7eee-45ab-8c4f-7bbe0bd69cd3 req-5d17e7c6-fe36-459f-a506-f0a1e80539d0 service nova] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] No waiting events found dispatching network-vif-plugged-494b363a-ab2e-4efc-9331-d2b303860a08 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:15:25 user nova-compute[74743]: WARNING nova.compute.manager [req-aa656d32-7eee-45ab-8c4f-7bbe0bd69cd3 req-5d17e7c6-fe36-459f-a506-f0a1e80539d0 service nova] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Received unexpected event network-vif-plugged-494b363a-ab2e-4efc-9331-d2b303860a08 for instance with vm_state active and task_state rescuing.
Nov 18 17:15:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8db625959abb54b8df31802a221ba4d162069606.part /opt/stack/data/nova/instances/_base/8db625959abb54b8df31802a221ba4d162069606.converted" returned: 0 in 0.312s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8db625959abb54b8df31802a221ba4d162069606.converted --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8db625959abb54b8df31802a221ba4d162069606.converted --force-share --output=json" returned: 0 in 0.175s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "8db625959abb54b8df31802a221ba4d162069606" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.708s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquiring lock "8db625959abb54b8df31802a221ba4d162069606" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "8db625959abb54b8df31802a221ba4d162069606" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8db625959abb54b8df31802a221ba4d162069606 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8db625959abb54b8df31802a221ba4d162069606 --force-share --output=json" returned: 0 in 0.177s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8db625959abb54b8df31802a221ba4d162069606,backing_fmt=raw /opt/stack/data/nova/instances/f649143e-f7db-475a-bbe5-d5e7316caac3/disk.rescue {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8db625959abb54b8df31802a221ba4d162069606,backing_fmt=raw /opt/stack/data/nova/instances/f649143e-f7db-475a-bbe5-d5e7316caac3/disk.rescue" returned: 0 in 0.054s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "8db625959abb54b8df31802a221ba4d162069606" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG nova.objects.instance [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lazy-loading 'migration_context' on Instance uuid f649143e-f7db-475a-bbe5-d5e7316caac3 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG nova.objects.base [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Object Instance<f649143e-f7db-475a-bbe5-d5e7316caac3> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Created local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Start _get_guest_xml network_info=[{"id": "494b363a-ab2e-4efc-9331-d2b303860a08", "address": "fa:16:3e:e7:77:41", "network": {"id": "1bbf6aff-4048-4212-a716-d0628575bfd0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "vif_mac": "fa:16:3e:e7:77:41"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc0fda74575d488a94e2dcfdc016598c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494b363a-ab", "ovs_interfaceid": "494b363a-ab2e-4efc-9331-d2b303860a08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'cec7209b-7ecb-4437-a5e9-8c665791e24a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '72ff9250-7c23-463d-98c0-19a363c42940', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nPaDyYBm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'f649143e-f7db-475a-bbe5-d5e7316caac3', 'attached_at': '', 'detached_at': '', 'volume_id': 'bc44e0d3-d7fa-4591-8c0d-47dc457d0127', 'serial': 'bc44e0d3-d7fa-4591-8c0d-47dc457d0127'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG nova.objects.instance [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lazy-loading 'resources' on Instance uuid f649143e-f7db-475a-bbe5-d5e7316caac3 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG nova.objects.base [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Object Instance<f649143e-f7db-475a-bbe5-d5e7316caac3> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG nova.objects.instance [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lazy-loading 'numa_topology' on Instance uuid f649143e-f7db-475a-bbe5-d5e7316caac3 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG nova.objects.base [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Object Instance<f649143e-f7db-475a-bbe5-d5e7316caac3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:15:26 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:15:26 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:15:26 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG nova.objects.instance [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lazy-loading 'vcpu_model' on Instance uuid f649143e-f7db-475a-bbe5-d5e7316caac3 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG nova.objects.base [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Object Instance<f649143e-f7db-475a-bbe5-d5e7316caac3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Calling os-brick to attach iSCSI Volume {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nPaDyYBm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:15:26 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:15:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:15:26 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:15:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:15:26 user nova-compute[74743]: INFO os_brick.initiator.connectors.iscsi [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 17:15:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 -p 172.16.0.220:3260 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ba7767-fdf9-49c2-bc13-2533d22e79c8]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = nPaDyYBm\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 18 17:15:26 user nova-compute[74743]: node.name = iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127
Nov 18 17:15:26 user nova-compute[74743]: node.tpgt = -1
Nov 18 17:15:26 user nova-compute[74743]: node.startup = automatic
Nov 18 17:15:26 user nova-compute[74743]: node.leading_login = No
Nov 18 17:15:26 user nova-compute[74743]: iface.iscsi_ifacename = default
Nov 18 17:15:26 user nova-compute[74743]: iface.net_ifacename = <empty>
Nov 18 17:15:26 user nova-compute[74743]: iface.ipaddress = <empty>
Nov 18 17:15:26 user nova-compute[74743]: iface.prefix_len = 0
Nov 18 17:15:26 user nova-compute[74743]: iface.hwaddress = <empty>
Nov 18 17:15:26 user nova-compute[74743]: iface.transport_name = tcp
Nov 18 17:15:26 user nova-compute[74743]: iface.initiatorname = <empty>
Nov 18 17:15:26 user nova-compute[74743]: iface.state = <empty>
Nov 18 17:15:26 user nova-compute[74743]: iface.vlan_id = 0
Nov 18 17:15:26 user nova-compute[74743]: iface.vlan_priority = 0
Nov 18 17:15:26 user nova-compute[74743]: iface.vlan_state = <empty>
Nov 18 17:15:26 user nova-compute[74743]: iface.iface_num = 0
Nov 18 17:15:26 user nova-compute[74743]: iface.mtu = 0
Nov 18 17:15:26 user nova-compute[74743]: iface.port = 0
Nov 18 17:15:26 user nova-compute[74743]: iface.bootproto = <empty>
Nov 18 17:15:26 user nova-compute[74743]: iface.subnet_mask = <empty>
Nov 18 17:15:26 user nova-compute[74743]: iface.gateway = <empty>
Nov 18 17:15:26 user nova-compute[74743]: iface.dhcp_alt_client_id_state = <empty>
Nov 18 17:15:26 user nova-compute[74743]: iface.dhcp_alt_client_id = <empty>
Nov 18 17:15:26 user nova-compute[74743]: iface.dhcp_dns = <empty>
Nov 18 17:15:26 user nova-compute[74743]: iface.dhcp_learn_iqn = <empty>
Nov 18 17:15:26 user nova-compute[74743]: iface.dhcp_req_vendor_id_state = <empty>
Nov 18 17:15:26 user nova-compute[74743]: iface.dhcp_vendor_id_state = <empty>
Nov 18 17:15:26 user nova-compute[74743]: iface.dhcp_vendor_id = <empty>
Nov 18 17:15:26 user nova-compute[74743]: iface.dhcp_slp_da = <empty>
Nov 18 17:15:26 user nova-compute[74743]: iface.fragmentation = <empty>
Nov 18 17:15:26 user nova-compute[74743]: iface.gratuitous_arp = <empty>
Nov 18 17:15:26 user nova-compute[74743]: iface.incoming_forwarding = <empty>
Nov 18 17:15:26 user nova-compute[74743]: iface.tos_state = <empty>
Nov 18 17:15:26 user nova-compute[74743]: iface.tos = 0
Nov 18 17:15:26 user nova-compute[74743]: iface.ttl = 0
Nov 18 17:15:26 user nova-compute[74743]: iface.delayed_ack = <empty>
Nov 18 17:15:26 user nova-compute[74743]: iface.tcp_nagle = <empty>
Nov 18 17:15:26 user nova-compute[74743]: iface.tcp_wsf_state = <empty>
Nov 18 17:15:26 user nova-compute[74743]: iface.tcp_wsf = 0
Nov 18 17:15:26 user nova-compute[74743]: iface.tcp_timer_scale = 0
Nov 18 17:15:26 user nova-compute[74743]: iface.tcp_timestamp = <empty>
Nov 18 17:15:26 user nova-compute[74743]: iface.redirect = <empty>
Nov 18 17:15:26 user nova-compute[74743]: iface.def_task_mgmt_timeout = 0
Nov 18 17:15:26 user nova-compute[74743]: iface.header_digest = <empty>
Nov 18 17:15:26 user nova-compute[74743]: iface.data_digest = <empty>
Nov 18 17:15:26 user nova-compute[74743]: iface.immediate_data = <empty>
Nov 18 17:15:26 user nova-compute[74743]: iface.initial_r2t = <empty>
Nov 18 17:15:26 user nova-compute[74743]: iface.data_seq_inorder = <empty>
Nov 18 17:15:26 user nova-compute[74743]: iface.data_pdu_inorder = <empty>
Nov 18 17:15:26 user nova-compute[74743]: iface.erl = 0
Nov 18 17:15:26 user nova-compute[74743]: iface.max_receive_data_len = 0
Nov 18 17:15:26 user nova-compute[74743]: iface.first_burst_len = 0
Nov 18 17:15:26 user nova-compute[74743]: iface.max_outstanding_r2t = 0
Nov 18 17:15:26 user nova-compute[74743]: iface.max_burst_len = 0
Nov 18 17:15:26 user nova-compute[74743]: iface.chap_auth = <empty>
Nov 18 17:15:26 user nova-compute[74743]: iface.bidi_chap = <empty>
Nov 18 17:15:26 user nova-compute[74743]: iface.strict_login_compliance = <empty>
Nov 18 17:15:26 user nova-compute[74743]: iface.discovery_auth = <empty>
Nov 18 17:15:26 user nova-compute[74743]: iface.discovery_logout = <empty>
Nov 18 17:15:26 user nova-compute[74743]: node.discovery_address = <empty>
Nov 18 17:15:26 user nova-compute[74743]: node.discovery_port = 0
Nov 18 17:15:26 user nova-compute[74743]: node.discovery_type = static
Nov 18 17:15:26 user nova-compute[74743]: node.session.initial_cmdsn = 0
Nov 18 17:15:26 user nova-compute[74743]: node.session.initial_login_retry_max = 8
Nov 18 17:15:26 user nova-compute[74743]: node.session.xmit_thread_priority = -20
Nov 18 17:15:26 user nova-compute[74743]: node.session.cmds_max = 128
Nov 18 17:15:26 user nova-compute[74743]: node.session.queue_depth = 32
Nov 18 17:15:26 user nova-compute[74743]: node.session.nr_sessions = 1
Nov 18 17:15:26 user nova-compute[74743]: node.session.auth.authmethod = CHAP
Nov 18 17:15:26 user nova-compute[74743]: node.session.auth.username = nPaDyYBm
Nov 18 17:15:26 user nova-compute[74743]: node.session.auth.password = ***
Nov 18 17:15:26 user nova-compute[74743]: node.session.auth.username_in = <empty>
Nov 18 17:15:26 user nova-compute[74743]: node.session.auth.password_in = <empty>
Nov 18 17:15:26 user nova-compute[74743]: node.session.auth.chap_algs = MD5
Nov 18 17:15:26 user nova-compute[74743]: node.session.timeo.replacement_timeout = 120
Nov 18 17:15:26 user nova-compute[74743]: node.session.err_timeo.abort_timeout = 15
Nov 18 17:15:26 user nova-compute[74743]: node.session.err_timeo.lu_reset_timeout = 30
Nov 18 17:15:26 user nova-compute[74743]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 18 17:15:26 user nova-compute[74743]: node.session.err_timeo.host_reset_timeout = 60
Nov 18 17:15:26 user nova-compute[74743]: node.session.iscsi.FastAbort = Yes
Nov 18 17:15:26 user nova-compute[74743]: node.session.iscsi.InitialR2T = No
Nov 18 17:15:26 user nova-compute[74743]: node.session.iscsi.ImmediateData = Yes
Nov 18 17:15:26 user nova-compute[74743]: node.session.iscsi.FirstBurstLength = 262144
Nov 18 17:15:26 user nova-compute[74743]: node.session.iscsi.MaxBurstLength = 16776192
Nov 18 17:15:26 user nova-compute[74743]: node.session.iscsi.DefaultTime2Retain = 0
Nov 18 17:15:26 user nova-compute[74743]: node.session.iscsi.DefaultTime2Wait = 2
Nov 18 17:15:26 user nova-compute[74743]: node.session.iscsi.MaxConnections = 1
Nov 18 17:15:26 user nova-compute[74743]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 18 17:15:26 user nova-compute[74743]: node.session.iscsi.ERL = 0
Nov 18 17:15:26 user nova-compute[74743]: node.session.scan = manual
Nov 18 17:15:26 user nova-compute[74743]: node.session.reopen_max = 0
Nov 18 17:15:26 user nova-compute[74743]: node.conn[0].address = 172.16.0.220
Nov 18 17:15:26 user nova-compute[74743]: node.conn[0].port = 3260
Nov 18 17:15:26 user nova-compute[74743]: node.conn[0].startup = manual
Nov 18 17:15:26 user nova-compute[74743]: node.conn[0].tcp.window_size = 524288
Nov 18 17:15:26 user nova-compute[74743]: node.conn[0].tcp.type_of_service = 0
Nov 18 17:15:26 user nova-compute[74743]: node.conn[0].timeo.logout_timeout = 15
Nov 18 17:15:26 user nova-compute[74743]: node.conn[0].timeo.login_timeout = 15
Nov 18 17:15:26 user nova-compute[74743]: node.conn[0].timeo.auth_timeout = 45
Nov 18 17:15:26 user nova-compute[74743]: node.conn[0].timeo.noop_out_interval = 5
Nov 18 17:15:26 user nova-compute[74743]: node.conn[0].timeo.noop_out_timeout = 5
Nov 18 17:15:26 user nova-compute[74743]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 18 17:15:26 user nova-compute[74743]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 18 17:15:26 user nova-compute[74743]: node.conn[0].iscsi.HeaderDigest = None
Nov 18 17:15:26 user nova-compute[74743]: node.conn[0].iscsi.DataDigest = None
Nov 18 17:15:26 user nova-compute[74743]: node.conn[0].iscsi.IFMarker = No
Nov 18 17:15:26 user nova-compute[74743]: node.conn[0].iscsi.OFMarker = No
Nov 18 17:15:26 user nova-compute[74743]: # END RECORD
Nov 18 17:15:26 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe5bf2f-e3e5-42f3-bc77-36bcd5c7af67]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b0d027-3ee1-4221-89fb-cb243636a9ef]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nPaDyYBm {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nPaDyYBm" returned: 0 in 0.023s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[94646256-1b70-4f22-a9ff-17f6806b94d9]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nPaDyYBm'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e4939e-a953-46bf-bdda-a330ed65f598]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44876c8-2f91-4b9a-a8a2-9d13c3541bb2]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:15:26 user nova-compute[74743]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:15:26 user nova-compute[74743]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)
Nov 18 17:15:26 user nova-compute[74743]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:15:26 user nova-compute[74743]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f (non-flash)
Nov 18 17:15:26 user nova-compute[74743]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9 (non-flash)
Nov 18 17:15:26 user nova-compute[74743]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)
Nov 18 17:15:26 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:15:26 user nova-compute[74743]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:15:26 user nova-compute[74743]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)
Nov 18 17:15:26 user nova-compute[74743]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:15:26 user nova-compute[74743]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f (non-flash)
Nov 18 17:15:26 user nova-compute[74743]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9 (non-flash)
Nov 18 17:15:26 user nova-compute[74743]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)
Nov 18 17:15:26 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.152s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Connected to 172.16.0.220:3260 {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] HCTL ('37', '0', '0', 0) found on session 34 with lun 0 {{(pid=74743) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=74743) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Starting heal instance info cache {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Rebuilding the list of instances to heal {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.013s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[f606c7cb-0329-4e99-b7b1-ec26cfbaaac9]: (4, ('0 0 0', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Searching for a device in session 34 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nPaDyYBm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.174s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] <== connect_volume: return (176ms) {'type': 'block', 'scsi_wwn': '23830653134343535', 'path': '/dev/sdf'} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830653134343535', 'path': '/dev/sdf'} {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:13:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-813639784',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-813639784',id=29,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:13:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc0fda74575d488a94e2dcfdc016598c',ramdisk_id='',reservation_id='r-i2jtfef2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-633893051',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:13:52Z,user_data=None,user_id='5639bd2666534fdca04d0958dcdc9f54',uuid=f649143e-f7db-475a-bbe5-d5e7316caac3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "494b363a-ab2e-4efc-9331-d2b303860a08", "address": "fa:16:3e:e7:77:41", "network": {"id": "1bbf6aff-4048-4212-a716-d0628575bfd0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "vif_mac": "fa:16:3e:e7:77:41"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc0fda74575d488a94e2dcfdc016598c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494b363a-ab", "ovs_interfaceid": "494b363a-ab2e-4efc-9331-d2b303860a08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Converting VIF {"id": "494b363a-ab2e-4efc-9331-d2b303860a08", "address": "fa:16:3e:e7:77:41", "network": {"id": "1bbf6aff-4048-4212-a716-d0628575bfd0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "vif_mac": "fa:16:3e:e7:77:41"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc0fda74575d488a94e2dcfdc016598c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494b363a-ab", "ovs_interfaceid": "494b363a-ab2e-4efc-9331-d2b303860a08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:77:41,bridge_name='br-int',has_traffic_filtering=True,id=494b363a-ab2e-4efc-9331-d2b303860a08,network=Network(1bbf6aff-4048-4212-a716-d0628575bfd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap494b363a-ab') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG nova.objects.instance [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lazy-loading 'pci_devices' on Instance uuid f649143e-f7db-475a-bbe5-d5e7316caac3 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG nova.objects.base [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Object Instance<f649143e-f7db-475a-bbe5-d5e7316caac3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:15:26 user nova-compute[74743]:   <uuid>f649143e-f7db-475a-bbe5-d5e7316caac3</uuid>
Nov 18 17:15:26 user nova-compute[74743]:   <name>instance-0000001d</name>
Nov 18 17:15:26 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:15:26 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:15:26 user nova-compute[74743]:   <metadata>
Nov 18 17:15:26 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:15:26 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:15:26 user nova-compute[74743]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-813639784</nova:name>
Nov 18 17:15:26 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:15:26</nova:creationTime>
Nov 18 17:15:26 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:15:26 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:15:26 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:15:26 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:15:26 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:15:26 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:15:26 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:15:26 user nova-compute[74743]:       <nova:owner>
Nov 18 17:15:26 user nova-compute[74743]:         <nova:user uuid="5639bd2666534fdca04d0958dcdc9f54">tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member</nova:user>
Nov 18 17:15:26 user nova-compute[74743]:         <nova:project uuid="bc0fda74575d488a94e2dcfdc016598c">tempest-ServerBootFromVolumeStableRescueTest-633893051</nova:project>
Nov 18 17:15:26 user nova-compute[74743]:       </nova:owner>
Nov 18 17:15:26 user nova-compute[74743]:       <nova:root type="image" uuid="9536f6cf-95c4-40e2-864a-09a91525678a"/>
Nov 18 17:15:26 user nova-compute[74743]:       <nova:ports>
Nov 18 17:15:26 user nova-compute[74743]:         <nova:port uuid="494b363a-ab2e-4efc-9331-d2b303860a08">
Nov 18 17:15:26 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 18 17:15:26 user nova-compute[74743]:         </nova:port>
Nov 18 17:15:26 user nova-compute[74743]:       </nova:ports>
Nov 18 17:15:26 user nova-compute[74743]:     </nova:instance>
Nov 18 17:15:26 user nova-compute[74743]:   </metadata>
Nov 18 17:15:26 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:15:26 user nova-compute[74743]:     <system>
Nov 18 17:15:26 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:15:26 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:15:26 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:15:26 user nova-compute[74743]:       <entry name="serial">f649143e-f7db-475a-bbe5-d5e7316caac3</entry>
Nov 18 17:15:26 user nova-compute[74743]:       <entry name="uuid">f649143e-f7db-475a-bbe5-d5e7316caac3</entry>
Nov 18 17:15:26 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:15:26 user nova-compute[74743]:     </system>
Nov 18 17:15:26 user nova-compute[74743]:   </sysinfo>
Nov 18 17:15:26 user nova-compute[74743]:   <os>
Nov 18 17:15:26 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:15:26 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:15:26 user nova-compute[74743]:   </os>
Nov 18 17:15:26 user nova-compute[74743]:   <features>
Nov 18 17:15:26 user nova-compute[74743]:     <acpi/>
Nov 18 17:15:26 user nova-compute[74743]:     <apic/>
Nov 18 17:15:26 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:15:26 user nova-compute[74743]:   </features>
Nov 18 17:15:26 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:15:26 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:15:26 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:15:26 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:15:26 user nova-compute[74743]:   </clock>
Nov 18 17:15:26 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:15:26 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:15:26 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:15:26 user nova-compute[74743]:   </cpu>
Nov 18 17:15:26 user nova-compute[74743]:   <devices>
Nov 18 17:15:26 user nova-compute[74743]:     <disk type="block" device="disk">
Nov 18 17:15:26 user nova-compute[74743]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:15:26 user nova-compute[74743]:       <source dev="/dev/sdf"/>
Nov 18 17:15:26 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:15:26 user nova-compute[74743]:       <serial>bc44e0d3-d7fa-4591-8c0d-47dc457d0127</serial>
Nov 18 17:15:26 user nova-compute[74743]:     </disk>
Nov 18 17:15:26 user nova-compute[74743]:     <disk type="file" device="disk">
Nov 18 17:15:26 user nova-compute[74743]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 17:15:26 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/f649143e-f7db-475a-bbe5-d5e7316caac3/disk.rescue"/>
Nov 18 17:15:26 user nova-compute[74743]:       <target dev="vdb" bus="virtio"/>
Nov 18 17:15:26 user nova-compute[74743]:       <boot order="1"/>
Nov 18 17:15:26 user nova-compute[74743]:     </disk>
Nov 18 17:15:26 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:15:26 user nova-compute[74743]:       <mac address="fa:16:3e:e7:77:41"/>
Nov 18 17:15:26 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:15:26 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:15:26 user nova-compute[74743]:       <target dev="tap494b363a-ab"/>
Nov 18 17:15:26 user nova-compute[74743]:     </interface>
Nov 18 17:15:26 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:15:26 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/f649143e-f7db-475a-bbe5-d5e7316caac3/console.log" append="off"/>
Nov 18 17:15:26 user nova-compute[74743]:     </serial>
Nov 18 17:15:26 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:15:26 user nova-compute[74743]:     <video>
Nov 18 17:15:26 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:15:26 user nova-compute[74743]:     </video>
Nov 18 17:15:26 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:15:26 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:15:26 user nova-compute[74743]:     </rng>
Nov 18 17:15:26 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:15:26 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:15:26 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:15:26 user nova-compute[74743]:     </memballoon>
Nov 18 17:15:26 user nova-compute[74743]:   </devices>
Nov 18 17:15:26 user nova-compute[74743]: </domain>
Nov 18 17:15:26 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:15:26 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Instance destroyed successfully.
Nov 18 17:15:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "refresh_cache-4cce1628-2dcb-40c7-abd4-6a327a432de3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquired lock "refresh_cache-4cce1628-2dcb-40c7-abd4-6a327a432de3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Forcefully refreshing network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG nova.objects.instance [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lazy-loading 'info_cache' on Instance uuid 4cce1628-2dcb-40c7-abd4-6a327a432de3 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:15:26 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] No VIF found with MAC fa:16:3e:e7:77:41, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:15:27 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Updating instance_info_cache with network_info: [{"id": "28f81291-34bb-4a6f-890b-faea6ef8a385", "address": "fa:16:3e:47:f5:86", "network": {"id": "252343cc-f379-471d-a2c9-99b9a60ebcb4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25c06dc8e7be46229750b8e283622c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28f81291-34", "ovs_interfaceid": "28f81291-34bb-4a6f-890b-faea6ef8a385", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:15:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Releasing lock "refresh_cache-4cce1628-2dcb-40c7-abd4-6a327a432de3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:15:27 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Updated the network info_cache for instance {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 17:15:27 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:15:27 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:15:27 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:15:27 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:15:27 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74743) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 17:15:27 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:15:27 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:15:27 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:15:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:15:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:15:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:15:27 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Auditing locally available compute resources for user (node: user) {{(pid=74743) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 17:15:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:28 user nova-compute[74743]: DEBUG nova.compute.manager [req-67f98c44-04b2-4d26-ad5a-efc10412fd02 req-3b9046ec-c413-48a3-8411-61ee08aabd64 service nova] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Received event network-vif-plugged-494b363a-ab2e-4efc-9331-d2b303860a08 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:15:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-67f98c44-04b2-4d26-ad5a-efc10412fd02 req-3b9046ec-c413-48a3-8411-61ee08aabd64 service nova] Acquiring lock "f649143e-f7db-475a-bbe5-d5e7316caac3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:15:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-67f98c44-04b2-4d26-ad5a-efc10412fd02 req-3b9046ec-c413-48a3-8411-61ee08aabd64 service nova] Lock "f649143e-f7db-475a-bbe5-d5e7316caac3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:15:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-67f98c44-04b2-4d26-ad5a-efc10412fd02 req-3b9046ec-c413-48a3-8411-61ee08aabd64 service nova] Lock "f649143e-f7db-475a-bbe5-d5e7316caac3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:15:28 user nova-compute[74743]: DEBUG nova.compute.manager [req-67f98c44-04b2-4d26-ad5a-efc10412fd02 req-3b9046ec-c413-48a3-8411-61ee08aabd64 service nova] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] No waiting events found dispatching network-vif-plugged-494b363a-ab2e-4efc-9331-d2b303860a08 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:15:28 user nova-compute[74743]: WARNING nova.compute.manager [req-67f98c44-04b2-4d26-ad5a-efc10412fd02 req-3b9046ec-c413-48a3-8411-61ee08aabd64 service nova] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Received unexpected event network-vif-plugged-494b363a-ab2e-4efc-9331-d2b303860a08 for instance with vm_state active and task_state rescuing.
Nov 18 17:15:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG nova.compute.manager [None req-98c334de-9167-4a6e-8524-8ccf836b075a tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG nova.compute.manager [req-ced41e93-00ef-4d84-8633-5cd00846c3c2 req-8a79093f-cb14-49b7-9e32-638a4b7a030a service nova] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Received event network-vif-plugged-494b363a-ab2e-4efc-9331-d2b303860a08 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ced41e93-00ef-4d84-8633-5cd00846c3c2 req-8a79093f-cb14-49b7-9e32-638a4b7a030a service nova] Acquiring lock "f649143e-f7db-475a-bbe5-d5e7316caac3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ced41e93-00ef-4d84-8633-5cd00846c3c2 req-8a79093f-cb14-49b7-9e32-638a4b7a030a service nova] Lock "f649143e-f7db-475a-bbe5-d5e7316caac3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ced41e93-00ef-4d84-8633-5cd00846c3c2 req-8a79093f-cb14-49b7-9e32-638a4b7a030a service nova] Lock "f649143e-f7db-475a-bbe5-d5e7316caac3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG nova.compute.manager [req-ced41e93-00ef-4d84-8633-5cd00846c3c2 req-8a79093f-cb14-49b7-9e32-638a4b7a030a service nova] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] No waiting events found dispatching network-vif-plugged-494b363a-ab2e-4efc-9331-d2b303860a08 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:15:30 user nova-compute[74743]: WARNING nova.compute.manager [req-ced41e93-00ef-4d84-8633-5cd00846c3c2 req-8a79093f-cb14-49b7-9e32-638a4b7a030a service nova] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Received unexpected event network-vif-plugged-494b363a-ab2e-4efc-9331-d2b303860a08 for instance with vm_state active and task_state rescuing.
Nov 18 17:15:30 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-1711e274-8dc1-4dd5-a108-a6780c181924 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f93bf0ac-ecc8-447d-b9c1-381d36cd3135 is timed out.
Nov 18 17:15:30 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-1711e274-8dc1-4dd5-a108-a6780c181924 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Successfully detached device vdb from instance f93bf0ac-ecc8-447d-b9c1-381d36cd3135 from the live domain config.
Nov 18 17:15:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f93bf0ac-ecc8-447d-b9c1-381d36cd3135/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1711e274-8dc1-4dd5-a108-a6780c181924 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] calling os-brick to detach iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-1711e274-8dc1-4dd5-a108-a6780c181924 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, {'target_iqn': 'iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UhApbaKo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:15:30 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-1711e274-8dc1-4dd5-a108-a6780c181924 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:15:30 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-1711e274-8dc1-4dd5-a108-a6780c181924 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-1711e274-8dc1-4dd5-a108-a6780c181924 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45c06a1-81a7-46c8-b342-d972656145b7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-1711e274-8dc1-4dd5-a108-a6780c181924 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 17:15:30 user nova-compute[74743]: No targets found.
Nov 18 17:15:30 user nova-compute[74743]: iSNS:
Nov 18 17:15:30 user nova-compute[74743]: No targets found.
Nov 18 17:15:30 user nova-compute[74743]: STATIC:
Nov 18 17:15:30 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f
Nov 18 17:15:30 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:15:30 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:15:30 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5
Nov 18 17:15:30 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:15:30 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:15:30 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127
Nov 18 17:15:30 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:15:30 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:15:30 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9
Nov 18 17:15:30 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:15:30 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:15:30 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685
Nov 18 17:15:30 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:15:30 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:15:30 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5
Nov 18 17:15:30 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:15:30 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:15:30 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f
Nov 18 17:15:30 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:15:30 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:15:30 user nova-compute[74743]: FIRMWARE:
Nov 18 17:15:30 user nova-compute[74743]: No targets found.
Nov 18 17:15:30 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-1711e274-8dc1-4dd5-a108-a6780c181924 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 17:15:30 user nova-compute[74743]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 17:15:30 user nova-compute[74743]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74743) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-1711e274-8dc1-4dd5-a108-a6780c181924 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9', 0)] {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f19710-1bb0-4eac-acc3-6fc4068834db]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb167693-de00-42fd-bc93-62f5340371d4]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-1711e274-8dc1-4dd5-a108-a6780c181924 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:15:30 user nova-compute[74743]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:15:30 user nova-compute[74743]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)
Nov 18 17:15:30 user nova-compute[74743]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:15:30 user nova-compute[74743]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f (non-flash)
Nov 18 17:15:30 user nova-compute[74743]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9 (non-flash)
Nov 18 17:15:30 user nova-compute[74743]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)
Nov 18 17:15:30 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-1711e274-8dc1-4dd5-a108-a6780c181924 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:15:30 user nova-compute[74743]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:15:30 user nova-compute[74743]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)
Nov 18 17:15:30 user nova-compute[74743]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:15:30 user nova-compute[74743]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f (non-flash)
Nov 18 17:15:30 user nova-compute[74743]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9 (non-flash)
Nov 18 17:15:30 user nova-compute[74743]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)
Nov 18 17:15:30 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-1711e274-8dc1-4dd5-a108-a6780c181924 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb084e24d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9'): ({'sdg'}, set())}) {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-1711e274-8dc1-4dd5-a108-a6780c181924 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Removing single pathed devices sdg {{(pid=74743) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[45693022-ed81-4cfa-b815-551eb9b3428a]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[6912384d-e0d9-464f-86ba-a6c2a13e79f9]: (4, ('ok\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-1711e274-8dc1-4dd5-a108-a6780c181924 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Flushing IO for device /dev/sdg {{(pid=74743) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f93bf0ac-ecc8-447d-b9c1-381d36cd3135/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f93bf0ac-ecc8-447d-b9c1-381d36cd3135/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb8c9c6-5d2d-49dc-96a2-c97e102e5b28]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-1711e274-8dc1-4dd5-a108-a6780c181924 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74743) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.132s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fe2581-fa3f-4488-8a8f-79b3a3dc56db]: (4, ('1', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-1711e274-8dc1-4dd5-a108-a6780c181924 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-1711e274-8dc1-4dd5-a108-a6780c181924 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] SCSI volumes sdg have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-1711e274-8dc1-4dd5-a108-a6780c181924 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9')] {{(pid=74743) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f93bf0ac-ecc8-447d-b9c1-381d36cd3135/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[de90431e-b525-4fd0-a91a-de1047c552fb]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-1711e274-8dc1-4dd5-a108-a6780c181924 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9 -p 172.16.0.220:3260 --logout {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[db83542f-4dac-4f81-9309-a75f45b3437c]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-1711e274-8dc1-4dd5-a108-a6780c181924 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9, portal: 172.16.0.220,3260]
Nov 18 17:15:30 user nova-compute[74743]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9, portal: 172.16.0.220,3260] successful.
Nov 18 17:15:30 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9 -p 172.16.0.220:3260 --op delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff3050e6-8384-4346-b140-9a09acdda1f9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[73bcceaf-aa97-4dd5-93c3-f811645ac242]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-1711e274-8dc1-4dd5-a108-a6780c181924 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-1711e274-8dc1-4dd5-a108-a6780c181924 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.477s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-1711e274-8dc1-4dd5-a108-a6780c181924 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] <== disconnect_volume: return (479ms) None {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1711e274-8dc1-4dd5-a108-a6780c181924 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Disconnected iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:31 user nova-compute[74743]: DEBUG nova.objects.instance [None req-1711e274-8dc1-4dd5-a108-a6780c181924 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lazy-loading 'flavor' on Instance uuid f93bf0ac-ecc8-447d-b9c1-381d36cd3135 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:15:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-1711e274-8dc1-4dd5-a108-a6780c181924 tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.958s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:15:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:31 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:15:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd467693-8b2d-4e3d-9b1a-7581c6ae6153/disk.rescue --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd467693-8b2d-4e3d-9b1a-7581c6ae6153/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd467693-8b2d-4e3d-9b1a-7581c6ae6153/disk.rescue --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd467693-8b2d-4e3d-9b1a-7581c6ae6153/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:32 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /opt/stack/data/nova/instances/cd467693-8b2d-4e3d-9b1a-7581c6ae6153/disk (vdb) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:15:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad8aa2d-663c-4829-87f9-07959105ca68/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad8aa2d-663c-4829-87f9-07959105ca68/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad8aa2d-663c-4829-87f9-07959105ca68/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:33 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad8aa2d-663c-4829-87f9-07959105ca68/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:33 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:15:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:33 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:15:33 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:15:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f649143e-f7db-475a-bbe5-d5e7316caac3/disk.rescue --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f649143e-f7db-475a-bbe5-d5e7316caac3/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f649143e-f7db-475a-bbe5-d5e7316caac3/disk.rescue --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f649143e-f7db-475a-bbe5-d5e7316caac3/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:34 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:15:34 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:15:34 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Hypervisor/Node resource view: name=user free_ram=7357MB free_disk=25.331058502197266GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74743) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 17:15:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:15:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:15:34 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 4cce1628-2dcb-40c7-abd4-6a327a432de3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:15:34 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance e9668e1c-1e8d-4dd7-8f58-d453db294557 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:15:34 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance c006a4ad-a8e2-4108-9af1-dec4dd53fcda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:15:34 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 0ad8aa2d-663c-4829-87f9-07959105ca68 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:15:34 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance f93bf0ac-ecc8-447d-b9c1-381d36cd3135 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:15:34 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance aefe3db1-b9bb-4cce-aa31-d0b6684ad791 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:15:34 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 49ebdd5a-824d-476a-bd10-3b891bbfe9e2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:15:34 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance cd467693-8b2d-4e3d-9b1a-7581c6ae6153 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:15:34 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:15:34 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance f649143e-f7db-475a-bbe5-d5e7316caac3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:15:34 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 637e2b9b-9777-487f-8131-bdfcd520b2cf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:15:34 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 69d78ecf-740d-492a-be5b-ffd064e36f00 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:15:34 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 17:15:34 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 17:15:35 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:35 user nova-compute[74743]: INFO nova.compute.manager [None req-0b41c7cb-b873-449f-b8b0-85358f3a664b tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Unrescuing
Nov 18 17:15:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-0b41c7cb-b873-449f-b8b0-85358f3a664b tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Acquiring lock "refresh_cache-cd467693-8b2d-4e3d-9b1a-7581c6ae6153" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:15:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-0b41c7cb-b873-449f-b8b0-85358f3a664b tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Acquired lock "refresh_cache-cd467693-8b2d-4e3d-9b1a-7581c6ae6153" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:15:35 user nova-compute[74743]: DEBUG nova.network.neutron [None req-0b41c7cb-b873-449f-b8b0-85358f3a664b tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:15:35 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:15:35 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:15:35 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Compute_service record updated for user:user {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 17:15:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.777s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:15:35 user nova-compute[74743]: DEBUG nova.network.neutron [None req-0b41c7cb-b873-449f-b8b0-85358f3a664b tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Updating instance_info_cache with network_info: [{"id": "106be5e5-0143-4ab2-8e1f-30b2e46c5753", "address": "fa:16:3e:35:df:4c", "network": {"id": "252343cc-f379-471d-a2c9-99b9a60ebcb4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25c06dc8e7be46229750b8e283622c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106be5e5-01", "ovs_interfaceid": "106be5e5-0143-4ab2-8e1f-30b2e46c5753", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:15:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-0b41c7cb-b873-449f-b8b0-85358f3a664b tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Releasing lock "refresh_cache-cd467693-8b2d-4e3d-9b1a-7581c6ae6153" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:15:35 user nova-compute[74743]: DEBUG nova.objects.instance [None req-0b41c7cb-b873-449f-b8b0-85358f3a664b tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lazy-loading 'flavor' on Instance uuid cd467693-8b2d-4e3d-9b1a-7581c6ae6153 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:15:36 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:36 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:36 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:36 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:36 user nova-compute[74743]: DEBUG nova.compute.manager [req-2b003628-f337-4f87-844b-cdcad7bdf119 req-8d182b85-738c-4b1f-bf8e-8278894f7f75 service nova] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Received event network-vif-unplugged-106be5e5-0143-4ab2-8e1f-30b2e46c5753 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:15:36 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-2b003628-f337-4f87-844b-cdcad7bdf119 req-8d182b85-738c-4b1f-bf8e-8278894f7f75 service nova] Acquiring lock "cd467693-8b2d-4e3d-9b1a-7581c6ae6153-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:15:36 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-2b003628-f337-4f87-844b-cdcad7bdf119 req-8d182b85-738c-4b1f-bf8e-8278894f7f75 service nova] Lock "cd467693-8b2d-4e3d-9b1a-7581c6ae6153-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:15:36 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-2b003628-f337-4f87-844b-cdcad7bdf119 req-8d182b85-738c-4b1f-bf8e-8278894f7f75 service nova] Lock "cd467693-8b2d-4e3d-9b1a-7581c6ae6153-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:15:36 user nova-compute[74743]: DEBUG nova.compute.manager [req-2b003628-f337-4f87-844b-cdcad7bdf119 req-8d182b85-738c-4b1f-bf8e-8278894f7f75 service nova] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] No waiting events found dispatching network-vif-unplugged-106be5e5-0143-4ab2-8e1f-30b2e46c5753 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:15:36 user nova-compute[74743]: WARNING nova.compute.manager [req-2b003628-f337-4f87-844b-cdcad7bdf119 req-8d182b85-738c-4b1f-bf8e-8278894f7f75 service nova] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Received unexpected event network-vif-unplugged-106be5e5-0143-4ab2-8e1f-30b2e46c5753 for instance with vm_state rescued and task_state unrescuing.
Nov 18 17:15:36 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:15:36 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:15:36 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Instance destroyed successfully.
Nov 18 17:15:38 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:38 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:38 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:38 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:38 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:38 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:38 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:38 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:38 user nova-compute[74743]: DEBUG nova.compute.manager [req-3ba18de5-c2b6-4e7f-b63b-bdbc7274a6f4 req-946ce331-674d-46c4-b86b-33177100a0d4 service nova] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Received event network-vif-plugged-106be5e5-0143-4ab2-8e1f-30b2e46c5753 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:15:38 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3ba18de5-c2b6-4e7f-b63b-bdbc7274a6f4 req-946ce331-674d-46c4-b86b-33177100a0d4 service nova] Acquiring lock "cd467693-8b2d-4e3d-9b1a-7581c6ae6153-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:15:38 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3ba18de5-c2b6-4e7f-b63b-bdbc7274a6f4 req-946ce331-674d-46c4-b86b-33177100a0d4 service nova] Lock "cd467693-8b2d-4e3d-9b1a-7581c6ae6153-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:15:38 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3ba18de5-c2b6-4e7f-b63b-bdbc7274a6f4 req-946ce331-674d-46c4-b86b-33177100a0d4 service nova] Lock "cd467693-8b2d-4e3d-9b1a-7581c6ae6153-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:15:38 user nova-compute[74743]: DEBUG nova.compute.manager [req-3ba18de5-c2b6-4e7f-b63b-bdbc7274a6f4 req-946ce331-674d-46c4-b86b-33177100a0d4 service nova] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] No waiting events found dispatching network-vif-plugged-106be5e5-0143-4ab2-8e1f-30b2e46c5753 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:15:38 user nova-compute[74743]: WARNING nova.compute.manager [req-3ba18de5-c2b6-4e7f-b63b-bdbc7274a6f4 req-946ce331-674d-46c4-b86b-33177100a0d4 service nova] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Received unexpected event network-vif-plugged-106be5e5-0143-4ab2-8e1f-30b2e46c5753 for instance with vm_state rescued and task_state unrescuing.
Nov 18 17:15:38 user nova-compute[74743]: DEBUG nova.compute.manager [req-3ba18de5-c2b6-4e7f-b63b-bdbc7274a6f4 req-946ce331-674d-46c4-b86b-33177100a0d4 service nova] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Received event network-vif-plugged-106be5e5-0143-4ab2-8e1f-30b2e46c5753 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:15:38 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3ba18de5-c2b6-4e7f-b63b-bdbc7274a6f4 req-946ce331-674d-46c4-b86b-33177100a0d4 service nova] Acquiring lock "cd467693-8b2d-4e3d-9b1a-7581c6ae6153-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:15:38 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3ba18de5-c2b6-4e7f-b63b-bdbc7274a6f4 req-946ce331-674d-46c4-b86b-33177100a0d4 service nova] Lock "cd467693-8b2d-4e3d-9b1a-7581c6ae6153-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:15:38 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3ba18de5-c2b6-4e7f-b63b-bdbc7274a6f4 req-946ce331-674d-46c4-b86b-33177100a0d4 service nova] Lock "cd467693-8b2d-4e3d-9b1a-7581c6ae6153-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:15:38 user nova-compute[74743]: DEBUG nova.compute.manager [req-3ba18de5-c2b6-4e7f-b63b-bdbc7274a6f4 req-946ce331-674d-46c4-b86b-33177100a0d4 service nova] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] No waiting events found dispatching network-vif-plugged-106be5e5-0143-4ab2-8e1f-30b2e46c5753 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:15:38 user nova-compute[74743]: WARNING nova.compute.manager [req-3ba18de5-c2b6-4e7f-b63b-bdbc7274a6f4 req-946ce331-674d-46c4-b86b-33177100a0d4 service nova] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Received unexpected event network-vif-plugged-106be5e5-0143-4ab2-8e1f-30b2e46c5753 for instance with vm_state rescued and task_state unrescuing.
Nov 18 17:15:40 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:40 user nova-compute[74743]: DEBUG nova.compute.manager [None req-0b41c7cb-b873-449f-b8b0-85358f3a664b tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:15:40 user nova-compute[74743]: DEBUG nova.compute.manager [req-c3da7e39-82dd-485f-afe7-99338c57844b req-142c644d-dd04-46e3-bf7d-4b45e650bed5 service nova] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Received event network-vif-plugged-106be5e5-0143-4ab2-8e1f-30b2e46c5753 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:15:40 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-c3da7e39-82dd-485f-afe7-99338c57844b req-142c644d-dd04-46e3-bf7d-4b45e650bed5 service nova] Acquiring lock "cd467693-8b2d-4e3d-9b1a-7581c6ae6153-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:15:40 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-c3da7e39-82dd-485f-afe7-99338c57844b req-142c644d-dd04-46e3-bf7d-4b45e650bed5 service nova] Lock "cd467693-8b2d-4e3d-9b1a-7581c6ae6153-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:15:40 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-c3da7e39-82dd-485f-afe7-99338c57844b req-142c644d-dd04-46e3-bf7d-4b45e650bed5 service nova] Lock "cd467693-8b2d-4e3d-9b1a-7581c6ae6153-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:15:40 user nova-compute[74743]: DEBUG nova.compute.manager [req-c3da7e39-82dd-485f-afe7-99338c57844b req-142c644d-dd04-46e3-bf7d-4b45e650bed5 service nova] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] No waiting events found dispatching network-vif-plugged-106be5e5-0143-4ab2-8e1f-30b2e46c5753 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:15:40 user nova-compute[74743]: WARNING nova.compute.manager [req-c3da7e39-82dd-485f-afe7-99338c57844b req-142c644d-dd04-46e3-bf7d-4b45e650bed5 service nova] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Received unexpected event network-vif-plugged-106be5e5-0143-4ab2-8e1f-30b2e46c5753 for instance with vm_state active and task_state None.
Nov 18 17:15:43 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:45 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:50 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:57 user nova-compute[74743]: DEBUG nova.compute.manager [req-c3d33bae-b5db-470b-9d08-680f077614fd req-bf2e61e7-a074-450d-a3a6-5f40be378d9a service nova] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Received event network-changed-516dfceb-fc7a-43ad-b874-1eb33cc0f525 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:15:57 user nova-compute[74743]: DEBUG nova.compute.manager [req-c3d33bae-b5db-470b-9d08-680f077614fd req-bf2e61e7-a074-450d-a3a6-5f40be378d9a service nova] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Refreshing instance network info cache due to event network-changed-516dfceb-fc7a-43ad-b874-1eb33cc0f525. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:15:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-c3d33bae-b5db-470b-9d08-680f077614fd req-bf2e61e7-a074-450d-a3a6-5f40be378d9a service nova] Acquiring lock "refresh_cache-637e2b9b-9777-487f-8131-bdfcd520b2cf" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:15:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-c3d33bae-b5db-470b-9d08-680f077614fd req-bf2e61e7-a074-450d-a3a6-5f40be378d9a service nova] Acquired lock "refresh_cache-637e2b9b-9777-487f-8131-bdfcd520b2cf" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:15:57 user nova-compute[74743]: DEBUG nova.network.neutron [req-c3d33bae-b5db-470b-9d08-680f077614fd req-bf2e61e7-a074-450d-a3a6-5f40be378d9a service nova] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Refreshing network info cache for port 516dfceb-fc7a-43ad-b874-1eb33cc0f525 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:15:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:58 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-01353b9e-e751-4172-970e-b4151dae4302 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "637e2b9b-9777-487f-8131-bdfcd520b2cf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:15:58 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-01353b9e-e751-4172-970e-b4151dae4302 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "637e2b9b-9777-487f-8131-bdfcd520b2cf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:15:58 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-01353b9e-e751-4172-970e-b4151dae4302 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "637e2b9b-9777-487f-8131-bdfcd520b2cf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:15:58 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-01353b9e-e751-4172-970e-b4151dae4302 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "637e2b9b-9777-487f-8131-bdfcd520b2cf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:15:58 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-01353b9e-e751-4172-970e-b4151dae4302 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "637e2b9b-9777-487f-8131-bdfcd520b2cf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:15:58 user nova-compute[74743]: INFO nova.compute.manager [None req-01353b9e-e751-4172-970e-b4151dae4302 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Terminating instance
Nov 18 17:15:58 user nova-compute[74743]: DEBUG nova.compute.manager [None req-01353b9e-e751-4172-970e-b4151dae4302 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Start destroying the instance on the hypervisor. {{(pid=74743) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 17:15:58 user nova-compute[74743]: DEBUG nova.network.neutron [req-c3d33bae-b5db-470b-9d08-680f077614fd req-bf2e61e7-a074-450d-a3a6-5f40be378d9a service nova] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Updated VIF entry in instance network info cache for port 516dfceb-fc7a-43ad-b874-1eb33cc0f525. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:15:58 user nova-compute[74743]: DEBUG nova.network.neutron [req-c3d33bae-b5db-470b-9d08-680f077614fd req-bf2e61e7-a074-450d-a3a6-5f40be378d9a service nova] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Updating instance_info_cache with network_info: [{"id": "516dfceb-fc7a-43ad-b874-1eb33cc0f525", "address": "fa:16:3e:82:84:7a", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap516dfceb-fc", "ovs_interfaceid": "516dfceb-fc7a-43ad-b874-1eb33cc0f525", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:15:58 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-c3d33bae-b5db-470b-9d08-680f077614fd req-bf2e61e7-a074-450d-a3a6-5f40be378d9a service nova] Releasing lock "refresh_cache-637e2b9b-9777-487f-8131-bdfcd520b2cf" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:15:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:58 user nova-compute[74743]: DEBUG nova.compute.manager [req-ab4250ae-55a5-45f3-896c-14b4f4956ac7 req-83cc07fa-2d39-4176-8342-4db6b51a38f7 service nova] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Received event network-vif-unplugged-516dfceb-fc7a-43ad-b874-1eb33cc0f525 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:15:58 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ab4250ae-55a5-45f3-896c-14b4f4956ac7 req-83cc07fa-2d39-4176-8342-4db6b51a38f7 service nova] Acquiring lock "637e2b9b-9777-487f-8131-bdfcd520b2cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:15:58 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ab4250ae-55a5-45f3-896c-14b4f4956ac7 req-83cc07fa-2d39-4176-8342-4db6b51a38f7 service nova] Lock "637e2b9b-9777-487f-8131-bdfcd520b2cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:15:58 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ab4250ae-55a5-45f3-896c-14b4f4956ac7 req-83cc07fa-2d39-4176-8342-4db6b51a38f7 service nova] Lock "637e2b9b-9777-487f-8131-bdfcd520b2cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:15:58 user nova-compute[74743]: DEBUG nova.compute.manager [req-ab4250ae-55a5-45f3-896c-14b4f4956ac7 req-83cc07fa-2d39-4176-8342-4db6b51a38f7 service nova] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] No waiting events found dispatching network-vif-unplugged-516dfceb-fc7a-43ad-b874-1eb33cc0f525 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:15:58 user nova-compute[74743]: DEBUG nova.compute.manager [req-ab4250ae-55a5-45f3-896c-14b4f4956ac7 req-83cc07fa-2d39-4176-8342-4db6b51a38f7 service nova] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Received event network-vif-unplugged-516dfceb-fc7a-43ad-b874-1eb33cc0f525 for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:15:59 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Instance destroyed successfully.
Nov 18 17:15:59 user nova-compute[74743]: DEBUG nova.objects.instance [None req-01353b9e-e751-4172-970e-b4151dae4302 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lazy-loading 'resources' on Instance uuid 637e2b9b-9777-487f-8131-bdfcd520b2cf {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-01353b9e-e751-4172-970e-b4151dae4302 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:14:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-647896724',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-647896724',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-647896724',id=30,image_ref='5181ad90-8e75-4121-94bf-097b312f8116',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9sY+e7+bXx7xx657lpp9T9wkaGY6OdXVIAxHFvlWLceFpLKLkG6qJH1tRzTNXnc4vahxl8bKQIP4LMaCexomCLKj7UapHmG4YvWAj0rqepU94udslF0FrvLYpXl+MIqw==',key_name='tempest-keypair-1816661825',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:14:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a956c4d6e4304d34872ecf989279c886',ramdisk_id='',reservation_id='r-usntrsyc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1373443944',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1373443944-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1373443944',owner_user_name='tempest-TestVolumeBootPattern-1373443944-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:14:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89ce0d4bf7234c348b9b1a8979609c7b',uuid=637e2b9b-9777-487f-8131-bdfcd520b2cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "516dfceb-fc7a-43ad-b874-1eb33cc0f525", "address": "fa:16:3e:82:84:7a", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap516dfceb-fc", "ovs_interfaceid": "516dfceb-fc7a-43ad-b874-1eb33cc0f525", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-01353b9e-e751-4172-970e-b4151dae4302 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Converting VIF {"id": "516dfceb-fc7a-43ad-b874-1eb33cc0f525", "address": "fa:16:3e:82:84:7a", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap516dfceb-fc", "ovs_interfaceid": "516dfceb-fc7a-43ad-b874-1eb33cc0f525", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-01353b9e-e751-4172-970e-b4151dae4302 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:84:7a,bridge_name='br-int',has_traffic_filtering=True,id=516dfceb-fc7a-43ad-b874-1eb33cc0f525,network=Network(fc55f18a-b779-4b04-8828-278ecd62211a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap516dfceb-fc') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG os_vif [None req-01353b9e-e751-4172-970e-b4151dae4302 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:84:7a,bridge_name='br-int',has_traffic_filtering=True,id=516dfceb-fc7a-43ad-b874-1eb33cc0f525,network=Network(fc55f18a-b779-4b04-8828-278ecd62211a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap516dfceb-fc') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap516dfceb-fc, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cb888ec3-0a82-45b4-b9fb-9caa4b722490) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:15:59 user nova-compute[74743]: INFO os_vif [None req-01353b9e-e751-4172-970e-b4151dae4302 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:84:7a,bridge_name='br-int',has_traffic_filtering=True,id=516dfceb-fc7a-43ad-b874-1eb33cc0f525,network=Network(fc55f18a-b779-4b04-8828-278ecd62211a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap516dfceb-fc')
Nov 18 17:15:59 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01353b9e-e751-4172-970e-b4151dae4302 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] calling os-brick to detach iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-01353b9e-e751-4172-970e-b4151dae4302 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, {'target_iqn': 'iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZilkWBbT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:15:59 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-01353b9e-e751-4172-970e-b4151dae4302 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:15:59 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-01353b9e-e751-4172-970e-b4151dae4302 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-01353b9e-e751-4172-970e-b4151dae4302 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[4533abbf-697c-429e-ad7e-325694814e50]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-01353b9e-e751-4172-970e-b4151dae4302 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 17:15:59 user nova-compute[74743]: No targets found.
Nov 18 17:15:59 user nova-compute[74743]: iSNS:
Nov 18 17:15:59 user nova-compute[74743]: No targets found.
Nov 18 17:15:59 user nova-compute[74743]: STATIC:
Nov 18 17:15:59 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f
Nov 18 17:15:59 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:15:59 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:15:59 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5
Nov 18 17:15:59 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:15:59 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:15:59 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127
Nov 18 17:15:59 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:15:59 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:15:59 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685
Nov 18 17:15:59 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:15:59 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:15:59 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5
Nov 18 17:15:59 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:15:59 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:15:59 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f
Nov 18 17:15:59 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:15:59 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:15:59 user nova-compute[74743]: FIRMWARE:
Nov 18 17:15:59 user nova-compute[74743]: No targets found.
Nov 18 17:15:59 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-01353b9e-e751-4172-970e-b4151dae4302 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 17:15:59 user nova-compute[74743]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 17:15:59 user nova-compute[74743]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74743) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-01353b9e-e751-4172-970e-b4151dae4302 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f', 0)] {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c52ed2b-20bc-4046-8030-7b71efb5f52e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[70271080-67db-4d44-a6e4-f69432bc18f5]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-01353b9e-e751-4172-970e-b4151dae4302 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:15:59 user nova-compute[74743]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:15:59 user nova-compute[74743]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)
Nov 18 17:15:59 user nova-compute[74743]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:15:59 user nova-compute[74743]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f (non-flash)
Nov 18 17:15:59 user nova-compute[74743]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)
Nov 18 17:15:59 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-01353b9e-e751-4172-970e-b4151dae4302 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:15:59 user nova-compute[74743]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:15:59 user nova-compute[74743]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)
Nov 18 17:15:59 user nova-compute[74743]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:15:59 user nova-compute[74743]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f (non-flash)
Nov 18 17:15:59 user nova-compute[74743]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)
Nov 18 17:15:59 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-01353b9e-e751-4172-970e-b4151dae4302 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb0829bac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f'): ({'sdb'}, set())}) {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-01353b9e-e751-4172-970e-b4151dae4302 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Removing single pathed devices sdb {{(pid=74743) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[069a17a4-0f7a-44d4-aa13-5e488677f698]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.028s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b4cf44-ff31-485b-866e-66c6a658439f]: (4, ('ok\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-01353b9e-e751-4172-970e-b4151dae4302 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Flushing IO for device /dev/sdb {{(pid=74743) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2dd362-f0d6-4737-b13c-e33e282531ef]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-01353b9e-e751-4172-970e-b4151dae4302 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74743) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.059s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[37147e8f-8fd2-4ea9-b983-913e1ee55687]: (4, ('1', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-01353b9e-e751-4172-970e-b4151dae4302 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-01353b9e-e751-4172-970e-b4151dae4302 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] SCSI volumes sdb have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO4fa55ed5-23b4c698b6e29841', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_4fa55ed5') {{(pid=85244) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 18 17:15:59 user nova-compute[74743]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO4fa55ed5-23b4c698b6e29841
Nov 18 17:15:59 user nova-compute[74743]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_4fa55ed5
Nov 18 17:15:59 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b473cde-ffd4-4e73-a65b-a2f9fe485953]: (4, None) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-01353b9e-e751-4172-970e-b4151dae4302 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f')] {{(pid=74743) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[f115377a-9e80-4aa0-9f59-5b7f2463b993]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-01353b9e-e751-4172-970e-b4151dae4302 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f -p 172.16.0.220:3260 --logout {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32cccdc-c989-4143-9556-7be66c292dcc]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-01353b9e-e751-4172-970e-b4151dae4302 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f, portal: 172.16.0.220,3260]
Nov 18 17:15:59 user nova-compute[74743]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f, portal: 172.16.0.220,3260] successful.
Nov 18 17:15:59 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f -p 172.16.0.220:3260 --op delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:859c2504-cec5-4bc7-a314-365fe200485f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[37313309-c6b1-4633-83d3-3ed675b57d99]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-01353b9e-e751-4172-970e-b4151dae4302 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-01353b9e-e751-4172-970e-b4151dae4302 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-01353b9e-e751-4172-970e-b4151dae4302 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] <== disconnect_volume: return (393ms) None {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01353b9e-e751-4172-970e-b4151dae4302 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Disconnected iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 17:15:59 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-01353b9e-e751-4172-970e-b4151dae4302 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Deleting instance files /opt/stack/data/nova/instances/637e2b9b-9777-487f-8131-bdfcd520b2cf_del
Nov 18 17:15:59 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-01353b9e-e751-4172-970e-b4151dae4302 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Deletion of /opt/stack/data/nova/instances/637e2b9b-9777-487f-8131-bdfcd520b2cf_del complete
Nov 18 17:15:59 user nova-compute[74743]: INFO nova.compute.manager [None req-01353b9e-e751-4172-970e-b4151dae4302 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Took 1.30 seconds to destroy the instance on the hypervisor.
Nov 18 17:15:59 user nova-compute[74743]: DEBUG oslo.service.loopingcall [None req-01353b9e-e751-4172-970e-b4151dae4302 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74743) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG nova.compute.manager [-] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Deallocating network for instance {{(pid=74743) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 17:15:59 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] deallocate_for_instance() {{(pid=74743) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 17:16:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:00 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:16:00 user nova-compute[74743]: DEBUG nova.compute.manager [req-69835552-812d-4e81-b5ea-5c795e9edf63 req-1f23f37f-7640-4197-8fc5-bafe8aada996 service nova] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Received event network-vif-deleted-516dfceb-fc7a-43ad-b874-1eb33cc0f525 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:16:00 user nova-compute[74743]: INFO nova.compute.manager [req-69835552-812d-4e81-b5ea-5c795e9edf63 req-1f23f37f-7640-4197-8fc5-bafe8aada996 service nova] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Neutron deleted interface 516dfceb-fc7a-43ad-b874-1eb33cc0f525; detaching it from the instance and deleting it from the info cache
Nov 18 17:16:00 user nova-compute[74743]: DEBUG nova.network.neutron [req-69835552-812d-4e81-b5ea-5c795e9edf63 req-1f23f37f-7640-4197-8fc5-bafe8aada996 service nova] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:16:00 user nova-compute[74743]: INFO nova.compute.manager [-] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Took 1.05 seconds to deallocate network for instance.
Nov 18 17:16:00 user nova-compute[74743]: DEBUG nova.compute.manager [req-69835552-812d-4e81-b5ea-5c795e9edf63 req-1f23f37f-7640-4197-8fc5-bafe8aada996 service nova] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Detach interface failed, port_id=516dfceb-fc7a-43ad-b874-1eb33cc0f525, reason: Instance 637e2b9b-9777-487f-8131-bdfcd520b2cf could not be found. {{(pid=74743) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 17:16:00 user nova-compute[74743]: DEBUG nova.compute.manager [req-277fb7d5-577d-48b4-86c9-77aed47dca8f req-311420d7-b604-4ebc-99b9-01adc5bbab4c service nova] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Received event network-vif-plugged-516dfceb-fc7a-43ad-b874-1eb33cc0f525 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:16:00 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-277fb7d5-577d-48b4-86c9-77aed47dca8f req-311420d7-b604-4ebc-99b9-01adc5bbab4c service nova] Acquiring lock "637e2b9b-9777-487f-8131-bdfcd520b2cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:16:00 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-277fb7d5-577d-48b4-86c9-77aed47dca8f req-311420d7-b604-4ebc-99b9-01adc5bbab4c service nova] Lock "637e2b9b-9777-487f-8131-bdfcd520b2cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:16:00 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-277fb7d5-577d-48b4-86c9-77aed47dca8f req-311420d7-b604-4ebc-99b9-01adc5bbab4c service nova] Lock "637e2b9b-9777-487f-8131-bdfcd520b2cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:16:00 user nova-compute[74743]: DEBUG nova.compute.manager [req-277fb7d5-577d-48b4-86c9-77aed47dca8f req-311420d7-b604-4ebc-99b9-01adc5bbab4c service nova] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] No waiting events found dispatching network-vif-plugged-516dfceb-fc7a-43ad-b874-1eb33cc0f525 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:16:00 user nova-compute[74743]: WARNING nova.compute.manager [req-277fb7d5-577d-48b4-86c9-77aed47dca8f req-311420d7-b604-4ebc-99b9-01adc5bbab4c service nova] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Received unexpected event network-vif-plugged-516dfceb-fc7a-43ad-b874-1eb33cc0f525 for instance with vm_state active and task_state deleting.
Nov 18 17:16:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:01 user nova-compute[74743]: INFO nova.compute.manager [None req-01353b9e-e751-4172-970e-b4151dae4302 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Took 1.08 seconds to detach 1 volumes for instance.
Nov 18 17:16:01 user nova-compute[74743]: DEBUG nova.compute.manager [None req-01353b9e-e751-4172-970e-b4151dae4302 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 637e2b9b-9777-487f-8131-bdfcd520b2cf] Deleting volume: 859c2504-cec5-4bc7-a314-365fe200485f {{(pid=74743) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 18 17:16:01 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-01353b9e-e751-4172-970e-b4151dae4302 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:16:01 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-01353b9e-e751-4172-970e-b4151dae4302 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:16:02 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-01353b9e-e751-4172-970e-b4151dae4302 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:16:02 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-01353b9e-e751-4172-970e-b4151dae4302 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:16:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-01353b9e-e751-4172-970e-b4151dae4302 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.500s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:16:02 user nova-compute[74743]: INFO nova.scheduler.client.report [None req-01353b9e-e751-4172-970e-b4151dae4302 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Deleted allocations for instance 637e2b9b-9777-487f-8131-bdfcd520b2cf
Nov 18 17:16:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-01353b9e-e751-4172-970e-b4151dae4302 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "637e2b9b-9777-487f-8131-bdfcd520b2cf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.259s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:16:04 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:08 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:09 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Acquiring lock "2b67d5fc-3753-4c5a-8477-e46315d9b2c2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:16:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Lock "2b67d5fc-3753-4c5a-8477-e46315d9b2c2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:16:11 user nova-compute[74743]: DEBUG nova.compute.manager [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Starting instance... {{(pid=74743) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 17:16:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:16:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:16:12 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74743) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 17:16:12 user nova-compute[74743]: INFO nova.compute.claims [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Claim successful on node user
Nov 18 17:16:12 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:16:12 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:16:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.460s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:16:12 user nova-compute[74743]: DEBUG nova.compute.manager [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Start building networks asynchronously for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 17:16:12 user nova-compute[74743]: DEBUG nova.compute.manager [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Allocating IP information in the background. {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 17:16:12 user nova-compute[74743]: DEBUG nova.network.neutron [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] allocate_for_instance() {{(pid=74743) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 17:16:12 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 17:16:12 user nova-compute[74743]: DEBUG nova.compute.manager [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Start building block device mappings for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 17:16:12 user nova-compute[74743]: DEBUG nova.policy [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6627b15dc436496aa77d96301162268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072a19c68f7643c4bd227345b698bede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74743) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 17:16:12 user nova-compute[74743]: DEBUG nova.compute.manager [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Start spawning the instance on the hypervisor. {{(pid=74743) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 17:16:12 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Creating instance directory {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 17:16:12 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Creating image(s)
Nov 18 17:16:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Acquiring lock "/opt/stack/data/nova/instances/2b67d5fc-3753-4c5a-8477-e46315d9b2c2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:16:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Lock "/opt/stack/data/nova/instances/2b67d5fc-3753-4c5a-8477-e46315d9b2c2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:16:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Lock "/opt/stack/data/nova/instances/2b67d5fc-3753-4c5a-8477-e46315d9b2c2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:16:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.183s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Acquiring lock "c188b3a997bfafa42fa341f9dcc326545681eed9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:16:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:16:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:13 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.176s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:13 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/2b67d5fc-3753-4c5a-8477-e46315d9b2c2/disk 1073741824 {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:13 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/2b67d5fc-3753-4c5a-8477-e46315d9b2c2/disk 1073741824" returned: 0 in 0.050s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:16:13 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:13 user nova-compute[74743]: DEBUG nova.network.neutron [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Successfully created port: 7936ec1c-0408-417f-8c26-f6c43264ac5f {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:16:13 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.185s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:13 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2b67d5fc-3753-4c5a-8477-e46315d9b2c2/disk. size=1073741824 {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 17:16:13 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b67d5fc-3753-4c5a-8477-e46315d9b2c2/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:13 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b67d5fc-3753-4c5a-8477-e46315d9b2c2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:13 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Cannot resize image /opt/stack/data/nova/instances/2b67d5fc-3753-4c5a-8477-e46315d9b2c2/disk to a smaller size. {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 17:16:13 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Created local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 17:16:13 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Ensure instance console log exists: /opt/stack/data/nova/instances/2b67d5fc-3753-4c5a-8477-e46315d9b2c2/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:16:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:16:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:16:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:16:13 user nova-compute[74743]: DEBUG nova.network.neutron [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Successfully updated port: 7936ec1c-0408-417f-8c26-f6c43264ac5f {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:16:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Acquiring lock "refresh_cache-2b67d5fc-3753-4c5a-8477-e46315d9b2c2" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:16:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Acquired lock "refresh_cache-2b67d5fc-3753-4c5a-8477-e46315d9b2c2" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:16:13 user nova-compute[74743]: DEBUG nova.network.neutron [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:16:13 user nova-compute[74743]: DEBUG nova.compute.manager [req-e818b681-8cff-4de3-a45c-bc090f930d04 req-d6c50c10-5da5-4c55-a59b-6ed4e5f0ff40 service nova] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Received event network-changed-7936ec1c-0408-417f-8c26-f6c43264ac5f {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:16:13 user nova-compute[74743]: DEBUG nova.compute.manager [req-e818b681-8cff-4de3-a45c-bc090f930d04 req-d6c50c10-5da5-4c55-a59b-6ed4e5f0ff40 service nova] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Refreshing instance network info cache due to event network-changed-7936ec1c-0408-417f-8c26-f6c43264ac5f. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:16:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e818b681-8cff-4de3-a45c-bc090f930d04 req-d6c50c10-5da5-4c55-a59b-6ed4e5f0ff40 service nova] Acquiring lock "refresh_cache-2b67d5fc-3753-4c5a-8477-e46315d9b2c2" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:16:13 user nova-compute[74743]: DEBUG nova.network.neutron [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:16:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:14 user nova-compute[74743]: DEBUG nova.network.neutron [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Updating instance_info_cache with network_info: [{"id": "7936ec1c-0408-417f-8c26-f6c43264ac5f", "address": "fa:16:3e:c1:3d:26", "network": {"id": "d8f4040b-7308-4136-af25-acea3f9b7319", "bridge": "br-int", "label": "tempest-TestStampPattern-304681565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "072a19c68f7643c4bd227345b698bede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7936ec1c-04", "ovs_interfaceid": "7936ec1c-0408-417f-8c26-f6c43264ac5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:16:14 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Releasing lock "refresh_cache-2b67d5fc-3753-4c5a-8477-e46315d9b2c2" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:16:14 user nova-compute[74743]: DEBUG nova.compute.manager [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Instance network_info: |[{"id": "7936ec1c-0408-417f-8c26-f6c43264ac5f", "address": "fa:16:3e:c1:3d:26", "network": {"id": "d8f4040b-7308-4136-af25-acea3f9b7319", "bridge": "br-int", "label": "tempest-TestStampPattern-304681565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "072a19c68f7643c4bd227345b698bede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7936ec1c-04", "ovs_interfaceid": "7936ec1c-0408-417f-8c26-f6c43264ac5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 17:16:14 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e818b681-8cff-4de3-a45c-bc090f930d04 req-d6c50c10-5da5-4c55-a59b-6ed4e5f0ff40 service nova] Acquired lock "refresh_cache-2b67d5fc-3753-4c5a-8477-e46315d9b2c2" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:16:14 user nova-compute[74743]: DEBUG nova.network.neutron [req-e818b681-8cff-4de3-a45c-bc090f930d04 req-d6c50c10-5da5-4c55-a59b-6ed4e5f0ff40 service nova] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Refreshing network info cache for port 7936ec1c-0408-417f-8c26-f6c43264ac5f {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:16:14 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Start _get_guest_xml network_info=[{"id": "7936ec1c-0408-417f-8c26-f6c43264ac5f", "address": "fa:16:3e:c1:3d:26", "network": {"id": "d8f4040b-7308-4136-af25-acea3f9b7319", "bridge": "br-int", "label": "tempest-TestStampPattern-304681565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "072a19c68f7643c4bd227345b698bede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7936ec1c-04", "ovs_interfaceid": "7936ec1c-0408-417f-8c26-f6c43264ac5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '9536f6cf-95c4-40e2-864a-09a91525678a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:16:14 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:16:14 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:16:14 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:16:14 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:16:14 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:16:14 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:16:14 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:16:14 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:16:14 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:16:14 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:16:14 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:16:14 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:16:14 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:16:14 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:16:14 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:16:14 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:16:14 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:16:14 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:16:14 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:16:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-18915004',display_name='tempest-TestStampPattern-server-18915004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-18915004',id=32,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIeJWqc/RpISD+eFEyUiucd29+D2+xTQFgQsJ5SoI7DLsQ5ykkCfc2YtdLTQr/OFkooGS0c/xKImvR2ShUEPtqOyxJHjD4YWOrQFxEUaRxezTFDuvczqvCIHxapLoqI2zA==',key_name='tempest-TestStampPattern-360928616',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='072a19c68f7643c4bd227345b698bede',ramdisk_id='',reservation_id='r-y822adyc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1373079607',owner_user_name='tempest-TestStampPattern-1373079607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:16:13Z,user_data=None,user_id='6627b15dc436496aa77d96301162268a',uuid=2b67d5fc-3753-4c5a-8477-e46315d9b2c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7936ec1c-0408-417f-8c26-f6c43264ac5f", "address": "fa:16:3e:c1:3d:26", "network": {"id": "d8f4040b-7308-4136-af25-acea3f9b7319", "bridge": "br-int", "label": "tempest-TestStampPattern-304681565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "072a19c68f7643c4bd227345b698bede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7936ec1c-04", "ovs_interfaceid": "7936ec1c-0408-417f-8c26-f6c43264ac5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:16:14 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Converting VIF {"id": "7936ec1c-0408-417f-8c26-f6c43264ac5f", "address": "fa:16:3e:c1:3d:26", "network": {"id": "d8f4040b-7308-4136-af25-acea3f9b7319", "bridge": "br-int", "label": "tempest-TestStampPattern-304681565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "072a19c68f7643c4bd227345b698bede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7936ec1c-04", "ovs_interfaceid": "7936ec1c-0408-417f-8c26-f6c43264ac5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:16:14 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:3d:26,bridge_name='br-int',has_traffic_filtering=True,id=7936ec1c-0408-417f-8c26-f6c43264ac5f,network=Network(d8f4040b-7308-4136-af25-acea3f9b7319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7936ec1c-04') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:16:14 user nova-compute[74743]: DEBUG nova.objects.instance [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Lazy-loading 'pci_devices' on Instance uuid 2b67d5fc-3753-4c5a-8477-e46315d9b2c2 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:16:14 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:16:14 user nova-compute[74743]:   <uuid>2b67d5fc-3753-4c5a-8477-e46315d9b2c2</uuid>
Nov 18 17:16:14 user nova-compute[74743]:   <name>instance-00000020</name>
Nov 18 17:16:14 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:16:14 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:16:14 user nova-compute[74743]:   <metadata>
Nov 18 17:16:14 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:16:14 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:16:14 user nova-compute[74743]:       <nova:name>tempest-TestStampPattern-server-18915004</nova:name>
Nov 18 17:16:14 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:16:14</nova:creationTime>
Nov 18 17:16:14 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:16:14 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:16:14 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:16:14 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:16:14 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:16:14 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:16:14 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:16:14 user nova-compute[74743]:       <nova:owner>
Nov 18 17:16:14 user nova-compute[74743]:         <nova:user uuid="6627b15dc436496aa77d96301162268a">tempest-TestStampPattern-1373079607-project-member</nova:user>
Nov 18 17:16:14 user nova-compute[74743]:         <nova:project uuid="072a19c68f7643c4bd227345b698bede">tempest-TestStampPattern-1373079607</nova:project>
Nov 18 17:16:14 user nova-compute[74743]:       </nova:owner>
Nov 18 17:16:14 user nova-compute[74743]:       <nova:root type="image" uuid="9536f6cf-95c4-40e2-864a-09a91525678a"/>
Nov 18 17:16:14 user nova-compute[74743]:       <nova:ports>
Nov 18 17:16:14 user nova-compute[74743]:         <nova:port uuid="7936ec1c-0408-417f-8c26-f6c43264ac5f">
Nov 18 17:16:14 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 18 17:16:14 user nova-compute[74743]:         </nova:port>
Nov 18 17:16:14 user nova-compute[74743]:       </nova:ports>
Nov 18 17:16:14 user nova-compute[74743]:     </nova:instance>
Nov 18 17:16:14 user nova-compute[74743]:   </metadata>
Nov 18 17:16:14 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:16:14 user nova-compute[74743]:     <system>
Nov 18 17:16:14 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:16:14 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:16:14 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:16:14 user nova-compute[74743]:       <entry name="serial">2b67d5fc-3753-4c5a-8477-e46315d9b2c2</entry>
Nov 18 17:16:14 user nova-compute[74743]:       <entry name="uuid">2b67d5fc-3753-4c5a-8477-e46315d9b2c2</entry>
Nov 18 17:16:14 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:16:14 user nova-compute[74743]:     </system>
Nov 18 17:16:14 user nova-compute[74743]:   </sysinfo>
Nov 18 17:16:14 user nova-compute[74743]:   <os>
Nov 18 17:16:14 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:16:14 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:16:14 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:16:14 user nova-compute[74743]:   </os>
Nov 18 17:16:14 user nova-compute[74743]:   <features>
Nov 18 17:16:14 user nova-compute[74743]:     <acpi/>
Nov 18 17:16:14 user nova-compute[74743]:     <apic/>
Nov 18 17:16:14 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:16:14 user nova-compute[74743]:   </features>
Nov 18 17:16:14 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:16:14 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:16:14 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:16:14 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:16:14 user nova-compute[74743]:   </clock>
Nov 18 17:16:14 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:16:14 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:16:14 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:16:14 user nova-compute[74743]:   </cpu>
Nov 18 17:16:14 user nova-compute[74743]:   <devices>
Nov 18 17:16:14 user nova-compute[74743]:     <disk type="file" device="disk">
Nov 18 17:16:14 user nova-compute[74743]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 17:16:14 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/2b67d5fc-3753-4c5a-8477-e46315d9b2c2/disk"/>
Nov 18 17:16:14 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:16:14 user nova-compute[74743]:     </disk>
Nov 18 17:16:14 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:16:14 user nova-compute[74743]:       <mac address="fa:16:3e:c1:3d:26"/>
Nov 18 17:16:14 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:16:14 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:16:14 user nova-compute[74743]:       <target dev="tap7936ec1c-04"/>
Nov 18 17:16:14 user nova-compute[74743]:     </interface>
Nov 18 17:16:14 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:16:14 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/2b67d5fc-3753-4c5a-8477-e46315d9b2c2/console.log" append="off"/>
Nov 18 17:16:14 user nova-compute[74743]:     </serial>
Nov 18 17:16:14 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:16:14 user nova-compute[74743]:     <video>
Nov 18 17:16:14 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:16:14 user nova-compute[74743]:     </video>
Nov 18 17:16:14 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:16:14 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:16:14 user nova-compute[74743]:     </rng>
Nov 18 17:16:14 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:16:14 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:16:14 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:16:14 user nova-compute[74743]:     </memballoon>
Nov 18 17:16:14 user nova-compute[74743]:   </devices>
Nov 18 17:16:14 user nova-compute[74743]: </domain>
Nov 18 17:16:14 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:16:14 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:16:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-18915004',display_name='tempest-TestStampPattern-server-18915004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-18915004',id=32,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIeJWqc/RpISD+eFEyUiucd29+D2+xTQFgQsJ5SoI7DLsQ5ykkCfc2YtdLTQr/OFkooGS0c/xKImvR2ShUEPtqOyxJHjD4YWOrQFxEUaRxezTFDuvczqvCIHxapLoqI2zA==',key_name='tempest-TestStampPattern-360928616',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='072a19c68f7643c4bd227345b698bede',ramdisk_id='',reservation_id='r-y822adyc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1373079607',owner_user_name='tempest-TestStampPattern-1373079607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:16:13Z,user_data=None,user_id='6627b15dc436496aa77d96301162268a',uuid=2b67d5fc-3753-4c5a-8477-e46315d9b2c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7936ec1c-0408-417f-8c26-f6c43264ac5f", "address": "fa:16:3e:c1:3d:26", "network": {"id": "d8f4040b-7308-4136-af25-acea3f9b7319", "bridge": "br-int", "label": "tempest-TestStampPattern-304681565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "072a19c68f7643c4bd227345b698bede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7936ec1c-04", "ovs_interfaceid": "7936ec1c-0408-417f-8c26-f6c43264ac5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:16:14 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Converting VIF {"id": "7936ec1c-0408-417f-8c26-f6c43264ac5f", "address": "fa:16:3e:c1:3d:26", "network": {"id": "d8f4040b-7308-4136-af25-acea3f9b7319", "bridge": "br-int", "label": "tempest-TestStampPattern-304681565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "072a19c68f7643c4bd227345b698bede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7936ec1c-04", "ovs_interfaceid": "7936ec1c-0408-417f-8c26-f6c43264ac5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:16:14 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:3d:26,bridge_name='br-int',has_traffic_filtering=True,id=7936ec1c-0408-417f-8c26-f6c43264ac5f,network=Network(d8f4040b-7308-4136-af25-acea3f9b7319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7936ec1c-04') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:16:14 user nova-compute[74743]: DEBUG os_vif [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:3d:26,bridge_name='br-int',has_traffic_filtering=True,id=7936ec1c-0408-417f-8c26-f6c43264ac5f,network=Network(d8f4040b-7308-4136-af25-acea3f9b7319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7936ec1c-04') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:16:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:16:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:16:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1200a7ef-2fdb-5c78-b4b3-c20b79ac2c9a', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:16:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:16:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7936ec1c-04, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:16:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7936ec1c-04, col_values=(('qos', UUID('0bbdef66-368d-4c3b-b283-2bbd315f3f79')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:16:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7936ec1c-04, col_values=(('external_ids', {'iface-id': '7936ec1c-0408-417f-8c26-f6c43264ac5f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:3d:26', 'vm-uuid': '2b67d5fc-3753-4c5a-8477-e46315d9b2c2'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:16:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:16:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:14 user nova-compute[74743]: INFO os_vif [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:3d:26,bridge_name='br-int',has_traffic_filtering=True,id=7936ec1c-0408-417f-8c26-f6c43264ac5f,network=Network(d8f4040b-7308-4136-af25-acea3f9b7319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7936ec1c-04')
Nov 18 17:16:14 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:16:14 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] No VIF found with MAC fa:16:3e:c1:3d:26, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:16:14 user nova-compute[74743]: DEBUG nova.network.neutron [req-e818b681-8cff-4de3-a45c-bc090f930d04 req-d6c50c10-5da5-4c55-a59b-6ed4e5f0ff40 service nova] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Updated VIF entry in instance network info cache for port 7936ec1c-0408-417f-8c26-f6c43264ac5f. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:16:14 user nova-compute[74743]: DEBUG nova.network.neutron [req-e818b681-8cff-4de3-a45c-bc090f930d04 req-d6c50c10-5da5-4c55-a59b-6ed4e5f0ff40 service nova] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Updating instance_info_cache with network_info: [{"id": "7936ec1c-0408-417f-8c26-f6c43264ac5f", "address": "fa:16:3e:c1:3d:26", "network": {"id": "d8f4040b-7308-4136-af25-acea3f9b7319", "bridge": "br-int", "label": "tempest-TestStampPattern-304681565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "072a19c68f7643c4bd227345b698bede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7936ec1c-04", "ovs_interfaceid": "7936ec1c-0408-417f-8c26-f6c43264ac5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:16:14 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e818b681-8cff-4de3-a45c-bc090f930d04 req-d6c50c10-5da5-4c55-a59b-6ed4e5f0ff40 service nova] Releasing lock "refresh_cache-2b67d5fc-3753-4c5a-8477-e46315d9b2c2" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:16:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:15 user nova-compute[74743]: DEBUG nova.compute.manager [req-8a51a5b9-80f7-4aee-bded-9d8b472e6850 req-2767d32c-eb6c-4617-ae9f-9aa921ba8ed4 service nova] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Received event network-vif-plugged-7936ec1c-0408-417f-8c26-f6c43264ac5f {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:16:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-8a51a5b9-80f7-4aee-bded-9d8b472e6850 req-2767d32c-eb6c-4617-ae9f-9aa921ba8ed4 service nova] Acquiring lock "2b67d5fc-3753-4c5a-8477-e46315d9b2c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:16:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-8a51a5b9-80f7-4aee-bded-9d8b472e6850 req-2767d32c-eb6c-4617-ae9f-9aa921ba8ed4 service nova] Lock "2b67d5fc-3753-4c5a-8477-e46315d9b2c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:16:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-8a51a5b9-80f7-4aee-bded-9d8b472e6850 req-2767d32c-eb6c-4617-ae9f-9aa921ba8ed4 service nova] Lock "2b67d5fc-3753-4c5a-8477-e46315d9b2c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:16:15 user nova-compute[74743]: DEBUG nova.compute.manager [req-8a51a5b9-80f7-4aee-bded-9d8b472e6850 req-2767d32c-eb6c-4617-ae9f-9aa921ba8ed4 service nova] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] No waiting events found dispatching network-vif-plugged-7936ec1c-0408-417f-8c26-f6c43264ac5f {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:16:15 user nova-compute[74743]: WARNING nova.compute.manager [req-8a51a5b9-80f7-4aee-bded-9d8b472e6850 req-2767d32c-eb6c-4617-ae9f-9aa921ba8ed4 service nova] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Received unexpected event network-vif-plugged-7936ec1c-0408-417f-8c26-f6c43264ac5f for instance with vm_state building and task_state spawning.
Nov 18 17:16:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-e888678c-e379-4056-bafb-f9d52c2a0bb1 req-0ae71298-c484-45b5-a9bb-4f8ef49e6079 service nova] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Received event network-vif-plugged-7936ec1c-0408-417f-8c26-f6c43264ac5f {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:16:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e888678c-e379-4056-bafb-f9d52c2a0bb1 req-0ae71298-c484-45b5-a9bb-4f8ef49e6079 service nova] Acquiring lock "2b67d5fc-3753-4c5a-8477-e46315d9b2c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:16:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e888678c-e379-4056-bafb-f9d52c2a0bb1 req-0ae71298-c484-45b5-a9bb-4f8ef49e6079 service nova] Lock "2b67d5fc-3753-4c5a-8477-e46315d9b2c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:16:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e888678c-e379-4056-bafb-f9d52c2a0bb1 req-0ae71298-c484-45b5-a9bb-4f8ef49e6079 service nova] Lock "2b67d5fc-3753-4c5a-8477-e46315d9b2c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:16:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-e888678c-e379-4056-bafb-f9d52c2a0bb1 req-0ae71298-c484-45b5-a9bb-4f8ef49e6079 service nova] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] No waiting events found dispatching network-vif-plugged-7936ec1c-0408-417f-8c26-f6c43264ac5f {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:16:18 user nova-compute[74743]: WARNING nova.compute.manager [req-e888678c-e379-4056-bafb-f9d52c2a0bb1 req-0ae71298-c484-45b5-a9bb-4f8ef49e6079 service nova] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Received unexpected event network-vif-plugged-7936ec1c-0408-417f-8c26-f6c43264ac5f for instance with vm_state building and task_state spawning.
Nov 18 17:16:18 user nova-compute[74743]: DEBUG nova.compute.manager [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:16:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Guest created on hypervisor {{(pid=74743) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 17:16:18 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Instance spawned successfully.
Nov 18 17:16:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 17:16:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Found default for hw_cdrom_bus of ide {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:16:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Found default for hw_disk_bus of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:16:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Found default for hw_input_bus of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:16:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Found default for hw_pointer_model of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:16:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Found default for hw_video_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:16:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Found default for hw_vif_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:16:18 user nova-compute[74743]: INFO nova.compute.manager [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Took 5.54 seconds to spawn the instance on the hypervisor.
Nov 18 17:16:18 user nova-compute[74743]: DEBUG nova.compute.manager [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:16:18 user nova-compute[74743]: INFO nova.compute.manager [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Took 6.38 seconds to build instance.
Nov 18 17:16:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ef925f1f-d43b-4d50-8211-29f95a00362e tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Lock "2b67d5fc-3753-4c5a-8477-e46315d9b2c2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.490s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:16:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ee6b30d6-3ea3-4897-94de-2d00e6ad535e tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Acquiring lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:16:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ee6b30d6-3ea3-4897-94de-2d00e6ad535e tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:16:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ee6b30d6-3ea3-4897-94de-2d00e6ad535e tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Acquiring lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:16:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ee6b30d6-3ea3-4897-94de-2d00e6ad535e tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:16:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ee6b30d6-3ea3-4897-94de-2d00e6ad535e tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:16:19 user nova-compute[74743]: INFO nova.compute.manager [None req-ee6b30d6-3ea3-4897-94de-2d00e6ad535e tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Terminating instance
Nov 18 17:16:19 user nova-compute[74743]: DEBUG nova.compute.manager [None req-ee6b30d6-3ea3-4897-94de-2d00e6ad535e tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Start destroying the instance on the hypervisor. {{(pid=74743) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 17:16:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-615612ed-aee7-4f3f-ba0f-2a38573cb7a4 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Acquiring lock "49ebdd5a-824d-476a-bd10-3b891bbfe9e2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:16:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-615612ed-aee7-4f3f-ba0f-2a38573cb7a4 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Lock "49ebdd5a-824d-476a-bd10-3b891bbfe9e2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:16:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-615612ed-aee7-4f3f-ba0f-2a38573cb7a4 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Acquiring lock "49ebdd5a-824d-476a-bd10-3b891bbfe9e2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:16:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-615612ed-aee7-4f3f-ba0f-2a38573cb7a4 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Lock "49ebdd5a-824d-476a-bd10-3b891bbfe9e2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:16:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-615612ed-aee7-4f3f-ba0f-2a38573cb7a4 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Lock "49ebdd5a-824d-476a-bd10-3b891bbfe9e2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:16:19 user nova-compute[74743]: INFO nova.compute.manager [None req-615612ed-aee7-4f3f-ba0f-2a38573cb7a4 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Terminating instance
Nov 18 17:16:19 user nova-compute[74743]: DEBUG nova.compute.manager [None req-615612ed-aee7-4f3f-ba0f-2a38573cb7a4 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Start destroying the instance on the hypervisor. {{(pid=74743) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 17:16:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:19 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Instance destroyed successfully.
Nov 18 17:16:19 user nova-compute[74743]: DEBUG nova.objects.instance [None req-ee6b30d6-3ea3-4897-94de-2d00e6ad535e tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lazy-loading 'resources' on Instance uuid f93bf0ac-ecc8-447d-b9c1-381d36cd3135 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:16:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-ee6b30d6-3ea3-4897-94de-2d00e6ad535e tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:09:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1712639045',display_name='tempest-SnapshotDataIntegrityTests-server-1712639045',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1712639045',id=22,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUdBDG4vH29jPY3bmVUYNHO0oRuii3NuUh/brt0xF7IahYMs+ti5pQThPWS/d5HfTxD6fBmVASDaiGQ6pXd9L/gYzupHfIIkF5jddBDaOc9ACBj7+PyWeJa0uYtyxS1Lw==',key_name='tempest-keypair-2092443033',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:09:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5705e5d6831a4d4dab6ae482e0ca1013',ramdisk_id='',reservation_id='r-y1z4jodf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1082949191',owner_user_name='tempest-SnapshotDataIntegrityTests-1082949191-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:09:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7230865273e42ac86cf5a340c1bd1cf',uuid=f93bf0ac-ecc8-447d-b9c1-381d36cd3135,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b307c7c0-aa55-4210-8e16-08b1cee78b4a", "address": "fa:16:3e:f3:91:b0", "network": {"id": "45fa6343-75cf-4308-937b-cddd9ca6b63f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1561993253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5705e5d6831a4d4dab6ae482e0ca1013", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb307c7c0-aa", "ovs_interfaceid": "b307c7c0-aa55-4210-8e16-08b1cee78b4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:16:19 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-ee6b30d6-3ea3-4897-94de-2d00e6ad535e tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Converting VIF {"id": "b307c7c0-aa55-4210-8e16-08b1cee78b4a", "address": "fa:16:3e:f3:91:b0", "network": {"id": "45fa6343-75cf-4308-937b-cddd9ca6b63f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1561993253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5705e5d6831a4d4dab6ae482e0ca1013", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb307c7c0-aa", "ovs_interfaceid": "b307c7c0-aa55-4210-8e16-08b1cee78b4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:16:19 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-ee6b30d6-3ea3-4897-94de-2d00e6ad535e tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:91:b0,bridge_name='br-int',has_traffic_filtering=True,id=b307c7c0-aa55-4210-8e16-08b1cee78b4a,network=Network(45fa6343-75cf-4308-937b-cddd9ca6b63f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb307c7c0-aa') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:16:19 user nova-compute[74743]: DEBUG os_vif [None req-ee6b30d6-3ea3-4897-94de-2d00e6ad535e tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:91:b0,bridge_name='br-int',has_traffic_filtering=True,id=b307c7c0-aa55-4210-8e16-08b1cee78b4a,network=Network(45fa6343-75cf-4308-937b-cddd9ca6b63f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb307c7c0-aa') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:16:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb307c7c0-aa, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:16:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:16:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3c912e18-1006-4630-b419-40d6ba568102) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:16:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:16:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:19 user nova-compute[74743]: INFO os_vif [None req-ee6b30d6-3ea3-4897-94de-2d00e6ad535e tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:91:b0,bridge_name='br-int',has_traffic_filtering=True,id=b307c7c0-aa55-4210-8e16-08b1cee78b4a,network=Network(45fa6343-75cf-4308-937b-cddd9ca6b63f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb307c7c0-aa')
Nov 18 17:16:19 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-ee6b30d6-3ea3-4897-94de-2d00e6ad535e tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Deleting instance files /opt/stack/data/nova/instances/f93bf0ac-ecc8-447d-b9c1-381d36cd3135_del
Nov 18 17:16:19 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-ee6b30d6-3ea3-4897-94de-2d00e6ad535e tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Deletion of /opt/stack/data/nova/instances/f93bf0ac-ecc8-447d-b9c1-381d36cd3135_del complete
Nov 18 17:16:20 user nova-compute[74743]: DEBUG nova.compute.manager [req-62c3a440-22f8-493c-9a92-a492a99af956 req-114e0745-02f6-4eaa-8dd6-eca60b963d4e service nova] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Received event network-vif-unplugged-c66ef239-8068-4eff-807a-830d5f3d0dba {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-62c3a440-22f8-493c-9a92-a492a99af956 req-114e0745-02f6-4eaa-8dd6-eca60b963d4e service nova] Acquiring lock "49ebdd5a-824d-476a-bd10-3b891bbfe9e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-62c3a440-22f8-493c-9a92-a492a99af956 req-114e0745-02f6-4eaa-8dd6-eca60b963d4e service nova] Lock "49ebdd5a-824d-476a-bd10-3b891bbfe9e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-62c3a440-22f8-493c-9a92-a492a99af956 req-114e0745-02f6-4eaa-8dd6-eca60b963d4e service nova] Lock "49ebdd5a-824d-476a-bd10-3b891bbfe9e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG nova.compute.manager [req-62c3a440-22f8-493c-9a92-a492a99af956 req-114e0745-02f6-4eaa-8dd6-eca60b963d4e service nova] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] No waiting events found dispatching network-vif-unplugged-c66ef239-8068-4eff-807a-830d5f3d0dba {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG nova.compute.manager [req-62c3a440-22f8-493c-9a92-a492a99af956 req-114e0745-02f6-4eaa-8dd6-eca60b963d4e service nova] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Received event network-vif-unplugged-c66ef239-8068-4eff-807a-830d5f3d0dba for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:16:20 user nova-compute[74743]: INFO nova.compute.manager [None req-ee6b30d6-3ea3-4897-94de-2d00e6ad535e tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 18 17:16:20 user nova-compute[74743]: DEBUG oslo.service.loopingcall [None req-ee6b30d6-3ea3-4897-94de-2d00e6ad535e tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74743) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG nova.compute.manager [-] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Deallocating network for instance {{(pid=74743) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] deallocate_for_instance() {{(pid=74743) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG nova.compute.manager [req-2a58c0b3-c755-458d-bbdb-2ff058027ea0 req-4c23bd8f-e0da-404b-8c1c-a4c349878d32 service nova] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Received event network-vif-unplugged-b307c7c0-aa55-4210-8e16-08b1cee78b4a {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-2a58c0b3-c755-458d-bbdb-2ff058027ea0 req-4c23bd8f-e0da-404b-8c1c-a4c349878d32 service nova] Acquiring lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-2a58c0b3-c755-458d-bbdb-2ff058027ea0 req-4c23bd8f-e0da-404b-8c1c-a4c349878d32 service nova] Lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-2a58c0b3-c755-458d-bbdb-2ff058027ea0 req-4c23bd8f-e0da-404b-8c1c-a4c349878d32 service nova] Lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG nova.compute.manager [req-2a58c0b3-c755-458d-bbdb-2ff058027ea0 req-4c23bd8f-e0da-404b-8c1c-a4c349878d32 service nova] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] No waiting events found dispatching network-vif-unplugged-b307c7c0-aa55-4210-8e16-08b1cee78b4a {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG nova.compute.manager [req-2a58c0b3-c755-458d-bbdb-2ff058027ea0 req-4c23bd8f-e0da-404b-8c1c-a4c349878d32 service nova] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Received event network-vif-unplugged-b307c7c0-aa55-4210-8e16-08b1cee78b4a for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG nova.compute.manager [req-2a58c0b3-c755-458d-bbdb-2ff058027ea0 req-4c23bd8f-e0da-404b-8c1c-a4c349878d32 service nova] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Received event network-vif-plugged-b307c7c0-aa55-4210-8e16-08b1cee78b4a {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-2a58c0b3-c755-458d-bbdb-2ff058027ea0 req-4c23bd8f-e0da-404b-8c1c-a4c349878d32 service nova] Acquiring lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-2a58c0b3-c755-458d-bbdb-2ff058027ea0 req-4c23bd8f-e0da-404b-8c1c-a4c349878d32 service nova] Lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-2a58c0b3-c755-458d-bbdb-2ff058027ea0 req-4c23bd8f-e0da-404b-8c1c-a4c349878d32 service nova] Lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG nova.compute.manager [req-2a58c0b3-c755-458d-bbdb-2ff058027ea0 req-4c23bd8f-e0da-404b-8c1c-a4c349878d32 service nova] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] No waiting events found dispatching network-vif-plugged-b307c7c0-aa55-4210-8e16-08b1cee78b4a {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:16:20 user nova-compute[74743]: WARNING nova.compute.manager [req-2a58c0b3-c755-458d-bbdb-2ff058027ea0 req-4c23bd8f-e0da-404b-8c1c-a4c349878d32 service nova] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Received unexpected event network-vif-plugged-b307c7c0-aa55-4210-8e16-08b1cee78b4a for instance with vm_state active and task_state deleting.
Nov 18 17:16:20 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Instance destroyed successfully.
Nov 18 17:16:20 user nova-compute[74743]: DEBUG nova.objects.instance [None req-615612ed-aee7-4f3f-ba0f-2a38573cb7a4 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Lazy-loading 'resources' on Instance uuid 49ebdd5a-824d-476a-bd10-3b891bbfe9e2 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-615612ed-aee7-4f3f-ba0f-2a38573cb7a4 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:07:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-761441758',display_name='tempest-ServerActionsTestOtherB-server-761441758',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-761441758',id=16,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHSxRrGlHxDyqlCOq0hy6p31kUDSaQIxafGDavUpZ/Ka4RS6tIfzT5avp8Ymkenpc8OEHVquoqpPuZPk62jn4N2SagQ88JWrrx/6+VzSF8w9eq7GAvBHe/3/xNVOBksa4g==',key_name='tempest-keypair-1267949685',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:13:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8955c5a052b34bde997f9db74d302edb',ramdisk_id='',reservation_id='r-ewenialm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-2984948',owner_user_name='tempest-ServerActionsTestOtherB-2984948-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:13:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c37b5fe2f7d74cab894eef0f41c6a5ed',uuid=49ebdd5a-824d-476a-bd10-3b891bbfe9e2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c66ef239-8068-4eff-807a-830d5f3d0dba", "address": "fa:16:3e:f3:3d:ca", "network": {"id": "79046ec4-e7a8-4b7d-8607-3205067366b6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1734449136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8955c5a052b34bde997f9db74d302edb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66ef239-80", "ovs_interfaceid": "c66ef239-8068-4eff-807a-830d5f3d0dba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-615612ed-aee7-4f3f-ba0f-2a38573cb7a4 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Converting VIF {"id": "c66ef239-8068-4eff-807a-830d5f3d0dba", "address": "fa:16:3e:f3:3d:ca", "network": {"id": "79046ec4-e7a8-4b7d-8607-3205067366b6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1734449136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8955c5a052b34bde997f9db74d302edb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66ef239-80", "ovs_interfaceid": "c66ef239-8068-4eff-807a-830d5f3d0dba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-615612ed-aee7-4f3f-ba0f-2a38573cb7a4 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:3d:ca,bridge_name='br-int',has_traffic_filtering=True,id=c66ef239-8068-4eff-807a-830d5f3d0dba,network=Network(79046ec4-e7a8-4b7d-8607-3205067366b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66ef239-80') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG os_vif [None req-615612ed-aee7-4f3f-ba0f-2a38573cb7a4 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:3d:ca,bridge_name='br-int',has_traffic_filtering=True,id=c66ef239-8068-4eff-807a-830d5f3d0dba,network=Network(79046ec4-e7a8-4b7d-8607-3205067366b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66ef239-80') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc66ef239-80, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9708b643-7ec3-4d79-b575-ffdad0a98805) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:16:20 user nova-compute[74743]: INFO os_vif [None req-615612ed-aee7-4f3f-ba0f-2a38573cb7a4 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:3d:ca,bridge_name='br-int',has_traffic_filtering=True,id=c66ef239-8068-4eff-807a-830d5f3d0dba,network=Network(79046ec4-e7a8-4b7d-8607-3205067366b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66ef239-80')
Nov 18 17:16:20 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-615612ed-aee7-4f3f-ba0f-2a38573cb7a4 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] calling os-brick to detach iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-615612ed-aee7-4f3f-ba0f-2a38573cb7a4 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, {'target_iqn': 'iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RWDmrpXN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:16:20 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-615612ed-aee7-4f3f-ba0f-2a38573cb7a4 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:16:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-615612ed-aee7-4f3f-ba0f-2a38573cb7a4 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-615612ed-aee7-4f3f-ba0f-2a38573cb7a4 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac535df-b7c1-45ff-ad16-df14d0c74521]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-615612ed-aee7-4f3f-ba0f-2a38573cb7a4 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 17:16:20 user nova-compute[74743]: No targets found.
Nov 18 17:16:20 user nova-compute[74743]: iSNS:
Nov 18 17:16:20 user nova-compute[74743]: No targets found.
Nov 18 17:16:20 user nova-compute[74743]: STATIC:
Nov 18 17:16:20 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f
Nov 18 17:16:20 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:16:20 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:16:20 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5
Nov 18 17:16:20 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:16:20 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:16:20 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127
Nov 18 17:16:20 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:16:20 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:16:20 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685
Nov 18 17:16:20 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:16:20 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:16:20 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5
Nov 18 17:16:20 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:16:20 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:16:20 user nova-compute[74743]: FIRMWARE:
Nov 18 17:16:20 user nova-compute[74743]: No targets found.
Nov 18 17:16:20 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-615612ed-aee7-4f3f-ba0f-2a38573cb7a4 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 17:16:20 user nova-compute[74743]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 17:16:20 user nova-compute[74743]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74743) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-615612ed-aee7-4f3f-ba0f-2a38573cb7a4 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5', 0)] {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5dcffdd-046c-4b7b-8567-42940211cc58]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d937d3c-1f42-4c14-ba7b-d693a88666d1]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-615612ed-aee7-4f3f-ba0f-2a38573cb7a4 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:16:20 user nova-compute[74743]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:16:20 user nova-compute[74743]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)
Nov 18 17:16:20 user nova-compute[74743]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:16:20 user nova-compute[74743]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)
Nov 18 17:16:20 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-615612ed-aee7-4f3f-ba0f-2a38573cb7a4 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:16:20 user nova-compute[74743]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 (non-flash)
Nov 18 17:16:20 user nova-compute[74743]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)
Nov 18 17:16:20 user nova-compute[74743]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:16:20 user nova-compute[74743]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)
Nov 18 17:16:20 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-615612ed-aee7-4f3f-ba0f-2a38573cb7a4 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb0829b250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5'): ({'sdc'}, set())}) {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-615612ed-aee7-4f3f-ba0f-2a38573cb7a4 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Removing single pathed devices sdc {{(pid=74743) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e45d40f-1bff-4d36-868b-dda07c6fc789]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1a46c9-c9b0-4632-bff0-8c02e64ef8a3]: (4, ('ok\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-615612ed-aee7-4f3f-ba0f-2a38573cb7a4 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Flushing IO for device /dev/sdc {{(pid=74743) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce7468d-7a27-4592-9813-c5bc177f3e2a]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-615612ed-aee7-4f3f-ba0f-2a38573cb7a4 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74743) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c3d8b1-bd6c-48ea-8e74-cfa11ca24f6f]: (4, ('1', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-615612ed-aee7-4f3f-ba0f-2a38573cb7a4 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-615612ed-aee7-4f3f-ba0f-2a38573cb7a4 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] SCSI volumes sdc have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-615612ed-aee7-4f3f-ba0f-2a38573cb7a4 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5')] {{(pid=74743) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:20 user nova-compute[74743]: INFO nova.compute.manager [-] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Took 0.74 seconds to deallocate network for instance.
Nov 18 17:16:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62eeea8-16e9-48fb-b279-53269513850a]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-615612ed-aee7-4f3f-ba0f-2a38573cb7a4 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --logout {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ee6b30d6-3ea3-4897-94de-2d00e6ad535e tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ee6b30d6-3ea3-4897-94de-2d00e6ad535e tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c9612b-23ac-47d5-acb8-93c31ce0fbc4]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-615612ed-aee7-4f3f-ba0f-2a38573cb7a4 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5, portal: 172.16.0.220,3260]
Nov 18 17:16:20 user nova-compute[74743]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5, portal: 172.16.0.220,3260] successful.
Nov 18 17:16:20 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --op delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e6161c-f450-4fe5-910c-e369f18f48d5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[11612dad-5aff-4065-9f04-be4511a2b5bf]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-615612ed-aee7-4f3f-ba0f-2a38573cb7a4 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-615612ed-aee7-4f3f-ba0f-2a38573cb7a4 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-615612ed-aee7-4f3f-ba0f-2a38573cb7a4 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] <== disconnect_volume: return (398ms) None {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:16:20 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-615612ed-aee7-4f3f-ba0f-2a38573cb7a4 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Disconnected iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 17:16:20 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-615612ed-aee7-4f3f-ba0f-2a38573cb7a4 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Deleting instance files /opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2_del
Nov 18 17:16:20 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-615612ed-aee7-4f3f-ba0f-2a38573cb7a4 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Deletion of /opt/stack/data/nova/instances/49ebdd5a-824d-476a-bd10-3b891bbfe9e2_del complete
Nov 18 17:16:21 user nova-compute[74743]: INFO nova.compute.manager [None req-615612ed-aee7-4f3f-ba0f-2a38573cb7a4 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Took 1.34 seconds to destroy the instance on the hypervisor.
Nov 18 17:16:21 user nova-compute[74743]: DEBUG oslo.service.loopingcall [None req-615612ed-aee7-4f3f-ba0f-2a38573cb7a4 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74743) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 17:16:21 user nova-compute[74743]: DEBUG nova.compute.manager [-] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Deallocating network for instance {{(pid=74743) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 17:16:21 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] deallocate_for_instance() {{(pid=74743) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 17:16:21 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-ee6b30d6-3ea3-4897-94de-2d00e6ad535e tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:16:21 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-ee6b30d6-3ea3-4897-94de-2d00e6ad535e tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:16:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ee6b30d6-3ea3-4897-94de-2d00e6ad535e tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.413s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:16:21 user nova-compute[74743]: INFO nova.scheduler.client.report [None req-ee6b30d6-3ea3-4897-94de-2d00e6ad535e tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Deleted allocations for instance f93bf0ac-ecc8-447d-b9c1-381d36cd3135
Nov 18 17:16:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ee6b30d6-3ea3-4897-94de-2d00e6ad535e tempest-SnapshotDataIntegrityTests-1082949191 tempest-SnapshotDataIntegrityTests-1082949191-project-member] Lock "f93bf0ac-ecc8-447d-b9c1-381d36cd3135" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.312s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:16:21 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:16:21 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:16:21 user nova-compute[74743]: INFO nova.compute.manager [-] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Took 0.86 seconds to deallocate network for instance.
Nov 18 17:16:22 user nova-compute[74743]: DEBUG nova.compute.manager [req-9649845d-4261-4374-939c-1b45bbddc4c4 req-8b6d2665-6b5f-4495-94e0-649f02d667df service nova] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Received event network-vif-plugged-c66ef239-8068-4eff-807a-830d5f3d0dba {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:16:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-9649845d-4261-4374-939c-1b45bbddc4c4 req-8b6d2665-6b5f-4495-94e0-649f02d667df service nova] Acquiring lock "49ebdd5a-824d-476a-bd10-3b891bbfe9e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:16:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-9649845d-4261-4374-939c-1b45bbddc4c4 req-8b6d2665-6b5f-4495-94e0-649f02d667df service nova] Lock "49ebdd5a-824d-476a-bd10-3b891bbfe9e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:16:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-9649845d-4261-4374-939c-1b45bbddc4c4 req-8b6d2665-6b5f-4495-94e0-649f02d667df service nova] Lock "49ebdd5a-824d-476a-bd10-3b891bbfe9e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:16:22 user nova-compute[74743]: DEBUG nova.compute.manager [req-9649845d-4261-4374-939c-1b45bbddc4c4 req-8b6d2665-6b5f-4495-94e0-649f02d667df service nova] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] No waiting events found dispatching network-vif-plugged-c66ef239-8068-4eff-807a-830d5f3d0dba {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:16:22 user nova-compute[74743]: WARNING nova.compute.manager [req-9649845d-4261-4374-939c-1b45bbddc4c4 req-8b6d2665-6b5f-4495-94e0-649f02d667df service nova] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Received unexpected event network-vif-plugged-c66ef239-8068-4eff-807a-830d5f3d0dba for instance with vm_state active and task_state deleting.
Nov 18 17:16:22 user nova-compute[74743]: DEBUG nova.compute.manager [req-548a1145-4f09-4fe1-a64e-c34962530b75 req-e4ea6c4a-7315-400f-97fa-46b6cf63ec12 service nova] [instance: f93bf0ac-ecc8-447d-b9c1-381d36cd3135] Received event network-vif-deleted-b307c7c0-aa55-4210-8e16-08b1cee78b4a {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:16:22 user nova-compute[74743]: DEBUG nova.compute.manager [req-548a1145-4f09-4fe1-a64e-c34962530b75 req-e4ea6c4a-7315-400f-97fa-46b6cf63ec12 service nova] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Received event network-vif-deleted-c66ef239-8068-4eff-807a-830d5f3d0dba {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:16:22 user nova-compute[74743]: INFO nova.compute.manager [None req-615612ed-aee7-4f3f-ba0f-2a38573cb7a4 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] [instance: 49ebdd5a-824d-476a-bd10-3b891bbfe9e2] Took 0.77 seconds to detach 1 volumes for instance.
Nov 18 17:16:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-615612ed-aee7-4f3f-ba0f-2a38573cb7a4 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:16:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-615612ed-aee7-4f3f-ba0f-2a38573cb7a4 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:16:22 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-615612ed-aee7-4f3f-ba0f-2a38573cb7a4 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:16:23 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-615612ed-aee7-4f3f-ba0f-2a38573cb7a4 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:16:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-615612ed-aee7-4f3f-ba0f-2a38573cb7a4 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.343s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:16:23 user nova-compute[74743]: INFO nova.scheduler.client.report [None req-615612ed-aee7-4f3f-ba0f-2a38573cb7a4 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Deleted allocations for instance 49ebdd5a-824d-476a-bd10-3b891bbfe9e2
Nov 18 17:16:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-615612ed-aee7-4f3f-ba0f-2a38573cb7a4 tempest-ServerActionsTestOtherB-2984948 tempest-ServerActionsTestOtherB-2984948-project-member] Lock "49ebdd5a-824d-476a-bd10-3b891bbfe9e2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.505s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:16:24 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:16:24 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74743) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 17:16:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:25 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:16:25 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Starting heal instance info cache {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 17:16:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "refresh_cache-e9668e1c-1e8d-4dd7-8f58-d453db294557" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:16:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquired lock "refresh_cache-e9668e1c-1e8d-4dd7-8f58-d453db294557" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:16:25 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Forcefully refreshing network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 17:16:26 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Updating instance_info_cache with network_info: [{"id": "fcc120f5-04f4-4675-817c-5161cc09a972", "address": "fa:16:3e:12:4a:34", "network": {"id": "252343cc-f379-471d-a2c9-99b9a60ebcb4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25c06dc8e7be46229750b8e283622c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc120f5-04", "ovs_interfaceid": "fcc120f5-04f4-4675-817c-5161cc09a972", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:16:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Releasing lock "refresh_cache-e9668e1c-1e8d-4dd7-8f58-d453db294557" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:16:26 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Updated the network info_cache for instance {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 17:16:26 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:16:26 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:16:27 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:16:29 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:16:29 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:16:29 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:16:29 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:16:29 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:16:29 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:16:29 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Auditing locally available compute resources for user (node: user) {{(pid=74743) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 17:16:29 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:16:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd467693-8b2d-4e3d-9b1a-7581c6ae6153/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd467693-8b2d-4e3d-9b1a-7581c6ae6153/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd467693-8b2d-4e3d-9b1a-7581c6ae6153/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd467693-8b2d-4e3d-9b1a-7581c6ae6153/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:30 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:16:30 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad8aa2d-663c-4829-87f9-07959105ca68/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad8aa2d-663c-4829-87f9-07959105ca68/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad8aa2d-663c-4829-87f9-07959105ca68/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad8aa2d-663c-4829-87f9-07959105ca68/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:31 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:16:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b67d5fc-3753-4c5a-8477-e46315d9b2c2/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b67d5fc-3753-4c5a-8477-e46315d9b2c2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b67d5fc-3753-4c5a-8477-e46315d9b2c2/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b67d5fc-3753-4c5a-8477-e46315d9b2c2/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:32 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:16:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f649143e-f7db-475a-bbe5-d5e7316caac3/disk.rescue --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f649143e-f7db-475a-bbe5-d5e7316caac3/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f649143e-f7db-475a-bbe5-d5e7316caac3/disk.rescue --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f649143e-f7db-475a-bbe5-d5e7316caac3/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:33 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:16:33 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:16:33 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Hypervisor/Node resource view: name=user free_ram=7355MB free_disk=25.37236785888672GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74743) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 17:16:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:16:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:16:33 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 4cce1628-2dcb-40c7-abd4-6a327a432de3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:16:33 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance e9668e1c-1e8d-4dd7-8f58-d453db294557 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:16:33 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance c006a4ad-a8e2-4108-9af1-dec4dd53fcda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:16:33 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 0ad8aa2d-663c-4829-87f9-07959105ca68 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:16:33 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance aefe3db1-b9bb-4cce-aa31-d0b6684ad791 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:16:33 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance cd467693-8b2d-4e3d-9b1a-7581c6ae6153 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:16:33 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:16:33 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance f649143e-f7db-475a-bbe5-d5e7316caac3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:16:33 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 69d78ecf-740d-492a-be5b-ffd064e36f00 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:16:33 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 2b67d5fc-3753-4c5a-8477-e46315d9b2c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:16:33 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 17:16:33 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 17:16:33 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:16:33 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:16:33 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Compute_service record updated for user:user {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 17:16:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.436s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:16:35 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:35 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:40 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:40 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Acquiring lock "f41ad39c-15fd-42e2-9ad6-ed5cd25e25de" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:16:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "f41ad39c-15fd-42e2-9ad6-ed5cd25e25de" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:16:43 user nova-compute[74743]: INFO nova.compute.manager [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Unshelving
Nov 18 17:16:43 user nova-compute[74743]: INFO nova.virt.block_device [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Booting with volume d3306e1e-9257-482e-88c8-0f98af92e102 at /dev/vdc
Nov 18 17:16:43 user nova-compute[74743]: DEBUG os_brick.utils [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:16:43 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:43 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:43 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc21083-595b-4308-a48f-79483e998fbc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1116acd8874d\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:16:43 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:44 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[df47adbd-f165-4dc5-a9e7-dad96f0b93ce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:16:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:44 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1d39d4-35dc-4268-9706-d12126d49712]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:16:44 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[344aff05-696c-46d6-a06f-902aab9755a9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:16:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Running cmd (subprocess): nvme version {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] 'nvme version' failed. Not Retrying. {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:16:44 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] nvme not present on system {{(pid=74743) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 17:16:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:16:44 user nova-compute[74743]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 17:16:44 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[8047b027-f9f4-4d91-a89e-836ba682f1a2]: (4, '') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:16:44 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74743) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 17:16:44 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 17:16:44 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] LIGHTOS: no hostnqn found. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 17:16:44 user nova-compute[74743]: DEBUG os_brick.utils [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1116acd8874d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:16:44 user nova-compute[74743]: DEBUG nova.virt.block_device [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Updating existing volume attachment record: 781e3cda-689b-4710-8148-20a19a6f12fa {{(pid=74743) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 17:16:45 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:45 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:16:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:16:49 user nova-compute[74743]: DEBUG nova.objects.instance [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lazy-loading 'pci_requests' on Instance uuid f41ad39c-15fd-42e2-9ad6-ed5cd25e25de {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:16:49 user nova-compute[74743]: DEBUG nova.objects.instance [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lazy-loading 'numa_topology' on Instance uuid f41ad39c-15fd-42e2-9ad6-ed5cd25e25de {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:16:49 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74743) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 17:16:49 user nova-compute[74743]: INFO nova.compute.claims [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Claim successful on node user
Nov 18 17:16:50 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:50 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:16:50 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:16:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.491s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:16:50 user nova-compute[74743]: INFO nova.network.neutron [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Updating port 3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 18 17:16:50 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Acquiring lock "refresh_cache-f41ad39c-15fd-42e2-9ad6-ed5cd25e25de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:16:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Acquired lock "refresh_cache-f41ad39c-15fd-42e2-9ad6-ed5cd25e25de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:16:50 user nova-compute[74743]: DEBUG nova.network.neutron [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:16:51 user nova-compute[74743]: DEBUG nova.compute.manager [req-9b475c3a-102c-4604-82f8-ac807f36f916 req-d0b733f5-abf1-40e0-8b8a-ef043e06931a service nova] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Received event network-changed-3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:16:51 user nova-compute[74743]: DEBUG nova.compute.manager [req-9b475c3a-102c-4604-82f8-ac807f36f916 req-d0b733f5-abf1-40e0-8b8a-ef043e06931a service nova] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Refreshing instance network info cache due to event network-changed-3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:16:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-9b475c3a-102c-4604-82f8-ac807f36f916 req-d0b733f5-abf1-40e0-8b8a-ef043e06931a service nova] Acquiring lock "refresh_cache-f41ad39c-15fd-42e2-9ad6-ed5cd25e25de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:16:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-2eaa24d3-f899-412a-be2a-e2209ebf529f tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:16:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-2eaa24d3-f899-412a-be2a-e2209ebf529f tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:16:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-2eaa24d3-f899-412a-be2a-e2209ebf529f tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:16:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-2eaa24d3-f899-412a-be2a-e2209ebf529f tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:16:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-2eaa24d3-f899-412a-be2a-e2209ebf529f tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:16:51 user nova-compute[74743]: INFO nova.compute.manager [None req-2eaa24d3-f899-412a-be2a-e2209ebf529f tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Terminating instance
Nov 18 17:16:51 user nova-compute[74743]: DEBUG nova.compute.manager [None req-2eaa24d3-f899-412a-be2a-e2209ebf529f tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Start destroying the instance on the hypervisor. {{(pid=74743) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 17:16:51 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:51 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:51 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:51 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:51 user nova-compute[74743]: DEBUG nova.compute.manager [req-f93c45af-06b4-4466-95d3-65d63693680c req-bb98ad69-1e8a-4fe5-b61d-62bf11a74b78 service nova] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Received event network-changed-999980cf-efd0-4b78-aa42-f4e80073b5a9 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:16:51 user nova-compute[74743]: DEBUG nova.compute.manager [req-f93c45af-06b4-4466-95d3-65d63693680c req-bb98ad69-1e8a-4fe5-b61d-62bf11a74b78 service nova] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Refreshing instance network info cache due to event network-changed-999980cf-efd0-4b78-aa42-f4e80073b5a9. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:16:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f93c45af-06b4-4466-95d3-65d63693680c req-bb98ad69-1e8a-4fe5-b61d-62bf11a74b78 service nova] Acquiring lock "refresh_cache-c006a4ad-a8e2-4108-9af1-dec4dd53fcda" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:16:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f93c45af-06b4-4466-95d3-65d63693680c req-bb98ad69-1e8a-4fe5-b61d-62bf11a74b78 service nova] Acquired lock "refresh_cache-c006a4ad-a8e2-4108-9af1-dec4dd53fcda" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:16:51 user nova-compute[74743]: DEBUG nova.network.neutron [req-f93c45af-06b4-4466-95d3-65d63693680c req-bb98ad69-1e8a-4fe5-b61d-62bf11a74b78 service nova] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Refreshing network info cache for port 999980cf-efd0-4b78-aa42-f4e80073b5a9 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:16:51 user nova-compute[74743]: DEBUG nova.compute.manager [req-bb7e4fd6-f491-4cef-b5d5-e6f3d33a737a req-4b54ea49-42c4-42f2-b821-b509d2894363 service nova] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Received event network-vif-unplugged-1c9871cc-eb56-4eef-8563-b12d5f69c1af {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:16:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-bb7e4fd6-f491-4cef-b5d5-e6f3d33a737a req-4b54ea49-42c4-42f2-b821-b509d2894363 service nova] Acquiring lock "cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:16:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-bb7e4fd6-f491-4cef-b5d5-e6f3d33a737a req-4b54ea49-42c4-42f2-b821-b509d2894363 service nova] Lock "cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:16:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-bb7e4fd6-f491-4cef-b5d5-e6f3d33a737a req-4b54ea49-42c4-42f2-b821-b509d2894363 service nova] Lock "cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:16:51 user nova-compute[74743]: DEBUG nova.compute.manager [req-bb7e4fd6-f491-4cef-b5d5-e6f3d33a737a req-4b54ea49-42c4-42f2-b821-b509d2894363 service nova] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] No waiting events found dispatching network-vif-unplugged-1c9871cc-eb56-4eef-8563-b12d5f69c1af {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:16:51 user nova-compute[74743]: DEBUG nova.compute.manager [req-bb7e4fd6-f491-4cef-b5d5-e6f3d33a737a req-4b54ea49-42c4-42f2-b821-b509d2894363 service nova] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Received event network-vif-unplugged-1c9871cc-eb56-4eef-8563-b12d5f69c1af for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:16:51 user nova-compute[74743]: DEBUG nova.network.neutron [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Updating instance_info_cache with network_info: [{"id": "3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5", "address": "fa:16:3e:0e:63:d2", "network": {"id": "e1c28f74-c9c1-4eb3-931e-003332ff6243", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-453481916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a17803c613c4ef299c797bba85c1a4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d1781f8-f4", "ovs_interfaceid": "3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:16:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Releasing lock "refresh_cache-f41ad39c-15fd-42e2-9ad6-ed5cd25e25de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:16:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Creating instance directory {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 17:16:51 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Creating image(s)
Nov 18 17:16:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Acquiring lock "/opt/stack/data/nova/instances/f41ad39c-15fd-42e2-9ad6-ed5cd25e25de/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:16:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "/opt/stack/data/nova/instances/f41ad39c-15fd-42e2-9ad6-ed5cd25e25de/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:16:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "/opt/stack/data/nova/instances/f41ad39c-15fd-42e2-9ad6-ed5cd25e25de/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:16:51 user nova-compute[74743]: DEBUG nova.objects.instance [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lazy-loading 'trusted_certs' on Instance uuid f41ad39c-15fd-42e2-9ad6-ed5cd25e25de {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:16:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-9b475c3a-102c-4604-82f8-ac807f36f916 req-d0b733f5-abf1-40e0-8b8a-ef043e06931a service nova] Acquired lock "refresh_cache-f41ad39c-15fd-42e2-9ad6-ed5cd25e25de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:16:51 user nova-compute[74743]: DEBUG nova.network.neutron [req-9b475c3a-102c-4604-82f8-ac807f36f916 req-d0b733f5-abf1-40e0-8b8a-ef043e06931a service nova] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Refreshing network info cache for port 3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:16:51 user nova-compute[74743]: DEBUG nova.objects.base [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Object Instance<f41ad39c-15fd-42e2-9ad6-ed5cd25e25de> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:16:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Acquiring lock "433841f53c5f6f2eab74d6f85731e9576770cc5d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:16:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "433841f53c5f6f2eab74d6f85731e9576770cc5d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:16:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/433841f53c5f6f2eab74d6f85731e9576770cc5d.part --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:52 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Instance destroyed successfully.
Nov 18 17:16:52 user nova-compute[74743]: DEBUG nova.objects.instance [None req-2eaa24d3-f899-412a-be2a-e2209ebf529f tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lazy-loading 'resources' on Instance uuid cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:16:52 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-2eaa24d3-f899-412a-be2a-e2209ebf529f tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:12:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1445401306',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1445401306',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1445401306',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHuq53pFbJtFz2jLBrgr31qm5IYMFOfEyVT5+EF0v8zWR9lFsevHQBdkqCfpEpuAGPGeldy+Lrg+ToUbY4nqpHL5H6Apayio2qHMA6Mh5/yr00ssL68q1cTaWMoErtqN8Q==',key_name='tempest-keypair-1644584425',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:12:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a956c4d6e4304d34872ecf989279c886',ramdisk_id='',reservation_id='r-1zmdkqrj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1373443944',owner_user_name='tempest-TestVolumeBootPattern-1373443944-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:12:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89ce0d4bf7234c348b9b1a8979609c7b',uuid=cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1c9871cc-eb56-4eef-8563-b12d5f69c1af", "address": "fa:16:3e:0d:f2:57", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c9871cc-eb", "ovs_interfaceid": "1c9871cc-eb56-4eef-8563-b12d5f69c1af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:16:52 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-2eaa24d3-f899-412a-be2a-e2209ebf529f tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Converting VIF {"id": "1c9871cc-eb56-4eef-8563-b12d5f69c1af", "address": "fa:16:3e:0d:f2:57", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c9871cc-eb", "ovs_interfaceid": "1c9871cc-eb56-4eef-8563-b12d5f69c1af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:16:52 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-2eaa24d3-f899-412a-be2a-e2209ebf529f tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:f2:57,bridge_name='br-int',has_traffic_filtering=True,id=1c9871cc-eb56-4eef-8563-b12d5f69c1af,network=Network(fc55f18a-b779-4b04-8828-278ecd62211a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c9871cc-eb') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:16:52 user nova-compute[74743]: DEBUG os_vif [None req-2eaa24d3-f899-412a-be2a-e2209ebf529f tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:f2:57,bridge_name='br-int',has_traffic_filtering=True,id=1c9871cc-eb56-4eef-8563-b12d5f69c1af,network=Network(fc55f18a-b779-4b04-8828-278ecd62211a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c9871cc-eb') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:16:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1c9871cc-eb, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:16:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:16:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fd2c4a0f-ba78-4751-9f29-b10e6059c2b5) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:16:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:16:52 user nova-compute[74743]: INFO os_vif [None req-2eaa24d3-f899-412a-be2a-e2209ebf529f tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:f2:57,bridge_name='br-int',has_traffic_filtering=True,id=1c9871cc-eb56-4eef-8563-b12d5f69c1af,network=Network(fc55f18a-b779-4b04-8828-278ecd62211a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c9871cc-eb')
Nov 18 17:16:52 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2eaa24d3-f899-412a-be2a-e2209ebf529f tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] calling os-brick to detach iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 17:16:52 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eaa24d3-f899-412a-be2a-e2209ebf529f tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, {'target_iqn': 'iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xjDQMAGp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:16:52 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-2eaa24d3-f899-412a-be2a-e2209ebf529f tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:16:52 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-2eaa24d3-f899-412a-be2a-e2209ebf529f tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:16:52 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-2eaa24d3-f899-412a-be2a-e2209ebf529f tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:16:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:52 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7b7946-bc9c-41b1-ace6-8d7abe190d18]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:16:52 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eaa24d3-f899-412a-be2a-e2209ebf529f tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 17:16:52 user nova-compute[74743]: No targets found.
Nov 18 17:16:52 user nova-compute[74743]: iSNS:
Nov 18 17:16:52 user nova-compute[74743]: No targets found.
Nov 18 17:16:52 user nova-compute[74743]: STATIC:
Nov 18 17:16:52 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f
Nov 18 17:16:52 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:16:52 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:16:52 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5
Nov 18 17:16:52 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:16:52 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:16:52 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127
Nov 18 17:16:52 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:16:52 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:16:52 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685
Nov 18 17:16:52 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:16:52 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:16:52 user nova-compute[74743]: FIRMWARE:
Nov 18 17:16:52 user nova-compute[74743]: No targets found.
Nov 18 17:16:52 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:16:52 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eaa24d3-f899-412a-be2a-e2209ebf529f tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 17:16:52 user nova-compute[74743]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 17:16:52 user nova-compute[74743]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74743) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 17:16:52 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eaa24d3-f899-412a-be2a-e2209ebf529f tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685', 0)] {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 17:16:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:52 user nova-compute[74743]: DEBUG nova.network.neutron [req-f93c45af-06b4-4466-95d3-65d63693680c req-bb98ad69-1e8a-4fe5-b61d-62bf11a74b78 service nova] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Updated VIF entry in instance network info cache for port 999980cf-efd0-4b78-aa42-f4e80073b5a9. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:16:52 user nova-compute[74743]: DEBUG nova.network.neutron [req-f93c45af-06b4-4466-95d3-65d63693680c req-bb98ad69-1e8a-4fe5-b61d-62bf11a74b78 service nova] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Updating instance_info_cache with network_info: [{"id": "999980cf-efd0-4b78-aa42-f4e80073b5a9", "address": "fa:16:3e:e4:7e:f3", "network": {"id": "fd98f398-6576-449b-a737-887906eb6656", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668610993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb8f5850162c479b8d185e48c03be7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap999980cf-ef", "ovs_interfaceid": "999980cf-efd0-4b78-aa42-f4e80073b5a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:16:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:52 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02f5135-2a14-46d3-a08e-aa29016604c1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:16:52 user nova-compute[74743]: DEBUG nova.compute.manager [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Stashing vm_state: active {{(pid=74743) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 18 17:16:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/433841f53c5f6f2eab74d6f85731e9576770cc5d.part --force-share --output=json" returned: 0 in 0.210s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f93c45af-06b4-4466-95d3-65d63693680c req-bb98ad69-1e8a-4fe5-b61d-62bf11a74b78 service nova] Releasing lock "refresh_cache-c006a4ad-a8e2-4108-9af1-dec4dd53fcda" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:16:52 user nova-compute[74743]: DEBUG nova.virt.images [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] 6ae32e7e-3eda-4c8a-98d7-fea879469db4 was qcow2, converting to raw {{(pid=74743) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 18 17:16:52 user nova-compute[74743]: DEBUG nova.privsep.utils [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74743) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 18 17:16:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/433841f53c5f6f2eab74d6f85731e9576770cc5d.part /opt/stack/data/nova/instances/_base/433841f53c5f6f2eab74d6f85731e9576770cc5d.converted {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:52 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3653353-6936-4622-bb81-6d28a3270603]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:16:53 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eaa24d3-f899-412a-be2a-e2209ebf529f tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:16:53 user nova-compute[74743]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)
Nov 18 17:16:53 user nova-compute[74743]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:16:53 user nova-compute[74743]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)
Nov 18 17:16:53 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:16:53 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eaa24d3-f899-412a-be2a-e2209ebf529f tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 (non-flash)
Nov 18 17:16:53 user nova-compute[74743]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)
Nov 18 17:16:53 user nova-compute[74743]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:16:53 user nova-compute[74743]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)
Nov 18 17:16:53 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:16:53 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eaa24d3-f899-412a-be2a-e2209ebf529f tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb08187250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685'): ({'sde'}, set())}) {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 17:16:53 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-2eaa24d3-f899-412a-be2a-e2209ebf529f tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Removing single pathed devices sde {{(pid=74743) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 17:16:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:53 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[82eab4d8-9b1e-4cbb-b2f7-59d789416fe2]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:16:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:16:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:16:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:53 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3d8b78-f2c1-469e-98ea-cc69aca3fe45]: (4, ('ok\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:16:53 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-2eaa24d3-f899-412a-be2a-e2209ebf529f tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Flushing IO for device /dev/sde {{(pid=74743) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 17:16:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:53 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74743) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 17:16:53 user nova-compute[74743]: INFO nova.compute.claims [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Claim successful on node user
Nov 18 17:16:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:53 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a92bba-7b6b-4bd9-8920-7e6d9cb7b763]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:16:53 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-2eaa24d3-f899-412a-be2a-e2209ebf529f tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74743) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 17:16:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:53 user nova-compute[74743]: DEBUG nova.network.neutron [req-9b475c3a-102c-4604-82f8-ac807f36f916 req-d0b733f5-abf1-40e0-8b8a-ef043e06931a service nova] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Updated VIF entry in instance network info cache for port 3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:16:53 user nova-compute[74743]: DEBUG nova.network.neutron [req-9b475c3a-102c-4604-82f8-ac807f36f916 req-d0b733f5-abf1-40e0-8b8a-ef043e06931a service nova] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Updating instance_info_cache with network_info: [{"id": "3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5", "address": "fa:16:3e:0e:63:d2", "network": {"id": "e1c28f74-c9c1-4eb3-931e-003332ff6243", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-453481916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a17803c613c4ef299c797bba85c1a4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d1781f8-f4", "ovs_interfaceid": "3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:16:53 user nova-compute[74743]: INFO nova.compute.resource_tracker [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Updating resource usage from migration 9f30ed74-7eb7-4032-9f5a-b01be5e0f191
Nov 18 17:16:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.120s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:53 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2099f1-2930-4fbc-9215-ed1c7293a414]: (4, ('1', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:16:53 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-2eaa24d3-f899-412a-be2a-e2209ebf529f tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 17:16:53 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-2eaa24d3-f899-412a-be2a-e2209ebf529f tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] SCSI volumes sde have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 17:16:53 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eaa24d3-f899-412a-be2a-e2209ebf529f tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685')] {{(pid=74743) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 17:16:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-9b475c3a-102c-4604-82f8-ac807f36f916 req-d0b733f5-abf1-40e0-8b8a-ef043e06931a service nova] Releasing lock "refresh_cache-f41ad39c-15fd-42e2-9ad6-ed5cd25e25de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:16:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:53 user nova-compute[74743]: DEBUG nova.compute.manager [req-7acf107b-909b-4430-bbd9-375b589af28b req-ec05ecba-b78c-4101-967a-33c8e62599c5 service nova] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Received event network-changed-4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:16:53 user nova-compute[74743]: DEBUG nova.compute.manager [req-7acf107b-909b-4430-bbd9-375b589af28b req-ec05ecba-b78c-4101-967a-33c8e62599c5 service nova] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Refreshing instance network info cache due to event network-changed-4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:16:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-7acf107b-909b-4430-bbd9-375b589af28b req-ec05ecba-b78c-4101-967a-33c8e62599c5 service nova] Acquiring lock "refresh_cache-69d78ecf-740d-492a-be5b-ffd064e36f00" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:16:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-7acf107b-909b-4430-bbd9-375b589af28b req-ec05ecba-b78c-4101-967a-33c8e62599c5 service nova] Acquired lock "refresh_cache-69d78ecf-740d-492a-be5b-ffd064e36f00" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:16:53 user nova-compute[74743]: DEBUG nova.network.neutron [req-7acf107b-909b-4430-bbd9-375b589af28b req-ec05ecba-b78c-4101-967a-33c8e62599c5 service nova] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Refreshing network info cache for port 4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:16:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:53 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c883a2-c5ed-4fe9-8b01-43f8c2342632]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:16:53 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eaa24d3-f899-412a-be2a-e2209ebf529f tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:16:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 -p 172.16.0.220:3260 --logout {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:53 user nova-compute[74743]: DEBUG nova.compute.manager [req-632b8a9f-2efb-4e59-90e0-baa131db4f80 req-bb56e82d-42f0-4f47-8517-76398671d2e2 service nova] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Received event network-vif-plugged-1c9871cc-eb56-4eef-8563-b12d5f69c1af {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:16:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-632b8a9f-2efb-4e59-90e0-baa131db4f80 req-bb56e82d-42f0-4f47-8517-76398671d2e2 service nova] Acquiring lock "cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:16:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-632b8a9f-2efb-4e59-90e0-baa131db4f80 req-bb56e82d-42f0-4f47-8517-76398671d2e2 service nova] Lock "cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:16:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-632b8a9f-2efb-4e59-90e0-baa131db4f80 req-bb56e82d-42f0-4f47-8517-76398671d2e2 service nova] Lock "cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:16:53 user nova-compute[74743]: DEBUG nova.compute.manager [req-632b8a9f-2efb-4e59-90e0-baa131db4f80 req-bb56e82d-42f0-4f47-8517-76398671d2e2 service nova] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] No waiting events found dispatching network-vif-plugged-1c9871cc-eb56-4eef-8563-b12d5f69c1af {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:16:53 user nova-compute[74743]: WARNING nova.compute.manager [req-632b8a9f-2efb-4e59-90e0-baa131db4f80 req-bb56e82d-42f0-4f47-8517-76398671d2e2 service nova] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Received unexpected event network-vif-plugged-1c9871cc-eb56-4eef-8563-b12d5f69c1af for instance with vm_state active and task_state deleting.
Nov 18 17:16:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 -p 172.16.0.220:3260 --logout" returned: 0 in 0.168s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:53 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1253116-c992-42e6-8298-e75968be13cf]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:16:53 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eaa24d3-f899-412a-be2a-e2209ebf529f tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685, portal: 172.16.0.220,3260]
Nov 18 17:16:53 user nova-compute[74743]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685, portal: 172.16.0.220,3260] successful.
Nov 18 17:16:53 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:16:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 -p 172.16.0.220:3260 --op delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17045ea7-5355-44f9-8ac7-87f27257d685 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:53 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[205ef343-41ee-47e2-bbaa-14489e38a903]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:16:53 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eaa24d3-f899-412a-be2a-e2209ebf529f tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:16:53 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-2eaa24d3-f899-412a-be2a-e2209ebf529f tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.695s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:16:53 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eaa24d3-f899-412a-be2a-e2209ebf529f tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] <== disconnect_volume: return (696ms) None {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:16:53 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2eaa24d3-f899-412a-be2a-e2209ebf529f tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Disconnected iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 17:16:53 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-2eaa24d3-f899-412a-be2a-e2209ebf529f tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Deleting instance files /opt/stack/data/nova/instances/cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4_del
Nov 18 17:16:53 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-2eaa24d3-f899-412a-be2a-e2209ebf529f tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Deletion of /opt/stack/data/nova/instances/cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4_del complete
Nov 18 17:16:53 user nova-compute[74743]: INFO nova.compute.manager [None req-2eaa24d3-f899-412a-be2a-e2209ebf529f tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Took 2.77 seconds to destroy the instance on the hypervisor.
Nov 18 17:16:53 user nova-compute[74743]: DEBUG oslo.service.loopingcall [None req-2eaa24d3-f899-412a-be2a-e2209ebf529f tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74743) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 17:16:53 user nova-compute[74743]: DEBUG nova.compute.manager [-] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Deallocating network for instance {{(pid=74743) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 17:16:53 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] deallocate_for_instance() {{(pid=74743) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 17:16:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/433841f53c5f6f2eab74d6f85731e9576770cc5d.part /opt/stack/data/nova/instances/_base/433841f53c5f6f2eab74d6f85731e9576770cc5d.converted" returned: 0 in 0.917s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:53 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/433841f53c5f6f2eab74d6f85731e9576770cc5d.converted --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:53 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:16:53 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:16:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.869s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:16:54 user nova-compute[74743]: INFO nova.compute.manager [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Migrating
Nov 18 17:16:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/433841f53c5f6f2eab74d6f85731e9576770cc5d.converted --force-share --output=json" returned: 0 in 0.177s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "433841f53c5f6f2eab74d6f85731e9576770cc5d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.441s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:16:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/433841f53c5f6f2eab74d6f85731e9576770cc5d --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquiring lock "refresh_cache-69d78ecf-740d-492a-be5b-ffd064e36f00" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:16:54 user nova-compute[74743]: DEBUG nova.network.neutron [req-7acf107b-909b-4430-bbd9-375b589af28b req-ec05ecba-b78c-4101-967a-33c8e62599c5 service nova] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Updated VIF entry in instance network info cache for port 4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:16:54 user nova-compute[74743]: DEBUG nova.network.neutron [req-7acf107b-909b-4430-bbd9-375b589af28b req-ec05ecba-b78c-4101-967a-33c8e62599c5 service nova] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Updating instance_info_cache with network_info: [{"id": "4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8", "address": "fa:16:3e:93:d9:fc", "network": {"id": "fd98f398-6576-449b-a737-887906eb6656", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668610993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb8f5850162c479b8d185e48c03be7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd5a403-19", "ovs_interfaceid": "4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:16:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-7acf107b-909b-4430-bbd9-375b589af28b req-ec05ecba-b78c-4101-967a-33c8e62599c5 service nova] Releasing lock "refresh_cache-69d78ecf-740d-492a-be5b-ffd064e36f00" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:16:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquired lock "refresh_cache-69d78ecf-740d-492a-be5b-ffd064e36f00" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:16:54 user nova-compute[74743]: DEBUG nova.network.neutron [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:16:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/433841f53c5f6f2eab74d6f85731e9576770cc5d --force-share --output=json" returned: 0 in 0.168s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Acquiring lock "433841f53c5f6f2eab74d6f85731e9576770cc5d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:16:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "433841f53c5f6f2eab74d6f85731e9576770cc5d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:16:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/433841f53c5f6f2eab74d6f85731e9576770cc5d --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/433841f53c5f6f2eab74d6f85731e9576770cc5d --force-share --output=json" returned: 0 in 0.187s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/433841f53c5f6f2eab74d6f85731e9576770cc5d,backing_fmt=raw /opt/stack/data/nova/instances/f41ad39c-15fd-42e2-9ad6-ed5cd25e25de/disk 1073741824 {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/433841f53c5f6f2eab74d6f85731e9576770cc5d,backing_fmt=raw /opt/stack/data/nova/instances/f41ad39c-15fd-42e2-9ad6-ed5cd25e25de/disk 1073741824" returned: 0 in 0.049s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "433841f53c5f6f2eab74d6f85731e9576770cc5d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:16:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/433841f53c5f6f2eab74d6f85731e9576770cc5d --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:54 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:16:54 user nova-compute[74743]: INFO nova.compute.manager [-] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Took 0.75 seconds to deallocate network for instance.
Nov 18 17:16:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/433841f53c5f6f2eab74d6f85731e9576770cc5d --force-share --output=json" returned: 0 in 0.182s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:54 user nova-compute[74743]: DEBUG nova.objects.instance [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lazy-loading 'migration_context' on Instance uuid f41ad39c-15fd-42e2-9ad6-ed5cd25e25de {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:16:54 user nova-compute[74743]: DEBUG nova.objects.base [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Object Instance<f41ad39c-15fd-42e2-9ad6-ed5cd25e25de> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:16:54 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Rebasing disk image.
Nov 18 17:16:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.203s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 -F raw /opt/stack/data/nova/instances/f41ad39c-15fd-42e2-9ad6-ed5cd25e25de/disk {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:55 user nova-compute[74743]: DEBUG nova.network.neutron [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Updating instance_info_cache with network_info: [{"id": "4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8", "address": "fa:16:3e:93:d9:fc", "network": {"id": "fd98f398-6576-449b-a737-887906eb6656", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668610993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb8f5850162c479b8d185e48c03be7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd5a403-19", "ovs_interfaceid": "4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:16:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Releasing lock "refresh_cache-69d78ecf-740d-492a-be5b-ffd064e36f00" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:16:55 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Starting migrate_disk_and_power_off {{(pid=74743) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 18 17:16:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:55 user nova-compute[74743]: INFO nova.compute.manager [None req-2eaa24d3-f899-412a-be2a-e2209ebf529f tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Took 0.75 seconds to detach 1 volumes for instance.
Nov 18 17:16:55 user nova-compute[74743]: DEBUG nova.compute.manager [None req-2eaa24d3-f899-412a-be2a-e2209ebf529f tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Deleting volume: 17045ea7-5355-44f9-8ac7-87f27257d685 {{(pid=74743) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 18 17:16:55 user nova-compute[74743]: DEBUG nova.compute.manager [req-1ffc53e8-2381-4070-af26-93b9d065797d req-990e6795-9dfe-4e8b-991c-b6597a4a1be1 service nova] [instance: cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4] Received event network-vif-deleted-1c9871cc-eb56-4eef-8563-b12d5f69c1af {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:16:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-2eaa24d3-f899-412a-be2a-e2209ebf529f tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:16:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-2eaa24d3-f899-412a-be2a-e2209ebf529f tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:16:55 user nova-compute[74743]: DEBUG nova.compute.manager [req-10ae5537-1ffb-4b73-9d75-a297608b1858 req-ac4917ff-9d88-49e6-8446-956f1d3132c1 service nova] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Received event network-vif-unplugged-4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:16:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-10ae5537-1ffb-4b73-9d75-a297608b1858 req-ac4917ff-9d88-49e6-8446-956f1d3132c1 service nova] Acquiring lock "69d78ecf-740d-492a-be5b-ffd064e36f00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:16:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-10ae5537-1ffb-4b73-9d75-a297608b1858 req-ac4917ff-9d88-49e6-8446-956f1d3132c1 service nova] Lock "69d78ecf-740d-492a-be5b-ffd064e36f00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:16:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-10ae5537-1ffb-4b73-9d75-a297608b1858 req-ac4917ff-9d88-49e6-8446-956f1d3132c1 service nova] Lock "69d78ecf-740d-492a-be5b-ffd064e36f00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:16:55 user nova-compute[74743]: DEBUG nova.compute.manager [req-10ae5537-1ffb-4b73-9d75-a297608b1858 req-ac4917ff-9d88-49e6-8446-956f1d3132c1 service nova] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] No waiting events found dispatching network-vif-unplugged-4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:16:55 user nova-compute[74743]: WARNING nova.compute.manager [req-10ae5537-1ffb-4b73-9d75-a297608b1858 req-ac4917ff-9d88-49e6-8446-956f1d3132c1 service nova] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Received unexpected event network-vif-unplugged-4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8 for instance with vm_state active and task_state resize_migrating.
Nov 18 17:16:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:55 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-2eaa24d3-f899-412a-be2a-e2209ebf529f tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:16:55 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-2eaa24d3-f899-412a-be2a-e2209ebf529f tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:16:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-2eaa24d3-f899-412a-be2a-e2209ebf529f tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.430s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:16:55 user nova-compute[74743]: INFO nova.scheduler.client.report [None req-2eaa24d3-f899-412a-be2a-e2209ebf529f tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Deleted allocations for instance cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4
Nov 18 17:16:55 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Instance destroyed successfully.
Nov 18 17:16:55 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:14:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-403226732',display_name='tempest-ServerActionsTestOtherA-server-403226732',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-403226732',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEVphqV0ovLOhWV5c4OtZaZAghiX4KqdCUzcXRNxI8zWTbqX3YOGnG7iLQKSTFxu3amDks//fytVOc70uGuSKqNKUeaE/kY0CmyGU71j0ZYQPWjJeA0I0UUP+FZUS4MWQ==',key_name='tempest-keypair-1212996543',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:15:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fb8f5850162c479b8d185e48c03be7d3',ramdisk_id='',reservation_id='r-elyg0ort',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-128885625',owner_user_name='tempest-ServerActionsTestOtherA-128885625-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:16:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce3e4cef47114a7c9327db639460d923',uuid=69d78ecf-740d-492a-be5b-ffd064e36f00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8", "address": "fa:16:3e:93:d9:fc", "network": {"id": "fd98f398-6576-449b-a737-887906eb6656", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668610993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-668610993-network", "vif_mac": "fa:16:3e:93:d9:fc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb8f5850162c479b8d185e48c03be7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd5a403-19", "ovs_interfaceid": "4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:16:55 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Converting VIF {"id": "4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8", "address": "fa:16:3e:93:d9:fc", "network": {"id": "fd98f398-6576-449b-a737-887906eb6656", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668610993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-668610993-network", "vif_mac": "fa:16:3e:93:d9:fc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb8f5850162c479b8d185e48c03be7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd5a403-19", "ovs_interfaceid": "4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:16:55 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:93:d9:fc,bridge_name='br-int',has_traffic_filtering=True,id=4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8,network=Network(fd98f398-6576-449b-a737-887906eb6656),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cd5a403-19') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:16:55 user nova-compute[74743]: DEBUG os_vif [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:d9:fc,bridge_name='br-int',has_traffic_filtering=True,id=4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8,network=Network(fd98f398-6576-449b-a737-887906eb6656),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cd5a403-19') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:16:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4cd5a403-19, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:16:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:16:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7c41fc91-2726-4f7f-8fa6-cc3dec9a5c10) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:16:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:56 user nova-compute[74743]: INFO os_vif [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:d9:fc,bridge_name='br-int',has_traffic_filtering=True,id=4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8,network=Network(fd98f398-6576-449b-a737-887906eb6656),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cd5a403-19')
Nov 18 17:16:56 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] calling os-brick to detach iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 17:16:56 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, {'target_iqn': 'iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xBLIUkZY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:16:56 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:16:56 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:16:56 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:16:56 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:56 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:56 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[332dad22-005e-4f73-b310-f7cabca60046]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:16:56 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 17:16:56 user nova-compute[74743]: No targets found.
Nov 18 17:16:56 user nova-compute[74743]: iSNS:
Nov 18 17:16:56 user nova-compute[74743]: No targets found.
Nov 18 17:16:56 user nova-compute[74743]: STATIC:
Nov 18 17:16:56 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f
Nov 18 17:16:56 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:16:56 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:16:56 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5
Nov 18 17:16:56 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:16:56 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:16:56 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127
Nov 18 17:16:56 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:16:56 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:16:56 user nova-compute[74743]: FIRMWARE:
Nov 18 17:16:56 user nova-compute[74743]: No targets found.
Nov 18 17:16:56 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:16:56 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 17:16:56 user nova-compute[74743]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 17:16:56 user nova-compute[74743]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74743) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 17:16:56 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f', 0)] {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 17:16:56 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-2eaa24d3-f899-412a-be2a-e2209ebf529f tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "cb7f143f-67bf-4bd2-9f80-8fa0251cf8b4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.983s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:16:56 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:56 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd5afc6-1186-47d3-b735-e8603b20dad6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:16:56 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:56 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:56 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44ebc25-8364-44cd-8b41-b158978f9d0f]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:16:56 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)
Nov 18 17:16:56 user nova-compute[74743]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:16:56 user nova-compute[74743]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)
Nov 18 17:16:56 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:16:56 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)
Nov 18 17:16:56 user nova-compute[74743]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:16:56 user nova-compute[74743]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)
Nov 18 17:16:56 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:16:56 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb08298670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f'): ({'sdh'}, set())}) {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 17:16:56 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Removing single pathed devices sdh {{(pid=74743) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 17:16:56 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:56 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:56 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7edcbb-e16b-46a1-a36b-da44f6819586]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:16:56 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:56 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:56 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62f7481-ab89-462b-9bb9-6a444bfad4c3]: (4, ('ok\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:16:56 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Flushing IO for device /dev/sdh {{(pid=74743) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 17:16:56 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:56 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:56 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[086a91e8-ced1-4a9a-9ab2-181b57cabf9f]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:16:56 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74743) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 17:16:56 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:56 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.074s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:56 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac7d7fb-6954-478a-9d05-7b833ac24575]: (4, ('1', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:16:56 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 17:16:56 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] SCSI volumes sdh have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 17:16:56 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f')] {{(pid=74743) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 17:16:56 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:56 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.053s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:56 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[34be5dd8-ff2c-4e37-ab88-7f0114a8887a]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:16:56 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:16:56 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f -p 172.16.0.220:3260 --logout {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:56 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f -p 172.16.0.220:3260 --logout" returned: 0 in 0.209s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:56 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ac1bd5-a944-4e97-a07a-9def4e28178b]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:16:56 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f, portal: 172.16.0.220,3260]
Nov 18 17:16:56 user nova-compute[74743]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f, portal: 172.16.0.220,3260] successful.
Nov 18 17:16:56 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:16:56 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f -p 172.16.0.220:3260 --op delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:56 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:56 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b242df-e58f-49d6-9fb1-f3d7448eb46b]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:16:56 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:16:56 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.538s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:16:56 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] <== disconnect_volume: return (538ms) None {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:16:56 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Disconnected iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 17:16:56 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] skipping disk /dev/sdh (vda) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 -F raw /opt/stack/data/nova/instances/f41ad39c-15fd-42e2-9ad6-ed5cd25e25de/disk" returned: 0 in 2.413s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Created local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Ensure instance console log exists: /opt/stack/data/nova/instances/f41ad39c-15fd-42e2-9ad6-ed5cd25e25de/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Start _get_guest_xml network_info=[{"id": "3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5", "address": "fa:16:3e:0e:63:d2", "network": {"id": "e1c28f74-c9c1-4eb3-931e-003332ff6243", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-453481916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a17803c613c4ef299c797bba85c1a4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d1781f8-f4", "ovs_interfaceid": "3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='6352d85b2b1e495bd9e3d2dda3c42b7d',container_format='bare',created_at=2023-11-18T17:14:51Z,direct_url=<?>,disk_format='qcow2',id=6ae32e7e-3eda-4c8a-98d7-fea879469db4,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1872287329-shelved',owner='0a17803c613c4ef299c797bba85c1a4b',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-18T17:14:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '9536f6cf-95c4-40e2-864a-09a91525678a'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'boot_index': None, 'mount_device': '/dev/vdc', 'attachment_id': '781e3cda-689b-4710-8148-20a19a6f12fa', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AHKvJNMO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'f41ad39c-15fd-42e2-9ad6-ed5cd25e25de', 'attached_at': '', 'detached_at': '', 'volume_id': 'd3306e1e-9257-482e-88c8-0f98af92e102', 'serial': 'd3306e1e-9257-482e-88c8-0f98af92e102'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:16:57 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:16:57 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:16:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='6352d85b2b1e495bd9e3d2dda3c42b7d',container_format='bare',created_at=2023-11-18T17:14:51Z,direct_url=<?>,disk_format='qcow2',id=6ae32e7e-3eda-4c8a-98d7-fea879469db4,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1872287329-shelved',owner='0a17803c613c4ef299c797bba85c1a4b',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-18T17:14:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG nova.objects.instance [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lazy-loading 'vcpu_model' on Instance uuid f41ad39c-15fd-42e2-9ad6-ed5cd25e25de {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG nova.objects.base [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Object Instance<f41ad39c-15fd-42e2-9ad6-ed5cd25e25de> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Calling os-brick to attach iSCSI Volume {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AHKvJNMO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:16:57 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:16:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:16:57 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:16:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:16:57 user nova-compute[74743]: INFO os_brick.initiator.connectors.iscsi [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 17:16:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102 -p 172.16.0.220:3260 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102 -p 172.16.0.220:3260" returned: 21 in 0.053s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[138fa91b-28d8-4c47-bde4-4774eb81544a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 17:16:57 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102 -p 172.16.0.220:3260 --interface default --op new {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0d4215-e806-427c-b2b8-34d894d35f85]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102] added\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102] added
Nov 18 17:16:57 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dfd1add-33c7-4f7e-a92f-8a985bfb5595]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[8163a636-37e2-419d-b840-006e5c01e2ec]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AHKvJNMO {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AHKvJNMO" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[11390639-7e59-4641-be91-6fc0b8cb68b6]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AHKvJNMO'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG nova.network.neutron [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Port 4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8 binding to destination host user is already ACTIVE {{(pid=74743) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df8351c-37d0-4197-8579-0366747ceadc]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG nova.compute.manager [req-065ffef7-0bbf-44fd-b756-ac97b7dca937 req-9d9e087b-8dee-44c0-9738-edfe1f372225 service nova] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Received event network-vif-plugged-4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-065ffef7-0bbf-44fd-b756-ac97b7dca937 req-9d9e087b-8dee-44c0-9738-edfe1f372225 service nova] Acquiring lock "69d78ecf-740d-492a-be5b-ffd064e36f00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-065ffef7-0bbf-44fd-b756-ac97b7dca937 req-9d9e087b-8dee-44c0-9738-edfe1f372225 service nova] Lock "69d78ecf-740d-492a-be5b-ffd064e36f00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-065ffef7-0bbf-44fd-b756-ac97b7dca937 req-9d9e087b-8dee-44c0-9738-edfe1f372225 service nova] Lock "69d78ecf-740d-492a-be5b-ffd064e36f00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG nova.compute.manager [req-065ffef7-0bbf-44fd-b756-ac97b7dca937 req-9d9e087b-8dee-44c0-9738-edfe1f372225 service nova] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] No waiting events found dispatching network-vif-plugged-4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:16:57 user nova-compute[74743]: WARNING nova.compute.manager [req-065ffef7-0bbf-44fd-b756-ac97b7dca937 req-9d9e087b-8dee-44c0-9738-edfe1f372225 service nova] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Received unexpected event network-vif-plugged-4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8 for instance with vm_state active and task_state resize_migrating.
Nov 18 17:16:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e144afd-dd9d-4e2e-8aa9-7ecbb62146eb]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)
Nov 18 17:16:57 user nova-compute[74743]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:16:57 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)
Nov 18 17:16:57 user nova-compute[74743]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:16:57 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102 -p 172.16.0.220:3260 --login {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38b1c6e-11c8-46c4-b8e5-9f7bcc076d3d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102, portal: 172.16.0.220,3260]
Nov 18 17:16:57 user nova-compute[74743]: Login to [iface: default, target: iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102, portal: 172.16.0.220,3260] successful.
Nov 18 17:16:57 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b056199-2243-43c0-abf8-03690cc0d82a]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e5c18a-ccfa-462a-b07b-b6fb2accd1b3]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)
Nov 18 17:16:57 user nova-compute[74743]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:16:57 user nova-compute[74743]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102 (non-flash)
Nov 18 17:16:57 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)
Nov 18 17:16:57 user nova-compute[74743]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:16:57 user nova-compute[74743]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102 (non-flash)
Nov 18 17:16:57 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Connected to 172.16.0.220:3260 {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=74743) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74743) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2346a3-3fab-4dad-ab29-760f94d954f6]: (4, ('- - 0', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AHKvJNMO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquiring lock "69d78ecf-740d-492a-be5b-ffd064e36f00-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "69d78ecf-740d-492a-be5b-ffd064e36f00-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "69d78ecf-740d-492a-be5b-ffd064e36f00-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquiring lock "refresh_cache-69d78ecf-740d-492a-be5b-ffd064e36f00" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquired lock "refresh_cache-69d78ecf-740d-492a-be5b-ffd064e36f00" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:16:57 user nova-compute[74743]: DEBUG nova.network.neutron [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:16:58 user nova-compute[74743]: DEBUG nova.network.neutron [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Updating instance_info_cache with network_info: [{"id": "4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8", "address": "fa:16:3e:93:d9:fc", "network": {"id": "fd98f398-6576-449b-a737-887906eb6656", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668610993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb8f5850162c479b8d185e48c03be7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd5a403-19", "ovs_interfaceid": "4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:16:58 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Releasing lock "refresh_cache-69d78ecf-740d-492a-be5b-ffd064e36f00" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:16:58 user nova-compute[74743]: DEBUG os_brick.utils [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:16:58 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:58 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:58 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[742903c3-a662-489d-abd7-3217b6c70b8d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1116acd8874d\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:16:58 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:58 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:58 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ed8210-4ce6-4625-87df-d7e64a359dc9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:16:58 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:58 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:16:58 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab2525d-595b-46bb-be71-9fb93357d5d1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:16:58 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[06559b9e-a34c-4775-9ba3-efc12160b1b2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:16:58 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Running cmd (subprocess): nvme version {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:58 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] 'nvme version' failed. Not Retrying. {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:16:58 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.nvmeof [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] nvme not present on system {{(pid=74743) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 17:16:58 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:16:58 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:16:58 user nova-compute[74743]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 17:16:58 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5c8b10-b52f-4f14-a3d2-63dc73ef7ad8]: (4, '') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:16:58 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74743) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 17:16:58 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 17:16:58 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] LIGHTOS: no hostnqn found. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 17:16:58 user nova-compute[74743]: DEBUG os_brick.utils [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1116acd8874d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:16:58 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:16:58 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '23538353839346139', 'path': '/dev/sdb'} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:16:58 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538353839346139', 'path': '/dev/sdb'} {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 17:16:58 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-18T17:12:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1872287329',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1872287329',id=28,image_ref='6ae32e7e-3eda-4c8a-98d7-fea879469db4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-257871102',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:13:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0a17803c613c4ef299c797bba85c1a4b',ramdisk_id='',reservation_id='r-wl7d2o6y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-13499029',owner_user_name='tempest-AttachVolumeShelveTestJSON-13499029-project-member',shelved_at='2023-11-18T17:14:55.344413',shelved_host='user',shelved_image_id='6ae32e7e-3eda-4c8a-98d7-fea879469db4'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:16:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18483ad6106b4d95afbbed450d625b53',uuid=f41ad39c-15fd-42e2-9ad6-ed5cd25e25de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5", "address": "fa:16:3e:0e:63:d2", "network": {"id": "e1c28f74-c9c1-4eb3-931e-003332ff6243", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-453481916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a17803c613c4ef299c797bba85c1a4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d1781f8-f4", "ovs_interfaceid": "3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:16:58 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Converting VIF {"id": "3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5", "address": "fa:16:3e:0e:63:d2", "network": {"id": "e1c28f74-c9c1-4eb3-931e-003332ff6243", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-453481916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a17803c613c4ef299c797bba85c1a4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d1781f8-f4", "ovs_interfaceid": "3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:16:58 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:63:d2,bridge_name='br-int',has_traffic_filtering=True,id=3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5,network=Network(e1c28f74-c9c1-4eb3-931e-003332ff6243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d1781f8-f4') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:16:58 user nova-compute[74743]: DEBUG nova.objects.instance [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lazy-loading 'pci_devices' on Instance uuid f41ad39c-15fd-42e2-9ad6-ed5cd25e25de {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:16:58 user nova-compute[74743]: DEBUG nova.objects.base [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Object Instance<f41ad39c-15fd-42e2-9ad6-ed5cd25e25de> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:16:58 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:16:58 user nova-compute[74743]:   <uuid>f41ad39c-15fd-42e2-9ad6-ed5cd25e25de</uuid>
Nov 18 17:16:58 user nova-compute[74743]:   <name>instance-0000001c</name>
Nov 18 17:16:58 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:16:58 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:16:58 user nova-compute[74743]:   <metadata>
Nov 18 17:16:58 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:16:58 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:16:58 user nova-compute[74743]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1872287329</nova:name>
Nov 18 17:16:58 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:16:57</nova:creationTime>
Nov 18 17:16:58 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:16:58 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:16:58 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:16:58 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:16:58 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:16:58 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:16:58 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:16:58 user nova-compute[74743]:       <nova:owner>
Nov 18 17:16:58 user nova-compute[74743]:         <nova:user uuid="18483ad6106b4d95afbbed450d625b53">tempest-AttachVolumeShelveTestJSON-13499029-project-member</nova:user>
Nov 18 17:16:58 user nova-compute[74743]:         <nova:project uuid="0a17803c613c4ef299c797bba85c1a4b">tempest-AttachVolumeShelveTestJSON-13499029</nova:project>
Nov 18 17:16:58 user nova-compute[74743]:       </nova:owner>
Nov 18 17:16:58 user nova-compute[74743]:       <nova:root type="image" uuid="6ae32e7e-3eda-4c8a-98d7-fea879469db4"/>
Nov 18 17:16:58 user nova-compute[74743]:       <nova:ports>
Nov 18 17:16:58 user nova-compute[74743]:         <nova:port uuid="3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5">
Nov 18 17:16:58 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 18 17:16:58 user nova-compute[74743]:         </nova:port>
Nov 18 17:16:58 user nova-compute[74743]:       </nova:ports>
Nov 18 17:16:58 user nova-compute[74743]:     </nova:instance>
Nov 18 17:16:58 user nova-compute[74743]:   </metadata>
Nov 18 17:16:58 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:16:58 user nova-compute[74743]:     <system>
Nov 18 17:16:58 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:16:58 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:16:58 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:16:58 user nova-compute[74743]:       <entry name="serial">f41ad39c-15fd-42e2-9ad6-ed5cd25e25de</entry>
Nov 18 17:16:58 user nova-compute[74743]:       <entry name="uuid">f41ad39c-15fd-42e2-9ad6-ed5cd25e25de</entry>
Nov 18 17:16:58 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:16:58 user nova-compute[74743]:     </system>
Nov 18 17:16:58 user nova-compute[74743]:   </sysinfo>
Nov 18 17:16:58 user nova-compute[74743]:   <os>
Nov 18 17:16:58 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:16:58 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:16:58 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:16:58 user nova-compute[74743]:   </os>
Nov 18 17:16:58 user nova-compute[74743]:   <features>
Nov 18 17:16:58 user nova-compute[74743]:     <acpi/>
Nov 18 17:16:58 user nova-compute[74743]:     <apic/>
Nov 18 17:16:58 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:16:58 user nova-compute[74743]:   </features>
Nov 18 17:16:58 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:16:58 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:16:58 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:16:58 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:16:58 user nova-compute[74743]:   </clock>
Nov 18 17:16:58 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:16:58 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:16:58 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:16:58 user nova-compute[74743]:   </cpu>
Nov 18 17:16:58 user nova-compute[74743]:   <devices>
Nov 18 17:16:58 user nova-compute[74743]:     <disk type="file" device="disk">
Nov 18 17:16:58 user nova-compute[74743]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 17:16:58 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/f41ad39c-15fd-42e2-9ad6-ed5cd25e25de/disk"/>
Nov 18 17:16:58 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:16:58 user nova-compute[74743]:     </disk>
Nov 18 17:16:58 user nova-compute[74743]:     <disk type="block" device="disk">
Nov 18 17:16:58 user nova-compute[74743]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:16:58 user nova-compute[74743]:       <source dev="/dev/sdb"/>
Nov 18 17:16:58 user nova-compute[74743]:       <target dev="vdc" bus="virtio"/>
Nov 18 17:16:58 user nova-compute[74743]:       <serial>d3306e1e-9257-482e-88c8-0f98af92e102</serial>
Nov 18 17:16:58 user nova-compute[74743]:     </disk>
Nov 18 17:16:58 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:16:58 user nova-compute[74743]:       <mac address="fa:16:3e:0e:63:d2"/>
Nov 18 17:16:58 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:16:58 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:16:58 user nova-compute[74743]:       <target dev="tap3d1781f8-f4"/>
Nov 18 17:16:58 user nova-compute[74743]:     </interface>
Nov 18 17:16:58 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:16:58 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/f41ad39c-15fd-42e2-9ad6-ed5cd25e25de/console.log" append="off"/>
Nov 18 17:16:58 user nova-compute[74743]:     </serial>
Nov 18 17:16:58 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:16:58 user nova-compute[74743]:     <video>
Nov 18 17:16:58 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:16:58 user nova-compute[74743]:     </video>
Nov 18 17:16:58 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:16:58 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:16:58 user nova-compute[74743]:     </rng>
Nov 18 17:16:58 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:16:58 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:16:58 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:16:58 user nova-compute[74743]:     </memballoon>
Nov 18 17:16:58 user nova-compute[74743]:   </devices>
Nov 18 17:16:58 user nova-compute[74743]: </domain>
Nov 18 17:16:58 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:16:58 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-18T17:12:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1872287329',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1872287329',id=28,image_ref='6ae32e7e-3eda-4c8a-98d7-fea879469db4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-257871102',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:13:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0a17803c613c4ef299c797bba85c1a4b',ramdisk_id='',reservation_id='r-wl7d2o6y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-13499029',owner_user_name='tempest-AttachVolumeShelveTestJSON-13499029-project-member',shelved_at='2023-11-18T17:14:55.344413',shelved_host='user',shelved_image_id='6ae32e7e-3eda-4c8a-98d7-fea879469db4'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:16:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18483ad6106b4d95afbbed450d625b53',uuid=f41ad39c-15fd-42e2-9ad6-ed5cd25e25de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5", "address": "fa:16:3e:0e:63:d2", "network": {"id": "e1c28f74-c9c1-4eb3-931e-003332ff6243", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-453481916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a17803c613c4ef299c797bba85c1a4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d1781f8-f4", "ovs_interfaceid": "3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:16:58 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Converting VIF {"id": "3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5", "address": "fa:16:3e:0e:63:d2", "network": {"id": "e1c28f74-c9c1-4eb3-931e-003332ff6243", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-453481916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a17803c613c4ef299c797bba85c1a4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d1781f8-f4", "ovs_interfaceid": "3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:16:58 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:63:d2,bridge_name='br-int',has_traffic_filtering=True,id=3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5,network=Network(e1c28f74-c9c1-4eb3-931e-003332ff6243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d1781f8-f4') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:16:58 user nova-compute[74743]: DEBUG os_vif [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:63:d2,bridge_name='br-int',has_traffic_filtering=True,id=3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5,network=Network(e1c28f74-c9c1-4eb3-931e-003332ff6243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d1781f8-f4') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:16:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:16:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:16:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '686f8c75-c186-5bf3-8707-00febd53366b', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:16:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:16:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d1781f8-f4, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:16:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3d1781f8-f4, col_values=(('qos', UUID('10453c1d-83c7-46b7-b403-c9b8c793eb91')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:16:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3d1781f8-f4, col_values=(('external_ids', {'iface-id': '3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:63:d2', 'vm-uuid': 'f41ad39c-15fd-42e2-9ad6-ed5cd25e25de'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:16:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:16:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:16:58 user nova-compute[74743]: INFO os_vif [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:63:d2,bridge_name='br-int',has_traffic_filtering=True,id=3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5,network=Network(e1c28f74-c9c1-4eb3-931e-003332ff6243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d1781f8-f4')
Nov 18 17:16:58 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:16:58 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:16:58 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] No VIF found with MAC fa:16:3e:0e:63:d2, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:17:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:00 user nova-compute[74743]: DEBUG nova.compute.manager [req-8281f96b-005e-4215-bbff-dc0f061837f3 req-a4f456f7-dcab-4e8d-84dc-9f0ce2e1f12e service nova] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Received event network-vif-plugged-3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:17:00 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-8281f96b-005e-4215-bbff-dc0f061837f3 req-a4f456f7-dcab-4e8d-84dc-9f0ce2e1f12e service nova] Acquiring lock "f41ad39c-15fd-42e2-9ad6-ed5cd25e25de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:17:00 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-8281f96b-005e-4215-bbff-dc0f061837f3 req-a4f456f7-dcab-4e8d-84dc-9f0ce2e1f12e service nova] Lock "f41ad39c-15fd-42e2-9ad6-ed5cd25e25de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:17:00 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-8281f96b-005e-4215-bbff-dc0f061837f3 req-a4f456f7-dcab-4e8d-84dc-9f0ce2e1f12e service nova] Lock "f41ad39c-15fd-42e2-9ad6-ed5cd25e25de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:17:00 user nova-compute[74743]: DEBUG nova.compute.manager [req-8281f96b-005e-4215-bbff-dc0f061837f3 req-a4f456f7-dcab-4e8d-84dc-9f0ce2e1f12e service nova] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] No waiting events found dispatching network-vif-plugged-3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:17:00 user nova-compute[74743]: WARNING nova.compute.manager [req-8281f96b-005e-4215-bbff-dc0f061837f3 req-a4f456f7-dcab-4e8d-84dc-9f0ce2e1f12e service nova] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Received unexpected event network-vif-plugged-3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 18 17:17:01 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:01 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:02 user nova-compute[74743]: DEBUG nova.compute.manager [req-d8b3174f-3458-44fe-8a98-417529899bdf req-2247f85a-9b48-4a67-95d5-5024b9f24fd0 service nova] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Received event network-vif-plugged-3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:17:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d8b3174f-3458-44fe-8a98-417529899bdf req-2247f85a-9b48-4a67-95d5-5024b9f24fd0 service nova] Acquiring lock "f41ad39c-15fd-42e2-9ad6-ed5cd25e25de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:17:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d8b3174f-3458-44fe-8a98-417529899bdf req-2247f85a-9b48-4a67-95d5-5024b9f24fd0 service nova] Lock "f41ad39c-15fd-42e2-9ad6-ed5cd25e25de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:17:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d8b3174f-3458-44fe-8a98-417529899bdf req-2247f85a-9b48-4a67-95d5-5024b9f24fd0 service nova] Lock "f41ad39c-15fd-42e2-9ad6-ed5cd25e25de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:17:02 user nova-compute[74743]: DEBUG nova.compute.manager [req-d8b3174f-3458-44fe-8a98-417529899bdf req-2247f85a-9b48-4a67-95d5-5024b9f24fd0 service nova] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] No waiting events found dispatching network-vif-plugged-3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:17:02 user nova-compute[74743]: WARNING nova.compute.manager [req-d8b3174f-3458-44fe-8a98-417529899bdf req-2247f85a-9b48-4a67-95d5-5024b9f24fd0 service nova] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Received unexpected event network-vif-plugged-3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 18 17:17:02 user nova-compute[74743]: DEBUG nova.compute.manager [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:17:02 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Guest created on hypervisor {{(pid=74743) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 17:17:02 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Instance spawned successfully.
Nov 18 17:17:02 user nova-compute[74743]: DEBUG nova.compute.manager [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:17:03 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4db49b33-623f-418f-a4d8-5eab246b9179 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "f41ad39c-15fd-42e2-9ad6-ed5cd25e25de" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 19.196s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:17:03 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Starting finish_migration {{(pid=74743) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Instance directory exists: not creating {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 18 17:17:04 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Creating image(s)
Nov 18 17:17:04 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Did not create local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Ensure instance console log exists: /opt/stack/data/nova/instances/69d78ecf-740d-492a-be5b-ffd064e36f00/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Start _get_guest_xml network_info=[{"id": "4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8", "address": "fa:16:3e:93:d9:fc", "network": {"id": "fd98f398-6576-449b-a737-887906eb6656", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668610993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-668610993-network", "vif_mac": "fa:16:3e:93:d9:fc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb8f5850162c479b8d185e48c03be7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd5a403-19", "ovs_interfaceid": "4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '401b853f-07ba-4ca3-9fb2-3bd80301dae4', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xBLIUkZY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '69d78ecf-740d-492a-be5b-ffd064e36f00', 'attached_at': '2023-11-18T17:17:04.000000', 'detached_at': '', 'volume_id': 'c12dbe72-19df-4534-bbb2-53dbc61fd87f', 'serial': 'c12dbe72-19df-4534-bbb2-53dbc61fd87f'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:17:04 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:17:04 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:17:04 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Calling os-brick to attach iSCSI Volume {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xBLIUkZY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:17:04 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:17:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:17:04 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:17:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:17:04 user nova-compute[74743]: INFO os_brick.initiator.connectors.iscsi [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 17:17:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f -p 172.16.0.220:3260 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[427829b1-1df9-4793-9cae-578d2b1f3fff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 17:17:04 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f -p 172.16.0.220:3260 --interface default --op new {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9cd91dd-73ca-4e12-9c79-efa59c80e5ae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f] added\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f] added
Nov 18 17:17:04 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[651afe68-1819-43c6-a105-0def370c957f]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50350aa-a97a-41a7-b0db-40e77de20a51]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xBLIUkZY {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xBLIUkZY" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[672a5021-c7df-4aea-a020-f4c6149f2e46]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xBLIUkZY'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee766e30-d9f4-4a1e-be39-c84a994b89da]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ecf916-ad81-4308-863e-3606b011ffb7]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)
Nov 18 17:17:04 user nova-compute[74743]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:17:04 user nova-compute[74743]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102 (non-flash)
Nov 18 17:17:04 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)
Nov 18 17:17:04 user nova-compute[74743]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:17:04 user nova-compute[74743]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102 (non-flash)
Nov 18 17:17:04 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f -p 172.16.0.220:3260 --login {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc6ddfd-48c1-4d45-826a-f89156e02492]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f, portal: 172.16.0.220,3260]
Nov 18 17:17:04 user nova-compute[74743]: Login to [iface: default, target: iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f, portal: 172.16.0.220,3260] successful.
Nov 18 17:17:04 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c19f3f-a44f-4dec-984c-7f760546bec2]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[496fd669-4733-4a31-ad91-2f4f09e4af48]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)
Nov 18 17:17:04 user nova-compute[74743]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:17:04 user nova-compute[74743]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102 (non-flash)
Nov 18 17:17:04 user nova-compute[74743]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)
Nov 18 17:17:04 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)
Nov 18 17:17:04 user nova-compute[74743]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:17:04 user nova-compute[74743]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102 (non-flash)
Nov 18 17:17:04 user nova-compute[74743]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)
Nov 18 17:17:04 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Connected to 172.16.0.220:3260 {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] HCTL ('34', '-', '-', 0) found on session 40 with lun 0 {{(pid=74743) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74743) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb0e25b-d182-40f5-99be-cf5aac6600b4]: (4, ('- - 0', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:17:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xBLIUkZY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 17:17:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:05 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:17:05 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23939376165633061', 'path': '/dev/sdc'} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:17:05 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939376165633061', 'path': '/dev/sdc'} {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 17:17:05 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:14:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-403226732',display_name='tempest-ServerActionsTestOtherA-server-403226732',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-403226732',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEVphqV0ovLOhWV5c4OtZaZAghiX4KqdCUzcXRNxI8zWTbqX3YOGnG7iLQKSTFxu3amDks//fytVOc70uGuSKqNKUeaE/kY0CmyGU71j0ZYQPWjJeA0I0UUP+FZUS4MWQ==',key_name='tempest-keypair-1212996543',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:15:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fb8f5850162c479b8d185e48c03be7d3',ramdisk_id='',reservation_id='r-elyg0ort',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-128885625',owner_user_name='tempest-ServerActionsTestOtherA-128885625-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:16:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce3e4cef47114a7c9327db639460d923',uuid=69d78ecf-740d-492a-be5b-ffd064e36f00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8", "address": "fa:16:3e:93:d9:fc", "network": {"id": "fd98f398-6576-449b-a737-887906eb6656", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668610993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-668610993-network", "vif_mac": "fa:16:3e:93:d9:fc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb8f5850162c479b8d185e48c03be7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd5a403-19", "ovs_interfaceid": "4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:17:05 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Converting VIF {"id": "4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8", "address": "fa:16:3e:93:d9:fc", "network": {"id": "fd98f398-6576-449b-a737-887906eb6656", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668610993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-668610993-network", "vif_mac": "fa:16:3e:93:d9:fc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb8f5850162c479b8d185e48c03be7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd5a403-19", "ovs_interfaceid": "4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:17:05 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:d9:fc,bridge_name='br-int',has_traffic_filtering=True,id=4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8,network=Network(fd98f398-6576-449b-a737-887906eb6656),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cd5a403-19') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:17:05 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:17:05 user nova-compute[74743]:   <uuid>69d78ecf-740d-492a-be5b-ffd064e36f00</uuid>
Nov 18 17:17:05 user nova-compute[74743]:   <name>instance-0000001f</name>
Nov 18 17:17:05 user nova-compute[74743]:   <memory>2097152</memory>
Nov 18 17:17:05 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:17:05 user nova-compute[74743]:   <metadata>
Nov 18 17:17:05 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:17:05 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:17:05 user nova-compute[74743]:       <nova:name>tempest-ServerActionsTestOtherA-server-403226732</nova:name>
Nov 18 17:17:05 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:17:04</nova:creationTime>
Nov 18 17:17:05 user nova-compute[74743]:       <nova:flavor name="m1.small">
Nov 18 17:17:05 user nova-compute[74743]:         <nova:memory>2048</nova:memory>
Nov 18 17:17:05 user nova-compute[74743]:         <nova:disk>20</nova:disk>
Nov 18 17:17:05 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:17:05 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:17:05 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:17:05 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:17:05 user nova-compute[74743]:       <nova:owner>
Nov 18 17:17:05 user nova-compute[74743]:         <nova:user uuid="ce3e4cef47114a7c9327db639460d923">tempest-ServerActionsTestOtherA-128885625-project-member</nova:user>
Nov 18 17:17:05 user nova-compute[74743]:         <nova:project uuid="fb8f5850162c479b8d185e48c03be7d3">tempest-ServerActionsTestOtherA-128885625</nova:project>
Nov 18 17:17:05 user nova-compute[74743]:       </nova:owner>
Nov 18 17:17:05 user nova-compute[74743]:       <nova:ports>
Nov 18 17:17:05 user nova-compute[74743]:         <nova:port uuid="4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8">
Nov 18 17:17:05 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 18 17:17:05 user nova-compute[74743]:         </nova:port>
Nov 18 17:17:05 user nova-compute[74743]:       </nova:ports>
Nov 18 17:17:05 user nova-compute[74743]:     </nova:instance>
Nov 18 17:17:05 user nova-compute[74743]:   </metadata>
Nov 18 17:17:05 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:17:05 user nova-compute[74743]:     <system>
Nov 18 17:17:05 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:17:05 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:17:05 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:17:05 user nova-compute[74743]:       <entry name="serial">69d78ecf-740d-492a-be5b-ffd064e36f00</entry>
Nov 18 17:17:05 user nova-compute[74743]:       <entry name="uuid">69d78ecf-740d-492a-be5b-ffd064e36f00</entry>
Nov 18 17:17:05 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:17:05 user nova-compute[74743]:     </system>
Nov 18 17:17:05 user nova-compute[74743]:   </sysinfo>
Nov 18 17:17:05 user nova-compute[74743]:   <os>
Nov 18 17:17:05 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:17:05 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:17:05 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:17:05 user nova-compute[74743]:   </os>
Nov 18 17:17:05 user nova-compute[74743]:   <features>
Nov 18 17:17:05 user nova-compute[74743]:     <acpi/>
Nov 18 17:17:05 user nova-compute[74743]:     <apic/>
Nov 18 17:17:05 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:17:05 user nova-compute[74743]:   </features>
Nov 18 17:17:05 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:17:05 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:17:05 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:17:05 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:17:05 user nova-compute[74743]:   </clock>
Nov 18 17:17:05 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:17:05 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:17:05 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:17:05 user nova-compute[74743]:   </cpu>
Nov 18 17:17:05 user nova-compute[74743]:   <devices>
Nov 18 17:17:05 user nova-compute[74743]:     <disk type="block" device="disk">
Nov 18 17:17:05 user nova-compute[74743]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:17:05 user nova-compute[74743]:       <source dev="/dev/sdc"/>
Nov 18 17:17:05 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:17:05 user nova-compute[74743]:       <serial>c12dbe72-19df-4534-bbb2-53dbc61fd87f</serial>
Nov 18 17:17:05 user nova-compute[74743]:     </disk>
Nov 18 17:17:05 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:17:05 user nova-compute[74743]:       <mac address="fa:16:3e:93:d9:fc"/>
Nov 18 17:17:05 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:17:05 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:17:05 user nova-compute[74743]:       <target dev="tap4cd5a403-19"/>
Nov 18 17:17:05 user nova-compute[74743]:     </interface>
Nov 18 17:17:05 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:17:05 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/69d78ecf-740d-492a-be5b-ffd064e36f00/console.log" append="off"/>
Nov 18 17:17:05 user nova-compute[74743]:     </serial>
Nov 18 17:17:05 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:17:05 user nova-compute[74743]:     <video>
Nov 18 17:17:05 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:17:05 user nova-compute[74743]:     </video>
Nov 18 17:17:05 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:17:05 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:17:05 user nova-compute[74743]:     </rng>
Nov 18 17:17:05 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:17:05 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:17:05 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:17:05 user nova-compute[74743]:     </memballoon>
Nov 18 17:17:05 user nova-compute[74743]:   </devices>
Nov 18 17:17:05 user nova-compute[74743]: </domain>
Nov 18 17:17:05 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:17:05 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:14:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-403226732',display_name='tempest-ServerActionsTestOtherA-server-403226732',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-403226732',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEVphqV0ovLOhWV5c4OtZaZAghiX4KqdCUzcXRNxI8zWTbqX3YOGnG7iLQKSTFxu3amDks//fytVOc70uGuSKqNKUeaE/kY0CmyGU71j0ZYQPWjJeA0I0UUP+FZUS4MWQ==',key_name='tempest-keypair-1212996543',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:15:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fb8f5850162c479b8d185e48c03be7d3',ramdisk_id='',reservation_id='r-elyg0ort',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-128885625',owner_user_name='tempest-ServerActionsTestOtherA-128885625-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:16:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce3e4cef47114a7c9327db639460d923',uuid=69d78ecf-740d-492a-be5b-ffd064e36f00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8", "address": "fa:16:3e:93:d9:fc", "network": {"id": "fd98f398-6576-449b-a737-887906eb6656", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668610993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-668610993-network", "vif_mac": "fa:16:3e:93:d9:fc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb8f5850162c479b8d185e48c03be7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd5a403-19", "ovs_interfaceid": "4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:17:05 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Converting VIF {"id": "4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8", "address": "fa:16:3e:93:d9:fc", "network": {"id": "fd98f398-6576-449b-a737-887906eb6656", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668610993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-668610993-network", "vif_mac": "fa:16:3e:93:d9:fc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb8f5850162c479b8d185e48c03be7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd5a403-19", "ovs_interfaceid": "4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:17:05 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:d9:fc,bridge_name='br-int',has_traffic_filtering=True,id=4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8,network=Network(fd98f398-6576-449b-a737-887906eb6656),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cd5a403-19') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:17:05 user nova-compute[74743]: DEBUG os_vif [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:d9:fc,bridge_name='br-int',has_traffic_filtering=True,id=4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8,network=Network(fd98f398-6576-449b-a737-887906eb6656),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cd5a403-19') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:17:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:17:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:17:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3395deaa-b35f-515b-a29a-e0edb16fc50f', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:17:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4cd5a403-19, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:17:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4cd5a403-19, col_values=(('qos', UUID('19eff6e8-8d07-429c-943b-942498607a68')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:17:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4cd5a403-19, col_values=(('external_ids', {'iface-id': '4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:d9:fc', 'vm-uuid': '69d78ecf-740d-492a-be5b-ffd064e36f00'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:17:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:17:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:05 user nova-compute[74743]: INFO os_vif [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:d9:fc,bridge_name='br-int',has_traffic_filtering=True,id=4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8,network=Network(fd98f398-6576-449b-a737-887906eb6656),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cd5a403-19')
Nov 18 17:17:05 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:17:05 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] No VIF found with MAC fa:16:3e:93:d9:fc, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:17:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:07 user nova-compute[74743]: DEBUG nova.compute.manager [req-ca7924bf-ad16-4d13-87ac-08ef28d71ed2 req-ad20115a-24fa-4d30-9fd8-0c0378772532 service nova] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Received event network-vif-plugged-4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:17:07 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ca7924bf-ad16-4d13-87ac-08ef28d71ed2 req-ad20115a-24fa-4d30-9fd8-0c0378772532 service nova] Acquiring lock "69d78ecf-740d-492a-be5b-ffd064e36f00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:17:07 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ca7924bf-ad16-4d13-87ac-08ef28d71ed2 req-ad20115a-24fa-4d30-9fd8-0c0378772532 service nova] Lock "69d78ecf-740d-492a-be5b-ffd064e36f00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:17:07 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ca7924bf-ad16-4d13-87ac-08ef28d71ed2 req-ad20115a-24fa-4d30-9fd8-0c0378772532 service nova] Lock "69d78ecf-740d-492a-be5b-ffd064e36f00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:17:07 user nova-compute[74743]: DEBUG nova.compute.manager [req-ca7924bf-ad16-4d13-87ac-08ef28d71ed2 req-ad20115a-24fa-4d30-9fd8-0c0378772532 service nova] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] No waiting events found dispatching network-vif-plugged-4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:17:07 user nova-compute[74743]: WARNING nova.compute.manager [req-ca7924bf-ad16-4d13-87ac-08ef28d71ed2 req-ad20115a-24fa-4d30-9fd8-0c0378772532 service nova] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Received unexpected event network-vif-plugged-4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8 for instance with vm_state active and task_state resize_finish.
Nov 18 17:17:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:09 user nova-compute[74743]: DEBUG nova.compute.manager [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:17:09 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Instance running successfully.
Nov 18 17:17:09 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Failed to set time: agent not configured {{(pid=74743) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 18 17:17:09 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-54e0e176-a968-41b3-ba20-16139843d66b tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] finish_migration finished successfully. {{(pid=74743) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 18 17:17:09 user nova-compute[74743]: DEBUG nova.compute.manager [req-53f97bb9-5414-49b3-b0ae-384cd878e6b0 req-94f559cf-6329-428d-851c-080acff28b9e service nova] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Received event network-vif-plugged-4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:17:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-53f97bb9-5414-49b3-b0ae-384cd878e6b0 req-94f559cf-6329-428d-851c-080acff28b9e service nova] Acquiring lock "69d78ecf-740d-492a-be5b-ffd064e36f00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:17:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-53f97bb9-5414-49b3-b0ae-384cd878e6b0 req-94f559cf-6329-428d-851c-080acff28b9e service nova] Lock "69d78ecf-740d-492a-be5b-ffd064e36f00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:17:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-53f97bb9-5414-49b3-b0ae-384cd878e6b0 req-94f559cf-6329-428d-851c-080acff28b9e service nova] Lock "69d78ecf-740d-492a-be5b-ffd064e36f00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:17:09 user nova-compute[74743]: DEBUG nova.compute.manager [req-53f97bb9-5414-49b3-b0ae-384cd878e6b0 req-94f559cf-6329-428d-851c-080acff28b9e service nova] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] No waiting events found dispatching network-vif-plugged-4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:17:09 user nova-compute[74743]: WARNING nova.compute.manager [req-53f97bb9-5414-49b3-b0ae-384cd878e6b0 req-94f559cf-6329-428d-851c-080acff28b9e service nova] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Received unexpected event network-vif-plugged-4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8 for instance with vm_state active and task_state resize_finish.
Nov 18 17:17:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:13 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:13 user nova-compute[74743]: INFO nova.compute.manager [None req-2aadca5f-63a3-467d-9bd0-ad2b43245729 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Unrescuing
Nov 18 17:17:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-2aadca5f-63a3-467d-9bd0-ad2b43245729 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquiring lock "refresh_cache-f649143e-f7db-475a-bbe5-d5e7316caac3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:17:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-2aadca5f-63a3-467d-9bd0-ad2b43245729 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquired lock "refresh_cache-f649143e-f7db-475a-bbe5-d5e7316caac3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:17:13 user nova-compute[74743]: DEBUG nova.network.neutron [None req-2aadca5f-63a3-467d-9bd0-ad2b43245729 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:17:14 user nova-compute[74743]: DEBUG nova.network.neutron [None req-2aadca5f-63a3-467d-9bd0-ad2b43245729 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Updating instance_info_cache with network_info: [{"id": "494b363a-ab2e-4efc-9331-d2b303860a08", "address": "fa:16:3e:e7:77:41", "network": {"id": "1bbf6aff-4048-4212-a716-d0628575bfd0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc0fda74575d488a94e2dcfdc016598c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494b363a-ab", "ovs_interfaceid": "494b363a-ab2e-4efc-9331-d2b303860a08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:17:14 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-2aadca5f-63a3-467d-9bd0-ad2b43245729 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Releasing lock "refresh_cache-f649143e-f7db-475a-bbe5-d5e7316caac3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:17:14 user nova-compute[74743]: DEBUG nova.objects.instance [None req-2aadca5f-63a3-467d-9bd0-ad2b43245729 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lazy-loading 'flavor' on Instance uuid f649143e-f7db-475a-bbe5-d5e7316caac3 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:17:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:15 user nova-compute[74743]: DEBUG nova.compute.manager [req-96132ec6-df25-478b-9699-14e088356c5d req-c541d8fa-1005-4a59-ba0f-279d01ec613e service nova] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Received event network-vif-unplugged-494b363a-ab2e-4efc-9331-d2b303860a08 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:17:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-96132ec6-df25-478b-9699-14e088356c5d req-c541d8fa-1005-4a59-ba0f-279d01ec613e service nova] Acquiring lock "f649143e-f7db-475a-bbe5-d5e7316caac3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:17:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-96132ec6-df25-478b-9699-14e088356c5d req-c541d8fa-1005-4a59-ba0f-279d01ec613e service nova] Lock "f649143e-f7db-475a-bbe5-d5e7316caac3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:17:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-96132ec6-df25-478b-9699-14e088356c5d req-c541d8fa-1005-4a59-ba0f-279d01ec613e service nova] Lock "f649143e-f7db-475a-bbe5-d5e7316caac3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:17:15 user nova-compute[74743]: DEBUG nova.compute.manager [req-96132ec6-df25-478b-9699-14e088356c5d req-c541d8fa-1005-4a59-ba0f-279d01ec613e service nova] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] No waiting events found dispatching network-vif-unplugged-494b363a-ab2e-4efc-9331-d2b303860a08 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:17:15 user nova-compute[74743]: WARNING nova.compute.manager [req-96132ec6-df25-478b-9699-14e088356c5d req-c541d8fa-1005-4a59-ba0f-279d01ec613e service nova] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Received unexpected event network-vif-unplugged-494b363a-ab2e-4efc-9331-d2b303860a08 for instance with vm_state rescued and task_state unrescuing.
Nov 18 17:17:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:15 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Instance destroyed successfully.
Nov 18 17:17:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:17 user nova-compute[74743]: DEBUG nova.compute.manager [req-a7e687e4-31d4-4ebd-93a3-eb1ec3626332 req-d3f8c070-4509-4f35-aad3-408b6f1423a1 service nova] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Received event network-vif-plugged-494b363a-ab2e-4efc-9331-d2b303860a08 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:17:17 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a7e687e4-31d4-4ebd-93a3-eb1ec3626332 req-d3f8c070-4509-4f35-aad3-408b6f1423a1 service nova] Acquiring lock "f649143e-f7db-475a-bbe5-d5e7316caac3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:17:17 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a7e687e4-31d4-4ebd-93a3-eb1ec3626332 req-d3f8c070-4509-4f35-aad3-408b6f1423a1 service nova] Lock "f649143e-f7db-475a-bbe5-d5e7316caac3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:17:17 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a7e687e4-31d4-4ebd-93a3-eb1ec3626332 req-d3f8c070-4509-4f35-aad3-408b6f1423a1 service nova] Lock "f649143e-f7db-475a-bbe5-d5e7316caac3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:17:17 user nova-compute[74743]: DEBUG nova.compute.manager [req-a7e687e4-31d4-4ebd-93a3-eb1ec3626332 req-d3f8c070-4509-4f35-aad3-408b6f1423a1 service nova] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] No waiting events found dispatching network-vif-plugged-494b363a-ab2e-4efc-9331-d2b303860a08 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:17:17 user nova-compute[74743]: WARNING nova.compute.manager [req-a7e687e4-31d4-4ebd-93a3-eb1ec3626332 req-d3f8c070-4509-4f35-aad3-408b6f1423a1 service nova] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Received unexpected event network-vif-plugged-494b363a-ab2e-4efc-9331-d2b303860a08 for instance with vm_state rescued and task_state unrescuing.
Nov 18 17:17:17 user nova-compute[74743]: DEBUG nova.compute.manager [req-a7e687e4-31d4-4ebd-93a3-eb1ec3626332 req-d3f8c070-4509-4f35-aad3-408b6f1423a1 service nova] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Received event network-vif-plugged-494b363a-ab2e-4efc-9331-d2b303860a08 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:17:17 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a7e687e4-31d4-4ebd-93a3-eb1ec3626332 req-d3f8c070-4509-4f35-aad3-408b6f1423a1 service nova] Acquiring lock "f649143e-f7db-475a-bbe5-d5e7316caac3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:17:17 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a7e687e4-31d4-4ebd-93a3-eb1ec3626332 req-d3f8c070-4509-4f35-aad3-408b6f1423a1 service nova] Lock "f649143e-f7db-475a-bbe5-d5e7316caac3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:17:17 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a7e687e4-31d4-4ebd-93a3-eb1ec3626332 req-d3f8c070-4509-4f35-aad3-408b6f1423a1 service nova] Lock "f649143e-f7db-475a-bbe5-d5e7316caac3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:17:17 user nova-compute[74743]: DEBUG nova.compute.manager [req-a7e687e4-31d4-4ebd-93a3-eb1ec3626332 req-d3f8c070-4509-4f35-aad3-408b6f1423a1 service nova] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] No waiting events found dispatching network-vif-plugged-494b363a-ab2e-4efc-9331-d2b303860a08 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:17:17 user nova-compute[74743]: WARNING nova.compute.manager [req-a7e687e4-31d4-4ebd-93a3-eb1ec3626332 req-d3f8c070-4509-4f35-aad3-408b6f1423a1 service nova] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Received unexpected event network-vif-plugged-494b363a-ab2e-4efc-9331-d2b303860a08 for instance with vm_state rescued and task_state unrescuing.
Nov 18 17:17:19 user nova-compute[74743]: DEBUG nova.compute.manager [None req-2aadca5f-63a3-467d-9bd0-ad2b43245729 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:17:19 user nova-compute[74743]: DEBUG nova.compute.manager [req-23058470-bdd8-48f1-a418-dded4e9eb7fb req-f91d123c-4daa-4fbe-87b0-f12b051214df service nova] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Received event network-vif-plugged-494b363a-ab2e-4efc-9331-d2b303860a08 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:17:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-23058470-bdd8-48f1-a418-dded4e9eb7fb req-f91d123c-4daa-4fbe-87b0-f12b051214df service nova] Acquiring lock "f649143e-f7db-475a-bbe5-d5e7316caac3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:17:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-23058470-bdd8-48f1-a418-dded4e9eb7fb req-f91d123c-4daa-4fbe-87b0-f12b051214df service nova] Lock "f649143e-f7db-475a-bbe5-d5e7316caac3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:17:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-23058470-bdd8-48f1-a418-dded4e9eb7fb req-f91d123c-4daa-4fbe-87b0-f12b051214df service nova] Lock "f649143e-f7db-475a-bbe5-d5e7316caac3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:17:19 user nova-compute[74743]: DEBUG nova.compute.manager [req-23058470-bdd8-48f1-a418-dded4e9eb7fb req-f91d123c-4daa-4fbe-87b0-f12b051214df service nova] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] No waiting events found dispatching network-vif-plugged-494b363a-ab2e-4efc-9331-d2b303860a08 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:17:19 user nova-compute[74743]: WARNING nova.compute.manager [req-23058470-bdd8-48f1-a418-dded4e9eb7fb req-f91d123c-4daa-4fbe-87b0-f12b051214df service nova] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Received unexpected event network-vif-plugged-494b363a-ab2e-4efc-9331-d2b303860a08 for instance with vm_state active and task_state None.
Nov 18 17:17:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-964c178c-e412-4402-8e2b-d8a3ba5658f3 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Acquiring lock "0ad8aa2d-663c-4829-87f9-07959105ca68" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:17:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-964c178c-e412-4402-8e2b-d8a3ba5658f3 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Lock "0ad8aa2d-663c-4829-87f9-07959105ca68" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:17:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-964c178c-e412-4402-8e2b-d8a3ba5658f3 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Acquiring lock "0ad8aa2d-663c-4829-87f9-07959105ca68-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:17:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-964c178c-e412-4402-8e2b-d8a3ba5658f3 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Lock "0ad8aa2d-663c-4829-87f9-07959105ca68-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:17:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-964c178c-e412-4402-8e2b-d8a3ba5658f3 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Lock "0ad8aa2d-663c-4829-87f9-07959105ca68-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:17:25 user nova-compute[74743]: INFO nova.compute.manager [None req-964c178c-e412-4402-8e2b-d8a3ba5658f3 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] Terminating instance
Nov 18 17:17:25 user nova-compute[74743]: DEBUG nova.compute.manager [None req-964c178c-e412-4402-8e2b-d8a3ba5658f3 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] Start destroying the instance on the hypervisor. {{(pid=74743) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 17:17:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:25 user nova-compute[74743]: DEBUG nova.compute.manager [req-73101f05-3a79-4f28-9e16-d1dc28945305 req-9bdcdc05-5298-4605-9957-0921641e4e3a service nova] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] Received event network-vif-unplugged-f8b70f64-c72b-4d3b-be6a-6e401ce15011 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:17:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-73101f05-3a79-4f28-9e16-d1dc28945305 req-9bdcdc05-5298-4605-9957-0921641e4e3a service nova] Acquiring lock "0ad8aa2d-663c-4829-87f9-07959105ca68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:17:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-73101f05-3a79-4f28-9e16-d1dc28945305 req-9bdcdc05-5298-4605-9957-0921641e4e3a service nova] Lock "0ad8aa2d-663c-4829-87f9-07959105ca68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:17:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-73101f05-3a79-4f28-9e16-d1dc28945305 req-9bdcdc05-5298-4605-9957-0921641e4e3a service nova] Lock "0ad8aa2d-663c-4829-87f9-07959105ca68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:17:25 user nova-compute[74743]: DEBUG nova.compute.manager [req-73101f05-3a79-4f28-9e16-d1dc28945305 req-9bdcdc05-5298-4605-9957-0921641e4e3a service nova] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] No waiting events found dispatching network-vif-unplugged-f8b70f64-c72b-4d3b-be6a-6e401ce15011 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:17:25 user nova-compute[74743]: DEBUG nova.compute.manager [req-73101f05-3a79-4f28-9e16-d1dc28945305 req-9bdcdc05-5298-4605-9957-0921641e4e3a service nova] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] Received event network-vif-unplugged-f8b70f64-c72b-4d3b-be6a-6e401ce15011 for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:17:26 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] Instance destroyed successfully.
Nov 18 17:17:26 user nova-compute[74743]: DEBUG nova.objects.instance [None req-964c178c-e412-4402-8e2b-d8a3ba5658f3 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Lazy-loading 'resources' on Instance uuid 0ad8aa2d-663c-4829-87f9-07959105ca68 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:17:26 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-964c178c-e412-4402-8e2b-d8a3ba5658f3 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:08:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1150764694',display_name='tempest-ServersNegativeTestJSON-server-1150764694',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1150764694',id=20,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:08:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b57ac6e8f2384c6fb2bb4cbdeee429c0',ramdisk_id='',reservation_id='r-9epp743l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-840944804',owner_user_name='tempest-ServersNegativeTestJSON-840944804-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:08:48Z,user_data=None,user_id='357f81ed0cae4dda9721d5ce81d23be5',uuid=0ad8aa2d-663c-4829-87f9-07959105ca68,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f8b70f64-c72b-4d3b-be6a-6e401ce15011", "address": "fa:16:3e:30:37:84", "network": {"id": "13e0d3be-e4a3-4f20-8aac-1cf64be1e1b2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-853497736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b57ac6e8f2384c6fb2bb4cbdeee429c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8b70f64-c7", "ovs_interfaceid": "f8b70f64-c72b-4d3b-be6a-6e401ce15011", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:17:26 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-964c178c-e412-4402-8e2b-d8a3ba5658f3 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Converting VIF {"id": "f8b70f64-c72b-4d3b-be6a-6e401ce15011", "address": "fa:16:3e:30:37:84", "network": {"id": "13e0d3be-e4a3-4f20-8aac-1cf64be1e1b2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-853497736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b57ac6e8f2384c6fb2bb4cbdeee429c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8b70f64-c7", "ovs_interfaceid": "f8b70f64-c72b-4d3b-be6a-6e401ce15011", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:17:26 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-964c178c-e412-4402-8e2b-d8a3ba5658f3 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:37:84,bridge_name='br-int',has_traffic_filtering=True,id=f8b70f64-c72b-4d3b-be6a-6e401ce15011,network=Network(13e0d3be-e4a3-4f20-8aac-1cf64be1e1b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8b70f64-c7') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:17:26 user nova-compute[74743]: DEBUG os_vif [None req-964c178c-e412-4402-8e2b-d8a3ba5658f3 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:37:84,bridge_name='br-int',has_traffic_filtering=True,id=f8b70f64-c72b-4d3b-be6a-6e401ce15011,network=Network(13e0d3be-e4a3-4f20-8aac-1cf64be1e1b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8b70f64-c7') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:17:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf8b70f64-c7, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:17:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:17:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=42d81abe-2bec-4350-968d-edd88048cef7) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:17:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:26 user nova-compute[74743]: INFO os_vif [None req-964c178c-e412-4402-8e2b-d8a3ba5658f3 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:37:84,bridge_name='br-int',has_traffic_filtering=True,id=f8b70f64-c72b-4d3b-be6a-6e401ce15011,network=Network(13e0d3be-e4a3-4f20-8aac-1cf64be1e1b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8b70f64-c7')
Nov 18 17:17:26 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-964c178c-e412-4402-8e2b-d8a3ba5658f3 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] Deleting instance files /opt/stack/data/nova/instances/0ad8aa2d-663c-4829-87f9-07959105ca68_del
Nov 18 17:17:26 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-964c178c-e412-4402-8e2b-d8a3ba5658f3 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] Deletion of /opt/stack/data/nova/instances/0ad8aa2d-663c-4829-87f9-07959105ca68_del complete
Nov 18 17:17:26 user nova-compute[74743]: INFO nova.compute.manager [None req-964c178c-e412-4402-8e2b-d8a3ba5658f3 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 18 17:17:26 user nova-compute[74743]: DEBUG oslo.service.loopingcall [None req-964c178c-e412-4402-8e2b-d8a3ba5658f3 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74743) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 17:17:26 user nova-compute[74743]: DEBUG nova.compute.manager [-] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] Deallocating network for instance {{(pid=74743) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 17:17:26 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] deallocate_for_instance() {{(pid=74743) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 17:17:26 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:17:26 user nova-compute[74743]: INFO nova.compute.manager [-] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] Took 0.53 seconds to deallocate network for instance.
Nov 18 17:17:26 user nova-compute[74743]: DEBUG nova.compute.manager [req-b2f48666-5682-4b8e-909d-8207bd1756a7 req-b2109bb5-f9d3-4de6-829e-6ef7c5ff7b64 service nova] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] Received event network-vif-deleted-f8b70f64-c72b-4d3b-be6a-6e401ce15011 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:17:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-964c178c-e412-4402-8e2b-d8a3ba5658f3 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:17:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-964c178c-e412-4402-8e2b-d8a3ba5658f3 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:17:26 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:17:26 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:17:26 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:17:26 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74743) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 17:17:26 user nova-compute[74743]: DEBUG nova.compute.manager [req-ec790ea4-1895-43bf-a9e1-47c9d07f8279 req-b8284d3a-00d3-40f0-aec0-f6910772b814 service nova] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Received event network-changed-106be5e5-0143-4ab2-8e1f-30b2e46c5753 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:17:26 user nova-compute[74743]: DEBUG nova.compute.manager [req-ec790ea4-1895-43bf-a9e1-47c9d07f8279 req-b8284d3a-00d3-40f0-aec0-f6910772b814 service nova] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Refreshing instance network info cache due to event network-changed-106be5e5-0143-4ab2-8e1f-30b2e46c5753. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:17:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ec790ea4-1895-43bf-a9e1-47c9d07f8279 req-b8284d3a-00d3-40f0-aec0-f6910772b814 service nova] Acquiring lock "refresh_cache-cd467693-8b2d-4e3d-9b1a-7581c6ae6153" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:17:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ec790ea4-1895-43bf-a9e1-47c9d07f8279 req-b8284d3a-00d3-40f0-aec0-f6910772b814 service nova] Acquired lock "refresh_cache-cd467693-8b2d-4e3d-9b1a-7581c6ae6153" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:17:26 user nova-compute[74743]: DEBUG nova.network.neutron [req-ec790ea4-1895-43bf-a9e1-47c9d07f8279 req-b8284d3a-00d3-40f0-aec0-f6910772b814 service nova] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Refreshing network info cache for port 106be5e5-0143-4ab2-8e1f-30b2e46c5753 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:17:27 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-964c178c-e412-4402-8e2b-d8a3ba5658f3 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:17:27 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-964c178c-e412-4402-8e2b-d8a3ba5658f3 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:17:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-964c178c-e412-4402-8e2b-d8a3ba5658f3 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.352s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:17:27 user nova-compute[74743]: INFO nova.scheduler.client.report [None req-964c178c-e412-4402-8e2b-d8a3ba5658f3 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Deleted allocations for instance 0ad8aa2d-663c-4829-87f9-07959105ca68
Nov 18 17:17:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-964c178c-e412-4402-8e2b-d8a3ba5658f3 tempest-ServersNegativeTestJSON-840944804 tempest-ServersNegativeTestJSON-840944804-project-member] Lock "0ad8aa2d-663c-4829-87f9-07959105ca68" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.936s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:17:27 user nova-compute[74743]: DEBUG nova.network.neutron [req-ec790ea4-1895-43bf-a9e1-47c9d07f8279 req-b8284d3a-00d3-40f0-aec0-f6910772b814 service nova] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Updated VIF entry in instance network info cache for port 106be5e5-0143-4ab2-8e1f-30b2e46c5753. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:17:27 user nova-compute[74743]: DEBUG nova.network.neutron [req-ec790ea4-1895-43bf-a9e1-47c9d07f8279 req-b8284d3a-00d3-40f0-aec0-f6910772b814 service nova] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Updating instance_info_cache with network_info: [{"id": "106be5e5-0143-4ab2-8e1f-30b2e46c5753", "address": "fa:16:3e:35:df:4c", "network": {"id": "252343cc-f379-471d-a2c9-99b9a60ebcb4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25c06dc8e7be46229750b8e283622c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106be5e5-01", "ovs_interfaceid": "106be5e5-0143-4ab2-8e1f-30b2e46c5753", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:17:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4b6035b7-d8ae-47f0-a058-46f3cd57559f tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Acquiring lock "cd467693-8b2d-4e3d-9b1a-7581c6ae6153" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:17:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4b6035b7-d8ae-47f0-a058-46f3cd57559f tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "cd467693-8b2d-4e3d-9b1a-7581c6ae6153" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:17:27 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:17:27 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Starting heal instance info cache {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 17:17:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ec790ea4-1895-43bf-a9e1-47c9d07f8279 req-b8284d3a-00d3-40f0-aec0-f6910772b814 service nova] Releasing lock "refresh_cache-cd467693-8b2d-4e3d-9b1a-7581c6ae6153" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:17:27 user nova-compute[74743]: INFO nova.compute.manager [None req-4b6035b7-d8ae-47f0-a058-46f3cd57559f tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Detaching volume c6cb318e-112e-4815-b5c7-c5517b17acc5
Nov 18 17:17:27 user nova-compute[74743]: INFO nova.virt.block_device [None req-4b6035b7-d8ae-47f0-a058-46f3cd57559f tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Attempting to driver detach volume c6cb318e-112e-4815-b5c7-c5517b17acc5 from mountpoint /dev/vdb
Nov 18 17:17:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "refresh_cache-c006a4ad-a8e2-4108-9af1-dec4dd53fcda" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:17:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquired lock "refresh_cache-c006a4ad-a8e2-4108-9af1-dec4dd53fcda" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:17:27 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Forcefully refreshing network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 17:17:27 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-4b6035b7-d8ae-47f0-a058-46f3cd57559f tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Attempting to detach device vdb from instance cd467693-8b2d-4e3d-9b1a-7581c6ae6153 from the persistent domain config. {{(pid=74743) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 17:17:27 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-4b6035b7-d8ae-47f0-a058-46f3cd57559f tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 17:17:27 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:17:27 user nova-compute[74743]:   <source dev="/dev/sdd"/>
Nov 18 17:17:27 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:17:27 user nova-compute[74743]:   <serial>c6cb318e-112e-4815-b5c7-c5517b17acc5</serial>
Nov 18 17:17:27 user nova-compute[74743]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 17:17:27 user nova-compute[74743]: </disk>
Nov 18 17:17:27 user nova-compute[74743]:  {{(pid=74743) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 17:17:27 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-4b6035b7-d8ae-47f0-a058-46f3cd57559f tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Successfully detached device vdb from instance cd467693-8b2d-4e3d-9b1a-7581c6ae6153 from the persistent domain config.
Nov 18 17:17:27 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-4b6035b7-d8ae-47f0-a058-46f3cd57559f tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cd467693-8b2d-4e3d-9b1a-7581c6ae6153 from the live domain config. {{(pid=74743) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 17:17:27 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-4b6035b7-d8ae-47f0-a058-46f3cd57559f tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 17:17:27 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:17:27 user nova-compute[74743]:   <source dev="/dev/sdd"/>
Nov 18 17:17:27 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:17:27 user nova-compute[74743]:   <serial>c6cb318e-112e-4815-b5c7-c5517b17acc5</serial>
Nov 18 17:17:27 user nova-compute[74743]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 17:17:27 user nova-compute[74743]: </disk>
Nov 18 17:17:27 user nova-compute[74743]:  {{(pid=74743) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 17:17:27 user nova-compute[74743]: DEBUG nova.compute.manager [req-a339519e-d665-4b9b-829a-0245e99ecdc8 req-16d47ea9-acfc-49ef-8572-c288938e896b service nova] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] Received event network-vif-plugged-f8b70f64-c72b-4d3b-be6a-6e401ce15011 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:17:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a339519e-d665-4b9b-829a-0245e99ecdc8 req-16d47ea9-acfc-49ef-8572-c288938e896b service nova] Acquiring lock "0ad8aa2d-663c-4829-87f9-07959105ca68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:17:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a339519e-d665-4b9b-829a-0245e99ecdc8 req-16d47ea9-acfc-49ef-8572-c288938e896b service nova] Lock "0ad8aa2d-663c-4829-87f9-07959105ca68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:17:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a339519e-d665-4b9b-829a-0245e99ecdc8 req-16d47ea9-acfc-49ef-8572-c288938e896b service nova] Lock "0ad8aa2d-663c-4829-87f9-07959105ca68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:17:27 user nova-compute[74743]: DEBUG nova.compute.manager [req-a339519e-d665-4b9b-829a-0245e99ecdc8 req-16d47ea9-acfc-49ef-8572-c288938e896b service nova] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] No waiting events found dispatching network-vif-plugged-f8b70f64-c72b-4d3b-be6a-6e401ce15011 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:17:27 user nova-compute[74743]: WARNING nova.compute.manager [req-a339519e-d665-4b9b-829a-0245e99ecdc8 req-16d47ea9-acfc-49ef-8572-c288938e896b service nova] [instance: 0ad8aa2d-663c-4829-87f9-07959105ca68] Received unexpected event network-vif-plugged-f8b70f64-c72b-4d3b-be6a-6e401ce15011 for instance with vm_state deleted and task_state None.
Nov 18 17:17:27 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Updating instance_info_cache with network_info: [{"id": "999980cf-efd0-4b78-aa42-f4e80073b5a9", "address": "fa:16:3e:e4:7e:f3", "network": {"id": "fd98f398-6576-449b-a737-887906eb6656", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668610993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb8f5850162c479b8d185e48c03be7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap999980cf-ef", "ovs_interfaceid": "999980cf-efd0-4b78-aa42-f4e80073b5a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:17:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Releasing lock "refresh_cache-c006a4ad-a8e2-4108-9af1-dec4dd53fcda" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:17:27 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Updated the network info_cache for instance {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 17:17:27 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:17:28 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-4b6035b7-d8ae-47f0-a058-46f3cd57559f tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cd467693-8b2d-4e3d-9b1a-7581c6ae6153 {{(pid=74743) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 17:17:28 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:17:29 user nova-compute[74743]: DEBUG nova.compute.manager [req-4d06f7da-3396-4ab2-a802-a203eb15f2c2 req-091a4f09-58ef-4046-956c-49328ffba1a2 service nova] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Received event network-changed-106be5e5-0143-4ab2-8e1f-30b2e46c5753 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:17:29 user nova-compute[74743]: DEBUG nova.compute.manager [req-4d06f7da-3396-4ab2-a802-a203eb15f2c2 req-091a4f09-58ef-4046-956c-49328ffba1a2 service nova] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Refreshing instance network info cache due to event network-changed-106be5e5-0143-4ab2-8e1f-30b2e46c5753. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:17:29 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4d06f7da-3396-4ab2-a802-a203eb15f2c2 req-091a4f09-58ef-4046-956c-49328ffba1a2 service nova] Acquiring lock "refresh_cache-cd467693-8b2d-4e3d-9b1a-7581c6ae6153" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:17:29 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4d06f7da-3396-4ab2-a802-a203eb15f2c2 req-091a4f09-58ef-4046-956c-49328ffba1a2 service nova] Acquired lock "refresh_cache-cd467693-8b2d-4e3d-9b1a-7581c6ae6153" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:17:29 user nova-compute[74743]: DEBUG nova.network.neutron [req-4d06f7da-3396-4ab2-a802-a203eb15f2c2 req-091a4f09-58ef-4046-956c-49328ffba1a2 service nova] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Refreshing network info cache for port 106be5e5-0143-4ab2-8e1f-30b2e46c5753 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:17:29 user nova-compute[74743]: DEBUG nova.network.neutron [req-4d06f7da-3396-4ab2-a802-a203eb15f2c2 req-091a4f09-58ef-4046-956c-49328ffba1a2 service nova] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Updated VIF entry in instance network info cache for port 106be5e5-0143-4ab2-8e1f-30b2e46c5753. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:17:29 user nova-compute[74743]: DEBUG nova.network.neutron [req-4d06f7da-3396-4ab2-a802-a203eb15f2c2 req-091a4f09-58ef-4046-956c-49328ffba1a2 service nova] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Updating instance_info_cache with network_info: [{"id": "106be5e5-0143-4ab2-8e1f-30b2e46c5753", "address": "fa:16:3e:35:df:4c", "network": {"id": "252343cc-f379-471d-a2c9-99b9a60ebcb4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25c06dc8e7be46229750b8e283622c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106be5e5-01", "ovs_interfaceid": "106be5e5-0143-4ab2-8e1f-30b2e46c5753", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:17:29 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4d06f7da-3396-4ab2-a802-a203eb15f2c2 req-091a4f09-58ef-4046-956c-49328ffba1a2 service nova] Releasing lock "refresh_cache-cd467693-8b2d-4e3d-9b1a-7581c6ae6153" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:17:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:30 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:17:30 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:17:31 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:31 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:17:31 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:17:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:17:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:17:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:17:31 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Auditing locally available compute resources for user (node: user) {{(pid=74743) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 17:17:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:17:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue --force-share --output=json" returned: 0 in 0.219s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:17:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:17:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:17:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:17:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:17:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:17:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:17:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd467693-8b2d-4e3d-9b1a-7581c6ae6153/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:17:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd467693-8b2d-4e3d-9b1a-7581c6ae6153/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:17:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd467693-8b2d-4e3d-9b1a-7581c6ae6153/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:17:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd467693-8b2d-4e3d-9b1a-7581c6ae6153/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:17:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:17:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:17:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:17:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:17:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:17:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:17:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:17:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:17:33 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:17:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:17:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:17:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:17:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:17:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b67d5fc-3753-4c5a-8477-e46315d9b2c2/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:17:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b67d5fc-3753-4c5a-8477-e46315d9b2c2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:17:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b67d5fc-3753-4c5a-8477-e46315d9b2c2/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:17:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b67d5fc-3753-4c5a-8477-e46315d9b2c2/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:17:34 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:17:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ad39c-15fd-42e2-9ad6-ed5cd25e25de/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:17:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ad39c-15fd-42e2-9ad6-ed5cd25e25de/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:17:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ad39c-15fd-42e2-9ad6-ed5cd25e25de/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:17:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ad39c-15fd-42e2-9ad6-ed5cd25e25de/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:17:34 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:17:35 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:35 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:17:35 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:17:35 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Hypervisor/Node resource view: name=user free_ram=7683MB free_disk=25.343521118164062GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74743) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 17:17:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:17:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:17:35 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Applying migration context for instance 69d78ecf-740d-492a-be5b-ffd064e36f00 as it has an incoming, in-progress migration 9f30ed74-7eb7-4032-9f5a-b01be5e0f191. Migration status is finished {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 18 17:17:35 user nova-compute[74743]: INFO nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Updating resource usage from migration 9f30ed74-7eb7-4032-9f5a-b01be5e0f191
Nov 18 17:17:35 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 4cce1628-2dcb-40c7-abd4-6a327a432de3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:17:35 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance e9668e1c-1e8d-4dd7-8f58-d453db294557 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:17:35 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance c006a4ad-a8e2-4108-9af1-dec4dd53fcda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:17:35 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance aefe3db1-b9bb-4cce-aa31-d0b6684ad791 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:17:35 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance cd467693-8b2d-4e3d-9b1a-7581c6ae6153 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:17:35 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance f649143e-f7db-475a-bbe5-d5e7316caac3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:17:35 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 2b67d5fc-3753-4c5a-8477-e46315d9b2c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:17:35 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance f41ad39c-15fd-42e2-9ad6-ed5cd25e25de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:17:35 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Migration 9f30ed74-7eb7-4032-9f5a-b01be5e0f191 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 18 17:17:35 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 69d78ecf-740d-492a-be5b-ffd064e36f00 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:17:35 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 17:17:35 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 17:17:35 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:17:35 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:17:35 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Compute_service record updated for user:user {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 17:17:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.517s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:17:36 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:40 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:41 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:48 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-4b6035b7-d8ae-47f0-a058-46f3cd57559f tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cd467693-8b2d-4e3d-9b1a-7581c6ae6153 is timed out.
Nov 18 17:17:48 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-4b6035b7-d8ae-47f0-a058-46f3cd57559f tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Successfully detached device vdb from instance cd467693-8b2d-4e3d-9b1a-7581c6ae6153 from the live domain config.
Nov 18 17:17:48 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b6035b7-d8ae-47f0-a058-46f3cd57559f tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] calling os-brick to detach iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 17:17:48 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6035b7-d8ae-47f0-a058-46f3cd57559f tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, {'target_iqn': 'iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'guixaBhK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:17:48 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-4b6035b7-d8ae-47f0-a058-46f3cd57559f tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:17:48 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-4b6035b7-d8ae-47f0-a058-46f3cd57559f tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:17:48 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-4b6035b7-d8ae-47f0-a058-46f3cd57559f tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:17:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:17:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:17:48 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83e0917-0967-4030-994c-f9d72d7b4087]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:17:48 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6035b7-d8ae-47f0-a058-46f3cd57559f tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 17:17:48 user nova-compute[74743]: No targets found.
Nov 18 17:17:48 user nova-compute[74743]: iSNS:
Nov 18 17:17:48 user nova-compute[74743]: No targets found.
Nov 18 17:17:48 user nova-compute[74743]: STATIC:
Nov 18 17:17:48 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f
Nov 18 17:17:48 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:17:48 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:17:48 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5
Nov 18 17:17:48 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:17:48 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:17:48 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127
Nov 18 17:17:48 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:17:48 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:17:48 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102
Nov 18 17:17:48 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:17:48 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:17:48 user nova-compute[74743]: FIRMWARE:
Nov 18 17:17:48 user nova-compute[74743]: No targets found.
Nov 18 17:17:48 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:17:48 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6035b7-d8ae-47f0-a058-46f3cd57559f tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 17:17:48 user nova-compute[74743]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 17:17:48 user nova-compute[74743]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74743) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 17:17:48 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6035b7-d8ae-47f0-a058-46f3cd57559f tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5', 0)] {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 17:17:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:17:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:17:48 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[379089f6-b6e2-4234-b12e-444b52b4c83d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:17:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:17:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:17:48 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ed0443-8ab3-4e49-a173-6e929aa70b56]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:17:48 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6035b7-d8ae-47f0-a058-46f3cd57559f tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)
Nov 18 17:17:48 user nova-compute[74743]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:17:48 user nova-compute[74743]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102 (non-flash)
Nov 18 17:17:48 user nova-compute[74743]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)
Nov 18 17:17:48 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:17:48 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6035b7-d8ae-47f0-a058-46f3cd57559f tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 (non-flash)
Nov 18 17:17:48 user nova-compute[74743]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:17:48 user nova-compute[74743]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102 (non-flash)
Nov 18 17:17:48 user nova-compute[74743]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)
Nov 18 17:17:48 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:17:48 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6035b7-d8ae-47f0-a058-46f3cd57559f tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb0833e0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5'): ({'sdd'}, set())}) {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 17:17:48 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-4b6035b7-d8ae-47f0-a058-46f3cd57559f tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Removing single pathed devices sdd {{(pid=74743) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 17:17:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:17:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:17:48 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76f7c87-05fc-4986-8e80-fdf81b06f232]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:17:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:17:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:17:48 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6530b6d-1bed-4f57-817f-614bfabea3e2]: (4, ('ok\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:17:48 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-4b6035b7-d8ae-47f0-a058-46f3cd57559f tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Flushing IO for device /dev/sdd {{(pid=74743) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 17:17:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:17:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:17:48 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[979f393d-8875-43db-b429-62a751e48353]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:17:48 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-4b6035b7-d8ae-47f0-a058-46f3cd57559f tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74743) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 17:17:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:17:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:17:48 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a677a5-b050-4867-ae9d-83e55c7ca954]: (4, ('1', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:17:48 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-4b6035b7-d8ae-47f0-a058-46f3cd57559f tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 17:17:48 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-4b6035b7-d8ae-47f0-a058-46f3cd57559f tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] SCSI volumes sdd have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 17:17:48 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6035b7-d8ae-47f0-a058-46f3cd57559f tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5')] {{(pid=74743) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 17:17:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:17:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:17:48 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf3c461-584e-4e46-9e82-52eb6d22a4f4]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:17:48 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6035b7-d8ae-47f0-a058-46f3cd57559f tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:17:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 -p 172.16.0.220:3260 --logout {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:17:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:17:48 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4483cb-f2c5-41cc-8dcc-7861849b741f]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:17:48 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6035b7-d8ae-47f0-a058-46f3cd57559f tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5, portal: 172.16.0.220,3260]
Nov 18 17:17:48 user nova-compute[74743]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5, portal: 172.16.0.220,3260] successful.
Nov 18 17:17:48 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:17:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 -p 172.16.0.220:3260 --op delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:17:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6cb318e-112e-4815-b5c7-c5517b17acc5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:17:48 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[369c41b4-2d37-4acc-8dc2-2768068368b0]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:17:48 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6035b7-d8ae-47f0-a058-46f3cd57559f tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:17:48 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-4b6035b7-d8ae-47f0-a058-46f3cd57559f tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:17:48 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6035b7-d8ae-47f0-a058-46f3cd57559f tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] <== disconnect_volume: return (337ms) None {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:17:48 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b6035b7-d8ae-47f0-a058-46f3cd57559f tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Disconnected iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 17:17:49 user nova-compute[74743]: DEBUG nova.objects.instance [None req-4b6035b7-d8ae-47f0-a058-46f3cd57559f tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lazy-loading 'flavor' on Instance uuid cd467693-8b2d-4e3d-9b1a-7581c6ae6153 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:17:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4b6035b7-d8ae-47f0-a058-46f3cd57559f tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "cd467693-8b2d-4e3d-9b1a-7581c6ae6153" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.816s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:17:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "8a6a8a09-fb67-46b8-b5a1-b443213ae8a2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:17:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "8a6a8a09-fb67-46b8-b5a1-b443213ae8a2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:17:50 user nova-compute[74743]: DEBUG nova.compute.manager [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Starting instance... {{(pid=74743) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 17:17:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:17:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:17:50 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74743) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 17:17:50 user nova-compute[74743]: INFO nova.compute.claims [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Claim successful on node user
Nov 18 17:17:50 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:17:50 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:17:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.578s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:17:50 user nova-compute[74743]: DEBUG nova.compute.manager [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Start building networks asynchronously for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 17:17:50 user nova-compute[74743]: DEBUG nova.compute.manager [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Allocating IP information in the background. {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 17:17:50 user nova-compute[74743]: DEBUG nova.network.neutron [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] allocate_for_instance() {{(pid=74743) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 17:17:50 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 17:17:50 user nova-compute[74743]: DEBUG nova.compute.manager [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Start building block device mappings for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 17:17:51 user nova-compute[74743]: DEBUG nova.policy [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '89ce0d4bf7234c348b9b1a8979609c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a956c4d6e4304d34872ecf989279c886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74743) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 17:17:51 user nova-compute[74743]: INFO nova.virt.block_device [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Booting with volume 36baaa29-2acc-4476-9f64-ec76a08f66f2 at /dev/vda
Nov 18 17:17:51 user nova-compute[74743]: DEBUG os_brick.utils [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:17:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:17:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:17:51 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79f21dc-742a-4d48-b72f-45972de4a35e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1116acd8874d\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:17:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:17:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:17:51 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a1394e-87e1-488a-861d-8268f081ea67]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:17:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:17:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:17:51 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c9a729-f1b0-41d4-9e1f-3f10dd3ad3f5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:17:51 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f011f8-f25a-482b-96c2-16a49743d402]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:17:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Running cmd (subprocess): nvme version {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:17:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] 'nvme version' failed. Not Retrying. {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:17:51 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.nvmeof [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] nvme not present on system {{(pid=74743) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 17:17:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:17:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:17:51 user nova-compute[74743]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 17:17:51 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b56afb0-ae1b-4584-9ef2-4130c35b7724]: (4, '') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:17:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74743) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 17:17:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 17:17:51 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] LIGHTOS: no hostnqn found. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 17:17:51 user nova-compute[74743]: DEBUG os_brick.utils [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1116acd8874d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:17:51 user nova-compute[74743]: DEBUG nova.virt.block_device [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Updating existing volume attachment record: eebfe215-688b-4648-9a9a-5f127557c872 {{(pid=74743) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 17:17:51 user nova-compute[74743]: DEBUG nova.network.neutron [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Successfully created port: 2bb302cf-a68c-46c1-b2da-fc264a18bec2 {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:17:52 user nova-compute[74743]: DEBUG nova.network.neutron [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Successfully updated port: 2bb302cf-a68c-46c1-b2da-fc264a18bec2 {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:17:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "refresh_cache-8a6a8a09-fb67-46b8-b5a1-b443213ae8a2" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:17:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquired lock "refresh_cache-8a6a8a09-fb67-46b8-b5a1-b443213ae8a2" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:17:52 user nova-compute[74743]: DEBUG nova.network.neutron [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:17:52 user nova-compute[74743]: DEBUG nova.compute.manager [req-7817aff1-d2ce-44e8-bcde-825a323a7dd4 req-cdabec00-1940-43e6-8045-2443476e3de7 service nova] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Received event network-changed-2bb302cf-a68c-46c1-b2da-fc264a18bec2 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:17:52 user nova-compute[74743]: DEBUG nova.compute.manager [req-7817aff1-d2ce-44e8-bcde-825a323a7dd4 req-cdabec00-1940-43e6-8045-2443476e3de7 service nova] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Refreshing instance network info cache due to event network-changed-2bb302cf-a68c-46c1-b2da-fc264a18bec2. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:17:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-7817aff1-d2ce-44e8-bcde-825a323a7dd4 req-cdabec00-1940-43e6-8045-2443476e3de7 service nova] Acquiring lock "refresh_cache-8a6a8a09-fb67-46b8-b5a1-b443213ae8a2" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:17:52 user nova-compute[74743]: DEBUG nova.network.neutron [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:17:52 user nova-compute[74743]: DEBUG nova.network.neutron [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Updating instance_info_cache with network_info: [{"id": "2bb302cf-a68c-46c1-b2da-fc264a18bec2", "address": "fa:16:3e:e7:3a:5a", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb302cf-a6", "ovs_interfaceid": "2bb302cf-a68c-46c1-b2da-fc264a18bec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:17:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Releasing lock "refresh_cache-8a6a8a09-fb67-46b8-b5a1-b443213ae8a2" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:17:52 user nova-compute[74743]: DEBUG nova.compute.manager [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Instance network_info: |[{"id": "2bb302cf-a68c-46c1-b2da-fc264a18bec2", "address": "fa:16:3e:e7:3a:5a", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb302cf-a6", "ovs_interfaceid": "2bb302cf-a68c-46c1-b2da-fc264a18bec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 17:17:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-7817aff1-d2ce-44e8-bcde-825a323a7dd4 req-cdabec00-1940-43e6-8045-2443476e3de7 service nova] Acquired lock "refresh_cache-8a6a8a09-fb67-46b8-b5a1-b443213ae8a2" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:17:52 user nova-compute[74743]: DEBUG nova.network.neutron [req-7817aff1-d2ce-44e8-bcde-825a323a7dd4 req-cdabec00-1940-43e6-8045-2443476e3de7 service nova] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Refreshing network info cache for port 2bb302cf-a68c-46c1-b2da-fc264a18bec2 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:17:53 user nova-compute[74743]: DEBUG nova.network.neutron [req-7817aff1-d2ce-44e8-bcde-825a323a7dd4 req-cdabec00-1940-43e6-8045-2443476e3de7 service nova] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Updated VIF entry in instance network info cache for port 2bb302cf-a68c-46c1-b2da-fc264a18bec2. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:17:53 user nova-compute[74743]: DEBUG nova.network.neutron [req-7817aff1-d2ce-44e8-bcde-825a323a7dd4 req-cdabec00-1940-43e6-8045-2443476e3de7 service nova] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Updating instance_info_cache with network_info: [{"id": "2bb302cf-a68c-46c1-b2da-fc264a18bec2", "address": "fa:16:3e:e7:3a:5a", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb302cf-a6", "ovs_interfaceid": "2bb302cf-a68c-46c1-b2da-fc264a18bec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:17:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-7817aff1-d2ce-44e8-bcde-825a323a7dd4 req-cdabec00-1940-43e6-8045-2443476e3de7 service nova] Releasing lock "refresh_cache-8a6a8a09-fb67-46b8-b5a1-b443213ae8a2" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:17:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG nova.compute.manager [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Start spawning the instance on the hypervisor. {{(pid=74743) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Creating instance directory {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 17:17:57 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Creating image(s)
Nov 18 17:17:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Did not create local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Ensure instance console log exists: /opt/stack/data/nova/instances/8a6a8a09-fb67-46b8-b5a1-b443213ae8a2/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Start _get_guest_xml network_info=[{"id": "2bb302cf-a68c-46c1-b2da-fc264a18bec2", "address": "fa:16:3e:e7:3a:5a", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb302cf-a6", "ovs_interfaceid": "2bb302cf-a68c-46c1-b2da-fc264a18bec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': 'eebfe215-688b-4648-9a9a-5f127557c872', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cGqFNkMi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8a6a8a09-fb67-46b8-b5a1-b443213ae8a2', 'attached_at': '', 'detached_at': '', 'volume_id': '36baaa29-2acc-4476-9f64-ec76a08f66f2', 'serial': '36baaa29-2acc-4476-9f64-ec76a08f66f2'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:17:57 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:17:57 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:17:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Calling os-brick to attach iSCSI Volume {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cGqFNkMi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:17:57 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:17:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:17:57 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:17:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:17:57 user nova-compute[74743]: INFO os_brick.initiator.connectors.iscsi [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 17:17:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 -p 172.16.0.220:3260 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2f4995-85f9-4967-8c5d-6a29ecd7a8e8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 17:17:57 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f306e61-19c5-4676-b9e1-8295a18f36e8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2] added\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2] added
Nov 18 17:17:57 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a404c51-364c-4ae8-aa50-44c4c927954b]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3feef3-549f-4e00-afe7-ae73f5473321]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cGqFNkMi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cGqFNkMi" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ffb35a-ed3c-47b7-bb02-10d93bec72bf]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cGqFNkMi'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[5950179e-a5c4-4382-88de-63a837014fd4]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[20af2e20-5371-45a6-b85b-cf353d71c6f0]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:17:57 user nova-compute[74743]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102 (non-flash)
Nov 18 17:17:57 user nova-compute[74743]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)
Nov 18 17:17:57 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:17:57 user nova-compute[74743]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102 (non-flash)
Nov 18 17:17:57 user nova-compute[74743]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)
Nov 18 17:17:57 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 -p 172.16.0.220:3260 --login {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[191c23c5-e129-405f-9950-a694aa985571]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2, portal: 172.16.0.220,3260]
Nov 18 17:17:57 user nova-compute[74743]: Login to [iface: default, target: iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2, portal: 172.16.0.220,3260] successful.
Nov 18 17:17:57 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce238a9-1e2f-4861-8c2c-fa65e1b196ce]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[122c0766-3b7e-426a-b6bf-1d7be864a421]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:17:57 user nova-compute[74743]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102 (non-flash)
Nov 18 17:17:57 user nova-compute[74743]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)
Nov 18 17:17:57 user nova-compute[74743]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 (non-flash)
Nov 18 17:17:57 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:17:57 user nova-compute[74743]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102 (non-flash)
Nov 18 17:17:57 user nova-compute[74743]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)
Nov 18 17:17:57 user nova-compute[74743]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 (non-flash)
Nov 18 17:17:57 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Connected to 172.16.0.220:3260 {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] HCTL ('35', '-', '-', 0) found on session 41 with lun 0 {{(pid=74743) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74743) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d6f1ca-b63b-4584-9d0c-16672841897d]: (4, ('- - 0', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:17:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cGqFNkMi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 17:17:58 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:17:58 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23761386266316134', 'path': '/dev/sdd'} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:17:58 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761386266316134', 'path': '/dev/sdd'} {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 17:17:58 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:17:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-211306172',display_name='tempest-TestVolumeBootPattern-server-211306172',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-211306172',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOLvs8QktAbg6ubYzS1yyIzjK6/SEgIlSEhHuVaKm0b6bpmV4klO8yadOBEcp58HtUXwfad9vILFBUP0iHELOBhABjjRYYSI0ECkBhwEERqTkNNauBgT8rgOot2Bwx6w0A==',key_name='tempest-TestVolumeBootPattern-2140749553',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a956c4d6e4304d34872ecf989279c886',ramdisk_id='',reservation_id='r-85gurwip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1373443944',owner_user_name='tempest-TestVolumeBootPattern-1373443944-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:17:51Z,user_data=None,user_id='89ce0d4bf7234c348b9b1a8979609c7b',uuid=8a6a8a09-fb67-46b8-b5a1-b443213ae8a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2bb302cf-a68c-46c1-b2da-fc264a18bec2", "address": "fa:16:3e:e7:3a:5a", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb302cf-a6", "ovs_interfaceid": "2bb302cf-a68c-46c1-b2da-fc264a18bec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:17:58 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Converting VIF {"id": "2bb302cf-a68c-46c1-b2da-fc264a18bec2", "address": "fa:16:3e:e7:3a:5a", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb302cf-a6", "ovs_interfaceid": "2bb302cf-a68c-46c1-b2da-fc264a18bec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:17:58 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:3a:5a,bridge_name='br-int',has_traffic_filtering=True,id=2bb302cf-a68c-46c1-b2da-fc264a18bec2,network=Network(fc55f18a-b779-4b04-8828-278ecd62211a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bb302cf-a6') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:17:58 user nova-compute[74743]: DEBUG nova.objects.instance [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lazy-loading 'pci_devices' on Instance uuid 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:17:58 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:17:58 user nova-compute[74743]:   <uuid>8a6a8a09-fb67-46b8-b5a1-b443213ae8a2</uuid>
Nov 18 17:17:58 user nova-compute[74743]:   <name>instance-00000021</name>
Nov 18 17:17:58 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:17:58 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:17:58 user nova-compute[74743]:   <metadata>
Nov 18 17:17:58 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:17:58 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:17:58 user nova-compute[74743]:       <nova:name>tempest-TestVolumeBootPattern-server-211306172</nova:name>
Nov 18 17:17:58 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:17:57</nova:creationTime>
Nov 18 17:17:58 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:17:58 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:17:58 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:17:58 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:17:58 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:17:58 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:17:58 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:17:58 user nova-compute[74743]:       <nova:owner>
Nov 18 17:17:58 user nova-compute[74743]:         <nova:user uuid="89ce0d4bf7234c348b9b1a8979609c7b">tempest-TestVolumeBootPattern-1373443944-project-member</nova:user>
Nov 18 17:17:58 user nova-compute[74743]:         <nova:project uuid="a956c4d6e4304d34872ecf989279c886">tempest-TestVolumeBootPattern-1373443944</nova:project>
Nov 18 17:17:58 user nova-compute[74743]:       </nova:owner>
Nov 18 17:17:58 user nova-compute[74743]:       <nova:ports>
Nov 18 17:17:58 user nova-compute[74743]:         <nova:port uuid="2bb302cf-a68c-46c1-b2da-fc264a18bec2">
Nov 18 17:17:58 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 18 17:17:58 user nova-compute[74743]:         </nova:port>
Nov 18 17:17:58 user nova-compute[74743]:       </nova:ports>
Nov 18 17:17:58 user nova-compute[74743]:     </nova:instance>
Nov 18 17:17:58 user nova-compute[74743]:   </metadata>
Nov 18 17:17:58 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:17:58 user nova-compute[74743]:     <system>
Nov 18 17:17:58 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:17:58 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:17:58 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:17:58 user nova-compute[74743]:       <entry name="serial">8a6a8a09-fb67-46b8-b5a1-b443213ae8a2</entry>
Nov 18 17:17:58 user nova-compute[74743]:       <entry name="uuid">8a6a8a09-fb67-46b8-b5a1-b443213ae8a2</entry>
Nov 18 17:17:58 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:17:58 user nova-compute[74743]:     </system>
Nov 18 17:17:58 user nova-compute[74743]:   </sysinfo>
Nov 18 17:17:58 user nova-compute[74743]:   <os>
Nov 18 17:17:58 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:17:58 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:17:58 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:17:58 user nova-compute[74743]:   </os>
Nov 18 17:17:58 user nova-compute[74743]:   <features>
Nov 18 17:17:58 user nova-compute[74743]:     <acpi/>
Nov 18 17:17:58 user nova-compute[74743]:     <apic/>
Nov 18 17:17:58 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:17:58 user nova-compute[74743]:   </features>
Nov 18 17:17:58 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:17:58 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:17:58 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:17:58 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:17:58 user nova-compute[74743]:   </clock>
Nov 18 17:17:58 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:17:58 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:17:58 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:17:58 user nova-compute[74743]:   </cpu>
Nov 18 17:17:58 user nova-compute[74743]:   <devices>
Nov 18 17:17:58 user nova-compute[74743]:     <disk type="block" device="disk">
Nov 18 17:17:58 user nova-compute[74743]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:17:58 user nova-compute[74743]:       <source dev="/dev/sdd"/>
Nov 18 17:17:58 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:17:58 user nova-compute[74743]:       <serial>36baaa29-2acc-4476-9f64-ec76a08f66f2</serial>
Nov 18 17:17:58 user nova-compute[74743]:     </disk>
Nov 18 17:17:58 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:17:58 user nova-compute[74743]:       <mac address="fa:16:3e:e7:3a:5a"/>
Nov 18 17:17:58 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:17:58 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:17:58 user nova-compute[74743]:       <target dev="tap2bb302cf-a6"/>
Nov 18 17:17:58 user nova-compute[74743]:     </interface>
Nov 18 17:17:58 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:17:58 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/8a6a8a09-fb67-46b8-b5a1-b443213ae8a2/console.log" append="off"/>
Nov 18 17:17:58 user nova-compute[74743]:     </serial>
Nov 18 17:17:58 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:17:58 user nova-compute[74743]:     <video>
Nov 18 17:17:58 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:17:58 user nova-compute[74743]:     </video>
Nov 18 17:17:58 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:17:58 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:17:58 user nova-compute[74743]:     </rng>
Nov 18 17:17:58 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:17:58 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:17:58 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:17:58 user nova-compute[74743]:     </memballoon>
Nov 18 17:17:58 user nova-compute[74743]:   </devices>
Nov 18 17:17:58 user nova-compute[74743]: </domain>
Nov 18 17:17:58 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:17:58 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:17:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-211306172',display_name='tempest-TestVolumeBootPattern-server-211306172',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-211306172',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOLvs8QktAbg6ubYzS1yyIzjK6/SEgIlSEhHuVaKm0b6bpmV4klO8yadOBEcp58HtUXwfad9vILFBUP0iHELOBhABjjRYYSI0ECkBhwEERqTkNNauBgT8rgOot2Bwx6w0A==',key_name='tempest-TestVolumeBootPattern-2140749553',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a956c4d6e4304d34872ecf989279c886',ramdisk_id='',reservation_id='r-85gurwip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1373443944',owner_user_name='tempest-TestVolumeBootPattern-1373443944-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:17:51Z,user_data=None,user_id='89ce0d4bf7234c348b9b1a8979609c7b',uuid=8a6a8a09-fb67-46b8-b5a1-b443213ae8a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2bb302cf-a68c-46c1-b2da-fc264a18bec2", "address": "fa:16:3e:e7:3a:5a", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb302cf-a6", "ovs_interfaceid": "2bb302cf-a68c-46c1-b2da-fc264a18bec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:17:58 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Converting VIF {"id": "2bb302cf-a68c-46c1-b2da-fc264a18bec2", "address": "fa:16:3e:e7:3a:5a", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb302cf-a6", "ovs_interfaceid": "2bb302cf-a68c-46c1-b2da-fc264a18bec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:17:58 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:3a:5a,bridge_name='br-int',has_traffic_filtering=True,id=2bb302cf-a68c-46c1-b2da-fc264a18bec2,network=Network(fc55f18a-b779-4b04-8828-278ecd62211a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bb302cf-a6') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:17:58 user nova-compute[74743]: DEBUG os_vif [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:3a:5a,bridge_name='br-int',has_traffic_filtering=True,id=2bb302cf-a68c-46c1-b2da-fc264a18bec2,network=Network(fc55f18a-b779-4b04-8828-278ecd62211a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bb302cf-a6') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:17:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:17:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:17:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '892d2e8c-df0a-5716-8fb3-62af6efcb886', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:17:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:17:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2bb302cf-a6, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:17:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2bb302cf-a6, col_values=(('qos', UUID('e424fdde-361e-49b2-9c02-bc81a5b57157')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:17:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2bb302cf-a6, col_values=(('external_ids', {'iface-id': '2bb302cf-a68c-46c1-b2da-fc264a18bec2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:3a:5a', 'vm-uuid': '8a6a8a09-fb67-46b8-b5a1-b443213ae8a2'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:17:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:17:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:58 user nova-compute[74743]: INFO os_vif [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:3a:5a,bridge_name='br-int',has_traffic_filtering=True,id=2bb302cf-a68c-46c1-b2da-fc264a18bec2,network=Network(fc55f18a-b779-4b04-8828-278ecd62211a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bb302cf-a6')
Nov 18 17:17:58 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:17:58 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] No VIF found with MAC fa:16:3e:e7:3a:5a, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:17:59 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:59 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:17:59 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:18:00 user nova-compute[74743]: DEBUG nova.compute.manager [req-5ac2d2ff-4953-4f76-b430-8ae5dc96c4de req-86aff7f0-44c2-47bf-b827-949651288f5f service nova] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Received event network-vif-plugged-2bb302cf-a68c-46c1-b2da-fc264a18bec2 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:18:00 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-5ac2d2ff-4953-4f76-b430-8ae5dc96c4de req-86aff7f0-44c2-47bf-b827-949651288f5f service nova] Acquiring lock "8a6a8a09-fb67-46b8-b5a1-b443213ae8a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:18:00 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-5ac2d2ff-4953-4f76-b430-8ae5dc96c4de req-86aff7f0-44c2-47bf-b827-949651288f5f service nova] Lock "8a6a8a09-fb67-46b8-b5a1-b443213ae8a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:18:00 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-5ac2d2ff-4953-4f76-b430-8ae5dc96c4de req-86aff7f0-44c2-47bf-b827-949651288f5f service nova] Lock "8a6a8a09-fb67-46b8-b5a1-b443213ae8a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:18:00 user nova-compute[74743]: DEBUG nova.compute.manager [req-5ac2d2ff-4953-4f76-b430-8ae5dc96c4de req-86aff7f0-44c2-47bf-b827-949651288f5f service nova] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] No waiting events found dispatching network-vif-plugged-2bb302cf-a68c-46c1-b2da-fc264a18bec2 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:18:00 user nova-compute[74743]: WARNING nova.compute.manager [req-5ac2d2ff-4953-4f76-b430-8ae5dc96c4de req-86aff7f0-44c2-47bf-b827-949651288f5f service nova] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Received unexpected event network-vif-plugged-2bb302cf-a68c-46c1-b2da-fc264a18bec2 for instance with vm_state building and task_state spawning.
Nov 18 17:18:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:18:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:18:02 user nova-compute[74743]: DEBUG nova.compute.manager [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:18:02 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Guest created on hypervisor {{(pid=74743) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 17:18:02 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Instance spawned successfully.
Nov 18 17:18:02 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 17:18:02 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Found default for hw_cdrom_bus of ide {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:18:02 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Found default for hw_disk_bus of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:18:02 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Found default for hw_input_bus of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:18:02 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Found default for hw_pointer_model of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:18:02 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Found default for hw_video_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:18:02 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Found default for hw_vif_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:18:02 user nova-compute[74743]: DEBUG nova.compute.manager [req-7639dd2c-6839-44a8-a0f1-8f223abc8296 req-7bf85b16-cf47-4d2f-8072-b2c845fea362 service nova] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Received event network-vif-plugged-2bb302cf-a68c-46c1-b2da-fc264a18bec2 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:18:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-7639dd2c-6839-44a8-a0f1-8f223abc8296 req-7bf85b16-cf47-4d2f-8072-b2c845fea362 service nova] Acquiring lock "8a6a8a09-fb67-46b8-b5a1-b443213ae8a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:18:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-7639dd2c-6839-44a8-a0f1-8f223abc8296 req-7bf85b16-cf47-4d2f-8072-b2c845fea362 service nova] Lock "8a6a8a09-fb67-46b8-b5a1-b443213ae8a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:18:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-7639dd2c-6839-44a8-a0f1-8f223abc8296 req-7bf85b16-cf47-4d2f-8072-b2c845fea362 service nova] Lock "8a6a8a09-fb67-46b8-b5a1-b443213ae8a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:18:02 user nova-compute[74743]: DEBUG nova.compute.manager [req-7639dd2c-6839-44a8-a0f1-8f223abc8296 req-7bf85b16-cf47-4d2f-8072-b2c845fea362 service nova] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] No waiting events found dispatching network-vif-plugged-2bb302cf-a68c-46c1-b2da-fc264a18bec2 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:18:02 user nova-compute[74743]: WARNING nova.compute.manager [req-7639dd2c-6839-44a8-a0f1-8f223abc8296 req-7bf85b16-cf47-4d2f-8072-b2c845fea362 service nova] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Received unexpected event network-vif-plugged-2bb302cf-a68c-46c1-b2da-fc264a18bec2 for instance with vm_state building and task_state spawning.
Nov 18 17:18:02 user nova-compute[74743]: INFO nova.compute.manager [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Took 5.13 seconds to spawn the instance on the hypervisor.
Nov 18 17:18:02 user nova-compute[74743]: DEBUG nova.compute.manager [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:18:02 user nova-compute[74743]: INFO nova.compute.manager [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Took 12.00 seconds to build instance.
Nov 18 17:18:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-931ce463-0bac-4317-b2ed-013fae203a13 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "8a6a8a09-fb67-46b8-b5a1-b443213ae8a2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.095s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:18:03 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:18:04 user nova-compute[74743]: DEBUG nova.compute.manager [req-4a925b7f-111f-457b-bd0a-8fc62ed38579 req-f67b2673-6b3c-469c-a9b4-2dbf49303fbf service nova] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Received event network-changed-7936ec1c-0408-417f-8c26-f6c43264ac5f {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:18:04 user nova-compute[74743]: DEBUG nova.compute.manager [req-4a925b7f-111f-457b-bd0a-8fc62ed38579 req-f67b2673-6b3c-469c-a9b4-2dbf49303fbf service nova] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Refreshing instance network info cache due to event network-changed-7936ec1c-0408-417f-8c26-f6c43264ac5f. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:18:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4a925b7f-111f-457b-bd0a-8fc62ed38579 req-f67b2673-6b3c-469c-a9b4-2dbf49303fbf service nova] Acquiring lock "refresh_cache-2b67d5fc-3753-4c5a-8477-e46315d9b2c2" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:18:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4a925b7f-111f-457b-bd0a-8fc62ed38579 req-f67b2673-6b3c-469c-a9b4-2dbf49303fbf service nova] Acquired lock "refresh_cache-2b67d5fc-3753-4c5a-8477-e46315d9b2c2" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:18:04 user nova-compute[74743]: DEBUG nova.network.neutron [req-4a925b7f-111f-457b-bd0a-8fc62ed38579 req-f67b2673-6b3c-469c-a9b4-2dbf49303fbf service nova] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Refreshing network info cache for port 7936ec1c-0408-417f-8c26-f6c43264ac5f {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:18:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-0cde6323-d95e-46c1-a298-481a5d35c843 tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Acquiring lock "2b67d5fc-3753-4c5a-8477-e46315d9b2c2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:18:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-0cde6323-d95e-46c1-a298-481a5d35c843 tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Lock "2b67d5fc-3753-4c5a-8477-e46315d9b2c2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:18:04 user nova-compute[74743]: DEBUG nova.objects.instance [None req-0cde6323-d95e-46c1-a298-481a5d35c843 tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Lazy-loading 'flavor' on Instance uuid 2b67d5fc-3753-4c5a-8477-e46315d9b2c2 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:18:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-0cde6323-d95e-46c1-a298-481a5d35c843 tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Lock "2b67d5fc-3753-4c5a-8477-e46315d9b2c2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:18:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-0cde6323-d95e-46c1-a298-481a5d35c843 tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Acquiring lock "2b67d5fc-3753-4c5a-8477-e46315d9b2c2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:18:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-0cde6323-d95e-46c1-a298-481a5d35c843 tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Lock "2b67d5fc-3753-4c5a-8477-e46315d9b2c2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:18:04 user nova-compute[74743]: INFO nova.compute.manager [None req-0cde6323-d95e-46c1-a298-481a5d35c843 tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Attaching volume c1e22808-d811-43ea-805a-93ecbf9c64fc to /dev/vdb
Nov 18 17:18:04 user nova-compute[74743]: DEBUG os_brick.utils [None req-0cde6323-d95e-46c1-a298-481a5d35c843 tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:18:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:18:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:18:04 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc958564-3c1f-4889-a7f2-6c60e8294481]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1116acd8874d\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:18:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:18:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:18:04 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16b0e8f-d3c0-4af5-bcee-aedbc408fdc3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:18:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:18:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:18:04 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[c868eb44-ff1d-46ba-8268-f7c7c55edf05]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:18:04 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54cc707-2fe1-4246-af9e-15419d5a3cd1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:18:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-0cde6323-d95e-46c1-a298-481a5d35c843 tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Running cmd (subprocess): nvme version {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:18:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-0cde6323-d95e-46c1-a298-481a5d35c843 tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] 'nvme version' failed. Not Retrying. {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:18:04 user nova-compute[74743]: DEBUG nova.network.neutron [req-4a925b7f-111f-457b-bd0a-8fc62ed38579 req-f67b2673-6b3c-469c-a9b4-2dbf49303fbf service nova] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Updated VIF entry in instance network info cache for port 7936ec1c-0408-417f-8c26-f6c43264ac5f. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:18:04 user nova-compute[74743]: DEBUG nova.network.neutron [req-4a925b7f-111f-457b-bd0a-8fc62ed38579 req-f67b2673-6b3c-469c-a9b4-2dbf49303fbf service nova] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Updating instance_info_cache with network_info: [{"id": "7936ec1c-0408-417f-8c26-f6c43264ac5f", "address": "fa:16:3e:c1:3d:26", "network": {"id": "d8f4040b-7308-4136-af25-acea3f9b7319", "bridge": "br-int", "label": "tempest-TestStampPattern-304681565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "072a19c68f7643c4bd227345b698bede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7936ec1c-04", "ovs_interfaceid": "7936ec1c-0408-417f-8c26-f6c43264ac5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:18:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0cde6323-d95e-46c1-a298-481a5d35c843 tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] nvme not present on system {{(pid=74743) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 17:18:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:18:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4a925b7f-111f-457b-bd0a-8fc62ed38579 req-f67b2673-6b3c-469c-a9b4-2dbf49303fbf service nova] Releasing lock "refresh_cache-2b67d5fc-3753-4c5a-8477-e46315d9b2c2" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:18:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:18:04 user nova-compute[74743]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 17:18:04 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19c8cca-7ac2-4ff4-a867-4d5c59a4b3b9]: (4, '') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:18:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-0cde6323-d95e-46c1-a298-481a5d35c843 tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74743) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 17:18:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-0cde6323-d95e-46c1-a298-481a5d35c843 tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 17:18:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-0cde6323-d95e-46c1-a298-481a5d35c843 tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] LIGHTOS: no hostnqn found. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 17:18:04 user nova-compute[74743]: DEBUG os_brick.utils [None req-0cde6323-d95e-46c1-a298-481a5d35c843 tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1116acd8874d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:18:04 user nova-compute[74743]: DEBUG nova.virt.block_device [None req-0cde6323-d95e-46c1-a298-481a5d35c843 tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Updating existing volume attachment record: 61e14fe5-04d1-4799-9ab1-c145261ff674 {{(pid=74743) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 17:18:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:18:07 user nova-compute[74743]: ERROR nova.volume.cinder [None req-0cde6323-d95e-46c1-a298-481a5d35c843 tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Update attachment failed for attachment 61e14fe5-04d1-4799-9ab1-c145261ff674. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-0eaa7d3e-2db6-469b-bd0d-f6e247acf6c4) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-0eaa7d3e-2db6-469b-bd0d-f6e247acf6c4)
Nov 18 17:18:07 user nova-compute[74743]: ERROR nova.compute.manager [None req-0cde6323-d95e-46c1-a298-481a5d35c843 tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Failed to attach c1e22808-d811-43ea-805a-93ecbf9c64fc at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-0eaa7d3e-2db6-469b-bd0d-f6e247acf6c4)
Nov 18 17:18:07 user nova-compute[74743]: ERROR nova.compute.manager [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Traceback (most recent call last):
Nov 18 17:18:07 user nova-compute[74743]: ERROR nova.compute.manager [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 18 17:18:07 user nova-compute[74743]: ERROR nova.compute.manager [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 18 17:18:07 user nova-compute[74743]: ERROR nova.compute.manager [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 18 17:18:07 user nova-compute[74743]: ERROR nova.compute.manager [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2]     ret_val = method(obj, context, *args, **kwargs)
Nov 18 17:18:07 user nova-compute[74743]: ERROR nova.compute.manager [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 18 17:18:07 user nova-compute[74743]: ERROR nova.compute.manager [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2]     self._do_attach(context, instance, volume, volume_api,
Nov 18 17:18:07 user nova-compute[74743]: ERROR nova.compute.manager [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 18 17:18:07 user nova-compute[74743]: ERROR nova.compute.manager [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2]     self._volume_attach(context, volume, connector, instance,
Nov 18 17:18:07 user nova-compute[74743]: ERROR nova.compute.manager [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 18 17:18:07 user nova-compute[74743]: ERROR nova.compute.manager [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2]     connection_info = volume_api.attachment_update(
Nov 18 17:18:07 user nova-compute[74743]: ERROR nova.compute.manager [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 18 17:18:07 user nova-compute[74743]: ERROR nova.compute.manager [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2]     res = method(self, ctx, *args, **kwargs)
Nov 18 17:18:07 user nova-compute[74743]: ERROR nova.compute.manager [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 18 17:18:07 user nova-compute[74743]: ERROR nova.compute.manager [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 18 17:18:07 user nova-compute[74743]: ERROR nova.compute.manager [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 18 17:18:07 user nova-compute[74743]: ERROR nova.compute.manager [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2]     with excutils.save_and_reraise_exception():
Nov 18 17:18:07 user nova-compute[74743]: ERROR nova.compute.manager [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 18 17:18:07 user nova-compute[74743]: ERROR nova.compute.manager [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2]     self.force_reraise()
Nov 18 17:18:07 user nova-compute[74743]: ERROR nova.compute.manager [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 18 17:18:07 user nova-compute[74743]: ERROR nova.compute.manager [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2]     raise self.value
Nov 18 17:18:07 user nova-compute[74743]: ERROR nova.compute.manager [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 18 17:18:07 user nova-compute[74743]: ERROR nova.compute.manager [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2]     context, '3.44', skip_version_check=True).attachments.update(
Nov 18 17:18:07 user nova-compute[74743]: ERROR nova.compute.manager [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 18 17:18:07 user nova-compute[74743]: ERROR nova.compute.manager [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2]     return method.func(obj, *args, **kwargs)
Nov 18 17:18:07 user nova-compute[74743]: ERROR nova.compute.manager [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 18 17:18:07 user nova-compute[74743]: ERROR nova.compute.manager [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2]     resp = self._update('/attachments/%s' % id, body)
Nov 18 17:18:07 user nova-compute[74743]: ERROR nova.compute.manager [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 18 17:18:07 user nova-compute[74743]: ERROR nova.compute.manager [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 18 17:18:07 user nova-compute[74743]: ERROR nova.compute.manager [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 18 17:18:07 user nova-compute[74743]: ERROR nova.compute.manager [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2]     return self._cs_request(url, 'PUT', **kwargs)
Nov 18 17:18:07 user nova-compute[74743]: ERROR nova.compute.manager [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 18 17:18:07 user nova-compute[74743]: ERROR nova.compute.manager [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2]     return self.request(url, method, **kwargs)
Nov 18 17:18:07 user nova-compute[74743]: ERROR nova.compute.manager [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 18 17:18:07 user nova-compute[74743]: ERROR nova.compute.manager [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2]     raise exceptions.from_response(resp, body)
Nov 18 17:18:07 user nova-compute[74743]: ERROR nova.compute.manager [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-0eaa7d3e-2db6-469b-bd0d-f6e247acf6c4)
Nov 18 17:18:07 user nova-compute[74743]: ERROR nova.compute.manager [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] 
Nov 18 17:18:07 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-0cde6323-d95e-46c1-a298-481a5d35c843 tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Lock "2b67d5fc-3753-4c5a-8477-e46315d9b2c2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 2.815s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server [None req-0cde6323-d95e-46c1-a298-481a5d35c843 tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-0eaa7d3e-2db6-469b-bd0d-f6e247acf6c4)
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-0eaa7d3e-2db6-469b-bd0d-f6e247acf6c4)
Nov 18 17:18:07 user nova-compute[74743]: ERROR oslo_messaging.rpc.server 
Nov 18 17:18:08 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:18:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:18:13 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:18:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:18:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:18:17 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d3dac93e-cc68-471b-8a37-affc74deded5 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Acquiring lock "cd467693-8b2d-4e3d-9b1a-7581c6ae6153" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:18:17 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d3dac93e-cc68-471b-8a37-affc74deded5 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "cd467693-8b2d-4e3d-9b1a-7581c6ae6153" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:18:17 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d3dac93e-cc68-471b-8a37-affc74deded5 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Acquiring lock "cd467693-8b2d-4e3d-9b1a-7581c6ae6153-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:18:17 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d3dac93e-cc68-471b-8a37-affc74deded5 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "cd467693-8b2d-4e3d-9b1a-7581c6ae6153-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:18:17 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d3dac93e-cc68-471b-8a37-affc74deded5 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "cd467693-8b2d-4e3d-9b1a-7581c6ae6153-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:18:17 user nova-compute[74743]: INFO nova.compute.manager [None req-d3dac93e-cc68-471b-8a37-affc74deded5 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Terminating instance
Nov 18 17:18:17 user nova-compute[74743]: DEBUG nova.compute.manager [None req-d3dac93e-cc68-471b-8a37-affc74deded5 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Start destroying the instance on the hypervisor. {{(pid=74743) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 17:18:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:18:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:18:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-5f28f05e-54ba-49e7-bb14-9de9ae31475c req-dbe15841-52c2-423b-aeaf-7ee2212c55fd service nova] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Received event network-vif-unplugged-106be5e5-0143-4ab2-8e1f-30b2e46c5753 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:18:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-5f28f05e-54ba-49e7-bb14-9de9ae31475c req-dbe15841-52c2-423b-aeaf-7ee2212c55fd service nova] Acquiring lock "cd467693-8b2d-4e3d-9b1a-7581c6ae6153-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:18:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-5f28f05e-54ba-49e7-bb14-9de9ae31475c req-dbe15841-52c2-423b-aeaf-7ee2212c55fd service nova] Lock "cd467693-8b2d-4e3d-9b1a-7581c6ae6153-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:18:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-5f28f05e-54ba-49e7-bb14-9de9ae31475c req-dbe15841-52c2-423b-aeaf-7ee2212c55fd service nova] Lock "cd467693-8b2d-4e3d-9b1a-7581c6ae6153-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:18:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-5f28f05e-54ba-49e7-bb14-9de9ae31475c req-dbe15841-52c2-423b-aeaf-7ee2212c55fd service nova] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] No waiting events found dispatching network-vif-unplugged-106be5e5-0143-4ab2-8e1f-30b2e46c5753 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:18:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-5f28f05e-54ba-49e7-bb14-9de9ae31475c req-dbe15841-52c2-423b-aeaf-7ee2212c55fd service nova] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Received event network-vif-unplugged-106be5e5-0143-4ab2-8e1f-30b2e46c5753 for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:18:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:18:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:18:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:18:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:18:18 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Instance destroyed successfully.
Nov 18 17:18:18 user nova-compute[74743]: DEBUG nova.objects.instance [None req-d3dac93e-cc68-471b-8a37-affc74deded5 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lazy-loading 'resources' on Instance uuid cd467693-8b2d-4e3d-9b1a-7581c6ae6153 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:18:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-d3dac93e-cc68-471b-8a37-affc74deded5 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:11:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1273732704',display_name='tempest-ServerRescueNegativeTestJSON-server-1273732704',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1273732704',id=26,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5i5YEzixtVxmS2iOjWM8/2naGXJ4Q5v/0QysXM2kLdJlCMCc++QaAgvj846YeFr6GNwkzyQptK6eTbco8N4N7YhM2ZbtBzmmRMtT6vYLz0rUMuGW/QGr33NXVcCB2opA==',key_name='tempest-keypair-2052404341',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:13:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='25c06dc8e7be46229750b8e283622c9b',ramdisk_id='',reservation_id='r-uxhicdwp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-732707405',owner_user_name='tempest-ServerRescueNegativeTestJSON-732707405-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:15:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1470478a455242f9ad92eaf95dc6a2f4',uuid=cd467693-8b2d-4e3d-9b1a-7581c6ae6153,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "106be5e5-0143-4ab2-8e1f-30b2e46c5753", "address": "fa:16:3e:35:df:4c", "network": {"id": "252343cc-f379-471d-a2c9-99b9a60ebcb4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25c06dc8e7be46229750b8e283622c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106be5e5-01", "ovs_interfaceid": "106be5e5-0143-4ab2-8e1f-30b2e46c5753", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:18:18 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-d3dac93e-cc68-471b-8a37-affc74deded5 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Converting VIF {"id": "106be5e5-0143-4ab2-8e1f-30b2e46c5753", "address": "fa:16:3e:35:df:4c", "network": {"id": "252343cc-f379-471d-a2c9-99b9a60ebcb4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25c06dc8e7be46229750b8e283622c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106be5e5-01", "ovs_interfaceid": "106be5e5-0143-4ab2-8e1f-30b2e46c5753", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:18:18 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-d3dac93e-cc68-471b-8a37-affc74deded5 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:df:4c,bridge_name='br-int',has_traffic_filtering=True,id=106be5e5-0143-4ab2-8e1f-30b2e46c5753,network=Network(252343cc-f379-471d-a2c9-99b9a60ebcb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap106be5e5-01') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:18:18 user nova-compute[74743]: DEBUG os_vif [None req-d3dac93e-cc68-471b-8a37-affc74deded5 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:df:4c,bridge_name='br-int',has_traffic_filtering=True,id=106be5e5-0143-4ab2-8e1f-30b2e46c5753,network=Network(252343cc-f379-471d-a2c9-99b9a60ebcb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap106be5e5-01') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:18:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:18:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap106be5e5-01, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:18:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:18:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:18:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:18:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=866a069e-2c33-4250-a3b8-280de27d22e4) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:18:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:18:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:18:18 user nova-compute[74743]: INFO os_vif [None req-d3dac93e-cc68-471b-8a37-affc74deded5 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:df:4c,bridge_name='br-int',has_traffic_filtering=True,id=106be5e5-0143-4ab2-8e1f-30b2e46c5753,network=Network(252343cc-f379-471d-a2c9-99b9a60ebcb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap106be5e5-01')
Nov 18 17:18:18 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-d3dac93e-cc68-471b-8a37-affc74deded5 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Deleting instance files /opt/stack/data/nova/instances/cd467693-8b2d-4e3d-9b1a-7581c6ae6153_del
Nov 18 17:18:18 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-d3dac93e-cc68-471b-8a37-affc74deded5 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Deletion of /opt/stack/data/nova/instances/cd467693-8b2d-4e3d-9b1a-7581c6ae6153_del complete
Nov 18 17:18:18 user nova-compute[74743]: INFO nova.compute.manager [None req-d3dac93e-cc68-471b-8a37-affc74deded5 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 18 17:18:18 user nova-compute[74743]: DEBUG oslo.service.loopingcall [None req-d3dac93e-cc68-471b-8a37-affc74deded5 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74743) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 17:18:18 user nova-compute[74743]: DEBUG nova.compute.manager [-] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Deallocating network for instance {{(pid=74743) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 17:18:18 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] deallocate_for_instance() {{(pid=74743) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 17:18:19 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:18:19 user nova-compute[74743]: INFO nova.compute.manager [-] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Took 0.68 seconds to deallocate network for instance.
Nov 18 17:18:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d3dac93e-cc68-471b-8a37-affc74deded5 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:18:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d3dac93e-cc68-471b-8a37-affc74deded5 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:18:19 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-d3dac93e-cc68-471b-8a37-affc74deded5 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:18:19 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-d3dac93e-cc68-471b-8a37-affc74deded5 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:18:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d3dac93e-cc68-471b-8a37-affc74deded5 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.376s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:18:20 user nova-compute[74743]: INFO nova.scheduler.client.report [None req-d3dac93e-cc68-471b-8a37-affc74deded5 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Deleted allocations for instance cd467693-8b2d-4e3d-9b1a-7581c6ae6153
Nov 18 17:18:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d3dac93e-cc68-471b-8a37-affc74deded5 tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "cd467693-8b2d-4e3d-9b1a-7581c6ae6153" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.129s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:18:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:18:20 user nova-compute[74743]: DEBUG nova.compute.manager [req-b65610d9-0303-47fe-b0f3-3c11592748dd req-ff544b7d-02fe-4cd6-8e7e-beba578d82a3 service nova] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Received event network-vif-plugged-106be5e5-0143-4ab2-8e1f-30b2e46c5753 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:18:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b65610d9-0303-47fe-b0f3-3c11592748dd req-ff544b7d-02fe-4cd6-8e7e-beba578d82a3 service nova] Acquiring lock "cd467693-8b2d-4e3d-9b1a-7581c6ae6153-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:18:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b65610d9-0303-47fe-b0f3-3c11592748dd req-ff544b7d-02fe-4cd6-8e7e-beba578d82a3 service nova] Lock "cd467693-8b2d-4e3d-9b1a-7581c6ae6153-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:18:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b65610d9-0303-47fe-b0f3-3c11592748dd req-ff544b7d-02fe-4cd6-8e7e-beba578d82a3 service nova] Lock "cd467693-8b2d-4e3d-9b1a-7581c6ae6153-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:18:20 user nova-compute[74743]: DEBUG nova.compute.manager [req-b65610d9-0303-47fe-b0f3-3c11592748dd req-ff544b7d-02fe-4cd6-8e7e-beba578d82a3 service nova] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] No waiting events found dispatching network-vif-plugged-106be5e5-0143-4ab2-8e1f-30b2e46c5753 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:18:20 user nova-compute[74743]: WARNING nova.compute.manager [req-b65610d9-0303-47fe-b0f3-3c11592748dd req-ff544b7d-02fe-4cd6-8e7e-beba578d82a3 service nova] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Received unexpected event network-vif-plugged-106be5e5-0143-4ab2-8e1f-30b2e46c5753 for instance with vm_state deleted and task_state None.
Nov 18 17:18:20 user nova-compute[74743]: DEBUG nova.compute.manager [req-b65610d9-0303-47fe-b0f3-3c11592748dd req-ff544b7d-02fe-4cd6-8e7e-beba578d82a3 service nova] [instance: cd467693-8b2d-4e3d-9b1a-7581c6ae6153] Received event network-vif-deleted-106be5e5-0143-4ab2-8e1f-30b2e46c5753 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:18:23 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:18:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:18:28 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:18:28 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:18:28 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:18:28 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:18:28 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74743) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 17:18:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:18:29 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:18:29 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Starting heal instance info cache {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 17:18:29 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "refresh_cache-aefe3db1-b9bb-4cce-aa31-d0b6684ad791" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:18:29 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquired lock "refresh_cache-aefe3db1-b9bb-4cce-aa31-d0b6684ad791" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:18:29 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Forcefully refreshing network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 17:18:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:18:30 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Updating instance_info_cache with network_info: [{"id": "7bc10485-32b0-44a5-8813-2fa64d1dfbba", "address": "fa:16:3e:47:96:7f", "network": {"id": "1bbf6aff-4048-4212-a716-d0628575bfd0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc0fda74575d488a94e2dcfdc016598c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc10485-32", "ovs_interfaceid": "7bc10485-32b0-44a5-8813-2fa64d1dfbba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:18:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Releasing lock "refresh_cache-aefe3db1-b9bb-4cce-aa31-d0b6684ad791" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:18:30 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Updated the network info_cache for instance {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 17:18:30 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:18:30 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:18:32 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:18:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:18:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:18:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:18:32 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Auditing locally available compute resources for user (node: user) {{(pid=74743) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 17:18:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:18:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:18:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:18:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:18:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:18:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:18:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:18:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:18:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:18:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:18:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:18:33 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:18:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:18:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:18:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4ca6f92f-ca26-47d3-b870-9a775186161d tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Acquiring lock "f41ad39c-15fd-42e2-9ad6-ed5cd25e25de" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:18:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4ca6f92f-ca26-47d3-b870-9a775186161d tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "f41ad39c-15fd-42e2-9ad6-ed5cd25e25de" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:18:33 user nova-compute[74743]: INFO nova.compute.manager [None req-4ca6f92f-ca26-47d3-b870-9a775186161d tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Detaching volume d3306e1e-9257-482e-88c8-0f98af92e102
Nov 18 17:18:33 user nova-compute[74743]: INFO nova.virt.block_device [None req-4ca6f92f-ca26-47d3-b870-9a775186161d tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Attempting to driver detach volume d3306e1e-9257-482e-88c8-0f98af92e102 from mountpoint /dev/vdc
Nov 18 17:18:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:18:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:18:34 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-4ca6f92f-ca26-47d3-b870-9a775186161d tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Attempting to detach device vdc from instance f41ad39c-15fd-42e2-9ad6-ed5cd25e25de from the persistent domain config. {{(pid=74743) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 17:18:34 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-4ca6f92f-ca26-47d3-b870-9a775186161d tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 17:18:34 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:18:34 user nova-compute[74743]:   <source dev="/dev/sdb"/>
Nov 18 17:18:34 user nova-compute[74743]:   <target dev="vdc" bus="virtio"/>
Nov 18 17:18:34 user nova-compute[74743]:   <serial>d3306e1e-9257-482e-88c8-0f98af92e102</serial>
Nov 18 17:18:34 user nova-compute[74743]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 18 17:18:34 user nova-compute[74743]: </disk>
Nov 18 17:18:34 user nova-compute[74743]:  {{(pid=74743) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 17:18:34 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-4ca6f92f-ca26-47d3-b870-9a775186161d tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Successfully detached device vdc from instance f41ad39c-15fd-42e2-9ad6-ed5cd25e25de from the persistent domain config.
Nov 18 17:18:34 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-4ca6f92f-ca26-47d3-b870-9a775186161d tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance f41ad39c-15fd-42e2-9ad6-ed5cd25e25de from the live domain config. {{(pid=74743) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 17:18:34 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-4ca6f92f-ca26-47d3-b870-9a775186161d tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 17:18:34 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:18:34 user nova-compute[74743]:   <source dev="/dev/sdb"/>
Nov 18 17:18:34 user nova-compute[74743]:   <target dev="vdc" bus="virtio"/>
Nov 18 17:18:34 user nova-compute[74743]:   <serial>d3306e1e-9257-482e-88c8-0f98af92e102</serial>
Nov 18 17:18:34 user nova-compute[74743]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 18 17:18:34 user nova-compute[74743]: </disk>
Nov 18 17:18:34 user nova-compute[74743]:  {{(pid=74743) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 17:18:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:18:34 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:18:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:18:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:18:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:18:34 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-4ca6f92f-ca26-47d3-b870-9a775186161d tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance f41ad39c-15fd-42e2-9ad6-ed5cd25e25de {{(pid=74743) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 17:18:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:18:34 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:18:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b67d5fc-3753-4c5a-8477-e46315d9b2c2/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:18:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b67d5fc-3753-4c5a-8477-e46315d9b2c2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:18:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b67d5fc-3753-4c5a-8477-e46315d9b2c2/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:18:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b67d5fc-3753-4c5a-8477-e46315d9b2c2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:18:34 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:18:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ad39c-15fd-42e2-9ad6-ed5cd25e25de/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:18:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ad39c-15fd-42e2-9ad6-ed5cd25e25de/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:18:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ad39c-15fd-42e2-9ad6-ed5cd25e25de/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:18:35 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:18:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ad39c-15fd-42e2-9ad6-ed5cd25e25de/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:18:35 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:18:35 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:18:35 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Hypervisor/Node resource view: name=user free_ram=7757MB free_disk=25.358341217041016GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74743) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 17:18:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:18:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:18:35 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Applying migration context for instance 69d78ecf-740d-492a-be5b-ffd064e36f00 as it has an incoming, in-progress migration 9f30ed74-7eb7-4032-9f5a-b01be5e0f191. Migration status is finished {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 18 17:18:35 user nova-compute[74743]: INFO nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Updating resource usage from migration 9f30ed74-7eb7-4032-9f5a-b01be5e0f191
Nov 18 17:18:35 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 4cce1628-2dcb-40c7-abd4-6a327a432de3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:18:35 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance e9668e1c-1e8d-4dd7-8f58-d453db294557 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:18:35 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance c006a4ad-a8e2-4108-9af1-dec4dd53fcda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:18:35 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance aefe3db1-b9bb-4cce-aa31-d0b6684ad791 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:18:35 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance f649143e-f7db-475a-bbe5-d5e7316caac3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:18:35 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 2b67d5fc-3753-4c5a-8477-e46315d9b2c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:18:35 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance f41ad39c-15fd-42e2-9ad6-ed5cd25e25de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:18:35 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Migration 9f30ed74-7eb7-4032-9f5a-b01be5e0f191 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 18 17:18:35 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 69d78ecf-740d-492a-be5b-ffd064e36f00 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:18:35 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:18:35 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 17:18:35 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 17:18:36 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:18:36 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:18:36 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Compute_service record updated for user:user {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 17:18:36 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.462s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:18:37 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:18:38 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:18:40 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:18:42 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-eef11cbf-af01-493e-b2ee-40c3de9f4e40 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquiring lock "69d78ecf-740d-492a-be5b-ffd064e36f00" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:18:42 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-eef11cbf-af01-493e-b2ee-40c3de9f4e40 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "69d78ecf-740d-492a-be5b-ffd064e36f00" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:18:42 user nova-compute[74743]: DEBUG nova.compute.manager [None req-eef11cbf-af01-493e-b2ee-40c3de9f4e40 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Going to confirm migration 2 {{(pid=74743) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 18 17:18:42 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-eef11cbf-af01-493e-b2ee-40c3de9f4e40 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquiring lock "refresh_cache-69d78ecf-740d-492a-be5b-ffd064e36f00" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:18:42 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-eef11cbf-af01-493e-b2ee-40c3de9f4e40 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquired lock "refresh_cache-69d78ecf-740d-492a-be5b-ffd064e36f00" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:18:42 user nova-compute[74743]: DEBUG nova.network.neutron [None req-eef11cbf-af01-493e-b2ee-40c3de9f4e40 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:18:42 user nova-compute[74743]: DEBUG nova.objects.instance [None req-eef11cbf-af01-493e-b2ee-40c3de9f4e40 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lazy-loading 'info_cache' on Instance uuid 69d78ecf-740d-492a-be5b-ffd064e36f00 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:18:43 user nova-compute[74743]: DEBUG nova.network.neutron [None req-eef11cbf-af01-493e-b2ee-40c3de9f4e40 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Updating instance_info_cache with network_info: [{"id": "4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8", "address": "fa:16:3e:93:d9:fc", "network": {"id": "fd98f398-6576-449b-a737-887906eb6656", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668610993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb8f5850162c479b8d185e48c03be7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd5a403-19", "ovs_interfaceid": "4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:18:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-eef11cbf-af01-493e-b2ee-40c3de9f4e40 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Releasing lock "refresh_cache-69d78ecf-740d-492a-be5b-ffd064e36f00" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:18:43 user nova-compute[74743]: DEBUG nova.objects.instance [None req-eef11cbf-af01-493e-b2ee-40c3de9f4e40 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lazy-loading 'migration_context' on Instance uuid 69d78ecf-740d-492a-be5b-ffd064e36f00 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:18:43 user nova-compute[74743]: DEBUG nova.objects.base [None req-eef11cbf-af01-493e-b2ee-40c3de9f4e40 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Object Instance<69d78ecf-740d-492a-be5b-ffd064e36f00> lazy-loaded attributes: info_cache,migration_context {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:18:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-eef11cbf-af01-493e-b2ee-40c3de9f4e40 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:18:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-eef11cbf-af01-493e-b2ee-40c3de9f4e40 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:18:43 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-eef11cbf-af01-493e-b2ee-40c3de9f4e40 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:18:43 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-eef11cbf-af01-493e-b2ee-40c3de9f4e40 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:18:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-eef11cbf-af01-493e-b2ee-40c3de9f4e40 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.368s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:18:43 user nova-compute[74743]: INFO nova.scheduler.client.report [None req-eef11cbf-af01-493e-b2ee-40c3de9f4e40 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Deleted allocation for migration 9f30ed74-7eb7-4032-9f5a-b01be5e0f191
Nov 18 17:18:43 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:18:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-eef11cbf-af01-493e-b2ee-40c3de9f4e40 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "69d78ecf-740d-492a-be5b-ffd064e36f00" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.422s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:18:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:18:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:18:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74743) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 17:18:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:18:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:18:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:18:50 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:18:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:18:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:18:54 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-4ca6f92f-ca26-47d3-b870-9a775186161d tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance f41ad39c-15fd-42e2-9ad6-ed5cd25e25de is timed out.
Nov 18 17:18:54 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-4ca6f92f-ca26-47d3-b870-9a775186161d tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Successfully detached device vdc from instance f41ad39c-15fd-42e2-9ad6-ed5cd25e25de from the live domain config.
Nov 18 17:18:54 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ca6f92f-ca26-47d3-b870-9a775186161d tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] calling os-brick to detach iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 17:18:54 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca6f92f-ca26-47d3-b870-9a775186161d tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, {'target_iqn': 'iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AHKvJNMO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:18:54 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-4ca6f92f-ca26-47d3-b870-9a775186161d tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:18:54 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-4ca6f92f-ca26-47d3-b870-9a775186161d tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:18:54 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-4ca6f92f-ca26-47d3-b870-9a775186161d tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:18:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:18:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:18:54 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e070970-42c8-4a72-97c8-de1da46eb2b2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:18:54 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca6f92f-ca26-47d3-b870-9a775186161d tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 17:18:54 user nova-compute[74743]: No targets found.
Nov 18 17:18:54 user nova-compute[74743]: iSNS:
Nov 18 17:18:54 user nova-compute[74743]: No targets found.
Nov 18 17:18:54 user nova-compute[74743]: STATIC:
Nov 18 17:18:54 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f
Nov 18 17:18:54 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:18:54 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:18:54 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127
Nov 18 17:18:54 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:18:54 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:18:54 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102
Nov 18 17:18:54 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:18:54 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:18:54 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2
Nov 18 17:18:54 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:18:54 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:18:54 user nova-compute[74743]: FIRMWARE:
Nov 18 17:18:54 user nova-compute[74743]: No targets found.
Nov 18 17:18:54 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:18:54 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca6f92f-ca26-47d3-b870-9a775186161d tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 17:18:54 user nova-compute[74743]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 17:18:54 user nova-compute[74743]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74743) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 17:18:54 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca6f92f-ca26-47d3-b870-9a775186161d tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102', 0)] {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 17:18:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:18:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:18:54 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[4745f908-3b49-43ce-9ce0-a3bb4189fa92]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:18:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:18:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:18:54 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d6e7ee-ecd3-47f4-ba5e-cccf3b334a44]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:18:54 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca6f92f-ca26-47d3-b870-9a775186161d tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:18:54 user nova-compute[74743]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102 (non-flash)
Nov 18 17:18:54 user nova-compute[74743]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)
Nov 18 17:18:54 user nova-compute[74743]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 (non-flash)
Nov 18 17:18:54 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:18:54 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca6f92f-ca26-47d3-b870-9a775186161d tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:18:54 user nova-compute[74743]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102 (non-flash)
Nov 18 17:18:54 user nova-compute[74743]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)
Nov 18 17:18:54 user nova-compute[74743]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 (non-flash)
Nov 18 17:18:54 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:18:54 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca6f92f-ca26-47d3-b870-9a775186161d tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb0833f490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102'): ({'sdb'}, set())}) {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 17:18:54 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-4ca6f92f-ca26-47d3-b870-9a775186161d tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Removing single pathed devices sdb {{(pid=74743) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 17:18:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:18:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:18:54 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[8001b765-a50f-444b-b4d0-c7903212b754]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:18:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:18:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:18:54 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b29b47-47cf-485c-a269-5bc7de2a0f12]: (4, ('ok\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:18:54 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-4ca6f92f-ca26-47d3-b870-9a775186161d tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Flushing IO for device /dev/sdb {{(pid=74743) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 17:18:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:18:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:18:54 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f86634c-84fd-4e36-be5d-b42226fc70dd]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:18:54 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-4ca6f92f-ca26-47d3-b870-9a775186161d tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74743) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 17:18:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:18:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:18:54 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[71193b9e-98bb-4de5-8395-ef73c8116557]: (4, ('1', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:18:54 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-4ca6f92f-ca26-47d3-b870-9a775186161d tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 17:18:54 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-4ca6f92f-ca26-47d3-b870-9a775186161d tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] SCSI volumes sdb have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 17:18:54 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca6f92f-ca26-47d3-b870-9a775186161d tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102')] {{(pid=74743) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 17:18:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:18:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:18:54 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d4b60e-5d91-498a-813d-2d81adb793bb]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:18:54 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca6f92f-ca26-47d3-b870-9a775186161d tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:18:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102 -p 172.16.0.220:3260 --logout {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:18:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:18:54 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[219c32d3-8a22-4992-9709-64826816670c]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:18:54 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca6f92f-ca26-47d3-b870-9a775186161d tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102, portal: 172.16.0.220,3260]
Nov 18 17:18:54 user nova-compute[74743]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102, portal: 172.16.0.220,3260] successful.
Nov 18 17:18:54 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:18:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102 -p 172.16.0.220:3260 --op delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:18:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3306e1e-9257-482e-88c8-0f98af92e102 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:18:54 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f75fb0-d26d-42c8-aa57-c83adbe8cdc1]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:18:54 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca6f92f-ca26-47d3-b870-9a775186161d tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:18:54 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-4ca6f92f-ca26-47d3-b870-9a775186161d tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:18:54 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca6f92f-ca26-47d3-b870-9a775186161d tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] <== disconnect_volume: return (308ms) None {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:18:54 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ca6f92f-ca26-47d3-b870-9a775186161d tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Disconnected iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 17:18:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:18:55 user nova-compute[74743]: DEBUG nova.objects.instance [None req-4ca6f92f-ca26-47d3-b870-9a775186161d tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lazy-loading 'flavor' on Instance uuid f41ad39c-15fd-42e2-9ad6-ed5cd25e25de {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:18:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4ca6f92f-ca26-47d3-b870-9a775186161d tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "f41ad39c-15fd-42e2-9ad6-ed5cd25e25de" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.685s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:18:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:18:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:18:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:01 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Acquiring lock "6aecacc3-577d-4b36-9223-8446afe54e26" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:19:01 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "6aecacc3-577d-4b36-9223-8446afe54e26" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:19:01 user nova-compute[74743]: DEBUG nova.compute.manager [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Starting instance... {{(pid=74743) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 17:19:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:19:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:19:02 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74743) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 17:19:02 user nova-compute[74743]: INFO nova.compute.claims [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Claim successful on node user
Nov 18 17:19:02 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:19:02 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:19:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.378s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:19:02 user nova-compute[74743]: DEBUG nova.compute.manager [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Start building networks asynchronously for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 17:19:02 user nova-compute[74743]: DEBUG nova.compute.manager [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Allocating IP information in the background. {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 17:19:02 user nova-compute[74743]: DEBUG nova.network.neutron [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] allocate_for_instance() {{(pid=74743) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 17:19:02 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 17:19:02 user nova-compute[74743]: DEBUG nova.compute.manager [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Start building block device mappings for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 17:19:02 user nova-compute[74743]: DEBUG nova.policy [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '52673e9f58e44abc8f9bd60d066c4197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38303e1b311044deb8c833ed3299ce88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74743) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 17:19:02 user nova-compute[74743]: DEBUG nova.compute.manager [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Start spawning the instance on the hypervisor. {{(pid=74743) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 17:19:02 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Creating instance directory {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 17:19:02 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Creating image(s)
Nov 18 17:19:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Acquiring lock "/opt/stack/data/nova/instances/6aecacc3-577d-4b36-9223-8446afe54e26/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:19:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "/opt/stack/data/nova/instances/6aecacc3-577d-4b36-9223-8446afe54e26/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:19:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "/opt/stack/data/nova/instances/6aecacc3-577d-4b36-9223-8446afe54e26/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:19:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Acquiring lock "6086defff6dc78d9c8c0985e5535c7c38331c8a6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:19:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "6086defff6dc78d9c8c0985e5535c7c38331c8a6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:19:03 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6086defff6dc78d9c8c0985e5535c7c38331c8a6.part --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:19:03 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6086defff6dc78d9c8c0985e5535c7c38331c8a6.part --force-share --output=json" returned: 0 in 0.184s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:19:03 user nova-compute[74743]: DEBUG nova.virt.images [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] 502d6d5f-7f9a-4b3b-af75-cf8915d0f14a was qcow2, converting to raw {{(pid=74743) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 18 17:19:03 user nova-compute[74743]: DEBUG nova.privsep.utils [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74743) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 18 17:19:03 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6086defff6dc78d9c8c0985e5535c7c38331c8a6.part /opt/stack/data/nova/instances/_base/6086defff6dc78d9c8c0985e5535c7c38331c8a6.converted {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:19:03 user nova-compute[74743]: DEBUG nova.network.neutron [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Successfully created port: 70799139-883d-4f9a-a2ba-e2fabf2871ec {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:19:03 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:03 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6086defff6dc78d9c8c0985e5535c7c38331c8a6.part /opt/stack/data/nova/instances/_base/6086defff6dc78d9c8c0985e5535c7c38331c8a6.converted" returned: 0 in 0.466s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:19:03 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6086defff6dc78d9c8c0985e5535c7c38331c8a6.converted --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:19:03 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6086defff6dc78d9c8c0985e5535c7c38331c8a6.converted --force-share --output=json" returned: 0 in 0.172s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:19:03 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "6086defff6dc78d9c8c0985e5535c7c38331c8a6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.384s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:19:03 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6086defff6dc78d9c8c0985e5535c7c38331c8a6 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG nova.network.neutron [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Successfully updated port: 70799139-883d-4f9a-a2ba-e2fabf2871ec {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Acquiring lock "refresh_cache-6aecacc3-577d-4b36-9223-8446afe54e26" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Acquired lock "refresh_cache-6aecacc3-577d-4b36-9223-8446afe54e26" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG nova.network.neutron [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG nova.compute.manager [req-7a440c44-350b-4953-be20-d2598baa550a req-7787d227-38ef-496f-a634-d2e516d85b2e service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Received event network-changed-70799139-883d-4f9a-a2ba-e2fabf2871ec {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG nova.compute.manager [req-7a440c44-350b-4953-be20-d2598baa550a req-7787d227-38ef-496f-a634-d2e516d85b2e service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Refreshing instance network info cache due to event network-changed-70799139-883d-4f9a-a2ba-e2fabf2871ec. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-7a440c44-350b-4953-be20-d2598baa550a req-7787d227-38ef-496f-a634-d2e516d85b2e service nova] Acquiring lock "refresh_cache-6aecacc3-577d-4b36-9223-8446afe54e26" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG nova.network.neutron [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6086defff6dc78d9c8c0985e5535c7c38331c8a6 --force-share --output=json" returned: 0 in 0.165s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Acquiring lock "6086defff6dc78d9c8c0985e5535c7c38331c8a6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "6086defff6dc78d9c8c0985e5535c7c38331c8a6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6086defff6dc78d9c8c0985e5535c7c38331c8a6 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6086defff6dc78d9c8c0985e5535c7c38331c8a6 --force-share --output=json" returned: 0 in 0.171s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6086defff6dc78d9c8c0985e5535c7c38331c8a6,backing_fmt=raw /opt/stack/data/nova/instances/6aecacc3-577d-4b36-9223-8446afe54e26/disk 1073741824 {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6086defff6dc78d9c8c0985e5535c7c38331c8a6,backing_fmt=raw /opt/stack/data/nova/instances/6aecacc3-577d-4b36-9223-8446afe54e26/disk 1073741824" returned: 0 in 0.046s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "6086defff6dc78d9c8c0985e5535c7c38331c8a6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6086defff6dc78d9c8c0985e5535c7c38331c8a6 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG nova.network.neutron [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Updating instance_info_cache with network_info: [{"id": "70799139-883d-4f9a-a2ba-e2fabf2871ec", "address": "fa:16:3e:1f:4b:8a", "network": {"id": "cd6d2dbc-0950-412a-ab9d-cf7615c06eb8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1261309930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38303e1b311044deb8c833ed3299ce88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70799139-88", "ovs_interfaceid": "70799139-883d-4f9a-a2ba-e2fabf2871ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Releasing lock "refresh_cache-6aecacc3-577d-4b36-9223-8446afe54e26" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG nova.compute.manager [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Instance network_info: |[{"id": "70799139-883d-4f9a-a2ba-e2fabf2871ec", "address": "fa:16:3e:1f:4b:8a", "network": {"id": "cd6d2dbc-0950-412a-ab9d-cf7615c06eb8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1261309930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38303e1b311044deb8c833ed3299ce88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70799139-88", "ovs_interfaceid": "70799139-883d-4f9a-a2ba-e2fabf2871ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-7a440c44-350b-4953-be20-d2598baa550a req-7787d227-38ef-496f-a634-d2e516d85b2e service nova] Acquired lock "refresh_cache-6aecacc3-577d-4b36-9223-8446afe54e26" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG nova.network.neutron [req-7a440c44-350b-4953-be20-d2598baa550a req-7787d227-38ef-496f-a634-d2e516d85b2e service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Refreshing network info cache for port 70799139-883d-4f9a-a2ba-e2fabf2871ec {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6086defff6dc78d9c8c0985e5535c7c38331c8a6 --force-share --output=json" returned: 0 in 0.180s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6aecacc3-577d-4b36-9223-8446afe54e26/disk. size=1073741824 {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aecacc3-577d-4b36-9223-8446afe54e26/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aecacc3-577d-4b36-9223-8446afe54e26/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Cannot resize image /opt/stack/data/nova/instances/6aecacc3-577d-4b36-9223-8446afe54e26/disk to a smaller size. {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Created local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Ensure instance console log exists: /opt/stack/data/nova/instances/6aecacc3-577d-4b36-9223-8446afe54e26/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Start _get_guest_xml network_info=[{"id": "70799139-883d-4f9a-a2ba-e2fabf2871ec", "address": "fa:16:3e:1f:4b:8a", "network": {"id": "cd6d2dbc-0950-412a-ab9d-cf7615c06eb8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1261309930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38303e1b311044deb8c833ed3299ce88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70799139-88", "ovs_interfaceid": "70799139-883d-4f9a-a2ba-e2fabf2871ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T17:18:59Z,direct_url=<?>,disk_format='qcow2',id=502d6d5f-7f9a-4b3b-af75-cf8915d0f14a,min_disk=0,min_ram=0,name='tempest-scenario-img--1073419771',owner='38303e1b311044deb8c833ed3299ce88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T17:19:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '502d6d5f-7f9a-4b3b-af75-cf8915d0f14a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:19:04 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:19:04 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:19:04 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T17:18:59Z,direct_url=<?>,disk_format='qcow2',id=502d6d5f-7f9a-4b3b-af75-cf8915d0f14a,min_disk=0,min_ram=0,name='tempest-scenario-img--1073419771',owner='38303e1b311044deb8c833ed3299ce88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T17:19:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:19:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-571016991',display_name='tempest-TestMinimumBasicScenario-server-571016991',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-571016991',id=34,image_ref='502d6d5f-7f9a-4b3b-af75-cf8915d0f14a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDhtFEpE8QQq5OQXk5qeUW0OP7QLpgRvDd9rkjiQBHiCfwQRKXXiuo4jCXffab0TYR+4YYJlJ/bv6z9gV1HPXH7ici9tntf4eAwrpJJu35hohZ9oXg0J27GRRsfKG9Xbw==',key_name='tempest-TestMinimumBasicScenario-597950928',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='38303e1b311044deb8c833ed3299ce88',ramdisk_id='',reservation_id='r-algq1rxa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='502d6d5f-7f9a-4b3b-af75-cf8915d0f14a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1229544582',owner_user_name='tempest-TestMinimumBasicScenario-1229544582-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:19:03Z,user_data=None,user_id='52673e9f58e44abc8f9bd60d066c4197',uuid=6aecacc3-577d-4b36-9223-8446afe54e26,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70799139-883d-4f9a-a2ba-e2fabf2871ec", "address": "fa:16:3e:1f:4b:8a", "network": {"id": "cd6d2dbc-0950-412a-ab9d-cf7615c06eb8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1261309930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38303e1b311044deb8c833ed3299ce88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70799139-88", "ovs_interfaceid": "70799139-883d-4f9a-a2ba-e2fabf2871ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Converting VIF {"id": "70799139-883d-4f9a-a2ba-e2fabf2871ec", "address": "fa:16:3e:1f:4b:8a", "network": {"id": "cd6d2dbc-0950-412a-ab9d-cf7615c06eb8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1261309930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38303e1b311044deb8c833ed3299ce88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70799139-88", "ovs_interfaceid": "70799139-883d-4f9a-a2ba-e2fabf2871ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:4b:8a,bridge_name='br-int',has_traffic_filtering=True,id=70799139-883d-4f9a-a2ba-e2fabf2871ec,network=Network(cd6d2dbc-0950-412a-ab9d-cf7615c06eb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70799139-88') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG nova.objects.instance [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lazy-loading 'pci_devices' on Instance uuid 6aecacc3-577d-4b36-9223-8446afe54e26 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:19:04 user nova-compute[74743]:   <uuid>6aecacc3-577d-4b36-9223-8446afe54e26</uuid>
Nov 18 17:19:04 user nova-compute[74743]:   <name>instance-00000022</name>
Nov 18 17:19:04 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:19:04 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:19:04 user nova-compute[74743]:   <metadata>
Nov 18 17:19:04 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:19:04 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:19:04 user nova-compute[74743]:       <nova:name>tempest-TestMinimumBasicScenario-server-571016991</nova:name>
Nov 18 17:19:04 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:19:04</nova:creationTime>
Nov 18 17:19:04 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:19:04 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:19:04 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:19:04 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:19:04 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:19:04 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:19:04 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:19:04 user nova-compute[74743]:       <nova:owner>
Nov 18 17:19:04 user nova-compute[74743]:         <nova:user uuid="52673e9f58e44abc8f9bd60d066c4197">tempest-TestMinimumBasicScenario-1229544582-project-member</nova:user>
Nov 18 17:19:04 user nova-compute[74743]:         <nova:project uuid="38303e1b311044deb8c833ed3299ce88">tempest-TestMinimumBasicScenario-1229544582</nova:project>
Nov 18 17:19:04 user nova-compute[74743]:       </nova:owner>
Nov 18 17:19:04 user nova-compute[74743]:       <nova:root type="image" uuid="502d6d5f-7f9a-4b3b-af75-cf8915d0f14a"/>
Nov 18 17:19:04 user nova-compute[74743]:       <nova:ports>
Nov 18 17:19:04 user nova-compute[74743]:         <nova:port uuid="70799139-883d-4f9a-a2ba-e2fabf2871ec">
Nov 18 17:19:04 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 18 17:19:04 user nova-compute[74743]:         </nova:port>
Nov 18 17:19:04 user nova-compute[74743]:       </nova:ports>
Nov 18 17:19:04 user nova-compute[74743]:     </nova:instance>
Nov 18 17:19:04 user nova-compute[74743]:   </metadata>
Nov 18 17:19:04 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:19:04 user nova-compute[74743]:     <system>
Nov 18 17:19:04 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:19:04 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:19:04 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:19:04 user nova-compute[74743]:       <entry name="serial">6aecacc3-577d-4b36-9223-8446afe54e26</entry>
Nov 18 17:19:04 user nova-compute[74743]:       <entry name="uuid">6aecacc3-577d-4b36-9223-8446afe54e26</entry>
Nov 18 17:19:04 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:19:04 user nova-compute[74743]:     </system>
Nov 18 17:19:04 user nova-compute[74743]:   </sysinfo>
Nov 18 17:19:04 user nova-compute[74743]:   <os>
Nov 18 17:19:04 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:19:04 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:19:04 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:19:04 user nova-compute[74743]:   </os>
Nov 18 17:19:04 user nova-compute[74743]:   <features>
Nov 18 17:19:04 user nova-compute[74743]:     <acpi/>
Nov 18 17:19:04 user nova-compute[74743]:     <apic/>
Nov 18 17:19:04 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:19:04 user nova-compute[74743]:   </features>
Nov 18 17:19:04 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:19:04 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:19:04 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:19:04 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:19:04 user nova-compute[74743]:   </clock>
Nov 18 17:19:04 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:19:04 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:19:04 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:19:04 user nova-compute[74743]:   </cpu>
Nov 18 17:19:04 user nova-compute[74743]:   <devices>
Nov 18 17:19:04 user nova-compute[74743]:     <disk type="file" device="disk">
Nov 18 17:19:04 user nova-compute[74743]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 17:19:04 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/6aecacc3-577d-4b36-9223-8446afe54e26/disk"/>
Nov 18 17:19:04 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:19:04 user nova-compute[74743]:     </disk>
Nov 18 17:19:04 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:19:04 user nova-compute[74743]:       <mac address="fa:16:3e:1f:4b:8a"/>
Nov 18 17:19:04 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:19:04 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:19:04 user nova-compute[74743]:       <target dev="tap70799139-88"/>
Nov 18 17:19:04 user nova-compute[74743]:     </interface>
Nov 18 17:19:04 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:19:04 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/6aecacc3-577d-4b36-9223-8446afe54e26/console.log" append="off"/>
Nov 18 17:19:04 user nova-compute[74743]:     </serial>
Nov 18 17:19:04 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:19:04 user nova-compute[74743]:     <video>
Nov 18 17:19:04 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:19:04 user nova-compute[74743]:     </video>
Nov 18 17:19:04 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:19:04 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:19:04 user nova-compute[74743]:     </rng>
Nov 18 17:19:04 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:19:04 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:19:04 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:19:04 user nova-compute[74743]:     </memballoon>
Nov 18 17:19:04 user nova-compute[74743]:   </devices>
Nov 18 17:19:04 user nova-compute[74743]: </domain>
Nov 18 17:19:04 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:19:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-571016991',display_name='tempest-TestMinimumBasicScenario-server-571016991',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-571016991',id=34,image_ref='502d6d5f-7f9a-4b3b-af75-cf8915d0f14a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDhtFEpE8QQq5OQXk5qeUW0OP7QLpgRvDd9rkjiQBHiCfwQRKXXiuo4jCXffab0TYR+4YYJlJ/bv6z9gV1HPXH7ici9tntf4eAwrpJJu35hohZ9oXg0J27GRRsfKG9Xbw==',key_name='tempest-TestMinimumBasicScenario-597950928',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='38303e1b311044deb8c833ed3299ce88',ramdisk_id='',reservation_id='r-algq1rxa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='502d6d5f-7f9a-4b3b-af75-cf8915d0f14a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1229544582',owner_user_name='tempest-TestMinimumBasicScenario-1229544582-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:19:03Z,user_data=None,user_id='52673e9f58e44abc8f9bd60d066c4197',uuid=6aecacc3-577d-4b36-9223-8446afe54e26,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70799139-883d-4f9a-a2ba-e2fabf2871ec", "address": "fa:16:3e:1f:4b:8a", "network": {"id": "cd6d2dbc-0950-412a-ab9d-cf7615c06eb8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1261309930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38303e1b311044deb8c833ed3299ce88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70799139-88", "ovs_interfaceid": "70799139-883d-4f9a-a2ba-e2fabf2871ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Converting VIF {"id": "70799139-883d-4f9a-a2ba-e2fabf2871ec", "address": "fa:16:3e:1f:4b:8a", "network": {"id": "cd6d2dbc-0950-412a-ab9d-cf7615c06eb8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1261309930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38303e1b311044deb8c833ed3299ce88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70799139-88", "ovs_interfaceid": "70799139-883d-4f9a-a2ba-e2fabf2871ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:4b:8a,bridge_name='br-int',has_traffic_filtering=True,id=70799139-883d-4f9a-a2ba-e2fabf2871ec,network=Network(cd6d2dbc-0950-412a-ab9d-cf7615c06eb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70799139-88') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG os_vif [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:4b:8a,bridge_name='br-int',has_traffic_filtering=True,id=70799139-883d-4f9a-a2ba-e2fabf2871ec,network=Network(cd6d2dbc-0950-412a-ab9d-cf7615c06eb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70799139-88') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ff6c50ab-7d05-5305-acf2-a628d81dcb0c', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap70799139-88, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap70799139-88, col_values=(('qos', UUID('575b77aa-5ea1-41e1-ad53-63b65a74e464')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap70799139-88, col_values=(('external_ids', {'iface-id': '70799139-883d-4f9a-a2ba-e2fabf2871ec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:4b:8a', 'vm-uuid': '6aecacc3-577d-4b36-9223-8446afe54e26'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:04 user nova-compute[74743]: INFO os_vif [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:4b:8a,bridge_name='br-int',has_traffic_filtering=True,id=70799139-883d-4f9a-a2ba-e2fabf2871ec,network=Network(cd6d2dbc-0950-412a-ab9d-cf7615c06eb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70799139-88')
Nov 18 17:19:04 user nova-compute[74743]: DEBUG nova.network.neutron [req-7a440c44-350b-4953-be20-d2598baa550a req-7787d227-38ef-496f-a634-d2e516d85b2e service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Updated VIF entry in instance network info cache for port 70799139-883d-4f9a-a2ba-e2fabf2871ec. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG nova.network.neutron [req-7a440c44-350b-4953-be20-d2598baa550a req-7787d227-38ef-496f-a634-d2e516d85b2e service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Updating instance_info_cache with network_info: [{"id": "70799139-883d-4f9a-a2ba-e2fabf2871ec", "address": "fa:16:3e:1f:4b:8a", "network": {"id": "cd6d2dbc-0950-412a-ab9d-cf7615c06eb8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1261309930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38303e1b311044deb8c833ed3299ce88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70799139-88", "ovs_interfaceid": "70799139-883d-4f9a-a2ba-e2fabf2871ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-7a440c44-350b-4953-be20-d2598baa550a req-7787d227-38ef-496f-a634-d2e516d85b2e service nova] Releasing lock "refresh_cache-6aecacc3-577d-4b36-9223-8446afe54e26" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:19:04 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] No VIF found with MAC fa:16:3e:1f:4b:8a, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:19:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquiring lock "789583c2-1c04-4510-a37e-0e9b7d3a0971" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:19:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "789583c2-1c04-4510-a37e-0e9b7d3a0971" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:19:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:06 user nova-compute[74743]: DEBUG nova.compute.manager [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Starting instance... {{(pid=74743) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 17:19:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:19:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:19:06 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74743) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 17:19:06 user nova-compute[74743]: INFO nova.compute.claims [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Claim successful on node user
Nov 18 17:19:06 user nova-compute[74743]: DEBUG nova.compute.manager [req-fb5be07a-8be4-4940-9c3a-ca7b4b359d45 req-818c35b7-820e-4862-ab00-2771ff4a07b8 service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Received event network-vif-plugged-70799139-883d-4f9a-a2ba-e2fabf2871ec {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:19:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-fb5be07a-8be4-4940-9c3a-ca7b4b359d45 req-818c35b7-820e-4862-ab00-2771ff4a07b8 service nova] Acquiring lock "6aecacc3-577d-4b36-9223-8446afe54e26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:19:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-fb5be07a-8be4-4940-9c3a-ca7b4b359d45 req-818c35b7-820e-4862-ab00-2771ff4a07b8 service nova] Lock "6aecacc3-577d-4b36-9223-8446afe54e26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:19:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-fb5be07a-8be4-4940-9c3a-ca7b4b359d45 req-818c35b7-820e-4862-ab00-2771ff4a07b8 service nova] Lock "6aecacc3-577d-4b36-9223-8446afe54e26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:19:06 user nova-compute[74743]: DEBUG nova.compute.manager [req-fb5be07a-8be4-4940-9c3a-ca7b4b359d45 req-818c35b7-820e-4862-ab00-2771ff4a07b8 service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] No waiting events found dispatching network-vif-plugged-70799139-883d-4f9a-a2ba-e2fabf2871ec {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:19:06 user nova-compute[74743]: WARNING nova.compute.manager [req-fb5be07a-8be4-4940-9c3a-ca7b4b359d45 req-818c35b7-820e-4862-ab00-2771ff4a07b8 service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Received unexpected event network-vif-plugged-70799139-883d-4f9a-a2ba-e2fabf2871ec for instance with vm_state building and task_state spawning.
Nov 18 17:19:06 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:19:06 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:19:07 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.587s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:19:07 user nova-compute[74743]: DEBUG nova.compute.manager [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Start building networks asynchronously for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 17:19:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:07 user nova-compute[74743]: DEBUG nova.compute.manager [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Allocating IP information in the background. {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 17:19:07 user nova-compute[74743]: DEBUG nova.network.neutron [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] allocate_for_instance() {{(pid=74743) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 17:19:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:07 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 17:19:07 user nova-compute[74743]: DEBUG nova.compute.manager [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Start building block device mappings for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 17:19:07 user nova-compute[74743]: DEBUG nova.policy [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5639bd2666534fdca04d0958dcdc9f54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0fda74575d488a94e2dcfdc016598c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74743) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 17:19:07 user nova-compute[74743]: DEBUG nova.compute.manager [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Start spawning the instance on the hypervisor. {{(pid=74743) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 17:19:07 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Creating instance directory {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 17:19:07 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Creating image(s)
Nov 18 17:19:07 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquiring lock "/opt/stack/data/nova/instances/789583c2-1c04-4510-a37e-0e9b7d3a0971/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:19:07 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "/opt/stack/data/nova/instances/789583c2-1c04-4510-a37e-0e9b7d3a0971/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:19:07 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "/opt/stack/data/nova/instances/789583c2-1c04-4510-a37e-0e9b7d3a0971/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:19:07 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:19:07 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.178s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:19:07 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquiring lock "c188b3a997bfafa42fa341f9dcc326545681eed9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:19:07 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:19:07 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:19:07 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.200s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:19:07 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/789583c2-1c04-4510-a37e-0e9b7d3a0971/disk 1073741824 {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:19:07 user nova-compute[74743]: DEBUG nova.network.neutron [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Successfully created port: db8b331f-9b3f-472b-968a-2151da14f567 {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:19:07 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/789583c2-1c04-4510-a37e-0e9b7d3a0971/disk 1073741824" returned: 0 in 0.064s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:19:07 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:19:07 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:19:07 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.180s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:19:07 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Checking if we can resize image /opt/stack/data/nova/instances/789583c2-1c04-4510-a37e-0e9b7d3a0971/disk. size=1073741824 {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 17:19:07 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/789583c2-1c04-4510-a37e-0e9b7d3a0971/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:19:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/789583c2-1c04-4510-a37e-0e9b7d3a0971/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:19:08 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Cannot resize image /opt/stack/data/nova/instances/789583c2-1c04-4510-a37e-0e9b7d3a0971/disk to a smaller size. {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 17:19:08 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Created local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 17:19:08 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Ensure instance console log exists: /opt/stack/data/nova/instances/789583c2-1c04-4510-a37e-0e9b7d3a0971/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:19:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:19:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:19:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:19:08 user nova-compute[74743]: DEBUG nova.network.neutron [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Successfully updated port: db8b331f-9b3f-472b-968a-2151da14f567 {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:19:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquiring lock "refresh_cache-789583c2-1c04-4510-a37e-0e9b7d3a0971" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:19:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquired lock "refresh_cache-789583c2-1c04-4510-a37e-0e9b7d3a0971" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:19:08 user nova-compute[74743]: DEBUG nova.network.neutron [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:19:08 user nova-compute[74743]: DEBUG nova.network.neutron [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:19:08 user nova-compute[74743]: DEBUG nova.compute.manager [req-abd4f64c-0980-45b3-bc56-221202ff25f3 req-6f799c21-434f-46ed-9fa5-9fa70971b37d service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Received event network-vif-plugged-70799139-883d-4f9a-a2ba-e2fabf2871ec {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:19:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-abd4f64c-0980-45b3-bc56-221202ff25f3 req-6f799c21-434f-46ed-9fa5-9fa70971b37d service nova] Acquiring lock "6aecacc3-577d-4b36-9223-8446afe54e26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:19:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-abd4f64c-0980-45b3-bc56-221202ff25f3 req-6f799c21-434f-46ed-9fa5-9fa70971b37d service nova] Lock "6aecacc3-577d-4b36-9223-8446afe54e26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:19:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-abd4f64c-0980-45b3-bc56-221202ff25f3 req-6f799c21-434f-46ed-9fa5-9fa70971b37d service nova] Lock "6aecacc3-577d-4b36-9223-8446afe54e26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:19:08 user nova-compute[74743]: DEBUG nova.compute.manager [req-abd4f64c-0980-45b3-bc56-221202ff25f3 req-6f799c21-434f-46ed-9fa5-9fa70971b37d service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] No waiting events found dispatching network-vif-plugged-70799139-883d-4f9a-a2ba-e2fabf2871ec {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:19:08 user nova-compute[74743]: WARNING nova.compute.manager [req-abd4f64c-0980-45b3-bc56-221202ff25f3 req-6f799c21-434f-46ed-9fa5-9fa70971b37d service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Received unexpected event network-vif-plugged-70799139-883d-4f9a-a2ba-e2fabf2871ec for instance with vm_state building and task_state spawning.
Nov 18 17:19:08 user nova-compute[74743]: DEBUG nova.compute.manager [req-abd4f64c-0980-45b3-bc56-221202ff25f3 req-6f799c21-434f-46ed-9fa5-9fa70971b37d service nova] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Received event network-changed-db8b331f-9b3f-472b-968a-2151da14f567 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:19:08 user nova-compute[74743]: DEBUG nova.compute.manager [req-abd4f64c-0980-45b3-bc56-221202ff25f3 req-6f799c21-434f-46ed-9fa5-9fa70971b37d service nova] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Refreshing instance network info cache due to event network-changed-db8b331f-9b3f-472b-968a-2151da14f567. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:19:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-abd4f64c-0980-45b3-bc56-221202ff25f3 req-6f799c21-434f-46ed-9fa5-9fa70971b37d service nova] Acquiring lock "refresh_cache-789583c2-1c04-4510-a37e-0e9b7d3a0971" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:19:08 user nova-compute[74743]: DEBUG nova.compute.manager [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:19:08 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Guest created on hypervisor {{(pid=74743) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 17:19:08 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Instance spawned successfully.
Nov 18 17:19:08 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 17:19:08 user nova-compute[74743]: DEBUG nova.network.neutron [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Updating instance_info_cache with network_info: [{"id": "db8b331f-9b3f-472b-968a-2151da14f567", "address": "fa:16:3e:50:6a:16", "network": {"id": "1bbf6aff-4048-4212-a716-d0628575bfd0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc0fda74575d488a94e2dcfdc016598c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb8b331f-9b", "ovs_interfaceid": "db8b331f-9b3f-472b-968a-2151da14f567", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:19:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Releasing lock "refresh_cache-789583c2-1c04-4510-a37e-0e9b7d3a0971" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:19:08 user nova-compute[74743]: DEBUG nova.compute.manager [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Instance network_info: |[{"id": "db8b331f-9b3f-472b-968a-2151da14f567", "address": "fa:16:3e:50:6a:16", "network": {"id": "1bbf6aff-4048-4212-a716-d0628575bfd0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc0fda74575d488a94e2dcfdc016598c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb8b331f-9b", "ovs_interfaceid": "db8b331f-9b3f-472b-968a-2151da14f567", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 17:19:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-abd4f64c-0980-45b3-bc56-221202ff25f3 req-6f799c21-434f-46ed-9fa5-9fa70971b37d service nova] Acquired lock "refresh_cache-789583c2-1c04-4510-a37e-0e9b7d3a0971" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:19:08 user nova-compute[74743]: DEBUG nova.network.neutron [req-abd4f64c-0980-45b3-bc56-221202ff25f3 req-6f799c21-434f-46ed-9fa5-9fa70971b37d service nova] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Refreshing network info cache for port db8b331f-9b3f-472b-968a-2151da14f567 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:19:08 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Start _get_guest_xml network_info=[{"id": "db8b331f-9b3f-472b-968a-2151da14f567", "address": "fa:16:3e:50:6a:16", "network": {"id": "1bbf6aff-4048-4212-a716-d0628575bfd0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc0fda74575d488a94e2dcfdc016598c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb8b331f-9b", "ovs_interfaceid": "db8b331f-9b3f-472b-968a-2151da14f567", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '9536f6cf-95c4-40e2-864a-09a91525678a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:19:08 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Found default for hw_cdrom_bus of ide {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:19:08 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Found default for hw_disk_bus of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:19:08 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Found default for hw_input_bus of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:19:08 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Found default for hw_pointer_model of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:19:08 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Found default for hw_video_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:19:08 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Found default for hw_vif_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:19:08 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:19:08 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:19:08 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:19:08 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:19:08 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:19:08 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:19:08 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:19:08 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:19:08 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:19:08 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:19:08 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:19:08 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:19:08 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:19:08 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:19:08 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:19:08 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:19:08 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:19:08 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:19:09 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:19:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1258737260',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1258737260',id=35,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc0fda74575d488a94e2dcfdc016598c',ramdisk_id='',reservation_id='r-obw0cpai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-633893051',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:19:07Z,user_data=None,user_id='5639bd2666534fdca04d0958dcdc9f54',uuid=789583c2-1c04-4510-a37e-0e9b7d3a0971,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db8b331f-9b3f-472b-968a-2151da14f567", "address": "fa:16:3e:50:6a:16", "network": {"id": "1bbf6aff-4048-4212-a716-d0628575bfd0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc0fda74575d488a94e2dcfdc016598c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb8b331f-9b", "ovs_interfaceid": "db8b331f-9b3f-472b-968a-2151da14f567", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:19:09 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Converting VIF {"id": "db8b331f-9b3f-472b-968a-2151da14f567", "address": "fa:16:3e:50:6a:16", "network": {"id": "1bbf6aff-4048-4212-a716-d0628575bfd0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc0fda74575d488a94e2dcfdc016598c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb8b331f-9b", "ovs_interfaceid": "db8b331f-9b3f-472b-968a-2151da14f567", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:19:09 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:6a:16,bridge_name='br-int',has_traffic_filtering=True,id=db8b331f-9b3f-472b-968a-2151da14f567,network=Network(1bbf6aff-4048-4212-a716-d0628575bfd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb8b331f-9b') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:19:09 user nova-compute[74743]: DEBUG nova.objects.instance [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lazy-loading 'pci_devices' on Instance uuid 789583c2-1c04-4510-a37e-0e9b7d3a0971 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:19:09 user nova-compute[74743]: INFO nova.compute.manager [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Took 6.46 seconds to spawn the instance on the hypervisor.
Nov 18 17:19:09 user nova-compute[74743]: DEBUG nova.compute.manager [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:19:09 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:19:09 user nova-compute[74743]:   <uuid>789583c2-1c04-4510-a37e-0e9b7d3a0971</uuid>
Nov 18 17:19:09 user nova-compute[74743]:   <name>instance-00000023</name>
Nov 18 17:19:09 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:19:09 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:19:09 user nova-compute[74743]:   <metadata>
Nov 18 17:19:09 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:19:09 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:19:09 user nova-compute[74743]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1258737260</nova:name>
Nov 18 17:19:09 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:19:08</nova:creationTime>
Nov 18 17:19:09 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:19:09 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:19:09 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:19:09 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:19:09 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:19:09 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:19:09 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:19:09 user nova-compute[74743]:       <nova:owner>
Nov 18 17:19:09 user nova-compute[74743]:         <nova:user uuid="5639bd2666534fdca04d0958dcdc9f54">tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member</nova:user>
Nov 18 17:19:09 user nova-compute[74743]:         <nova:project uuid="bc0fda74575d488a94e2dcfdc016598c">tempest-ServerBootFromVolumeStableRescueTest-633893051</nova:project>
Nov 18 17:19:09 user nova-compute[74743]:       </nova:owner>
Nov 18 17:19:09 user nova-compute[74743]:       <nova:root type="image" uuid="9536f6cf-95c4-40e2-864a-09a91525678a"/>
Nov 18 17:19:09 user nova-compute[74743]:       <nova:ports>
Nov 18 17:19:09 user nova-compute[74743]:         <nova:port uuid="db8b331f-9b3f-472b-968a-2151da14f567">
Nov 18 17:19:09 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 18 17:19:09 user nova-compute[74743]:         </nova:port>
Nov 18 17:19:09 user nova-compute[74743]:       </nova:ports>
Nov 18 17:19:09 user nova-compute[74743]:     </nova:instance>
Nov 18 17:19:09 user nova-compute[74743]:   </metadata>
Nov 18 17:19:09 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:19:09 user nova-compute[74743]:     <system>
Nov 18 17:19:09 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:19:09 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:19:09 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:19:09 user nova-compute[74743]:       <entry name="serial">789583c2-1c04-4510-a37e-0e9b7d3a0971</entry>
Nov 18 17:19:09 user nova-compute[74743]:       <entry name="uuid">789583c2-1c04-4510-a37e-0e9b7d3a0971</entry>
Nov 18 17:19:09 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:19:09 user nova-compute[74743]:     </system>
Nov 18 17:19:09 user nova-compute[74743]:   </sysinfo>
Nov 18 17:19:09 user nova-compute[74743]:   <os>
Nov 18 17:19:09 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:19:09 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:19:09 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:19:09 user nova-compute[74743]:   </os>
Nov 18 17:19:09 user nova-compute[74743]:   <features>
Nov 18 17:19:09 user nova-compute[74743]:     <acpi/>
Nov 18 17:19:09 user nova-compute[74743]:     <apic/>
Nov 18 17:19:09 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:19:09 user nova-compute[74743]:   </features>
Nov 18 17:19:09 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:19:09 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:19:09 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:19:09 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:19:09 user nova-compute[74743]:   </clock>
Nov 18 17:19:09 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:19:09 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:19:09 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:19:09 user nova-compute[74743]:   </cpu>
Nov 18 17:19:09 user nova-compute[74743]:   <devices>
Nov 18 17:19:09 user nova-compute[74743]:     <disk type="file" device="disk">
Nov 18 17:19:09 user nova-compute[74743]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 17:19:09 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/789583c2-1c04-4510-a37e-0e9b7d3a0971/disk"/>
Nov 18 17:19:09 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:19:09 user nova-compute[74743]:     </disk>
Nov 18 17:19:09 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:19:09 user nova-compute[74743]:       <mac address="fa:16:3e:50:6a:16"/>
Nov 18 17:19:09 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:19:09 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:19:09 user nova-compute[74743]:       <target dev="tapdb8b331f-9b"/>
Nov 18 17:19:09 user nova-compute[74743]:     </interface>
Nov 18 17:19:09 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:19:09 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/789583c2-1c04-4510-a37e-0e9b7d3a0971/console.log" append="off"/>
Nov 18 17:19:09 user nova-compute[74743]:     </serial>
Nov 18 17:19:09 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:19:09 user nova-compute[74743]:     <video>
Nov 18 17:19:09 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:19:09 user nova-compute[74743]:     </video>
Nov 18 17:19:09 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:19:09 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:19:09 user nova-compute[74743]:     </rng>
Nov 18 17:19:09 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:19:09 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:19:09 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:19:09 user nova-compute[74743]:     </memballoon>
Nov 18 17:19:09 user nova-compute[74743]:   </devices>
Nov 18 17:19:09 user nova-compute[74743]: </domain>
Nov 18 17:19:09 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:19:09 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:19:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1258737260',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1258737260',id=35,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc0fda74575d488a94e2dcfdc016598c',ramdisk_id='',reservation_id='r-obw0cpai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-633893051',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:19:07Z,user_data=None,user_id='5639bd2666534fdca04d0958dcdc9f54',uuid=789583c2-1c04-4510-a37e-0e9b7d3a0971,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db8b331f-9b3f-472b-968a-2151da14f567", "address": "fa:16:3e:50:6a:16", "network": {"id": "1bbf6aff-4048-4212-a716-d0628575bfd0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc0fda74575d488a94e2dcfdc016598c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb8b331f-9b", "ovs_interfaceid": "db8b331f-9b3f-472b-968a-2151da14f567", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:19:09 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Converting VIF {"id": "db8b331f-9b3f-472b-968a-2151da14f567", "address": "fa:16:3e:50:6a:16", "network": {"id": "1bbf6aff-4048-4212-a716-d0628575bfd0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc0fda74575d488a94e2dcfdc016598c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb8b331f-9b", "ovs_interfaceid": "db8b331f-9b3f-472b-968a-2151da14f567", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:19:09 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:6a:16,bridge_name='br-int',has_traffic_filtering=True,id=db8b331f-9b3f-472b-968a-2151da14f567,network=Network(1bbf6aff-4048-4212-a716-d0628575bfd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb8b331f-9b') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:19:09 user nova-compute[74743]: DEBUG os_vif [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:6a:16,bridge_name='br-int',has_traffic_filtering=True,id=db8b331f-9b3f-472b-968a-2151da14f567,network=Network(1bbf6aff-4048-4212-a716-d0628575bfd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb8b331f-9b') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:19:09 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:09 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:19:09 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:19:09 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:09 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd12b325b-7eb0-50a5-a0c5-b1f928a1053d', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:19:09 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:09 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:19:09 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:09 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb8b331f-9b, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:19:09 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdb8b331f-9b, col_values=(('qos', UUID('b2b0962a-66b5-4d27-b544-811b3e959532')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:19:09 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdb8b331f-9b, col_values=(('external_ids', {'iface-id': 'db8b331f-9b3f-472b-968a-2151da14f567', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:6a:16', 'vm-uuid': '789583c2-1c04-4510-a37e-0e9b7d3a0971'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:19:09 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:09 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:19:09 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:09 user nova-compute[74743]: INFO os_vif [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:6a:16,bridge_name='br-int',has_traffic_filtering=True,id=db8b331f-9b3f-472b-968a-2151da14f567,network=Network(1bbf6aff-4048-4212-a716-d0628575bfd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb8b331f-9b')
Nov 18 17:19:09 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:19:09 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] No VIF found with MAC fa:16:3e:50:6a:16, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:19:09 user nova-compute[74743]: INFO nova.compute.manager [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Took 7.22 seconds to build instance.
Nov 18 17:19:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-465fd60d-dd4b-4ac0-bac8-bd75ca574e4f tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "6aecacc3-577d-4b36-9223-8446afe54e26" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.324s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:19:09 user nova-compute[74743]: DEBUG nova.network.neutron [req-abd4f64c-0980-45b3-bc56-221202ff25f3 req-6f799c21-434f-46ed-9fa5-9fa70971b37d service nova] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Updated VIF entry in instance network info cache for port db8b331f-9b3f-472b-968a-2151da14f567. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:19:09 user nova-compute[74743]: DEBUG nova.network.neutron [req-abd4f64c-0980-45b3-bc56-221202ff25f3 req-6f799c21-434f-46ed-9fa5-9fa70971b37d service nova] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Updating instance_info_cache with network_info: [{"id": "db8b331f-9b3f-472b-968a-2151da14f567", "address": "fa:16:3e:50:6a:16", "network": {"id": "1bbf6aff-4048-4212-a716-d0628575bfd0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc0fda74575d488a94e2dcfdc016598c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb8b331f-9b", "ovs_interfaceid": "db8b331f-9b3f-472b-968a-2151da14f567", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:19:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-abd4f64c-0980-45b3-bc56-221202ff25f3 req-6f799c21-434f-46ed-9fa5-9fa70971b37d service nova] Releasing lock "refresh_cache-789583c2-1c04-4510-a37e-0e9b7d3a0971" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:19:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:11 user nova-compute[74743]: DEBUG nova.compute.manager [req-234f249d-7603-4871-8ed0-42dc1356350f req-490aad96-11ff-461c-bd1e-b73d5b17cfd0 service nova] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Received event network-vif-plugged-db8b331f-9b3f-472b-968a-2151da14f567 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:19:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-234f249d-7603-4871-8ed0-42dc1356350f req-490aad96-11ff-461c-bd1e-b73d5b17cfd0 service nova] Acquiring lock "789583c2-1c04-4510-a37e-0e9b7d3a0971-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:19:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-234f249d-7603-4871-8ed0-42dc1356350f req-490aad96-11ff-461c-bd1e-b73d5b17cfd0 service nova] Lock "789583c2-1c04-4510-a37e-0e9b7d3a0971-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:19:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-234f249d-7603-4871-8ed0-42dc1356350f req-490aad96-11ff-461c-bd1e-b73d5b17cfd0 service nova] Lock "789583c2-1c04-4510-a37e-0e9b7d3a0971-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:19:11 user nova-compute[74743]: DEBUG nova.compute.manager [req-234f249d-7603-4871-8ed0-42dc1356350f req-490aad96-11ff-461c-bd1e-b73d5b17cfd0 service nova] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] No waiting events found dispatching network-vif-plugged-db8b331f-9b3f-472b-968a-2151da14f567 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:19:11 user nova-compute[74743]: WARNING nova.compute.manager [req-234f249d-7603-4871-8ed0-42dc1356350f req-490aad96-11ff-461c-bd1e-b73d5b17cfd0 service nova] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Received unexpected event network-vif-plugged-db8b331f-9b3f-472b-968a-2151da14f567 for instance with vm_state building and task_state spawning.
Nov 18 17:19:13 user nova-compute[74743]: DEBUG nova.compute.manager [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:19:13 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Guest created on hypervisor {{(pid=74743) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 17:19:13 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Instance spawned successfully.
Nov 18 17:19:13 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 17:19:13 user nova-compute[74743]: DEBUG nova.compute.manager [req-50800f1d-6644-4e76-81e0-5ee7f9e70d19 req-9293666a-38e4-4342-89be-d5446f32f3fd service nova] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Received event network-vif-plugged-db8b331f-9b3f-472b-968a-2151da14f567 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:19:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-50800f1d-6644-4e76-81e0-5ee7f9e70d19 req-9293666a-38e4-4342-89be-d5446f32f3fd service nova] Acquiring lock "789583c2-1c04-4510-a37e-0e9b7d3a0971-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:19:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-50800f1d-6644-4e76-81e0-5ee7f9e70d19 req-9293666a-38e4-4342-89be-d5446f32f3fd service nova] Lock "789583c2-1c04-4510-a37e-0e9b7d3a0971-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:19:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-50800f1d-6644-4e76-81e0-5ee7f9e70d19 req-9293666a-38e4-4342-89be-d5446f32f3fd service nova] Lock "789583c2-1c04-4510-a37e-0e9b7d3a0971-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:19:13 user nova-compute[74743]: DEBUG nova.compute.manager [req-50800f1d-6644-4e76-81e0-5ee7f9e70d19 req-9293666a-38e4-4342-89be-d5446f32f3fd service nova] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] No waiting events found dispatching network-vif-plugged-db8b331f-9b3f-472b-968a-2151da14f567 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:19:13 user nova-compute[74743]: WARNING nova.compute.manager [req-50800f1d-6644-4e76-81e0-5ee7f9e70d19 req-9293666a-38e4-4342-89be-d5446f32f3fd service nova] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Received unexpected event network-vif-plugged-db8b331f-9b3f-472b-968a-2151da14f567 for instance with vm_state building and task_state spawning.
Nov 18 17:19:13 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Found default for hw_cdrom_bus of ide {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:19:13 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Found default for hw_disk_bus of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:19:13 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Found default for hw_input_bus of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:19:13 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Found default for hw_pointer_model of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:19:13 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Found default for hw_video_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:19:13 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Found default for hw_vif_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:19:13 user nova-compute[74743]: INFO nova.compute.manager [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Took 5.98 seconds to spawn the instance on the hypervisor.
Nov 18 17:19:13 user nova-compute[74743]: DEBUG nova.compute.manager [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:19:13 user nova-compute[74743]: INFO nova.compute.manager [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Took 6.92 seconds to build instance.
Nov 18 17:19:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f1342119-d596-4299-be04-a8537182f804 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "789583c2-1c04-4510-a37e-0e9b7d3a0971" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.038s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:19:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-74773e3b-f568-411f-a6bf-2727d014a95d tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Acquiring lock "e9668e1c-1e8d-4dd7-8f58-d453db294557" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:19:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-74773e3b-f568-411f-a6bf-2727d014a95d tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "e9668e1c-1e8d-4dd7-8f58-d453db294557" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:19:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-74773e3b-f568-411f-a6bf-2727d014a95d tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Acquiring lock "e9668e1c-1e8d-4dd7-8f58-d453db294557-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:19:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-74773e3b-f568-411f-a6bf-2727d014a95d tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "e9668e1c-1e8d-4dd7-8f58-d453db294557-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:19:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-74773e3b-f568-411f-a6bf-2727d014a95d tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "e9668e1c-1e8d-4dd7-8f58-d453db294557-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:19:15 user nova-compute[74743]: INFO nova.compute.manager [None req-74773e3b-f568-411f-a6bf-2727d014a95d tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Terminating instance
Nov 18 17:19:15 user nova-compute[74743]: DEBUG nova.compute.manager [None req-74773e3b-f568-411f-a6bf-2727d014a95d tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Start destroying the instance on the hypervisor. {{(pid=74743) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 17:19:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:16 user nova-compute[74743]: DEBUG nova.compute.manager [req-96b0176b-fd9c-4e9a-a498-6095dc7a4abf req-4df797a1-ec96-4340-bdde-c03b470dd5bd service nova] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Received event network-vif-unplugged-fcc120f5-04f4-4675-817c-5161cc09a972 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:19:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-96b0176b-fd9c-4e9a-a498-6095dc7a4abf req-4df797a1-ec96-4340-bdde-c03b470dd5bd service nova] Acquiring lock "e9668e1c-1e8d-4dd7-8f58-d453db294557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:19:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-96b0176b-fd9c-4e9a-a498-6095dc7a4abf req-4df797a1-ec96-4340-bdde-c03b470dd5bd service nova] Lock "e9668e1c-1e8d-4dd7-8f58-d453db294557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:19:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-96b0176b-fd9c-4e9a-a498-6095dc7a4abf req-4df797a1-ec96-4340-bdde-c03b470dd5bd service nova] Lock "e9668e1c-1e8d-4dd7-8f58-d453db294557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:19:16 user nova-compute[74743]: DEBUG nova.compute.manager [req-96b0176b-fd9c-4e9a-a498-6095dc7a4abf req-4df797a1-ec96-4340-bdde-c03b470dd5bd service nova] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] No waiting events found dispatching network-vif-unplugged-fcc120f5-04f4-4675-817c-5161cc09a972 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:19:16 user nova-compute[74743]: DEBUG nova.compute.manager [req-96b0176b-fd9c-4e9a-a498-6095dc7a4abf req-4df797a1-ec96-4340-bdde-c03b470dd5bd service nova] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Received event network-vif-unplugged-fcc120f5-04f4-4675-817c-5161cc09a972 for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:19:16 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Instance destroyed successfully.
Nov 18 17:19:16 user nova-compute[74743]: DEBUG nova.objects.instance [None req-74773e3b-f568-411f-a6bf-2727d014a95d tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lazy-loading 'resources' on Instance uuid e9668e1c-1e8d-4dd7-8f58-d453db294557 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:19:16 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-74773e3b-f568-411f-a6bf-2727d014a95d tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:03:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1341409759',display_name='tempest-ServerRescueNegativeTestJSON-server-1341409759',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1341409759',id=2,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:05:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='25c06dc8e7be46229750b8e283622c9b',ramdisk_id='',reservation_id='r-pxylybnj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-732707405',owner_user_name='tempest-ServerRescueNegativeTestJSON-732707405-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:05:08Z,user_data=None,user_id='1470478a455242f9ad92eaf95dc6a2f4',uuid=e9668e1c-1e8d-4dd7-8f58-d453db294557,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "fcc120f5-04f4-4675-817c-5161cc09a972", "address": "fa:16:3e:12:4a:34", "network": {"id": "252343cc-f379-471d-a2c9-99b9a60ebcb4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25c06dc8e7be46229750b8e283622c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc120f5-04", "ovs_interfaceid": "fcc120f5-04f4-4675-817c-5161cc09a972", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:19:16 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-74773e3b-f568-411f-a6bf-2727d014a95d tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Converting VIF {"id": "fcc120f5-04f4-4675-817c-5161cc09a972", "address": "fa:16:3e:12:4a:34", "network": {"id": "252343cc-f379-471d-a2c9-99b9a60ebcb4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25c06dc8e7be46229750b8e283622c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc120f5-04", "ovs_interfaceid": "fcc120f5-04f4-4675-817c-5161cc09a972", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:19:16 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-74773e3b-f568-411f-a6bf-2727d014a95d tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:4a:34,bridge_name='br-int',has_traffic_filtering=True,id=fcc120f5-04f4-4675-817c-5161cc09a972,network=Network(252343cc-f379-471d-a2c9-99b9a60ebcb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcc120f5-04') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:19:16 user nova-compute[74743]: DEBUG os_vif [None req-74773e3b-f568-411f-a6bf-2727d014a95d tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:4a:34,bridge_name='br-int',has_traffic_filtering=True,id=fcc120f5-04f4-4675-817c-5161cc09a972,network=Network(252343cc-f379-471d-a2c9-99b9a60ebcb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcc120f5-04') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:19:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfcc120f5-04, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:19:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c6e0acc0-b48e-4c08-b58f-b1e2e8840ae7) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:19:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:19:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:16 user nova-compute[74743]: INFO os_vif [None req-74773e3b-f568-411f-a6bf-2727d014a95d tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:4a:34,bridge_name='br-int',has_traffic_filtering=True,id=fcc120f5-04f4-4675-817c-5161cc09a972,network=Network(252343cc-f379-471d-a2c9-99b9a60ebcb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcc120f5-04')
Nov 18 17:19:16 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-74773e3b-f568-411f-a6bf-2727d014a95d tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Deleting instance files /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557_del
Nov 18 17:19:16 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-74773e3b-f568-411f-a6bf-2727d014a95d tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Deletion of /opt/stack/data/nova/instances/e9668e1c-1e8d-4dd7-8f58-d453db294557_del complete
Nov 18 17:19:16 user nova-compute[74743]: INFO nova.compute.manager [None req-74773e3b-f568-411f-a6bf-2727d014a95d tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 18 17:19:16 user nova-compute[74743]: DEBUG oslo.service.loopingcall [None req-74773e3b-f568-411f-a6bf-2727d014a95d tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74743) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 17:19:16 user nova-compute[74743]: DEBUG nova.compute.manager [-] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Deallocating network for instance {{(pid=74743) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 17:19:16 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] deallocate_for_instance() {{(pid=74743) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 17:19:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:17 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:19:17 user nova-compute[74743]: INFO nova.compute.manager [-] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Took 0.52 seconds to deallocate network for instance.
Nov 18 17:19:17 user nova-compute[74743]: DEBUG nova.compute.manager [req-ebda2f4c-6bc7-45fd-96c5-2c810328399e req-6fb6435a-889e-49f1-91ce-e24682590225 service nova] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Received event network-vif-deleted-fcc120f5-04f4-4675-817c-5161cc09a972 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:19:17 user nova-compute[74743]: INFO nova.compute.manager [req-ebda2f4c-6bc7-45fd-96c5-2c810328399e req-6fb6435a-889e-49f1-91ce-e24682590225 service nova] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Neutron deleted interface fcc120f5-04f4-4675-817c-5161cc09a972; detaching it from the instance and deleting it from the info cache
Nov 18 17:19:17 user nova-compute[74743]: DEBUG nova.network.neutron [req-ebda2f4c-6bc7-45fd-96c5-2c810328399e req-6fb6435a-889e-49f1-91ce-e24682590225 service nova] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:19:17 user nova-compute[74743]: DEBUG nova.compute.manager [req-ebda2f4c-6bc7-45fd-96c5-2c810328399e req-6fb6435a-889e-49f1-91ce-e24682590225 service nova] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Detach interface failed, port_id=fcc120f5-04f4-4675-817c-5161cc09a972, reason: Instance e9668e1c-1e8d-4dd7-8f58-d453db294557 could not be found. {{(pid=74743) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 17:19:17 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-74773e3b-f568-411f-a6bf-2727d014a95d tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:19:17 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-74773e3b-f568-411f-a6bf-2727d014a95d tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:19:17 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-74773e3b-f568-411f-a6bf-2727d014a95d tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:19:17 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-74773e3b-f568-411f-a6bf-2727d014a95d tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:19:17 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-74773e3b-f568-411f-a6bf-2727d014a95d tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.387s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:19:17 user nova-compute[74743]: INFO nova.scheduler.client.report [None req-74773e3b-f568-411f-a6bf-2727d014a95d tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Deleted allocations for instance e9668e1c-1e8d-4dd7-8f58-d453db294557
Nov 18 17:19:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-74773e3b-f568-411f-a6bf-2727d014a95d tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "e9668e1c-1e8d-4dd7-8f58-d453db294557" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.099s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:19:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-ede33729-f55c-436b-a3c5-385bb85b8c54 req-8dd06b4e-2fa7-4b3a-934a-346b31d07f33 service nova] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Received event network-vif-plugged-fcc120f5-04f4-4675-817c-5161cc09a972 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:19:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ede33729-f55c-436b-a3c5-385bb85b8c54 req-8dd06b4e-2fa7-4b3a-934a-346b31d07f33 service nova] Acquiring lock "e9668e1c-1e8d-4dd7-8f58-d453db294557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:19:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ede33729-f55c-436b-a3c5-385bb85b8c54 req-8dd06b4e-2fa7-4b3a-934a-346b31d07f33 service nova] Lock "e9668e1c-1e8d-4dd7-8f58-d453db294557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:19:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ede33729-f55c-436b-a3c5-385bb85b8c54 req-8dd06b4e-2fa7-4b3a-934a-346b31d07f33 service nova] Lock "e9668e1c-1e8d-4dd7-8f58-d453db294557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:19:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-ede33729-f55c-436b-a3c5-385bb85b8c54 req-8dd06b4e-2fa7-4b3a-934a-346b31d07f33 service nova] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] No waiting events found dispatching network-vif-plugged-fcc120f5-04f4-4675-817c-5161cc09a972 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:19:18 user nova-compute[74743]: WARNING nova.compute.manager [req-ede33729-f55c-436b-a3c5-385bb85b8c54 req-8dd06b4e-2fa7-4b3a-934a-346b31d07f33 service nova] [instance: e9668e1c-1e8d-4dd7-8f58-d453db294557] Received unexpected event network-vif-plugged-fcc120f5-04f4-4675-817c-5161cc09a972 for instance with vm_state deleted and task_state None.
Nov 18 17:19:19 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:19:19 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Cleaning up deleted instances {{(pid=74743) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 18 17:19:19 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] There are 0 instances to clean {{(pid=74743) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 18 17:19:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:24 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8d673e75-5732-40aa-997c-b3c7144a0da7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Acquiring lock "f41ad39c-15fd-42e2-9ad6-ed5cd25e25de" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:19:24 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8d673e75-5732-40aa-997c-b3c7144a0da7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "f41ad39c-15fd-42e2-9ad6-ed5cd25e25de" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:19:24 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8d673e75-5732-40aa-997c-b3c7144a0da7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Acquiring lock "f41ad39c-15fd-42e2-9ad6-ed5cd25e25de-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:19:24 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8d673e75-5732-40aa-997c-b3c7144a0da7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "f41ad39c-15fd-42e2-9ad6-ed5cd25e25de-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:19:24 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8d673e75-5732-40aa-997c-b3c7144a0da7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "f41ad39c-15fd-42e2-9ad6-ed5cd25e25de-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:19:24 user nova-compute[74743]: INFO nova.compute.manager [None req-8d673e75-5732-40aa-997c-b3c7144a0da7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Terminating instance
Nov 18 17:19:24 user nova-compute[74743]: DEBUG nova.compute.manager [None req-8d673e75-5732-40aa-997c-b3c7144a0da7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Start destroying the instance on the hypervisor. {{(pid=74743) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 17:19:24 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:24 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:24 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:24 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:24 user nova-compute[74743]: DEBUG nova.compute.manager [req-3e40c404-d507-4f88-9dad-d6405cea6dc0 req-f062c520-81f8-43a8-9b70-61db18d40301 service nova] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Received event network-vif-unplugged-3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:19:24 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3e40c404-d507-4f88-9dad-d6405cea6dc0 req-f062c520-81f8-43a8-9b70-61db18d40301 service nova] Acquiring lock "f41ad39c-15fd-42e2-9ad6-ed5cd25e25de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:19:24 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3e40c404-d507-4f88-9dad-d6405cea6dc0 req-f062c520-81f8-43a8-9b70-61db18d40301 service nova] Lock "f41ad39c-15fd-42e2-9ad6-ed5cd25e25de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:19:24 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3e40c404-d507-4f88-9dad-d6405cea6dc0 req-f062c520-81f8-43a8-9b70-61db18d40301 service nova] Lock "f41ad39c-15fd-42e2-9ad6-ed5cd25e25de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:19:24 user nova-compute[74743]: DEBUG nova.compute.manager [req-3e40c404-d507-4f88-9dad-d6405cea6dc0 req-f062c520-81f8-43a8-9b70-61db18d40301 service nova] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] No waiting events found dispatching network-vif-unplugged-3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:19:24 user nova-compute[74743]: DEBUG nova.compute.manager [req-3e40c404-d507-4f88-9dad-d6405cea6dc0 req-f062c520-81f8-43a8-9b70-61db18d40301 service nova] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Received event network-vif-unplugged-3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5 for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:19:25 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Instance destroyed successfully.
Nov 18 17:19:25 user nova-compute[74743]: DEBUG nova.objects.instance [None req-8d673e75-5732-40aa-997c-b3c7144a0da7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lazy-loading 'resources' on Instance uuid f41ad39c-15fd-42e2-9ad6-ed5cd25e25de {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:19:25 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-8d673e75-5732-40aa-997c-b3c7144a0da7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-18T17:12:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1872287329',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1872287329',id=28,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFeAf5pe/SM9rbt1HiXBv/Qy4kx4IdHwG3fexElEhkBcZPfKQFDg+/NTyRMqyRqYDaJEZ/lV9IRH0FTea8siiY9i8r4fxRG+ACR/2qEf8DIIhRuTvTaRMqurC/OE1FYk5Q==',key_name='tempest-keypair-257871102',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:17:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0a17803c613c4ef299c797bba85c1a4b',ramdisk_id='',reservation_id='r-wl7d2o6y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-13499029',owner_user_name='tempest-AttachVolumeShelveTestJSON-13499029-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:17:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18483ad6106b4d95afbbed450d625b53',uuid=f41ad39c-15fd-42e2-9ad6-ed5cd25e25de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5", "address": "fa:16:3e:0e:63:d2", "network": {"id": "e1c28f74-c9c1-4eb3-931e-003332ff6243", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-453481916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a17803c613c4ef299c797bba85c1a4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d1781f8-f4", "ovs_interfaceid": "3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:19:25 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-8d673e75-5732-40aa-997c-b3c7144a0da7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Converting VIF {"id": "3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5", "address": "fa:16:3e:0e:63:d2", "network": {"id": "e1c28f74-c9c1-4eb3-931e-003332ff6243", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-453481916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a17803c613c4ef299c797bba85c1a4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d1781f8-f4", "ovs_interfaceid": "3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:19:25 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-8d673e75-5732-40aa-997c-b3c7144a0da7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:63:d2,bridge_name='br-int',has_traffic_filtering=True,id=3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5,network=Network(e1c28f74-c9c1-4eb3-931e-003332ff6243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d1781f8-f4') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:19:25 user nova-compute[74743]: DEBUG os_vif [None req-8d673e75-5732-40aa-997c-b3c7144a0da7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:63:d2,bridge_name='br-int',has_traffic_filtering=True,id=3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5,network=Network(e1c28f74-c9c1-4eb3-931e-003332ff6243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d1781f8-f4') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:19:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d1781f8-f4, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:19:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:19:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=10453c1d-83c7-46b7-b403-c9b8c793eb91) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:19:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:25 user nova-compute[74743]: INFO os_vif [None req-8d673e75-5732-40aa-997c-b3c7144a0da7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:63:d2,bridge_name='br-int',has_traffic_filtering=True,id=3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5,network=Network(e1c28f74-c9c1-4eb3-931e-003332ff6243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d1781f8-f4')
Nov 18 17:19:25 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-8d673e75-5732-40aa-997c-b3c7144a0da7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Deleting instance files /opt/stack/data/nova/instances/f41ad39c-15fd-42e2-9ad6-ed5cd25e25de_del
Nov 18 17:19:25 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-8d673e75-5732-40aa-997c-b3c7144a0da7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Deletion of /opt/stack/data/nova/instances/f41ad39c-15fd-42e2-9ad6-ed5cd25e25de_del complete
Nov 18 17:19:25 user nova-compute[74743]: INFO nova.compute.manager [None req-8d673e75-5732-40aa-997c-b3c7144a0da7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 18 17:19:25 user nova-compute[74743]: DEBUG oslo.service.loopingcall [None req-8d673e75-5732-40aa-997c-b3c7144a0da7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74743) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 17:19:25 user nova-compute[74743]: DEBUG nova.compute.manager [-] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Deallocating network for instance {{(pid=74743) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 17:19:25 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] deallocate_for_instance() {{(pid=74743) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 17:19:26 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:19:26 user nova-compute[74743]: INFO nova.compute.manager [-] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Took 0.79 seconds to deallocate network for instance.
Nov 18 17:19:26 user nova-compute[74743]: DEBUG nova.compute.manager [req-29809f15-96b9-4927-8dda-3c64d2cacd94 req-fd810364-ab91-436c-93e9-bdbfb5f6acae service nova] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Received event network-vif-deleted-3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:19:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8d673e75-5732-40aa-997c-b3c7144a0da7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:19:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8d673e75-5732-40aa-997c-b3c7144a0da7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:19:26 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-8d673e75-5732-40aa-997c-b3c7144a0da7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:19:26 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-8d673e75-5732-40aa-997c-b3c7144a0da7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:19:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8d673e75-5732-40aa-997c-b3c7144a0da7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.305s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:19:26 user nova-compute[74743]: INFO nova.scheduler.client.report [None req-8d673e75-5732-40aa-997c-b3c7144a0da7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Deleted allocations for instance f41ad39c-15fd-42e2-9ad6-ed5cd25e25de
Nov 18 17:19:26 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:19:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8d673e75-5732-40aa-997c-b3c7144a0da7 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "f41ad39c-15fd-42e2-9ad6-ed5cd25e25de" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.136s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:19:26 user nova-compute[74743]: DEBUG nova.compute.manager [req-5585799d-706c-446d-8047-79a16f24df6d req-963ec073-00bb-4a3e-a8fd-583f24157237 service nova] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Received event network-vif-plugged-3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:19:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-5585799d-706c-446d-8047-79a16f24df6d req-963ec073-00bb-4a3e-a8fd-583f24157237 service nova] Acquiring lock "f41ad39c-15fd-42e2-9ad6-ed5cd25e25de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:19:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-5585799d-706c-446d-8047-79a16f24df6d req-963ec073-00bb-4a3e-a8fd-583f24157237 service nova] Lock "f41ad39c-15fd-42e2-9ad6-ed5cd25e25de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:19:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-5585799d-706c-446d-8047-79a16f24df6d req-963ec073-00bb-4a3e-a8fd-583f24157237 service nova] Lock "f41ad39c-15fd-42e2-9ad6-ed5cd25e25de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:19:26 user nova-compute[74743]: DEBUG nova.compute.manager [req-5585799d-706c-446d-8047-79a16f24df6d req-963ec073-00bb-4a3e-a8fd-583f24157237 service nova] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] No waiting events found dispatching network-vif-plugged-3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:19:26 user nova-compute[74743]: WARNING nova.compute.manager [req-5585799d-706c-446d-8047-79a16f24df6d req-963ec073-00bb-4a3e-a8fd-583f24157237 service nova] [instance: f41ad39c-15fd-42e2-9ad6-ed5cd25e25de] Received unexpected event network-vif-plugged-3d1781f8-f45b-4ea4-b7c5-e3bba08dd2f5 for instance with vm_state deleted and task_state None.
Nov 18 17:19:27 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:19:28 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:19:29 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:19:29 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74743) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 17:19:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:31 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:19:31 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Starting heal instance info cache {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 17:19:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "refresh_cache-f649143e-f7db-475a-bbe5-d5e7316caac3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:19:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquired lock "refresh_cache-f649143e-f7db-475a-bbe5-d5e7316caac3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:19:31 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Forcefully refreshing network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 17:19:32 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Updating instance_info_cache with network_info: [{"id": "494b363a-ab2e-4efc-9331-d2b303860a08", "address": "fa:16:3e:e7:77:41", "network": {"id": "1bbf6aff-4048-4212-a716-d0628575bfd0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc0fda74575d488a94e2dcfdc016598c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494b363a-ab", "ovs_interfaceid": "494b363a-ab2e-4efc-9331-d2b303860a08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:19:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Releasing lock "refresh_cache-f649143e-f7db-475a-bbe5-d5e7316caac3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:19:32 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Updated the network info_cache for instance {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 17:19:32 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:19:32 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:19:33 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:19:34 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:19:34 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:19:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:19:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:19:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:19:34 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Auditing locally available compute resources for user (node: user) {{(pid=74743) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 17:19:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/789583c2-1c04-4510-a37e-0e9b7d3a0971/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:19:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/789583c2-1c04-4510-a37e-0e9b7d3a0971/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:19:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/789583c2-1c04-4510-a37e-0e9b7d3a0971/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:19:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/789583c2-1c04-4510-a37e-0e9b7d3a0971/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:19:34 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:19:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:19:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:19:35 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:19:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:19:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:19:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:19:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:19:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:19:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:19:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:19:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:19:36 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:19:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b67d5fc-3753-4c5a-8477-e46315d9b2c2/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:19:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b67d5fc-3753-4c5a-8477-e46315d9b2c2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:19:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b67d5fc-3753-4c5a-8477-e46315d9b2c2/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:19:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b67d5fc-3753-4c5a-8477-e46315d9b2c2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:19:36 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:19:36 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:19:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aecacc3-577d-4b36-9223-8446afe54e26/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:19:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aecacc3-577d-4b36-9223-8446afe54e26/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:19:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aecacc3-577d-4b36-9223-8446afe54e26/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:19:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aecacc3-577d-4b36-9223-8446afe54e26/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:19:37 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:19:37 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:19:37 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Hypervisor/Node resource view: name=user free_ram=7753MB free_disk=25.27877426147461GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74743) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 17:19:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:19:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:19:37 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 4cce1628-2dcb-40c7-abd4-6a327a432de3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:19:37 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance c006a4ad-a8e2-4108-9af1-dec4dd53fcda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:19:37 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance aefe3db1-b9bb-4cce-aa31-d0b6684ad791 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:19:37 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance f649143e-f7db-475a-bbe5-d5e7316caac3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:19:37 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 2b67d5fc-3753-4c5a-8477-e46315d9b2c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:19:37 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 69d78ecf-740d-492a-be5b-ffd064e36f00 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:19:37 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:19:37 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 6aecacc3-577d-4b36-9223-8446afe54e26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:19:37 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 789583c2-1c04-4510-a37e-0e9b7d3a0971 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:19:37 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 17:19:37 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 17:19:37 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Refreshing inventories for resource provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 18 17:19:37 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Updating ProviderTree inventory for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 18 17:19:37 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Updating inventory in ProviderTree for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 18 17:19:37 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Refreshing aggregate associations for resource provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8, aggregates: None {{(pid=74743) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 18 17:19:37 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Refreshing trait associations for resource provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=74743) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 18 17:19:37 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:19:37 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:19:37 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Compute_service record updated for user:user {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 17:19:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.577s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:19:37 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:19:37 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Cleaning up deleted instances with incomplete migration  {{(pid=74743) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 18 17:19:38 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:19:40 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:40 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:42 user nova-compute[74743]: DEBUG nova.compute.manager [req-6defb6fb-ee01-4573-ba8f-4c6b123c211f req-dbc2ad91-68a5-4405-af31-4684473e8490 service nova] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Received event network-changed-2bb302cf-a68c-46c1-b2da-fc264a18bec2 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:19:42 user nova-compute[74743]: DEBUG nova.compute.manager [req-6defb6fb-ee01-4573-ba8f-4c6b123c211f req-dbc2ad91-68a5-4405-af31-4684473e8490 service nova] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Refreshing instance network info cache due to event network-changed-2bb302cf-a68c-46c1-b2da-fc264a18bec2. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:19:42 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-6defb6fb-ee01-4573-ba8f-4c6b123c211f req-dbc2ad91-68a5-4405-af31-4684473e8490 service nova] Acquiring lock "refresh_cache-8a6a8a09-fb67-46b8-b5a1-b443213ae8a2" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:19:42 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-6defb6fb-ee01-4573-ba8f-4c6b123c211f req-dbc2ad91-68a5-4405-af31-4684473e8490 service nova] Acquired lock "refresh_cache-8a6a8a09-fb67-46b8-b5a1-b443213ae8a2" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:19:42 user nova-compute[74743]: DEBUG nova.network.neutron [req-6defb6fb-ee01-4573-ba8f-4c6b123c211f req-dbc2ad91-68a5-4405-af31-4684473e8490 service nova] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Refreshing network info cache for port 2bb302cf-a68c-46c1-b2da-fc264a18bec2 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:19:43 user nova-compute[74743]: DEBUG nova.network.neutron [req-6defb6fb-ee01-4573-ba8f-4c6b123c211f req-dbc2ad91-68a5-4405-af31-4684473e8490 service nova] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Updated VIF entry in instance network info cache for port 2bb302cf-a68c-46c1-b2da-fc264a18bec2. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:19:43 user nova-compute[74743]: DEBUG nova.network.neutron [req-6defb6fb-ee01-4573-ba8f-4c6b123c211f req-dbc2ad91-68a5-4405-af31-4684473e8490 service nova] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Updating instance_info_cache with network_info: [{"id": "2bb302cf-a68c-46c1-b2da-fc264a18bec2", "address": "fa:16:3e:e7:3a:5a", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb302cf-a6", "ovs_interfaceid": "2bb302cf-a68c-46c1-b2da-fc264a18bec2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:19:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-6defb6fb-ee01-4573-ba8f-4c6b123c211f req-dbc2ad91-68a5-4405-af31-4684473e8490 service nova] Releasing lock "refresh_cache-8a6a8a09-fb67-46b8-b5a1-b443213ae8a2" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:19:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-502d8406-2512-4207-a011-c250d285ebb0 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "8a6a8a09-fb67-46b8-b5a1-b443213ae8a2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:19:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-502d8406-2512-4207-a011-c250d285ebb0 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "8a6a8a09-fb67-46b8-b5a1-b443213ae8a2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:19:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-502d8406-2512-4207-a011-c250d285ebb0 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "8a6a8a09-fb67-46b8-b5a1-b443213ae8a2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:19:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-502d8406-2512-4207-a011-c250d285ebb0 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "8a6a8a09-fb67-46b8-b5a1-b443213ae8a2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:19:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-502d8406-2512-4207-a011-c250d285ebb0 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "8a6a8a09-fb67-46b8-b5a1-b443213ae8a2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:19:43 user nova-compute[74743]: INFO nova.compute.manager [None req-502d8406-2512-4207-a011-c250d285ebb0 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Terminating instance
Nov 18 17:19:43 user nova-compute[74743]: DEBUG nova.compute.manager [None req-502d8406-2512-4207-a011-c250d285ebb0 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Start destroying the instance on the hypervisor. {{(pid=74743) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 17:19:43 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:43 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:43 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:43 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:43 user nova-compute[74743]: DEBUG nova.compute.manager [req-887ffa5f-691d-4e28-9851-54dd814395b2 req-8d534d6a-6e19-4792-a81d-6ba1b4d73b33 service nova] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Received event network-vif-unplugged-2bb302cf-a68c-46c1-b2da-fc264a18bec2 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:19:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-887ffa5f-691d-4e28-9851-54dd814395b2 req-8d534d6a-6e19-4792-a81d-6ba1b4d73b33 service nova] Acquiring lock "8a6a8a09-fb67-46b8-b5a1-b443213ae8a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:19:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-887ffa5f-691d-4e28-9851-54dd814395b2 req-8d534d6a-6e19-4792-a81d-6ba1b4d73b33 service nova] Lock "8a6a8a09-fb67-46b8-b5a1-b443213ae8a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:19:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-887ffa5f-691d-4e28-9851-54dd814395b2 req-8d534d6a-6e19-4792-a81d-6ba1b4d73b33 service nova] Lock "8a6a8a09-fb67-46b8-b5a1-b443213ae8a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:19:43 user nova-compute[74743]: DEBUG nova.compute.manager [req-887ffa5f-691d-4e28-9851-54dd814395b2 req-8d534d6a-6e19-4792-a81d-6ba1b4d73b33 service nova] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] No waiting events found dispatching network-vif-unplugged-2bb302cf-a68c-46c1-b2da-fc264a18bec2 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:19:43 user nova-compute[74743]: DEBUG nova.compute.manager [req-887ffa5f-691d-4e28-9851-54dd814395b2 req-8d534d6a-6e19-4792-a81d-6ba1b4d73b33 service nova] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Received event network-vif-unplugged-2bb302cf-a68c-46c1-b2da-fc264a18bec2 for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:19:43 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:43 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:43 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:43 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Instance destroyed successfully.
Nov 18 17:19:43 user nova-compute[74743]: DEBUG nova.objects.instance [None req-502d8406-2512-4207-a011-c250d285ebb0 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lazy-loading 'resources' on Instance uuid 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-502d8406-2512-4207-a011-c250d285ebb0 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:17:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-211306172',display_name='tempest-TestVolumeBootPattern-server-211306172',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-211306172',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOLvs8QktAbg6ubYzS1yyIzjK6/SEgIlSEhHuVaKm0b6bpmV4klO8yadOBEcp58HtUXwfad9vILFBUP0iHELOBhABjjRYYSI0ECkBhwEERqTkNNauBgT8rgOot2Bwx6w0A==',key_name='tempest-TestVolumeBootPattern-2140749553',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:18:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a956c4d6e4304d34872ecf989279c886',ramdisk_id='',reservation_id='r-85gurwip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1373443944',owner_user_name='tempest-TestVolumeBootPattern-1373443944-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:18:02Z,user_data=None,user_id='89ce0d4bf7234c348b9b1a8979609c7b',uuid=8a6a8a09-fb67-46b8-b5a1-b443213ae8a2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2bb302cf-a68c-46c1-b2da-fc264a18bec2", "address": "fa:16:3e:e7:3a:5a", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb302cf-a6", "ovs_interfaceid": "2bb302cf-a68c-46c1-b2da-fc264a18bec2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-502d8406-2512-4207-a011-c250d285ebb0 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Converting VIF {"id": "2bb302cf-a68c-46c1-b2da-fc264a18bec2", "address": "fa:16:3e:e7:3a:5a", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb302cf-a6", "ovs_interfaceid": "2bb302cf-a68c-46c1-b2da-fc264a18bec2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-502d8406-2512-4207-a011-c250d285ebb0 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:3a:5a,bridge_name='br-int',has_traffic_filtering=True,id=2bb302cf-a68c-46c1-b2da-fc264a18bec2,network=Network(fc55f18a-b779-4b04-8828-278ecd62211a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bb302cf-a6') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG os_vif [None req-502d8406-2512-4207-a011-c250d285ebb0 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:3a:5a,bridge_name='br-int',has_traffic_filtering=True,id=2bb302cf-a68c-46c1-b2da-fc264a18bec2,network=Network(fc55f18a-b779-4b04-8828-278ecd62211a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bb302cf-a6') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2bb302cf-a6, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e424fdde-361e-49b2-9c02-bc81a5b57157) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:19:44 user nova-compute[74743]: INFO os_vif [None req-502d8406-2512-4207-a011-c250d285ebb0 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:3a:5a,bridge_name='br-int',has_traffic_filtering=True,id=2bb302cf-a68c-46c1-b2da-fc264a18bec2,network=Network(fc55f18a-b779-4b04-8828-278ecd62211a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bb302cf-a6')
Nov 18 17:19:44 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-502d8406-2512-4207-a011-c250d285ebb0 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] calling os-brick to detach iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-502d8406-2512-4207-a011-c250d285ebb0 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, {'target_iqn': 'iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cGqFNkMi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:19:44 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-502d8406-2512-4207-a011-c250d285ebb0 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:19:44 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-502d8406-2512-4207-a011-c250d285ebb0 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-502d8406-2512-4207-a011-c250d285ebb0 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[75fca168-15c3-484e-b4e1-f266a45a8351]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-502d8406-2512-4207-a011-c250d285ebb0 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 17:19:44 user nova-compute[74743]: No targets found.
Nov 18 17:19:44 user nova-compute[74743]: iSNS:
Nov 18 17:19:44 user nova-compute[74743]: No targets found.
Nov 18 17:19:44 user nova-compute[74743]: STATIC:
Nov 18 17:19:44 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f
Nov 18 17:19:44 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:19:44 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:19:44 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127
Nov 18 17:19:44 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:19:44 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:19:44 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2
Nov 18 17:19:44 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:19:44 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:19:44 user nova-compute[74743]: FIRMWARE:
Nov 18 17:19:44 user nova-compute[74743]: No targets found.
Nov 18 17:19:44 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-502d8406-2512-4207-a011-c250d285ebb0 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 17:19:44 user nova-compute[74743]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 17:19:44 user nova-compute[74743]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74743) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-502d8406-2512-4207-a011-c250d285ebb0 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2', 0)] {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[735449b4-c64c-469a-8a53-6a90d5fe4a0a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a11e1f-5806-47c7-8dda-737d36ef86d2]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-502d8406-2512-4207-a011-c250d285ebb0 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:19:44 user nova-compute[74743]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)
Nov 18 17:19:44 user nova-compute[74743]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 (non-flash)
Nov 18 17:19:44 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-502d8406-2512-4207-a011-c250d285ebb0 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:19:44 user nova-compute[74743]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)
Nov 18 17:19:44 user nova-compute[74743]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 (non-flash)
Nov 18 17:19:44 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-502d8406-2512-4207-a011-c250d285ebb0 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb08366710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2'): ({'sdd'}, set())}) {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-502d8406-2512-4207-a011-c250d285ebb0 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Removing single pathed devices sdd {{(pid=74743) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[874bccc9-3ef0-4cd8-9479-b673fd8a4c8b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.031s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[205e805d-053e-47d1-a06a-1594d8615b20]: (4, ('ok\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-502d8406-2512-4207-a011-c250d285ebb0 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Flushing IO for device /dev/sdd {{(pid=74743) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fb7000-2698-4648-9992-29594d9a8e15]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-502d8406-2512-4207-a011-c250d285ebb0 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74743) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.061s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d06ebc-3b95-4a8a-bff9-5eb81e7d9b0e]: (4, ('1', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-502d8406-2512-4207-a011-c250d285ebb0 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-502d8406-2512-4207-a011-c250d285ebb0 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] SCSI volumes sdd have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-502d8406-2512-4207-a011-c250d285ebb0 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2')] {{(pid=74743) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cfcc9b8-b0fe-4d4b-882b-ef7403ef82b6]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-502d8406-2512-4207-a011-c250d285ebb0 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 -p 172.16.0.220:3260 --logout {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e6b6b8-24dd-4f4d-8674-71f7715c0831]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-502d8406-2512-4207-a011-c250d285ebb0 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2, portal: 172.16.0.220,3260]
Nov 18 17:19:44 user nova-compute[74743]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2, portal: 172.16.0.220,3260] successful.
Nov 18 17:19:44 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 -p 172.16.0.220:3260 --op delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d4f2ef-34d5-41ac-a724-cd91550ff7b6]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-502d8406-2512-4207-a011-c250d285ebb0 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-502d8406-2512-4207-a011-c250d285ebb0 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.381s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-502d8406-2512-4207-a011-c250d285ebb0 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] <== disconnect_volume: return (382ms) None {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-502d8406-2512-4207-a011-c250d285ebb0 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Disconnected iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 17:19:44 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-502d8406-2512-4207-a011-c250d285ebb0 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Deleting instance files /opt/stack/data/nova/instances/8a6a8a09-fb67-46b8-b5a1-b443213ae8a2_del
Nov 18 17:19:44 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-502d8406-2512-4207-a011-c250d285ebb0 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Deletion of /opt/stack/data/nova/instances/8a6a8a09-fb67-46b8-b5a1-b443213ae8a2_del complete
Nov 18 17:19:44 user nova-compute[74743]: INFO nova.compute.manager [None req-502d8406-2512-4207-a011-c250d285ebb0 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Took 1.32 seconds to destroy the instance on the hypervisor.
Nov 18 17:19:44 user nova-compute[74743]: DEBUG oslo.service.loopingcall [None req-502d8406-2512-4207-a011-c250d285ebb0 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74743) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG nova.compute.manager [-] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Deallocating network for instance {{(pid=74743) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] deallocate_for_instance() {{(pid=74743) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:44 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:45 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:45 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:19:45 user nova-compute[74743]: INFO nova.compute.manager [-] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Took 0.91 seconds to deallocate network for instance.
Nov 18 17:19:45 user nova-compute[74743]: DEBUG nova.compute.manager [req-9f261393-9485-4deb-a417-e62680eda003 req-b1db7354-17e6-4d70-bd6e-b6fc050fb123 service nova] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Received event network-vif-plugged-2bb302cf-a68c-46c1-b2da-fc264a18bec2 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:19:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-9f261393-9485-4deb-a417-e62680eda003 req-b1db7354-17e6-4d70-bd6e-b6fc050fb123 service nova] Acquiring lock "8a6a8a09-fb67-46b8-b5a1-b443213ae8a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:19:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-9f261393-9485-4deb-a417-e62680eda003 req-b1db7354-17e6-4d70-bd6e-b6fc050fb123 service nova] Lock "8a6a8a09-fb67-46b8-b5a1-b443213ae8a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:19:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-9f261393-9485-4deb-a417-e62680eda003 req-b1db7354-17e6-4d70-bd6e-b6fc050fb123 service nova] Lock "8a6a8a09-fb67-46b8-b5a1-b443213ae8a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:19:45 user nova-compute[74743]: DEBUG nova.compute.manager [req-9f261393-9485-4deb-a417-e62680eda003 req-b1db7354-17e6-4d70-bd6e-b6fc050fb123 service nova] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] No waiting events found dispatching network-vif-plugged-2bb302cf-a68c-46c1-b2da-fc264a18bec2 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:19:45 user nova-compute[74743]: WARNING nova.compute.manager [req-9f261393-9485-4deb-a417-e62680eda003 req-b1db7354-17e6-4d70-bd6e-b6fc050fb123 service nova] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Received unexpected event network-vif-plugged-2bb302cf-a68c-46c1-b2da-fc264a18bec2 for instance with vm_state active and task_state deleting.
Nov 18 17:19:45 user nova-compute[74743]: DEBUG nova.compute.manager [req-9f261393-9485-4deb-a417-e62680eda003 req-b1db7354-17e6-4d70-bd6e-b6fc050fb123 service nova] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Received event network-vif-plugged-2bb302cf-a68c-46c1-b2da-fc264a18bec2 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:19:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-9f261393-9485-4deb-a417-e62680eda003 req-b1db7354-17e6-4d70-bd6e-b6fc050fb123 service nova] Acquiring lock "8a6a8a09-fb67-46b8-b5a1-b443213ae8a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:19:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-9f261393-9485-4deb-a417-e62680eda003 req-b1db7354-17e6-4d70-bd6e-b6fc050fb123 service nova] Lock "8a6a8a09-fb67-46b8-b5a1-b443213ae8a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:19:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-9f261393-9485-4deb-a417-e62680eda003 req-b1db7354-17e6-4d70-bd6e-b6fc050fb123 service nova] Lock "8a6a8a09-fb67-46b8-b5a1-b443213ae8a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:19:45 user nova-compute[74743]: DEBUG nova.compute.manager [req-9f261393-9485-4deb-a417-e62680eda003 req-b1db7354-17e6-4d70-bd6e-b6fc050fb123 service nova] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] No waiting events found dispatching network-vif-plugged-2bb302cf-a68c-46c1-b2da-fc264a18bec2 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:19:45 user nova-compute[74743]: WARNING nova.compute.manager [req-9f261393-9485-4deb-a417-e62680eda003 req-b1db7354-17e6-4d70-bd6e-b6fc050fb123 service nova] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Received unexpected event network-vif-plugged-2bb302cf-a68c-46c1-b2da-fc264a18bec2 for instance with vm_state active and task_state deleting.
Nov 18 17:19:45 user nova-compute[74743]: DEBUG nova.compute.manager [req-9f261393-9485-4deb-a417-e62680eda003 req-b1db7354-17e6-4d70-bd6e-b6fc050fb123 service nova] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Received event network-vif-plugged-2bb302cf-a68c-46c1-b2da-fc264a18bec2 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:19:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-9f261393-9485-4deb-a417-e62680eda003 req-b1db7354-17e6-4d70-bd6e-b6fc050fb123 service nova] Acquiring lock "8a6a8a09-fb67-46b8-b5a1-b443213ae8a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:19:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-9f261393-9485-4deb-a417-e62680eda003 req-b1db7354-17e6-4d70-bd6e-b6fc050fb123 service nova] Lock "8a6a8a09-fb67-46b8-b5a1-b443213ae8a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:19:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-9f261393-9485-4deb-a417-e62680eda003 req-b1db7354-17e6-4d70-bd6e-b6fc050fb123 service nova] Lock "8a6a8a09-fb67-46b8-b5a1-b443213ae8a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:19:45 user nova-compute[74743]: DEBUG nova.compute.manager [req-9f261393-9485-4deb-a417-e62680eda003 req-b1db7354-17e6-4d70-bd6e-b6fc050fb123 service nova] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] No waiting events found dispatching network-vif-plugged-2bb302cf-a68c-46c1-b2da-fc264a18bec2 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:19:45 user nova-compute[74743]: WARNING nova.compute.manager [req-9f261393-9485-4deb-a417-e62680eda003 req-b1db7354-17e6-4d70-bd6e-b6fc050fb123 service nova] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Received unexpected event network-vif-plugged-2bb302cf-a68c-46c1-b2da-fc264a18bec2 for instance with vm_state active and task_state deleting.
Nov 18 17:19:45 user nova-compute[74743]: DEBUG nova.compute.manager [req-9f261393-9485-4deb-a417-e62680eda003 req-b1db7354-17e6-4d70-bd6e-b6fc050fb123 service nova] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Received event network-vif-unplugged-2bb302cf-a68c-46c1-b2da-fc264a18bec2 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:19:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-9f261393-9485-4deb-a417-e62680eda003 req-b1db7354-17e6-4d70-bd6e-b6fc050fb123 service nova] Acquiring lock "8a6a8a09-fb67-46b8-b5a1-b443213ae8a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:19:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-9f261393-9485-4deb-a417-e62680eda003 req-b1db7354-17e6-4d70-bd6e-b6fc050fb123 service nova] Lock "8a6a8a09-fb67-46b8-b5a1-b443213ae8a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:19:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-9f261393-9485-4deb-a417-e62680eda003 req-b1db7354-17e6-4d70-bd6e-b6fc050fb123 service nova] Lock "8a6a8a09-fb67-46b8-b5a1-b443213ae8a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:19:45 user nova-compute[74743]: DEBUG nova.compute.manager [req-9f261393-9485-4deb-a417-e62680eda003 req-b1db7354-17e6-4d70-bd6e-b6fc050fb123 service nova] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] No waiting events found dispatching network-vif-unplugged-2bb302cf-a68c-46c1-b2da-fc264a18bec2 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:19:45 user nova-compute[74743]: DEBUG nova.compute.manager [req-9f261393-9485-4deb-a417-e62680eda003 req-b1db7354-17e6-4d70-bd6e-b6fc050fb123 service nova] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Received event network-vif-unplugged-2bb302cf-a68c-46c1-b2da-fc264a18bec2 for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:19:45 user nova-compute[74743]: DEBUG nova.compute.manager [req-9f261393-9485-4deb-a417-e62680eda003 req-b1db7354-17e6-4d70-bd6e-b6fc050fb123 service nova] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Received event network-vif-plugged-2bb302cf-a68c-46c1-b2da-fc264a18bec2 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:19:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-9f261393-9485-4deb-a417-e62680eda003 req-b1db7354-17e6-4d70-bd6e-b6fc050fb123 service nova] Acquiring lock "8a6a8a09-fb67-46b8-b5a1-b443213ae8a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:19:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-9f261393-9485-4deb-a417-e62680eda003 req-b1db7354-17e6-4d70-bd6e-b6fc050fb123 service nova] Lock "8a6a8a09-fb67-46b8-b5a1-b443213ae8a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:19:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-9f261393-9485-4deb-a417-e62680eda003 req-b1db7354-17e6-4d70-bd6e-b6fc050fb123 service nova] Lock "8a6a8a09-fb67-46b8-b5a1-b443213ae8a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:19:45 user nova-compute[74743]: DEBUG nova.compute.manager [req-9f261393-9485-4deb-a417-e62680eda003 req-b1db7354-17e6-4d70-bd6e-b6fc050fb123 service nova] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] No waiting events found dispatching network-vif-plugged-2bb302cf-a68c-46c1-b2da-fc264a18bec2 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:19:45 user nova-compute[74743]: WARNING nova.compute.manager [req-9f261393-9485-4deb-a417-e62680eda003 req-b1db7354-17e6-4d70-bd6e-b6fc050fb123 service nova] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Received unexpected event network-vif-plugged-2bb302cf-a68c-46c1-b2da-fc264a18bec2 for instance with vm_state active and task_state deleting.
Nov 18 17:19:45 user nova-compute[74743]: DEBUG nova.compute.manager [req-9f261393-9485-4deb-a417-e62680eda003 req-b1db7354-17e6-4d70-bd6e-b6fc050fb123 service nova] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Received event network-vif-deleted-2bb302cf-a68c-46c1-b2da-fc264a18bec2 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:19:46 user nova-compute[74743]: INFO nova.compute.manager [None req-502d8406-2512-4207-a011-c250d285ebb0 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2] Took 0.78 seconds to detach 1 volumes for instance.
Nov 18 17:19:46 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-502d8406-2512-4207-a011-c250d285ebb0 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:19:46 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-502d8406-2512-4207-a011-c250d285ebb0 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:19:46 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-502d8406-2512-4207-a011-c250d285ebb0 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:19:46 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-502d8406-2512-4207-a011-c250d285ebb0 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:19:46 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-502d8406-2512-4207-a011-c250d285ebb0 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.274s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:19:46 user nova-compute[74743]: INFO nova.scheduler.client.report [None req-502d8406-2512-4207-a011-c250d285ebb0 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Deleted allocations for instance 8a6a8a09-fb67-46b8-b5a1-b443213ae8a2
Nov 18 17:19:46 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-502d8406-2512-4207-a011-c250d285ebb0 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "8a6a8a09-fb67-46b8-b5a1-b443213ae8a2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.459s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:19:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:59 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._sync_power_states {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:19:59 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:19:59 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Triggering sync for uuid 4cce1628-2dcb-40c7-abd4-6a327a432de3 {{(pid=74743) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 17:19:59 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Triggering sync for uuid c006a4ad-a8e2-4108-9af1-dec4dd53fcda {{(pid=74743) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 17:19:59 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Triggering sync for uuid aefe3db1-b9bb-4cce-aa31-d0b6684ad791 {{(pid=74743) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 17:19:59 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Triggering sync for uuid f649143e-f7db-475a-bbe5-d5e7316caac3 {{(pid=74743) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 17:19:59 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Triggering sync for uuid 69d78ecf-740d-492a-be5b-ffd064e36f00 {{(pid=74743) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 17:19:59 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Triggering sync for uuid 2b67d5fc-3753-4c5a-8477-e46315d9b2c2 {{(pid=74743) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 17:19:59 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Triggering sync for uuid 6aecacc3-577d-4b36-9223-8446afe54e26 {{(pid=74743) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 17:19:59 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Triggering sync for uuid 789583c2-1c04-4510-a37e-0e9b7d3a0971 {{(pid=74743) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 17:19:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "4cce1628-2dcb-40c7-abd4-6a327a432de3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:19:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "4cce1628-2dcb-40c7-abd4-6a327a432de3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:19:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "c006a4ad-a8e2-4108-9af1-dec4dd53fcda" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:19:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "c006a4ad-a8e2-4108-9af1-dec4dd53fcda" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:19:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "aefe3db1-b9bb-4cce-aa31-d0b6684ad791" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:19:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "aefe3db1-b9bb-4cce-aa31-d0b6684ad791" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:19:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "f649143e-f7db-475a-bbe5-d5e7316caac3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:19:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "f649143e-f7db-475a-bbe5-d5e7316caac3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:19:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "69d78ecf-740d-492a-be5b-ffd064e36f00" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:19:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "69d78ecf-740d-492a-be5b-ffd064e36f00" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:19:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "2b67d5fc-3753-4c5a-8477-e46315d9b2c2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:19:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "2b67d5fc-3753-4c5a-8477-e46315d9b2c2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:19:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "6aecacc3-577d-4b36-9223-8446afe54e26" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:19:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "6aecacc3-577d-4b36-9223-8446afe54e26" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:19:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "789583c2-1c04-4510-a37e-0e9b7d3a0971" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:19:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "789583c2-1c04-4510-a37e-0e9b7d3a0971" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:19:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "c006a4ad-a8e2-4108-9af1-dec4dd53fcda" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:19:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "aefe3db1-b9bb-4cce-aa31-d0b6684ad791" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:19:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "69d78ecf-740d-492a-be5b-ffd064e36f00" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:19:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "2b67d5fc-3753-4c5a-8477-e46315d9b2c2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:19:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "4cce1628-2dcb-40c7-abd4-6a327a432de3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:19:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "f649143e-f7db-475a-bbe5-d5e7316caac3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:19:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "789583c2-1c04-4510-a37e-0e9b7d3a0971" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.065s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:19:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "6aecacc3-577d-4b36-9223-8446afe54e26" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:20:04 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-2e94e479-33d7-4d2e-bca9-ef8fd238ab6d tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Acquiring lock "4cce1628-2dcb-40c7-abd4-6a327a432de3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:20:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-2e94e479-33d7-4d2e-bca9-ef8fd238ab6d tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "4cce1628-2dcb-40c7-abd4-6a327a432de3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:20:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-2e94e479-33d7-4d2e-bca9-ef8fd238ab6d tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Acquiring lock "4cce1628-2dcb-40c7-abd4-6a327a432de3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:20:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-2e94e479-33d7-4d2e-bca9-ef8fd238ab6d tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "4cce1628-2dcb-40c7-abd4-6a327a432de3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:20:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-2e94e479-33d7-4d2e-bca9-ef8fd238ab6d tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "4cce1628-2dcb-40c7-abd4-6a327a432de3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:20:06 user nova-compute[74743]: INFO nova.compute.manager [None req-2e94e479-33d7-4d2e-bca9-ef8fd238ab6d tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Terminating instance
Nov 18 17:20:06 user nova-compute[74743]: DEBUG nova.compute.manager [None req-2e94e479-33d7-4d2e-bca9-ef8fd238ab6d tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Start destroying the instance on the hypervisor. {{(pid=74743) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 17:20:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:07 user nova-compute[74743]: DEBUG nova.compute.manager [req-921ddd45-a817-456a-aa20-192a7d42ed99 req-e309f76a-7c12-4c00-bd67-daacaea0a718 service nova] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Received event network-vif-unplugged-28f81291-34bb-4a6f-890b-faea6ef8a385 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:20:07 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-921ddd45-a817-456a-aa20-192a7d42ed99 req-e309f76a-7c12-4c00-bd67-daacaea0a718 service nova] Acquiring lock "4cce1628-2dcb-40c7-abd4-6a327a432de3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:20:07 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-921ddd45-a817-456a-aa20-192a7d42ed99 req-e309f76a-7c12-4c00-bd67-daacaea0a718 service nova] Lock "4cce1628-2dcb-40c7-abd4-6a327a432de3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:20:07 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-921ddd45-a817-456a-aa20-192a7d42ed99 req-e309f76a-7c12-4c00-bd67-daacaea0a718 service nova] Lock "4cce1628-2dcb-40c7-abd4-6a327a432de3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:20:07 user nova-compute[74743]: DEBUG nova.compute.manager [req-921ddd45-a817-456a-aa20-192a7d42ed99 req-e309f76a-7c12-4c00-bd67-daacaea0a718 service nova] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] No waiting events found dispatching network-vif-unplugged-28f81291-34bb-4a6f-890b-faea6ef8a385 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:20:07 user nova-compute[74743]: DEBUG nova.compute.manager [req-921ddd45-a817-456a-aa20-192a7d42ed99 req-e309f76a-7c12-4c00-bd67-daacaea0a718 service nova] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Received event network-vif-unplugged-28f81291-34bb-4a6f-890b-faea6ef8a385 for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:20:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:07 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Instance destroyed successfully.
Nov 18 17:20:07 user nova-compute[74743]: DEBUG nova.objects.instance [None req-2e94e479-33d7-4d2e-bca9-ef8fd238ab6d tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lazy-loading 'resources' on Instance uuid 4cce1628-2dcb-40c7-abd4-6a327a432de3 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:20:07 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-2e94e479-33d7-4d2e-bca9-ef8fd238ab6d tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:03:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1591726463',display_name='tempest-ServerRescueNegativeTestJSON-server-1591726463',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1591726463',id=1,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:08:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='25c06dc8e7be46229750b8e283622c9b',ramdisk_id='',reservation_id='r-x3cybepq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-732707405',owner_user_name='tempest-ServerRescueNegativeTestJSON-732707405-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:09:54Z,user_data=None,user_id='1470478a455242f9ad92eaf95dc6a2f4',uuid=4cce1628-2dcb-40c7-abd4-6a327a432de3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28f81291-34bb-4a6f-890b-faea6ef8a385", "address": "fa:16:3e:47:f5:86", "network": {"id": "252343cc-f379-471d-a2c9-99b9a60ebcb4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25c06dc8e7be46229750b8e283622c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28f81291-34", "ovs_interfaceid": "28f81291-34bb-4a6f-890b-faea6ef8a385", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:20:07 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-2e94e479-33d7-4d2e-bca9-ef8fd238ab6d tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Converting VIF {"id": "28f81291-34bb-4a6f-890b-faea6ef8a385", "address": "fa:16:3e:47:f5:86", "network": {"id": "252343cc-f379-471d-a2c9-99b9a60ebcb4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-224039015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25c06dc8e7be46229750b8e283622c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28f81291-34", "ovs_interfaceid": "28f81291-34bb-4a6f-890b-faea6ef8a385", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:20:07 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-2e94e479-33d7-4d2e-bca9-ef8fd238ab6d tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:f5:86,bridge_name='br-int',has_traffic_filtering=True,id=28f81291-34bb-4a6f-890b-faea6ef8a385,network=Network(252343cc-f379-471d-a2c9-99b9a60ebcb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28f81291-34') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:20:07 user nova-compute[74743]: DEBUG os_vif [None req-2e94e479-33d7-4d2e-bca9-ef8fd238ab6d tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:f5:86,bridge_name='br-int',has_traffic_filtering=True,id=28f81291-34bb-4a6f-890b-faea6ef8a385,network=Network(252343cc-f379-471d-a2c9-99b9a60ebcb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28f81291-34') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:20:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap28f81291-34, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:20:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f786856d-9969-445b-b3e9-458a1b172f87) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:20:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:07 user nova-compute[74743]: INFO os_vif [None req-2e94e479-33d7-4d2e-bca9-ef8fd238ab6d tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:f5:86,bridge_name='br-int',has_traffic_filtering=True,id=28f81291-34bb-4a6f-890b-faea6ef8a385,network=Network(252343cc-f379-471d-a2c9-99b9a60ebcb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28f81291-34')
Nov 18 17:20:07 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-2e94e479-33d7-4d2e-bca9-ef8fd238ab6d tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Deleting instance files /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3_del
Nov 18 17:20:07 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-2e94e479-33d7-4d2e-bca9-ef8fd238ab6d tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Deletion of /opt/stack/data/nova/instances/4cce1628-2dcb-40c7-abd4-6a327a432de3_del complete
Nov 18 17:20:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:07 user nova-compute[74743]: INFO nova.compute.manager [None req-2e94e479-33d7-4d2e-bca9-ef8fd238ab6d tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 18 17:20:07 user nova-compute[74743]: DEBUG oslo.service.loopingcall [None req-2e94e479-33d7-4d2e-bca9-ef8fd238ab6d tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74743) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 17:20:07 user nova-compute[74743]: DEBUG nova.compute.manager [-] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Deallocating network for instance {{(pid=74743) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 17:20:07 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] deallocate_for_instance() {{(pid=74743) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 17:20:08 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:08 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:08 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:08 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:08 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:20:08 user nova-compute[74743]: INFO nova.compute.manager [-] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Took 0.52 seconds to deallocate network for instance.
Nov 18 17:20:08 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-2e94e479-33d7-4d2e-bca9-ef8fd238ab6d tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:20:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-2e94e479-33d7-4d2e-bca9-ef8fd238ab6d tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:20:08 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:08 user nova-compute[74743]: DEBUG nova.compute.manager [req-589bdef4-6ed6-48b0-bdee-c1a85981e2a6 req-d8ec45be-5ad5-4a72-a906-c8fc54e3b761 service nova] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Received event network-vif-deleted-28f81291-34bb-4a6f-890b-faea6ef8a385 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:20:08 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-2e94e479-33d7-4d2e-bca9-ef8fd238ab6d tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:20:08 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-2e94e479-33d7-4d2e-bca9-ef8fd238ab6d tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:20:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-2e94e479-33d7-4d2e-bca9-ef8fd238ab6d tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.292s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:20:08 user nova-compute[74743]: INFO nova.scheduler.client.report [None req-2e94e479-33d7-4d2e-bca9-ef8fd238ab6d tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Deleted allocations for instance 4cce1628-2dcb-40c7-abd4-6a327a432de3
Nov 18 17:20:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-2e94e479-33d7-4d2e-bca9-ef8fd238ab6d tempest-ServerRescueNegativeTestJSON-732707405 tempest-ServerRescueNegativeTestJSON-732707405-project-member] Lock "4cce1628-2dcb-40c7-abd4-6a327a432de3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.873s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:20:09 user nova-compute[74743]: DEBUG nova.compute.manager [req-5f80bce8-29d8-4aea-a528-6049cccfc294 req-96e26358-516d-465f-9f84-fd5a9cbb0c10 service nova] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Received event network-vif-plugged-28f81291-34bb-4a6f-890b-faea6ef8a385 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:20:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-5f80bce8-29d8-4aea-a528-6049cccfc294 req-96e26358-516d-465f-9f84-fd5a9cbb0c10 service nova] Acquiring lock "4cce1628-2dcb-40c7-abd4-6a327a432de3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:20:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-5f80bce8-29d8-4aea-a528-6049cccfc294 req-96e26358-516d-465f-9f84-fd5a9cbb0c10 service nova] Lock "4cce1628-2dcb-40c7-abd4-6a327a432de3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:20:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-5f80bce8-29d8-4aea-a528-6049cccfc294 req-96e26358-516d-465f-9f84-fd5a9cbb0c10 service nova] Lock "4cce1628-2dcb-40c7-abd4-6a327a432de3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:20:09 user nova-compute[74743]: DEBUG nova.compute.manager [req-5f80bce8-29d8-4aea-a528-6049cccfc294 req-96e26358-516d-465f-9f84-fd5a9cbb0c10 service nova] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] No waiting events found dispatching network-vif-plugged-28f81291-34bb-4a6f-890b-faea6ef8a385 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:20:09 user nova-compute[74743]: WARNING nova.compute.manager [req-5f80bce8-29d8-4aea-a528-6049cccfc294 req-96e26358-516d-465f-9f84-fd5a9cbb0c10 service nova] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Received unexpected event network-vif-plugged-28f81291-34bb-4a6f-890b-faea6ef8a385 for instance with vm_state deleted and task_state None.
Nov 18 17:20:09 user nova-compute[74743]: DEBUG nova.compute.manager [req-5f80bce8-29d8-4aea-a528-6049cccfc294 req-96e26358-516d-465f-9f84-fd5a9cbb0c10 service nova] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Received event network-vif-plugged-28f81291-34bb-4a6f-890b-faea6ef8a385 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:20:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-5f80bce8-29d8-4aea-a528-6049cccfc294 req-96e26358-516d-465f-9f84-fd5a9cbb0c10 service nova] Acquiring lock "4cce1628-2dcb-40c7-abd4-6a327a432de3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:20:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-5f80bce8-29d8-4aea-a528-6049cccfc294 req-96e26358-516d-465f-9f84-fd5a9cbb0c10 service nova] Lock "4cce1628-2dcb-40c7-abd4-6a327a432de3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:20:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-5f80bce8-29d8-4aea-a528-6049cccfc294 req-96e26358-516d-465f-9f84-fd5a9cbb0c10 service nova] Lock "4cce1628-2dcb-40c7-abd4-6a327a432de3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:20:09 user nova-compute[74743]: DEBUG nova.compute.manager [req-5f80bce8-29d8-4aea-a528-6049cccfc294 req-96e26358-516d-465f-9f84-fd5a9cbb0c10 service nova] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] No waiting events found dispatching network-vif-plugged-28f81291-34bb-4a6f-890b-faea6ef8a385 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:20:09 user nova-compute[74743]: WARNING nova.compute.manager [req-5f80bce8-29d8-4aea-a528-6049cccfc294 req-96e26358-516d-465f-9f84-fd5a9cbb0c10 service nova] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Received unexpected event network-vif-plugged-28f81291-34bb-4a6f-890b-faea6ef8a385 for instance with vm_state deleted and task_state None.
Nov 18 17:20:09 user nova-compute[74743]: DEBUG nova.compute.manager [req-5f80bce8-29d8-4aea-a528-6049cccfc294 req-96e26358-516d-465f-9f84-fd5a9cbb0c10 service nova] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Received event network-vif-plugged-28f81291-34bb-4a6f-890b-faea6ef8a385 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:20:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-5f80bce8-29d8-4aea-a528-6049cccfc294 req-96e26358-516d-465f-9f84-fd5a9cbb0c10 service nova] Acquiring lock "4cce1628-2dcb-40c7-abd4-6a327a432de3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:20:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-5f80bce8-29d8-4aea-a528-6049cccfc294 req-96e26358-516d-465f-9f84-fd5a9cbb0c10 service nova] Lock "4cce1628-2dcb-40c7-abd4-6a327a432de3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:20:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-5f80bce8-29d8-4aea-a528-6049cccfc294 req-96e26358-516d-465f-9f84-fd5a9cbb0c10 service nova] Lock "4cce1628-2dcb-40c7-abd4-6a327a432de3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:20:09 user nova-compute[74743]: DEBUG nova.compute.manager [req-5f80bce8-29d8-4aea-a528-6049cccfc294 req-96e26358-516d-465f-9f84-fd5a9cbb0c10 service nova] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] No waiting events found dispatching network-vif-plugged-28f81291-34bb-4a6f-890b-faea6ef8a385 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:20:09 user nova-compute[74743]: WARNING nova.compute.manager [req-5f80bce8-29d8-4aea-a528-6049cccfc294 req-96e26358-516d-465f-9f84-fd5a9cbb0c10 service nova] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Received unexpected event network-vif-plugged-28f81291-34bb-4a6f-890b-faea6ef8a385 for instance with vm_state deleted and task_state None.
Nov 18 17:20:09 user nova-compute[74743]: DEBUG nova.compute.manager [req-5f80bce8-29d8-4aea-a528-6049cccfc294 req-96e26358-516d-465f-9f84-fd5a9cbb0c10 service nova] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Received event network-vif-unplugged-28f81291-34bb-4a6f-890b-faea6ef8a385 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:20:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-5f80bce8-29d8-4aea-a528-6049cccfc294 req-96e26358-516d-465f-9f84-fd5a9cbb0c10 service nova] Acquiring lock "4cce1628-2dcb-40c7-abd4-6a327a432de3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:20:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-5f80bce8-29d8-4aea-a528-6049cccfc294 req-96e26358-516d-465f-9f84-fd5a9cbb0c10 service nova] Lock "4cce1628-2dcb-40c7-abd4-6a327a432de3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:20:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-5f80bce8-29d8-4aea-a528-6049cccfc294 req-96e26358-516d-465f-9f84-fd5a9cbb0c10 service nova] Lock "4cce1628-2dcb-40c7-abd4-6a327a432de3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:20:09 user nova-compute[74743]: DEBUG nova.compute.manager [req-5f80bce8-29d8-4aea-a528-6049cccfc294 req-96e26358-516d-465f-9f84-fd5a9cbb0c10 service nova] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] No waiting events found dispatching network-vif-unplugged-28f81291-34bb-4a6f-890b-faea6ef8a385 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:20:09 user nova-compute[74743]: WARNING nova.compute.manager [req-5f80bce8-29d8-4aea-a528-6049cccfc294 req-96e26358-516d-465f-9f84-fd5a9cbb0c10 service nova] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Received unexpected event network-vif-unplugged-28f81291-34bb-4a6f-890b-faea6ef8a385 for instance with vm_state deleted and task_state None.
Nov 18 17:20:09 user nova-compute[74743]: DEBUG nova.compute.manager [req-5f80bce8-29d8-4aea-a528-6049cccfc294 req-96e26358-516d-465f-9f84-fd5a9cbb0c10 service nova] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Received event network-vif-plugged-28f81291-34bb-4a6f-890b-faea6ef8a385 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:20:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-5f80bce8-29d8-4aea-a528-6049cccfc294 req-96e26358-516d-465f-9f84-fd5a9cbb0c10 service nova] Acquiring lock "4cce1628-2dcb-40c7-abd4-6a327a432de3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:20:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-5f80bce8-29d8-4aea-a528-6049cccfc294 req-96e26358-516d-465f-9f84-fd5a9cbb0c10 service nova] Lock "4cce1628-2dcb-40c7-abd4-6a327a432de3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:20:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-5f80bce8-29d8-4aea-a528-6049cccfc294 req-96e26358-516d-465f-9f84-fd5a9cbb0c10 service nova] Lock "4cce1628-2dcb-40c7-abd4-6a327a432de3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:20:09 user nova-compute[74743]: DEBUG nova.compute.manager [req-5f80bce8-29d8-4aea-a528-6049cccfc294 req-96e26358-516d-465f-9f84-fd5a9cbb0c10 service nova] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] No waiting events found dispatching network-vif-plugged-28f81291-34bb-4a6f-890b-faea6ef8a385 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:20:09 user nova-compute[74743]: WARNING nova.compute.manager [req-5f80bce8-29d8-4aea-a528-6049cccfc294 req-96e26358-516d-465f-9f84-fd5a9cbb0c10 service nova] [instance: 4cce1628-2dcb-40c7-abd4-6a327a432de3] Received unexpected event network-vif-plugged-28f81291-34bb-4a6f-890b-faea6ef8a385 for instance with vm_state deleted and task_state None.
Nov 18 17:20:12 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:20:17 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Acquiring lock "c58db905-7030-44d1-80ca-91e0cd746218" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:20:17 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "c58db905-7030-44d1-80ca-91e0cd746218" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:20:17 user nova-compute[74743]: DEBUG nova.compute.manager [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Starting instance... {{(pid=74743) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 17:20:17 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:20:17 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:20:17 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74743) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 17:20:17 user nova-compute[74743]: INFO nova.compute.claims [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Claim successful on node user
Nov 18 17:20:18 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:20:18 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:20:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.395s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:20:18 user nova-compute[74743]: DEBUG nova.compute.manager [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Start building networks asynchronously for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 17:20:18 user nova-compute[74743]: DEBUG nova.compute.manager [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Allocating IP information in the background. {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 17:20:18 user nova-compute[74743]: DEBUG nova.network.neutron [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] allocate_for_instance() {{(pid=74743) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 17:20:18 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 17:20:18 user nova-compute[74743]: DEBUG nova.compute.manager [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Start building block device mappings for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 17:20:18 user nova-compute[74743]: DEBUG nova.policy [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '18483ad6106b4d95afbbed450d625b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a17803c613c4ef299c797bba85c1a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74743) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 17:20:18 user nova-compute[74743]: DEBUG nova.compute.manager [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Start spawning the instance on the hypervisor. {{(pid=74743) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 17:20:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Creating instance directory {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 17:20:18 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Creating image(s)
Nov 18 17:20:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Acquiring lock "/opt/stack/data/nova/instances/c58db905-7030-44d1-80ca-91e0cd746218/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:20:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "/opt/stack/data/nova/instances/c58db905-7030-44d1-80ca-91e0cd746218/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:20:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "/opt/stack/data/nova/instances/c58db905-7030-44d1-80ca-91e0cd746218/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:20:18 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:20:18 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.180s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:20:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Acquiring lock "c188b3a997bfafa42fa341f9dcc326545681eed9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:20:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:20:18 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:20:18 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.170s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:20:18 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/c58db905-7030-44d1-80ca-91e0cd746218/disk 1073741824 {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:20:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:18 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/c58db905-7030-44d1-80ca-91e0cd746218/disk 1073741824" returned: 0 in 0.062s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:20:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:20:18 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:20:18 user nova-compute[74743]: DEBUG nova.network.neutron [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Successfully created port: 2dc327a1-177d-4d19-9fb1-ce60b5367a7e {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.175s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c58db905-7030-44d1-80ca-91e0cd746218/disk. size=1073741824 {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c58db905-7030-44d1-80ca-91e0cd746218/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c58db905-7030-44d1-80ca-91e0cd746218/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Cannot resize image /opt/stack/data/nova/instances/c58db905-7030-44d1-80ca-91e0cd746218/disk to a smaller size. {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Created local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Ensure instance console log exists: /opt/stack/data/nova/instances/c58db905-7030-44d1-80ca-91e0cd746218/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG nova.network.neutron [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Successfully updated port: 2dc327a1-177d-4d19-9fb1-ce60b5367a7e {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Acquiring lock "refresh_cache-c58db905-7030-44d1-80ca-91e0cd746218" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Acquired lock "refresh_cache-c58db905-7030-44d1-80ca-91e0cd746218" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG nova.network.neutron [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG nova.compute.manager [req-2d935454-294c-4513-9420-8653cd59ad71 req-73c54a9a-c46f-4c66-ba26-800a1d930a57 service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Received event network-changed-2dc327a1-177d-4d19-9fb1-ce60b5367a7e {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG nova.compute.manager [req-2d935454-294c-4513-9420-8653cd59ad71 req-73c54a9a-c46f-4c66-ba26-800a1d930a57 service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Refreshing instance network info cache due to event network-changed-2dc327a1-177d-4d19-9fb1-ce60b5367a7e. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-2d935454-294c-4513-9420-8653cd59ad71 req-73c54a9a-c46f-4c66-ba26-800a1d930a57 service nova] Acquiring lock "refresh_cache-c58db905-7030-44d1-80ca-91e0cd746218" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG nova.network.neutron [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG nova.network.neutron [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Updating instance_info_cache with network_info: [{"id": "2dc327a1-177d-4d19-9fb1-ce60b5367a7e", "address": "fa:16:3e:05:b8:d4", "network": {"id": "e1c28f74-c9c1-4eb3-931e-003332ff6243", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-453481916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a17803c613c4ef299c797bba85c1a4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc327a1-17", "ovs_interfaceid": "2dc327a1-177d-4d19-9fb1-ce60b5367a7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Releasing lock "refresh_cache-c58db905-7030-44d1-80ca-91e0cd746218" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG nova.compute.manager [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Instance network_info: |[{"id": "2dc327a1-177d-4d19-9fb1-ce60b5367a7e", "address": "fa:16:3e:05:b8:d4", "network": {"id": "e1c28f74-c9c1-4eb3-931e-003332ff6243", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-453481916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a17803c613c4ef299c797bba85c1a4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc327a1-17", "ovs_interfaceid": "2dc327a1-177d-4d19-9fb1-ce60b5367a7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-2d935454-294c-4513-9420-8653cd59ad71 req-73c54a9a-c46f-4c66-ba26-800a1d930a57 service nova] Acquired lock "refresh_cache-c58db905-7030-44d1-80ca-91e0cd746218" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG nova.network.neutron [req-2d935454-294c-4513-9420-8653cd59ad71 req-73c54a9a-c46f-4c66-ba26-800a1d930a57 service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Refreshing network info cache for port 2dc327a1-177d-4d19-9fb1-ce60b5367a7e {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Start _get_guest_xml network_info=[{"id": "2dc327a1-177d-4d19-9fb1-ce60b5367a7e", "address": "fa:16:3e:05:b8:d4", "network": {"id": "e1c28f74-c9c1-4eb3-931e-003332ff6243", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-453481916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a17803c613c4ef299c797bba85c1a4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc327a1-17", "ovs_interfaceid": "2dc327a1-177d-4d19-9fb1-ce60b5367a7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '9536f6cf-95c4-40e2-864a-09a91525678a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:20:19 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:20:19 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:20:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:20:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1999190186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1999190186',id=36,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAVdZsN+DFKrCPNzanPHBqWs091OcQHgphg4iBlSfWRqz7epu6i3jKz8RNDrRHwUSaEHm/Cp6vRBJpFWpKEkvK3bZeVx7cY08vXJaHPMBdOZ7gBw6/rmmlh7AEdXEtEhkA==',key_name='tempest-keypair-405514316',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a17803c613c4ef299c797bba85c1a4b',ramdisk_id='',reservation_id='r-p5x4eoy0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-13499029',owner_user_name='tempest-AttachVolumeShelveTestJSON-13499029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:20:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18483ad6106b4d95afbbed450d625b53',uuid=c58db905-7030-44d1-80ca-91e0cd746218,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2dc327a1-177d-4d19-9fb1-ce60b5367a7e", "address": "fa:16:3e:05:b8:d4", "network": {"id": "e1c28f74-c9c1-4eb3-931e-003332ff6243", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-453481916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a17803c613c4ef299c797bba85c1a4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc327a1-17", "ovs_interfaceid": "2dc327a1-177d-4d19-9fb1-ce60b5367a7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Converting VIF {"id": "2dc327a1-177d-4d19-9fb1-ce60b5367a7e", "address": "fa:16:3e:05:b8:d4", "network": {"id": "e1c28f74-c9c1-4eb3-931e-003332ff6243", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-453481916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a17803c613c4ef299c797bba85c1a4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc327a1-17", "ovs_interfaceid": "2dc327a1-177d-4d19-9fb1-ce60b5367a7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:b8:d4,bridge_name='br-int',has_traffic_filtering=True,id=2dc327a1-177d-4d19-9fb1-ce60b5367a7e,network=Network(e1c28f74-c9c1-4eb3-931e-003332ff6243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dc327a1-17') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG nova.objects.instance [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lazy-loading 'pci_devices' on Instance uuid c58db905-7030-44d1-80ca-91e0cd746218 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:20:19 user nova-compute[74743]:   <uuid>c58db905-7030-44d1-80ca-91e0cd746218</uuid>
Nov 18 17:20:19 user nova-compute[74743]:   <name>instance-00000024</name>
Nov 18 17:20:19 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:20:19 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:20:19 user nova-compute[74743]:   <metadata>
Nov 18 17:20:19 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:20:19 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:20:19 user nova-compute[74743]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1999190186</nova:name>
Nov 18 17:20:19 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:20:19</nova:creationTime>
Nov 18 17:20:19 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:20:19 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:20:19 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:20:19 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:20:19 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:20:19 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:20:19 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:20:19 user nova-compute[74743]:       <nova:owner>
Nov 18 17:20:19 user nova-compute[74743]:         <nova:user uuid="18483ad6106b4d95afbbed450d625b53">tempest-AttachVolumeShelveTestJSON-13499029-project-member</nova:user>
Nov 18 17:20:19 user nova-compute[74743]:         <nova:project uuid="0a17803c613c4ef299c797bba85c1a4b">tempest-AttachVolumeShelveTestJSON-13499029</nova:project>
Nov 18 17:20:19 user nova-compute[74743]:       </nova:owner>
Nov 18 17:20:19 user nova-compute[74743]:       <nova:root type="image" uuid="9536f6cf-95c4-40e2-864a-09a91525678a"/>
Nov 18 17:20:19 user nova-compute[74743]:       <nova:ports>
Nov 18 17:20:19 user nova-compute[74743]:         <nova:port uuid="2dc327a1-177d-4d19-9fb1-ce60b5367a7e">
Nov 18 17:20:19 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 18 17:20:19 user nova-compute[74743]:         </nova:port>
Nov 18 17:20:19 user nova-compute[74743]:       </nova:ports>
Nov 18 17:20:19 user nova-compute[74743]:     </nova:instance>
Nov 18 17:20:19 user nova-compute[74743]:   </metadata>
Nov 18 17:20:19 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:20:19 user nova-compute[74743]:     <system>
Nov 18 17:20:19 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:20:19 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:20:19 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:20:19 user nova-compute[74743]:       <entry name="serial">c58db905-7030-44d1-80ca-91e0cd746218</entry>
Nov 18 17:20:19 user nova-compute[74743]:       <entry name="uuid">c58db905-7030-44d1-80ca-91e0cd746218</entry>
Nov 18 17:20:19 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:20:19 user nova-compute[74743]:     </system>
Nov 18 17:20:19 user nova-compute[74743]:   </sysinfo>
Nov 18 17:20:19 user nova-compute[74743]:   <os>
Nov 18 17:20:19 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:20:19 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:20:19 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:20:19 user nova-compute[74743]:   </os>
Nov 18 17:20:19 user nova-compute[74743]:   <features>
Nov 18 17:20:19 user nova-compute[74743]:     <acpi/>
Nov 18 17:20:19 user nova-compute[74743]:     <apic/>
Nov 18 17:20:19 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:20:19 user nova-compute[74743]:   </features>
Nov 18 17:20:19 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:20:19 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:20:19 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:20:19 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:20:19 user nova-compute[74743]:   </clock>
Nov 18 17:20:19 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:20:19 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:20:19 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:20:19 user nova-compute[74743]:   </cpu>
Nov 18 17:20:19 user nova-compute[74743]:   <devices>
Nov 18 17:20:19 user nova-compute[74743]:     <disk type="file" device="disk">
Nov 18 17:20:19 user nova-compute[74743]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 17:20:19 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/c58db905-7030-44d1-80ca-91e0cd746218/disk"/>
Nov 18 17:20:19 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:20:19 user nova-compute[74743]:     </disk>
Nov 18 17:20:19 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:20:19 user nova-compute[74743]:       <mac address="fa:16:3e:05:b8:d4"/>
Nov 18 17:20:19 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:20:19 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:20:19 user nova-compute[74743]:       <target dev="tap2dc327a1-17"/>
Nov 18 17:20:19 user nova-compute[74743]:     </interface>
Nov 18 17:20:19 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:20:19 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/c58db905-7030-44d1-80ca-91e0cd746218/console.log" append="off"/>
Nov 18 17:20:19 user nova-compute[74743]:     </serial>
Nov 18 17:20:19 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:20:19 user nova-compute[74743]:     <video>
Nov 18 17:20:19 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:20:19 user nova-compute[74743]:     </video>
Nov 18 17:20:19 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:20:19 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:20:19 user nova-compute[74743]:     </rng>
Nov 18 17:20:19 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:20:19 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:20:19 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:20:19 user nova-compute[74743]:     </memballoon>
Nov 18 17:20:19 user nova-compute[74743]:   </devices>
Nov 18 17:20:19 user nova-compute[74743]: </domain>
Nov 18 17:20:19 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:20:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1999190186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1999190186',id=36,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAVdZsN+DFKrCPNzanPHBqWs091OcQHgphg4iBlSfWRqz7epu6i3jKz8RNDrRHwUSaEHm/Cp6vRBJpFWpKEkvK3bZeVx7cY08vXJaHPMBdOZ7gBw6/rmmlh7AEdXEtEhkA==',key_name='tempest-keypair-405514316',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a17803c613c4ef299c797bba85c1a4b',ramdisk_id='',reservation_id='r-p5x4eoy0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-13499029',owner_user_name='tempest-AttachVolumeShelveTestJSON-13499029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:20:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18483ad6106b4d95afbbed450d625b53',uuid=c58db905-7030-44d1-80ca-91e0cd746218,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2dc327a1-177d-4d19-9fb1-ce60b5367a7e", "address": "fa:16:3e:05:b8:d4", "network": {"id": "e1c28f74-c9c1-4eb3-931e-003332ff6243", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-453481916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a17803c613c4ef299c797bba85c1a4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc327a1-17", "ovs_interfaceid": "2dc327a1-177d-4d19-9fb1-ce60b5367a7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Converting VIF {"id": "2dc327a1-177d-4d19-9fb1-ce60b5367a7e", "address": "fa:16:3e:05:b8:d4", "network": {"id": "e1c28f74-c9c1-4eb3-931e-003332ff6243", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-453481916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a17803c613c4ef299c797bba85c1a4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc327a1-17", "ovs_interfaceid": "2dc327a1-177d-4d19-9fb1-ce60b5367a7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:b8:d4,bridge_name='br-int',has_traffic_filtering=True,id=2dc327a1-177d-4d19-9fb1-ce60b5367a7e,network=Network(e1c28f74-c9c1-4eb3-931e-003332ff6243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dc327a1-17') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG os_vif [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:b8:d4,bridge_name='br-int',has_traffic_filtering=True,id=2dc327a1-177d-4d19-9fb1-ce60b5367a7e,network=Network(e1c28f74-c9c1-4eb3-931e-003332ff6243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dc327a1-17') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fa48dc30-dce9-541e-ac10-95bcc16363fd', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2dc327a1-17, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2dc327a1-17, col_values=(('qos', UUID('366393c6-0d7c-421d-8846-00d2d129d538')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2dc327a1-17, col_values=(('external_ids', {'iface-id': '2dc327a1-177d-4d19-9fb1-ce60b5367a7e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:b8:d4', 'vm-uuid': 'c58db905-7030-44d1-80ca-91e0cd746218'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:20:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:19 user nova-compute[74743]: INFO os_vif [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:b8:d4,bridge_name='br-int',has_traffic_filtering=True,id=2dc327a1-177d-4d19-9fb1-ce60b5367a7e,network=Network(e1c28f74-c9c1-4eb3-931e-003332ff6243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dc327a1-17')
Nov 18 17:20:20 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:20:20 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] No VIF found with MAC fa:16:3e:05:b8:d4, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:20:20 user nova-compute[74743]: DEBUG nova.network.neutron [req-2d935454-294c-4513-9420-8653cd59ad71 req-73c54a9a-c46f-4c66-ba26-800a1d930a57 service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Updated VIF entry in instance network info cache for port 2dc327a1-177d-4d19-9fb1-ce60b5367a7e. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:20:20 user nova-compute[74743]: DEBUG nova.network.neutron [req-2d935454-294c-4513-9420-8653cd59ad71 req-73c54a9a-c46f-4c66-ba26-800a1d930a57 service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Updating instance_info_cache with network_info: [{"id": "2dc327a1-177d-4d19-9fb1-ce60b5367a7e", "address": "fa:16:3e:05:b8:d4", "network": {"id": "e1c28f74-c9c1-4eb3-931e-003332ff6243", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-453481916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a17803c613c4ef299c797bba85c1a4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc327a1-17", "ovs_interfaceid": "2dc327a1-177d-4d19-9fb1-ce60b5367a7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:20:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-2d935454-294c-4513-9420-8653cd59ad71 req-73c54a9a-c46f-4c66-ba26-800a1d930a57 service nova] Releasing lock "refresh_cache-c58db905-7030-44d1-80ca-91e0cd746218" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:20:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:21 user nova-compute[74743]: DEBUG nova.compute.manager [req-f09b4cfd-88cd-4154-a466-feb11dd0ce36 req-f8d1ec75-a9cc-4645-a298-16d81576dac9 service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Received event network-vif-plugged-2dc327a1-177d-4d19-9fb1-ce60b5367a7e {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:20:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f09b4cfd-88cd-4154-a466-feb11dd0ce36 req-f8d1ec75-a9cc-4645-a298-16d81576dac9 service nova] Acquiring lock "c58db905-7030-44d1-80ca-91e0cd746218-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:20:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f09b4cfd-88cd-4154-a466-feb11dd0ce36 req-f8d1ec75-a9cc-4645-a298-16d81576dac9 service nova] Lock "c58db905-7030-44d1-80ca-91e0cd746218-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:20:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f09b4cfd-88cd-4154-a466-feb11dd0ce36 req-f8d1ec75-a9cc-4645-a298-16d81576dac9 service nova] Lock "c58db905-7030-44d1-80ca-91e0cd746218-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:20:21 user nova-compute[74743]: DEBUG nova.compute.manager [req-f09b4cfd-88cd-4154-a466-feb11dd0ce36 req-f8d1ec75-a9cc-4645-a298-16d81576dac9 service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] No waiting events found dispatching network-vif-plugged-2dc327a1-177d-4d19-9fb1-ce60b5367a7e {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:20:21 user nova-compute[74743]: WARNING nova.compute.manager [req-f09b4cfd-88cd-4154-a466-feb11dd0ce36 req-f8d1ec75-a9cc-4645-a298-16d81576dac9 service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Received unexpected event network-vif-plugged-2dc327a1-177d-4d19-9fb1-ce60b5367a7e for instance with vm_state building and task_state spawning.
Nov 18 17:20:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:23 user nova-compute[74743]: DEBUG nova.compute.manager [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:20:23 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Guest created on hypervisor {{(pid=74743) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 17:20:23 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Instance spawned successfully.
Nov 18 17:20:23 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 17:20:23 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Found default for hw_cdrom_bus of ide {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:20:23 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Found default for hw_disk_bus of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:20:23 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Found default for hw_input_bus of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:20:23 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Found default for hw_pointer_model of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:20:23 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Found default for hw_video_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:20:23 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Found default for hw_vif_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:20:23 user nova-compute[74743]: INFO nova.compute.manager [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Took 5.14 seconds to spawn the instance on the hypervisor.
Nov 18 17:20:23 user nova-compute[74743]: DEBUG nova.compute.manager [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:20:23 user nova-compute[74743]: DEBUG nova.compute.manager [req-91a5d521-43dc-43f9-a533-bd3b9269078f req-fb0828fd-2841-4a4c-8446-ea89d1d0a6bb service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Received event network-vif-plugged-2dc327a1-177d-4d19-9fb1-ce60b5367a7e {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:20:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-91a5d521-43dc-43f9-a533-bd3b9269078f req-fb0828fd-2841-4a4c-8446-ea89d1d0a6bb service nova] Acquiring lock "c58db905-7030-44d1-80ca-91e0cd746218-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:20:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-91a5d521-43dc-43f9-a533-bd3b9269078f req-fb0828fd-2841-4a4c-8446-ea89d1d0a6bb service nova] Lock "c58db905-7030-44d1-80ca-91e0cd746218-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:20:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-91a5d521-43dc-43f9-a533-bd3b9269078f req-fb0828fd-2841-4a4c-8446-ea89d1d0a6bb service nova] Lock "c58db905-7030-44d1-80ca-91e0cd746218-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:20:23 user nova-compute[74743]: DEBUG nova.compute.manager [req-91a5d521-43dc-43f9-a533-bd3b9269078f req-fb0828fd-2841-4a4c-8446-ea89d1d0a6bb service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] No waiting events found dispatching network-vif-plugged-2dc327a1-177d-4d19-9fb1-ce60b5367a7e {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:20:23 user nova-compute[74743]: WARNING nova.compute.manager [req-91a5d521-43dc-43f9-a533-bd3b9269078f req-fb0828fd-2841-4a4c-8446-ea89d1d0a6bb service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Received unexpected event network-vif-plugged-2dc327a1-177d-4d19-9fb1-ce60b5367a7e for instance with vm_state building and task_state spawning.
Nov 18 17:20:23 user nova-compute[74743]: INFO nova.compute.manager [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Took 5.87 seconds to build instance.
Nov 18 17:20:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-fe9848ac-c14d-471d-aa65-115a4d23de88 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "c58db905-7030-44d1-80ca-91e0cd746218" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.964s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:20:24 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:27 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:20:28 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:20:29 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:20:29 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:20:29 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74743) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 17:20:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:31 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:20:31 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Starting heal instance info cache {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 17:20:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "refresh_cache-69d78ecf-740d-492a-be5b-ffd064e36f00" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:20:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquired lock "refresh_cache-69d78ecf-740d-492a-be5b-ffd064e36f00" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:20:31 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Forcefully refreshing network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 17:20:31 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Updating instance_info_cache with network_info: [{"id": "4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8", "address": "fa:16:3e:93:d9:fc", "network": {"id": "fd98f398-6576-449b-a737-887906eb6656", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668610993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb8f5850162c479b8d185e48c03be7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd5a403-19", "ovs_interfaceid": "4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:20:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Releasing lock "refresh_cache-69d78ecf-740d-492a-be5b-ffd064e36f00" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:20:31 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Updated the network info_cache for instance {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 17:20:33 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:20:33 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:20:33 user nova-compute[74743]: INFO nova.compute.manager [None req-acf8675e-89ed-4948-b0e0-dfb7d2e019e0 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Get console output
Nov 18 17:20:33 user nova-compute[74743]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 18 17:20:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "9cbdffd6-df57-4bab-b69c-b41a2718fd68" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:20:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "9cbdffd6-df57-4bab-b69c-b41a2718fd68" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:20:34 user nova-compute[74743]: DEBUG nova.compute.manager [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Starting instance... {{(pid=74743) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 17:20:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:20:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:20:34 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74743) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 17:20:34 user nova-compute[74743]: INFO nova.compute.claims [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Claim successful on node user
Nov 18 17:20:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:20:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:20:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74743) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 17:20:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:20:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:20:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:35 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:20:35 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:20:35 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.352s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:20:35 user nova-compute[74743]: DEBUG nova.compute.manager [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Start building networks asynchronously for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 17:20:35 user nova-compute[74743]: DEBUG nova.compute.manager [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Allocating IP information in the background. {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 17:20:35 user nova-compute[74743]: DEBUG nova.network.neutron [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] allocate_for_instance() {{(pid=74743) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 17:20:35 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 17:20:35 user nova-compute[74743]: DEBUG nova.compute.manager [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Start building block device mappings for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 17:20:35 user nova-compute[74743]: DEBUG nova.policy [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '89ce0d4bf7234c348b9b1a8979609c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a956c4d6e4304d34872ecf989279c886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74743) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 17:20:35 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:20:35 user nova-compute[74743]: INFO nova.virt.block_device [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Booting with volume 36baaa29-2acc-4476-9f64-ec76a08f66f2 at /dev/vda
Nov 18 17:20:35 user nova-compute[74743]: DEBUG os_brick.utils [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:20:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:20:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:20:35 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87aba62-a1a7-4757-8b12-7ca3556a0b6d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1116acd8874d\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:20:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:20:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:20:35 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ec27d3-5839-44ea-bd13-c18f44af476a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:20:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:20:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:20:35 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d9517a-7e50-4381-83ff-1179f1e3152b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:20:35 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75d003e-de14-43d9-8dda-58672fcab3ec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:20:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Running cmd (subprocess): nvme version {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:20:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] 'nvme version' failed. Not Retrying. {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:20:35 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.nvmeof [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] nvme not present on system {{(pid=74743) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 17:20:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:20:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:20:35 user nova-compute[74743]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 17:20:35 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a898b8-876d-462b-8a07-a486a0c82415]: (4, '') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:20:35 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74743) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 17:20:35 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 17:20:35 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] LIGHTOS: no hostnqn found. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 17:20:35 user nova-compute[74743]: DEBUG os_brick.utils [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1116acd8874d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:20:35 user nova-compute[74743]: DEBUG nova.virt.block_device [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Updating existing volume attachment record: d23a5ca0-6027-4bfc-8fde-44db7edaa76a {{(pid=74743) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 17:20:36 user nova-compute[74743]: DEBUG nova.network.neutron [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Successfully created port: 55c54294-3f4d-4199-a9fa-a273016b376b {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:20:36 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:20:36 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:20:36 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:20:36 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:20:36 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Auditing locally available compute resources for user (node: user) {{(pid=74743) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 17:20:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/789583c2-1c04-4510-a37e-0e9b7d3a0971/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:20:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/789583c2-1c04-4510-a37e-0e9b7d3a0971/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:20:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/789583c2-1c04-4510-a37e-0e9b7d3a0971/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:20:37 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/789583c2-1c04-4510-a37e-0e9b7d3a0971/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:20:37 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c58db905-7030-44d1-80ca-91e0cd746218/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:20:37 user nova-compute[74743]: DEBUG nova.network.neutron [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Successfully updated port: 55c54294-3f4d-4199-a9fa-a273016b376b {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:20:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "refresh_cache-9cbdffd6-df57-4bab-b69c-b41a2718fd68" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:20:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquired lock "refresh_cache-9cbdffd6-df57-4bab-b69c-b41a2718fd68" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:20:37 user nova-compute[74743]: DEBUG nova.network.neutron [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:20:37 user nova-compute[74743]: DEBUG nova.compute.manager [req-1c07a825-d628-41e9-85fd-968a6f3f826f req-96f2014f-8f62-437a-9659-c39fe6cf456b service nova] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Received event network-changed-55c54294-3f4d-4199-a9fa-a273016b376b {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:20:37 user nova-compute[74743]: DEBUG nova.compute.manager [req-1c07a825-d628-41e9-85fd-968a6f3f826f req-96f2014f-8f62-437a-9659-c39fe6cf456b service nova] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Refreshing instance network info cache due to event network-changed-55c54294-3f4d-4199-a9fa-a273016b376b. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:20:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-1c07a825-d628-41e9-85fd-968a6f3f826f req-96f2014f-8f62-437a-9659-c39fe6cf456b service nova] Acquiring lock "refresh_cache-9cbdffd6-df57-4bab-b69c-b41a2718fd68" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:20:37 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c58db905-7030-44d1-80ca-91e0cd746218/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:20:37 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c58db905-7030-44d1-80ca-91e0cd746218/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:20:37 user nova-compute[74743]: DEBUG nova.network.neutron [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:20:37 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c58db905-7030-44d1-80ca-91e0cd746218/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:20:37 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:20:37 user nova-compute[74743]: DEBUG nova.network.neutron [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Updating instance_info_cache with network_info: [{"id": "55c54294-3f4d-4199-a9fa-a273016b376b", "address": "fa:16:3e:70:96:90", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55c54294-3f", "ovs_interfaceid": "55c54294-3f4d-4199-a9fa-a273016b376b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:20:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Releasing lock "refresh_cache-9cbdffd6-df57-4bab-b69c-b41a2718fd68" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:20:37 user nova-compute[74743]: DEBUG nova.compute.manager [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Instance network_info: |[{"id": "55c54294-3f4d-4199-a9fa-a273016b376b", "address": "fa:16:3e:70:96:90", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55c54294-3f", "ovs_interfaceid": "55c54294-3f4d-4199-a9fa-a273016b376b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 17:20:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-1c07a825-d628-41e9-85fd-968a6f3f826f req-96f2014f-8f62-437a-9659-c39fe6cf456b service nova] Acquired lock "refresh_cache-9cbdffd6-df57-4bab-b69c-b41a2718fd68" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:20:37 user nova-compute[74743]: DEBUG nova.network.neutron [req-1c07a825-d628-41e9-85fd-968a6f3f826f req-96f2014f-8f62-437a-9659-c39fe6cf456b service nova] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Refreshing network info cache for port 55c54294-3f4d-4199-a9fa-a273016b376b {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:20:37 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:20:37 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:20:37 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:20:37 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:20:37 user nova-compute[74743]: DEBUG nova.network.neutron [req-1c07a825-d628-41e9-85fd-968a6f3f826f req-96f2014f-8f62-437a-9659-c39fe6cf456b service nova] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Updated VIF entry in instance network info cache for port 55c54294-3f4d-4199-a9fa-a273016b376b. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:20:38 user nova-compute[74743]: DEBUG nova.network.neutron [req-1c07a825-d628-41e9-85fd-968a6f3f826f req-96f2014f-8f62-437a-9659-c39fe6cf456b service nova] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Updating instance_info_cache with network_info: [{"id": "55c54294-3f4d-4199-a9fa-a273016b376b", "address": "fa:16:3e:70:96:90", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55c54294-3f", "ovs_interfaceid": "55c54294-3f4d-4199-a9fa-a273016b376b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:20:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:20:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:20:38 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-1c07a825-d628-41e9-85fd-968a6f3f826f req-96f2014f-8f62-437a-9659-c39fe6cf456b service nova] Releasing lock "refresh_cache-9cbdffd6-df57-4bab-b69c-b41a2718fd68" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:20:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:20:38 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:20:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b67d5fc-3753-4c5a-8477-e46315d9b2c2/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:20:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b67d5fc-3753-4c5a-8477-e46315d9b2c2/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:20:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b67d5fc-3753-4c5a-8477-e46315d9b2c2/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:20:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b67d5fc-3753-4c5a-8477-e46315d9b2c2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:20:38 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:20:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aecacc3-577d-4b36-9223-8446afe54e26/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:20:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aecacc3-577d-4b36-9223-8446afe54e26/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:20:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aecacc3-577d-4b36-9223-8446afe54e26/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:20:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aecacc3-577d-4b36-9223-8446afe54e26/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:20:39 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:20:39 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:20:39 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Hypervisor/Node resource view: name=user free_ram=7894MB free_disk=25.275493621826172GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74743) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 17:20:39 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:20:39 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:20:39 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance c006a4ad-a8e2-4108-9af1-dec4dd53fcda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:20:39 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance aefe3db1-b9bb-4cce-aa31-d0b6684ad791 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:20:39 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance f649143e-f7db-475a-bbe5-d5e7316caac3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:20:39 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 2b67d5fc-3753-4c5a-8477-e46315d9b2c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:20:39 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 69d78ecf-740d-492a-be5b-ffd064e36f00 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:20:39 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 6aecacc3-577d-4b36-9223-8446afe54e26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:20:39 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 789583c2-1c04-4510-a37e-0e9b7d3a0971 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:20:39 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance c58db905-7030-44d1-80ca-91e0cd746218 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:20:39 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 9cbdffd6-df57-4bab-b69c-b41a2718fd68 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:20:39 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 17:20:39 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 17:20:39 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:20:39 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:20:39 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Compute_service record updated for user:user {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 17:20:39 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.397s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:20:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:40 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG nova.compute.manager [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Start spawning the instance on the hypervisor. {{(pid=74743) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Creating instance directory {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 17:20:41 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Creating image(s)
Nov 18 17:20:41 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Did not create local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Ensure instance console log exists: /opt/stack/data/nova/instances/9cbdffd6-df57-4bab-b69c-b41a2718fd68/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Start _get_guest_xml network_info=[{"id": "55c54294-3f4d-4199-a9fa-a273016b376b", "address": "fa:16:3e:70:96:90", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55c54294-3f", "ovs_interfaceid": "55c54294-3f4d-4199-a9fa-a273016b376b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': 'd23a5ca0-6027-4bfc-8fde-44db7edaa76a', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cGqFNkMi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9cbdffd6-df57-4bab-b69c-b41a2718fd68', 'attached_at': '', 'detached_at': '', 'volume_id': '36baaa29-2acc-4476-9f64-ec76a08f66f2', 'serial': '36baaa29-2acc-4476-9f64-ec76a08f66f2'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:20:41 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:20:41 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:20:41 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Calling os-brick to attach iSCSI Volume {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cGqFNkMi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:20:41 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:20:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:20:41 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:20:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:20:41 user nova-compute[74743]: INFO os_brick.initiator.connectors.iscsi [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 17:20:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 -p 172.16.0.220:3260 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4aae5b-b6b5-4256-b5d6-d82cc5a0005f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 17:20:41 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6dad0b-6dc0-4016-a6f2-80defd56e9b2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2] added\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2] added
Nov 18 17:20:41 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[452a733d-1c9f-4d5a-bc5b-bb748b926140]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[567b05eb-b26c-4f69-bc41-7502e67908cf]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cGqFNkMi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cGqFNkMi" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0362abe-4841-4577-9d86-0e4a183ece31]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cGqFNkMi'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.180s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2c962d-1863-4a59-8f9c-43403c4bffb2]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4f4100-3872-46e2-847e-a6bbb4891a50]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:20:41 user nova-compute[74743]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)
Nov 18 17:20:41 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:20:41 user nova-compute[74743]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)
Nov 18 17:20:41 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 -p 172.16.0.220:3260 --login {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e62fdf5-7c7a-4ca6-98e5-e950b23e1788]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2, portal: 172.16.0.220,3260]
Nov 18 17:20:41 user nova-compute[74743]: Login to [iface: default, target: iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2, portal: 172.16.0.220,3260] successful.
Nov 18 17:20:41 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ddac79c-7883-4f15-80f3-cd4bb4dc786a]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2c0bfc-e70c-4f48-a368-279a1ad3f3fc]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:20:41 user nova-compute[74743]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)
Nov 18 17:20:41 user nova-compute[74743]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 (non-flash)
Nov 18 17:20:41 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:20:41 user nova-compute[74743]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)
Nov 18 17:20:41 user nova-compute[74743]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 (non-flash)
Nov 18 17:20:41 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.441s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Connected to 172.16.0.220:3260 {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=74743) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74743) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d0ab26-f1c6-42ed-9b8b-595b6cb1569a]: (4, ('- - 0', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:20:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cGqFNkMi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 17:20:42 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.471s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:20:42 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] <== connect_volume: return (1473ms) {'type': 'block', 'scsi_wwn': '23761386266316134', 'path': '/dev/sdb'} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:20:42 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761386266316134', 'path': '/dev/sdb'} {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 17:20:42 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:20:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-260240897',display_name='tempest-TestVolumeBootPattern-server-260240897',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-260240897',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOLvs8QktAbg6ubYzS1yyIzjK6/SEgIlSEhHuVaKm0b6bpmV4klO8yadOBEcp58HtUXwfad9vILFBUP0iHELOBhABjjRYYSI0ECkBhwEERqTkNNauBgT8rgOot2Bwx6w0A==',key_name='tempest-TestVolumeBootPattern-2140749553',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a956c4d6e4304d34872ecf989279c886',ramdisk_id='',reservation_id='r-pq273w0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1373443944',owner_user_name='tempest-TestVolumeBootPattern-1373443944-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:20:35Z,user_data=None,user_id='89ce0d4bf7234c348b9b1a8979609c7b',uuid=9cbdffd6-df57-4bab-b69c-b41a2718fd68,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55c54294-3f4d-4199-a9fa-a273016b376b", "address": "fa:16:3e:70:96:90", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55c54294-3f", "ovs_interfaceid": "55c54294-3f4d-4199-a9fa-a273016b376b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:20:42 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Converting VIF {"id": "55c54294-3f4d-4199-a9fa-a273016b376b", "address": "fa:16:3e:70:96:90", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55c54294-3f", "ovs_interfaceid": "55c54294-3f4d-4199-a9fa-a273016b376b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:20:42 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:96:90,bridge_name='br-int',has_traffic_filtering=True,id=55c54294-3f4d-4199-a9fa-a273016b376b,network=Network(fc55f18a-b779-4b04-8828-278ecd62211a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55c54294-3f') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:20:42 user nova-compute[74743]: DEBUG nova.objects.instance [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lazy-loading 'pci_devices' on Instance uuid 9cbdffd6-df57-4bab-b69c-b41a2718fd68 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:20:42 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:20:42 user nova-compute[74743]:   <uuid>9cbdffd6-df57-4bab-b69c-b41a2718fd68</uuid>
Nov 18 17:20:42 user nova-compute[74743]:   <name>instance-00000025</name>
Nov 18 17:20:42 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:20:42 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:20:42 user nova-compute[74743]:   <metadata>
Nov 18 17:20:42 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:20:42 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:20:42 user nova-compute[74743]:       <nova:name>tempest-TestVolumeBootPattern-server-260240897</nova:name>
Nov 18 17:20:42 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:20:41</nova:creationTime>
Nov 18 17:20:42 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:20:42 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:20:42 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:20:42 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:20:42 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:20:42 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:20:42 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:20:42 user nova-compute[74743]:       <nova:owner>
Nov 18 17:20:42 user nova-compute[74743]:         <nova:user uuid="89ce0d4bf7234c348b9b1a8979609c7b">tempest-TestVolumeBootPattern-1373443944-project-member</nova:user>
Nov 18 17:20:42 user nova-compute[74743]:         <nova:project uuid="a956c4d6e4304d34872ecf989279c886">tempest-TestVolumeBootPattern-1373443944</nova:project>
Nov 18 17:20:42 user nova-compute[74743]:       </nova:owner>
Nov 18 17:20:42 user nova-compute[74743]:       <nova:ports>
Nov 18 17:20:42 user nova-compute[74743]:         <nova:port uuid="55c54294-3f4d-4199-a9fa-a273016b376b">
Nov 18 17:20:42 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 18 17:20:42 user nova-compute[74743]:         </nova:port>
Nov 18 17:20:42 user nova-compute[74743]:       </nova:ports>
Nov 18 17:20:42 user nova-compute[74743]:     </nova:instance>
Nov 18 17:20:42 user nova-compute[74743]:   </metadata>
Nov 18 17:20:42 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:20:42 user nova-compute[74743]:     <system>
Nov 18 17:20:42 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:20:42 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:20:42 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:20:42 user nova-compute[74743]:       <entry name="serial">9cbdffd6-df57-4bab-b69c-b41a2718fd68</entry>
Nov 18 17:20:42 user nova-compute[74743]:       <entry name="uuid">9cbdffd6-df57-4bab-b69c-b41a2718fd68</entry>
Nov 18 17:20:42 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:20:42 user nova-compute[74743]:     </system>
Nov 18 17:20:42 user nova-compute[74743]:   </sysinfo>
Nov 18 17:20:42 user nova-compute[74743]:   <os>
Nov 18 17:20:42 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:20:42 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:20:42 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:20:42 user nova-compute[74743]:   </os>
Nov 18 17:20:42 user nova-compute[74743]:   <features>
Nov 18 17:20:42 user nova-compute[74743]:     <acpi/>
Nov 18 17:20:42 user nova-compute[74743]:     <apic/>
Nov 18 17:20:42 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:20:42 user nova-compute[74743]:   </features>
Nov 18 17:20:42 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:20:42 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:20:42 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:20:42 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:20:42 user nova-compute[74743]:   </clock>
Nov 18 17:20:42 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:20:42 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:20:42 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:20:42 user nova-compute[74743]:   </cpu>
Nov 18 17:20:42 user nova-compute[74743]:   <devices>
Nov 18 17:20:42 user nova-compute[74743]:     <disk type="block" device="disk">
Nov 18 17:20:42 user nova-compute[74743]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:20:42 user nova-compute[74743]:       <source dev="/dev/sdb"/>
Nov 18 17:20:42 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:20:42 user nova-compute[74743]:       <serial>36baaa29-2acc-4476-9f64-ec76a08f66f2</serial>
Nov 18 17:20:42 user nova-compute[74743]:     </disk>
Nov 18 17:20:42 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:20:42 user nova-compute[74743]:       <mac address="fa:16:3e:70:96:90"/>
Nov 18 17:20:42 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:20:42 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:20:42 user nova-compute[74743]:       <target dev="tap55c54294-3f"/>
Nov 18 17:20:42 user nova-compute[74743]:     </interface>
Nov 18 17:20:42 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:20:42 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/9cbdffd6-df57-4bab-b69c-b41a2718fd68/console.log" append="off"/>
Nov 18 17:20:42 user nova-compute[74743]:     </serial>
Nov 18 17:20:42 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:20:42 user nova-compute[74743]:     <video>
Nov 18 17:20:42 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:20:42 user nova-compute[74743]:     </video>
Nov 18 17:20:42 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:20:42 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:20:42 user nova-compute[74743]:     </rng>
Nov 18 17:20:42 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:20:42 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:20:42 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:20:42 user nova-compute[74743]:     </memballoon>
Nov 18 17:20:42 user nova-compute[74743]:   </devices>
Nov 18 17:20:42 user nova-compute[74743]: </domain>
Nov 18 17:20:42 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:20:42 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:20:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-260240897',display_name='tempest-TestVolumeBootPattern-server-260240897',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-260240897',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOLvs8QktAbg6ubYzS1yyIzjK6/SEgIlSEhHuVaKm0b6bpmV4klO8yadOBEcp58HtUXwfad9vILFBUP0iHELOBhABjjRYYSI0ECkBhwEERqTkNNauBgT8rgOot2Bwx6w0A==',key_name='tempest-TestVolumeBootPattern-2140749553',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a956c4d6e4304d34872ecf989279c886',ramdisk_id='',reservation_id='r-pq273w0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1373443944',owner_user_name='tempest-TestVolumeBootPattern-1373443944-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:20:35Z,user_data=None,user_id='89ce0d4bf7234c348b9b1a8979609c7b',uuid=9cbdffd6-df57-4bab-b69c-b41a2718fd68,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55c54294-3f4d-4199-a9fa-a273016b376b", "address": "fa:16:3e:70:96:90", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55c54294-3f", "ovs_interfaceid": "55c54294-3f4d-4199-a9fa-a273016b376b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:20:42 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Converting VIF {"id": "55c54294-3f4d-4199-a9fa-a273016b376b", "address": "fa:16:3e:70:96:90", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55c54294-3f", "ovs_interfaceid": "55c54294-3f4d-4199-a9fa-a273016b376b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:20:42 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:96:90,bridge_name='br-int',has_traffic_filtering=True,id=55c54294-3f4d-4199-a9fa-a273016b376b,network=Network(fc55f18a-b779-4b04-8828-278ecd62211a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55c54294-3f') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:20:42 user nova-compute[74743]: DEBUG os_vif [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:96:90,bridge_name='br-int',has_traffic_filtering=True,id=55c54294-3f4d-4199-a9fa-a273016b376b,network=Network(fc55f18a-b779-4b04-8828-278ecd62211a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55c54294-3f') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:20:42 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:42 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:20:42 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:20:42 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:42 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '30d19bfa-a14d-5f2f-af36-0a6473eea92d', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:20:42 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:42 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:42 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:42 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap55c54294-3f, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:20:42 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap55c54294-3f, col_values=(('qos', UUID('aec6ab24-9cc1-453b-b6de-a86c94b47294')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:20:42 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap55c54294-3f, col_values=(('external_ids', {'iface-id': '55c54294-3f4d-4199-a9fa-a273016b376b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:96:90', 'vm-uuid': '9cbdffd6-df57-4bab-b69c-b41a2718fd68'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:20:42 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:42 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:20:42 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:42 user nova-compute[74743]: INFO os_vif [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:96:90,bridge_name='br-int',has_traffic_filtering=True,id=55c54294-3f4d-4199-a9fa-a273016b376b,network=Network(fc55f18a-b779-4b04-8828-278ecd62211a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55c54294-3f')
Nov 18 17:20:42 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:20:42 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] No VIF found with MAC fa:16:3e:70:96:90, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:20:44 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:44 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:44 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:44 user nova-compute[74743]: DEBUG nova.compute.manager [req-46d44450-3619-4bc1-a3f1-9130782252bf req-b3268748-1431-44a8-924e-38aeff9e87fb service nova] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Received event network-vif-plugged-55c54294-3f4d-4199-a9fa-a273016b376b {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:20:44 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-46d44450-3619-4bc1-a3f1-9130782252bf req-b3268748-1431-44a8-924e-38aeff9e87fb service nova] Acquiring lock "9cbdffd6-df57-4bab-b69c-b41a2718fd68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:20:44 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-46d44450-3619-4bc1-a3f1-9130782252bf req-b3268748-1431-44a8-924e-38aeff9e87fb service nova] Lock "9cbdffd6-df57-4bab-b69c-b41a2718fd68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:20:44 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-46d44450-3619-4bc1-a3f1-9130782252bf req-b3268748-1431-44a8-924e-38aeff9e87fb service nova] Lock "9cbdffd6-df57-4bab-b69c-b41a2718fd68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:20:44 user nova-compute[74743]: DEBUG nova.compute.manager [req-46d44450-3619-4bc1-a3f1-9130782252bf req-b3268748-1431-44a8-924e-38aeff9e87fb service nova] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] No waiting events found dispatching network-vif-plugged-55c54294-3f4d-4199-a9fa-a273016b376b {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:20:44 user nova-compute[74743]: WARNING nova.compute.manager [req-46d44450-3619-4bc1-a3f1-9130782252bf req-b3268748-1431-44a8-924e-38aeff9e87fb service nova] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Received unexpected event network-vif-plugged-55c54294-3f4d-4199-a9fa-a273016b376b for instance with vm_state building and task_state spawning.
Nov 18 17:20:44 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:44 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:44 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:45 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:46 user nova-compute[74743]: DEBUG nova.compute.manager [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:20:46 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Guest created on hypervisor {{(pid=74743) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 17:20:46 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Instance spawned successfully.
Nov 18 17:20:46 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 17:20:46 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Found default for hw_cdrom_bus of ide {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:20:46 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Found default for hw_disk_bus of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:20:46 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Found default for hw_input_bus of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:20:46 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Found default for hw_pointer_model of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:20:46 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Found default for hw_video_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:20:46 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Found default for hw_vif_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:20:46 user nova-compute[74743]: INFO nova.compute.manager [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Took 5.22 seconds to spawn the instance on the hypervisor.
Nov 18 17:20:46 user nova-compute[74743]: DEBUG nova.compute.manager [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:20:46 user nova-compute[74743]: DEBUG nova.compute.manager [req-5b0dbd8e-72c4-4a01-9402-d81fd81ae8c0 req-aad0dde7-f5e5-4a18-b9d1-a742436aa8fd service nova] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Received event network-vif-plugged-55c54294-3f4d-4199-a9fa-a273016b376b {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:20:46 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-5b0dbd8e-72c4-4a01-9402-d81fd81ae8c0 req-aad0dde7-f5e5-4a18-b9d1-a742436aa8fd service nova] Acquiring lock "9cbdffd6-df57-4bab-b69c-b41a2718fd68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:20:46 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-5b0dbd8e-72c4-4a01-9402-d81fd81ae8c0 req-aad0dde7-f5e5-4a18-b9d1-a742436aa8fd service nova] Lock "9cbdffd6-df57-4bab-b69c-b41a2718fd68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:20:46 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-5b0dbd8e-72c4-4a01-9402-d81fd81ae8c0 req-aad0dde7-f5e5-4a18-b9d1-a742436aa8fd service nova] Lock "9cbdffd6-df57-4bab-b69c-b41a2718fd68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:20:46 user nova-compute[74743]: DEBUG nova.compute.manager [req-5b0dbd8e-72c4-4a01-9402-d81fd81ae8c0 req-aad0dde7-f5e5-4a18-b9d1-a742436aa8fd service nova] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] No waiting events found dispatching network-vif-plugged-55c54294-3f4d-4199-a9fa-a273016b376b {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:20:46 user nova-compute[74743]: WARNING nova.compute.manager [req-5b0dbd8e-72c4-4a01-9402-d81fd81ae8c0 req-aad0dde7-f5e5-4a18-b9d1-a742436aa8fd service nova] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Received unexpected event network-vif-plugged-55c54294-3f4d-4199-a9fa-a273016b376b for instance with vm_state building and task_state spawning.
Nov 18 17:20:46 user nova-compute[74743]: INFO nova.compute.manager [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Took 11.69 seconds to build instance.
Nov 18 17:20:46 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-af728977-d373-45ba-8e49-4bdbd2856d54 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "9cbdffd6-df57-4bab-b69c-b41a2718fd68" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.785s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:20:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:50 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-fa3b8d3f-42b4-404a-8829-6b4931764735 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Acquiring lock "6aecacc3-577d-4b36-9223-8446afe54e26" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:20:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-fa3b8d3f-42b4-404a-8829-6b4931764735 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "6aecacc3-577d-4b36-9223-8446afe54e26" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:20:54 user nova-compute[74743]: DEBUG nova.objects.instance [None req-fa3b8d3f-42b4-404a-8829-6b4931764735 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lazy-loading 'flavor' on Instance uuid 6aecacc3-577d-4b36-9223-8446afe54e26 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:20:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-fa3b8d3f-42b4-404a-8829-6b4931764735 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "6aecacc3-577d-4b36-9223-8446afe54e26" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:20:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-fa3b8d3f-42b4-404a-8829-6b4931764735 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Acquiring lock "6aecacc3-577d-4b36-9223-8446afe54e26" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:20:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-fa3b8d3f-42b4-404a-8829-6b4931764735 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "6aecacc3-577d-4b36-9223-8446afe54e26" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:20:54 user nova-compute[74743]: INFO nova.compute.manager [None req-fa3b8d3f-42b4-404a-8829-6b4931764735 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Attaching volume 0fbaeb5b-46d6-4d34-918f-48160528ae76 to /dev/vdb
Nov 18 17:20:54 user nova-compute[74743]: DEBUG os_brick.utils [None req-fa3b8d3f-42b4-404a-8829-6b4931764735 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:20:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:20:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:20:54 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9e363c-dd7d-4a5a-ac49-2cf4ae1dae04]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1116acd8874d\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:20:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:20:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:20:54 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2f5d9d-8085-427b-a251-90cae6e66bd7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:20:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:20:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:20:54 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e260bab-c1f9-4189-98e6-04406d7f436b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:20:54 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[546cdac7-0794-4a3b-a4f7-d4dc5b77245c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:20:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-fa3b8d3f-42b4-404a-8829-6b4931764735 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Running cmd (subprocess): nvme version {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:20:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-fa3b8d3f-42b4-404a-8829-6b4931764735 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] 'nvme version' failed. Not Retrying. {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:20:54 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fa3b8d3f-42b4-404a-8829-6b4931764735 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] nvme not present on system {{(pid=74743) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 17:20:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:20:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:20:54 user nova-compute[74743]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 17:20:54 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5a524f-192d-4f91-9e93-22a9cd568552]: (4, '') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:20:54 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-fa3b8d3f-42b4-404a-8829-6b4931764735 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74743) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 17:20:54 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-fa3b8d3f-42b4-404a-8829-6b4931764735 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 17:20:54 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-fa3b8d3f-42b4-404a-8829-6b4931764735 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] LIGHTOS: no hostnqn found. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 17:20:54 user nova-compute[74743]: DEBUG os_brick.utils [None req-fa3b8d3f-42b4-404a-8829-6b4931764735 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1116acd8874d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:20:54 user nova-compute[74743]: DEBUG nova.virt.block_device [None req-fa3b8d3f-42b4-404a-8829-6b4931764735 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Updating existing volume attachment record: 5cf634aa-f4e2-4fd5-a969-55f663917764 {{(pid=74743) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 17:20:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:57 user nova-compute[74743]: DEBUG nova.compute.manager [None req-db4926e9-06f5-4833-9f9b-94234a653744 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:20:57 user nova-compute[74743]: INFO nova.compute.manager [None req-db4926e9-06f5-4833-9f9b-94234a653744 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] instance snapshotting
Nov 18 17:20:57 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-db4926e9-06f5-4833-9f9b-94234a653744 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Beginning live snapshot process
Nov 18 17:20:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-db4926e9-06f5-4833-9f9b-94234a653744 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/789583c2-1c04-4510-a37e-0e9b7d3a0971/disk --force-share --output=json -f qcow2 {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:20:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-db4926e9-06f5-4833-9f9b-94234a653744 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/789583c2-1c04-4510-a37e-0e9b7d3a0971/disk --force-share --output=json -f qcow2" returned: 0 in 0.236s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:20:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-db4926e9-06f5-4833-9f9b-94234a653744 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/789583c2-1c04-4510-a37e-0e9b7d3a0971/disk --force-share --output=json -f qcow2 {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:20:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:20:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-db4926e9-06f5-4833-9f9b-94234a653744 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/789583c2-1c04-4510-a37e-0e9b7d3a0971/disk --force-share --output=json -f qcow2" returned: 0 in 0.190s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:20:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-db4926e9-06f5-4833-9f9b-94234a653744 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:20:58 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-db4926e9-06f5-4833-9f9b-94234a653744 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.189s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:20:58 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-db4926e9-06f5-4833-9f9b-94234a653744 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpu9zgkfnx/f18faa04641d4921a8c29b0b9eefd7aa.delta 1073741824 {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:20:58 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-db4926e9-06f5-4833-9f9b-94234a653744 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpu9zgkfnx/f18faa04641d4921a8c29b0b9eefd7aa.delta 1073741824" returned: 0 in 0.056s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:20:58 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-db4926e9-06f5-4833-9f9b-94234a653744 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 18 17:20:58 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-db4926e9-06f5-4833-9f9b-94234a653744 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74743) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 17:20:59 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-db4926e9-06f5-4833-9f9b-94234a653744 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74743) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 17:20:59 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-db4926e9-06f5-4833-9f9b-94234a653744 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 18 17:20:59 user nova-compute[74743]: DEBUG nova.privsep.utils [None req-db4926e9-06f5-4833-9f9b-94234a653744 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74743) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 18 17:20:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-db4926e9-06f5-4833-9f9b-94234a653744 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpu9zgkfnx/f18faa04641d4921a8c29b0b9eefd7aa.delta /opt/stack/data/nova/instances/snapshots/tmpu9zgkfnx/f18faa04641d4921a8c29b0b9eefd7aa {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:20:59 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:00 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa3b8d3f-42b4-404a-8829-6b4931764735 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Calling os-brick to attach iSCSI Volume {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 17:21:00 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3b8d3f-42b4-404a-8829-6b4931764735 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RabfjIkA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:21:00 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-fa3b8d3f-42b4-404a-8829-6b4931764735 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:21:00 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-fa3b8d3f-42b4-404a-8829-6b4931764735 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:21:00 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-fa3b8d3f-42b4-404a-8829-6b4931764735 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:21:00 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-fa3b8d3f-42b4-404a-8829-6b4931764735 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:21:00 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-fa3b8d3f-42b4-404a-8829-6b4931764735 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:21:00 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-fa3b8d3f-42b4-404a-8829-6b4931764735 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:21:00 user nova-compute[74743]: INFO os_brick.initiator.connectors.iscsi [None req-fa3b8d3f-42b4-404a-8829-6b4931764735 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 17:21:00 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-db4926e9-06f5-4833-9f9b-94234a653744 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpu9zgkfnx/f18faa04641d4921a8c29b0b9eefd7aa.delta /opt/stack/data/nova/instances/snapshots/tmpu9zgkfnx/f18faa04641d4921a8c29b0b9eefd7aa" returned: 0 in 0.709s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:00 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-db4926e9-06f5-4833-9f9b-94234a653744 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Snapshot extracted, beginning image upload
Nov 18 17:21:00 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 -p 172.16.0.220:3260 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:00 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:00 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d75ee2-67c0-4c50-a8a8-fc26a9f4b66a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:21:00 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3b8d3f-42b4-404a-8829-6b4931764735 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 17:21:00 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:21:00 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 -p 172.16.0.220:3260 --interface default --op new {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:00 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:00 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[2525b3a6-c265-4798-861f-c9453d3db865]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76] added\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:21:00 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3b8d3f-42b4-404a-8829-6b4931764735 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76] added
Nov 18 17:21:00 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:21:00 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:00 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:00 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ba6f13-50f6-405e-9bdb-425dbf30512c]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:21:00 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3b8d3f-42b4-404a-8829-6b4931764735 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:21:00 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:00 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:00 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca5fd7e-1a36-42b4-a66f-6c02a21c3554]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:21:00 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3b8d3f-42b4-404a-8829-6b4931764735 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:21:00 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RabfjIkA {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:00 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RabfjIkA" returned: 0 in 0.024s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:00 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[de036324-8152-4e11-8862-a9f3a78c0366]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:21:00 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3b8d3f-42b4-404a-8829-6b4931764735 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RabfjIkA'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:21:00 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:00 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:00 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[5543b8f9-ef6a-4e7f-93eb-6caf1ee1b74c]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:21:00 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3b8d3f-42b4-404a-8829-6b4931764735 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:21:00 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:00 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:00 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d7618f-5709-45d0-8f82-7d5e7a2c06ea]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:21:00 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3b8d3f-42b4-404a-8829-6b4931764735 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:21:00 user nova-compute[74743]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)
Nov 18 17:21:00 user nova-compute[74743]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 (non-flash)
Nov 18 17:21:00 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:21:00 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3b8d3f-42b4-404a-8829-6b4931764735 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:21:00 user nova-compute[74743]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)
Nov 18 17:21:00 user nova-compute[74743]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 (non-flash)
Nov 18 17:21:00 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:21:00 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 -p 172.16.0.220:3260 --login {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:00 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:00 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb701ab-d6b9-4f1f-b2f8-925d3c45ef2d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:21:00 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3b8d3f-42b4-404a-8829-6b4931764735 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76, portal: 172.16.0.220,3260]
Nov 18 17:21:00 user nova-compute[74743]: Login to [iface: default, target: iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76, portal: 172.16.0.220,3260] successful.
Nov 18 17:21:00 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:21:00 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:00 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:00 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6416ee-7030-448a-af24-7c034057a10a]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:21:00 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3b8d3f-42b4-404a-8829-6b4931764735 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:21:00 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:00 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:00 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b780e26-16d3-489d-abca-a9332dbeac13]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:21:00 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3b8d3f-42b4-404a-8829-6b4931764735 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:21:00 user nova-compute[74743]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)
Nov 18 17:21:00 user nova-compute[74743]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 (non-flash)
Nov 18 17:21:00 user nova-compute[74743]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 (non-flash)
Nov 18 17:21:00 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:21:00 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3b8d3f-42b4-404a-8829-6b4931764735 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:21:00 user nova-compute[74743]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)
Nov 18 17:21:00 user nova-compute[74743]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 (non-flash)
Nov 18 17:21:00 user nova-compute[74743]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 (non-flash)
Nov 18 17:21:00 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:21:00 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-fa3b8d3f-42b4-404a-8829-6b4931764735 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:21:00 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3b8d3f-42b4-404a-8829-6b4931764735 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Connected to 172.16.0.220:3260 {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 17:21:00 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-fa3b8d3f-42b4-404a-8829-6b4931764735 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] HCTL ('35', '-', '-', 0) found on session 44 with lun 0 {{(pid=74743) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 17:21:00 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-fa3b8d3f-42b4-404a-8829-6b4931764735 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74743) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 17:21:00 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:00 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:00 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff22a18a-529c-42f7-9341-b6f9baec154e]: (4, ('- - 0', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:21:00 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-fa3b8d3f-42b4-404a-8829-6b4931764735 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Searching for a device in session 44 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:21:00 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3b8d3f-42b4-404a-8829-6b4931764735 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RabfjIkA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 17:21:01 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-fa3b8d3f-42b4-404a-8829-6b4931764735 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:21:01 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3b8d3f-42b4-404a-8829-6b4931764735 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23463376139613364', 'path': '/dev/sdd'} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:21:01 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa3b8d3f-42b4-404a-8829-6b4931764735 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463376139613364', 'path': '/dev/sdd'} {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 17:21:01 user nova-compute[74743]: DEBUG nova.objects.instance [None req-fa3b8d3f-42b4-404a-8829-6b4931764735 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lazy-loading 'flavor' on Instance uuid 6aecacc3-577d-4b36-9223-8446afe54e26 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:21:01 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-fa3b8d3f-42b4-404a-8829-6b4931764735 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 17:21:01 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:21:01 user nova-compute[74743]:   <source dev="/dev/sdd"/>
Nov 18 17:21:01 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:21:01 user nova-compute[74743]:   <serial>0fbaeb5b-46d6-4d34-918f-48160528ae76</serial>
Nov 18 17:21:01 user nova-compute[74743]: </disk>
Nov 18 17:21:01 user nova-compute[74743]:  {{(pid=74743) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 17:21:01 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-fa3b8d3f-42b4-404a-8829-6b4931764735 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:21:01 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-fa3b8d3f-42b4-404a-8829-6b4931764735 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:21:01 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-fa3b8d3f-42b4-404a-8829-6b4931764735 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] No VIF found with MAC fa:16:3e:1f:4b:8a, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:21:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-fa3b8d3f-42b4-404a-8829-6b4931764735 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "6aecacc3-577d-4b36-9223-8446afe54e26" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.903s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:21:02 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:02 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-db4926e9-06f5-4833-9f9b-94234a653744 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Snapshot image upload complete
Nov 18 17:21:02 user nova-compute[74743]: INFO nova.compute.manager [None req-db4926e9-06f5-4833-9f9b-94234a653744 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Took 5.69 seconds to snapshot the instance on the hypervisor.
Nov 18 17:21:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:07 user nova-compute[74743]: DEBUG nova.compute.manager [req-36c1ce2f-d486-46e6-b699-fdd9a954c30f req-1a36bc90-ebcf-4f30-89fd-09c31f36ea48 service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Received event network-changed-70799139-883d-4f9a-a2ba-e2fabf2871ec {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:21:07 user nova-compute[74743]: DEBUG nova.compute.manager [req-36c1ce2f-d486-46e6-b699-fdd9a954c30f req-1a36bc90-ebcf-4f30-89fd-09c31f36ea48 service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Refreshing instance network info cache due to event network-changed-70799139-883d-4f9a-a2ba-e2fabf2871ec. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:21:07 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-36c1ce2f-d486-46e6-b699-fdd9a954c30f req-1a36bc90-ebcf-4f30-89fd-09c31f36ea48 service nova] Acquiring lock "refresh_cache-6aecacc3-577d-4b36-9223-8446afe54e26" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:21:07 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-36c1ce2f-d486-46e6-b699-fdd9a954c30f req-1a36bc90-ebcf-4f30-89fd-09c31f36ea48 service nova] Acquired lock "refresh_cache-6aecacc3-577d-4b36-9223-8446afe54e26" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:21:07 user nova-compute[74743]: DEBUG nova.network.neutron [req-36c1ce2f-d486-46e6-b699-fdd9a954c30f req-1a36bc90-ebcf-4f30-89fd-09c31f36ea48 service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Refreshing network info cache for port 70799139-883d-4f9a-a2ba-e2fabf2871ec {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:21:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:07 user nova-compute[74743]: DEBUG nova.network.neutron [req-36c1ce2f-d486-46e6-b699-fdd9a954c30f req-1a36bc90-ebcf-4f30-89fd-09c31f36ea48 service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Updated VIF entry in instance network info cache for port 70799139-883d-4f9a-a2ba-e2fabf2871ec. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:21:07 user nova-compute[74743]: DEBUG nova.network.neutron [req-36c1ce2f-d486-46e6-b699-fdd9a954c30f req-1a36bc90-ebcf-4f30-89fd-09c31f36ea48 service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Updating instance_info_cache with network_info: [{"id": "70799139-883d-4f9a-a2ba-e2fabf2871ec", "address": "fa:16:3e:1f:4b:8a", "network": {"id": "cd6d2dbc-0950-412a-ab9d-cf7615c06eb8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1261309930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38303e1b311044deb8c833ed3299ce88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70799139-88", "ovs_interfaceid": "70799139-883d-4f9a-a2ba-e2fabf2871ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:21:07 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-36c1ce2f-d486-46e6-b699-fdd9a954c30f req-1a36bc90-ebcf-4f30-89fd-09c31f36ea48 service nova] Releasing lock "refresh_cache-6aecacc3-577d-4b36-9223-8446afe54e26" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:21:10 user nova-compute[74743]: DEBUG nova.compute.manager [req-821e6009-27da-4e5c-a19a-55e29d21f44d req-3af59ac2-cd5e-4914-b077-ad2daa7e57ff service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Received event network-changed-70799139-883d-4f9a-a2ba-e2fabf2871ec {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:21:10 user nova-compute[74743]: DEBUG nova.compute.manager [req-821e6009-27da-4e5c-a19a-55e29d21f44d req-3af59ac2-cd5e-4914-b077-ad2daa7e57ff service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Refreshing instance network info cache due to event network-changed-70799139-883d-4f9a-a2ba-e2fabf2871ec. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:21:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-821e6009-27da-4e5c-a19a-55e29d21f44d req-3af59ac2-cd5e-4914-b077-ad2daa7e57ff service nova] Acquiring lock "refresh_cache-6aecacc3-577d-4b36-9223-8446afe54e26" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:21:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-821e6009-27da-4e5c-a19a-55e29d21f44d req-3af59ac2-cd5e-4914-b077-ad2daa7e57ff service nova] Acquired lock "refresh_cache-6aecacc3-577d-4b36-9223-8446afe54e26" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:21:10 user nova-compute[74743]: DEBUG nova.network.neutron [req-821e6009-27da-4e5c-a19a-55e29d21f44d req-3af59ac2-cd5e-4914-b077-ad2daa7e57ff service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Refreshing network info cache for port 70799139-883d-4f9a-a2ba-e2fabf2871ec {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:21:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:10 user nova-compute[74743]: DEBUG nova.network.neutron [req-821e6009-27da-4e5c-a19a-55e29d21f44d req-3af59ac2-cd5e-4914-b077-ad2daa7e57ff service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Updated VIF entry in instance network info cache for port 70799139-883d-4f9a-a2ba-e2fabf2871ec. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:21:10 user nova-compute[74743]: DEBUG nova.network.neutron [req-821e6009-27da-4e5c-a19a-55e29d21f44d req-3af59ac2-cd5e-4914-b077-ad2daa7e57ff service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Updating instance_info_cache with network_info: [{"id": "70799139-883d-4f9a-a2ba-e2fabf2871ec", "address": "fa:16:3e:1f:4b:8a", "network": {"id": "cd6d2dbc-0950-412a-ab9d-cf7615c06eb8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1261309930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38303e1b311044deb8c833ed3299ce88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70799139-88", "ovs_interfaceid": "70799139-883d-4f9a-a2ba-e2fabf2871ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:21:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-821e6009-27da-4e5c-a19a-55e29d21f44d req-3af59ac2-cd5e-4914-b077-ad2daa7e57ff service nova] Releasing lock "refresh_cache-6aecacc3-577d-4b36-9223-8446afe54e26" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:21:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:12 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Acquiring lock "6aecacc3-577d-4b36-9223-8446afe54e26" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:21:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "6aecacc3-577d-4b36-9223-8446afe54e26" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:21:13 user nova-compute[74743]: INFO nova.compute.manager [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Rebooting instance
Nov 18 17:21:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Acquiring lock "refresh_cache-6aecacc3-577d-4b36-9223-8446afe54e26" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:21:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Acquired lock "refresh_cache-6aecacc3-577d-4b36-9223-8446afe54e26" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:21:13 user nova-compute[74743]: DEBUG nova.network.neutron [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:21:14 user nova-compute[74743]: DEBUG nova.network.neutron [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Updating instance_info_cache with network_info: [{"id": "70799139-883d-4f9a-a2ba-e2fabf2871ec", "address": "fa:16:3e:1f:4b:8a", "network": {"id": "cd6d2dbc-0950-412a-ab9d-cf7615c06eb8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1261309930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38303e1b311044deb8c833ed3299ce88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70799139-88", "ovs_interfaceid": "70799139-883d-4f9a-a2ba-e2fabf2871ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:21:14 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Releasing lock "refresh_cache-6aecacc3-577d-4b36-9223-8446afe54e26" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:21:14 user nova-compute[74743]: DEBUG nova.compute.manager [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:21:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:14 user nova-compute[74743]: DEBUG nova.compute.manager [req-cb1aec06-e407-4d13-9a03-9be452b5d580 req-bc3168ca-419f-4a10-a8ee-ec13de34d1b9 service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Received event network-vif-unplugged-70799139-883d-4f9a-a2ba-e2fabf2871ec {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:21:14 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-cb1aec06-e407-4d13-9a03-9be452b5d580 req-bc3168ca-419f-4a10-a8ee-ec13de34d1b9 service nova] Acquiring lock "6aecacc3-577d-4b36-9223-8446afe54e26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:21:14 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-cb1aec06-e407-4d13-9a03-9be452b5d580 req-bc3168ca-419f-4a10-a8ee-ec13de34d1b9 service nova] Lock "6aecacc3-577d-4b36-9223-8446afe54e26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:21:14 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-cb1aec06-e407-4d13-9a03-9be452b5d580 req-bc3168ca-419f-4a10-a8ee-ec13de34d1b9 service nova] Lock "6aecacc3-577d-4b36-9223-8446afe54e26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:21:14 user nova-compute[74743]: DEBUG nova.compute.manager [req-cb1aec06-e407-4d13-9a03-9be452b5d580 req-bc3168ca-419f-4a10-a8ee-ec13de34d1b9 service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] No waiting events found dispatching network-vif-unplugged-70799139-883d-4f9a-a2ba-e2fabf2871ec {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:21:14 user nova-compute[74743]: WARNING nova.compute.manager [req-cb1aec06-e407-4d13-9a03-9be452b5d580 req-bc3168ca-419f-4a10-a8ee-ec13de34d1b9 service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Received unexpected event network-vif-unplugged-70799139-883d-4f9a-a2ba-e2fabf2871ec for instance with vm_state active and task_state reboot_started_hard.
Nov 18 17:21:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:15 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Instance destroyed successfully.
Nov 18 17:21:15 user nova-compute[74743]: DEBUG nova.objects.instance [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lazy-loading 'resources' on Instance uuid 6aecacc3-577d-4b36-9223-8446afe54e26 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:19:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-571016991',display_name='tempest-TestMinimumBasicScenario-server-571016991',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-571016991',id=34,image_ref='502d6d5f-7f9a-4b3b-af75-cf8915d0f14a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDhtFEpE8QQq5OQXk5qeUW0OP7QLpgRvDd9rkjiQBHiCfwQRKXXiuo4jCXffab0TYR+4YYJlJ/bv6z9gV1HPXH7ici9tntf4eAwrpJJu35hohZ9oXg0J27GRRsfKG9Xbw==',key_name='tempest-TestMinimumBasicScenario-597950928',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:19:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='38303e1b311044deb8c833ed3299ce88',ramdisk_id='',reservation_id='r-algq1rxa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='502d6d5f-7f9a-4b3b-af75-cf8915d0f14a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1229544582',owner_user_name='tempest-TestMinimumBasicScenario-1229544582-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:21:14Z,user_data=None,user_id='52673e9f58e44abc8f9bd60d066c4197',uuid=6aecacc3-577d-4b36-9223-8446afe54e26,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "70799139-883d-4f9a-a2ba-e2fabf2871ec", "address": "fa:16:3e:1f:4b:8a", "network": {"id": "cd6d2dbc-0950-412a-ab9d-cf7615c06eb8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1261309930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38303e1b311044deb8c833ed3299ce88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70799139-88", "ovs_interfaceid": "70799139-883d-4f9a-a2ba-e2fabf2871ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Converting VIF {"id": "70799139-883d-4f9a-a2ba-e2fabf2871ec", "address": "fa:16:3e:1f:4b:8a", "network": {"id": "cd6d2dbc-0950-412a-ab9d-cf7615c06eb8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1261309930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38303e1b311044deb8c833ed3299ce88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70799139-88", "ovs_interfaceid": "70799139-883d-4f9a-a2ba-e2fabf2871ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:4b:8a,bridge_name='br-int',has_traffic_filtering=True,id=70799139-883d-4f9a-a2ba-e2fabf2871ec,network=Network(cd6d2dbc-0950-412a-ab9d-cf7615c06eb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70799139-88') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG os_vif [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:4b:8a,bridge_name='br-int',has_traffic_filtering=True,id=70799139-883d-4f9a-a2ba-e2fabf2871ec,network=Network(cd6d2dbc-0950-412a-ab9d-cf7615c06eb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70799139-88') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap70799139-88, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=575b77aa-5ea1-41e1-ad53-63b65a74e464) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:15 user nova-compute[74743]: INFO os_vif [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:4b:8a,bridge_name='br-int',has_traffic_filtering=True,id=70799139-883d-4f9a-a2ba-e2fabf2871ec,network=Network(cd6d2dbc-0950-412a-ab9d-cf7615c06eb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70799139-88')
Nov 18 17:21:15 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] calling os-brick to detach iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, {'target_iqn': 'iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RabfjIkA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:21:15 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:21:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d93a1f5-68e4-49a3-a5e6-03ceec0e5204]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 17:21:15 user nova-compute[74743]: No targets found.
Nov 18 17:21:15 user nova-compute[74743]: iSNS:
Nov 18 17:21:15 user nova-compute[74743]: No targets found.
Nov 18 17:21:15 user nova-compute[74743]: STATIC:
Nov 18 17:21:15 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f
Nov 18 17:21:15 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:21:15 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:21:15 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127
Nov 18 17:21:15 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:21:15 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:21:15 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76
Nov 18 17:21:15 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:21:15 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:21:15 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2
Nov 18 17:21:15 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:21:15 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:21:15 user nova-compute[74743]: FIRMWARE:
Nov 18 17:21:15 user nova-compute[74743]: No targets found.
Nov 18 17:21:15 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 17:21:15 user nova-compute[74743]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 17:21:15 user nova-compute[74743]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74743) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76', 0)] {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2203d8f-289b-47b7-b342-8ad6b4096881]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[86106094-b4cf-4e49-b2a6-ec4685734cd6]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:21:15 user nova-compute[74743]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)
Nov 18 17:21:15 user nova-compute[74743]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 (non-flash)
Nov 18 17:21:15 user nova-compute[74743]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 (non-flash)
Nov 18 17:21:15 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:21:15 user nova-compute[74743]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)
Nov 18 17:21:15 user nova-compute[74743]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 (non-flash)
Nov 18 17:21:15 user nova-compute[74743]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 (non-flash)
Nov 18 17:21:15 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb398ff7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76'): ({'sdd'}, set())}) {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Removing single pathed devices sdd {{(pid=74743) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6a2d8e-2b4f-4a62-828f-9b4f555529f6]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cdfdfee-b4a7-4dd6-b747-101d030bb91e]: (4, ('ok\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Flushing IO for device /dev/sdd {{(pid=74743) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d557e644-e575-47e5-9174-a8d28cbfa426]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74743) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b63a9c-9713-4618-8f8f-bd254e41c668]: (4, ('1', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] SCSI volumes sdd have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76')] {{(pid=74743) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8693a4-68bb-46f1-9dbb-3363c7bb1992]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 -p 172.16.0.220:3260 --logout {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[95296898-881d-47b8-ac21-f5b1305986ea]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76, portal: 172.16.0.220,3260]
Nov 18 17:21:15 user nova-compute[74743]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76, portal: 172.16.0.220,3260] successful.
Nov 18 17:21:15 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 -p 172.16.0.220:3260 --op delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e15441-a933-4564-83ec-e423578569a5]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] <== disconnect_volume: return (327ms) None {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Disconnected iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Start _get_guest_xml network_info=[{"id": "70799139-883d-4f9a-a2ba-e2fabf2871ec", "address": "fa:16:3e:1f:4b:8a", "network": {"id": "cd6d2dbc-0950-412a-ab9d-cf7615c06eb8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1261309930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38303e1b311044deb8c833ed3299ce88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70799139-88", "ovs_interfaceid": "70799139-883d-4f9a-a2ba-e2fabf2871ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=502d6d5f-7f9a-4b3b-af75-cf8915d0f14a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '502d6d5f-7f9a-4b3b-af75-cf8915d0f14a'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'boot_index': None, 'mount_device': '/dev/vdb', 'attachment_id': '5cf634aa-f4e2-4fd5-a969-55f663917764', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RabfjIkA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '6aecacc3-577d-4b36-9223-8446afe54e26', 'attached_at': '', 'detached_at': '', 'volume_id': '0fbaeb5b-46d6-4d34-918f-48160528ae76', 'serial': '0fbaeb5b-46d6-4d34-918f-48160528ae76'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:21:15 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:21:15 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:21:15 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=502d6d5f-7f9a-4b3b-af75-cf8915d0f14a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG nova.objects.instance [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6aecacc3-577d-4b36-9223-8446afe54e26 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG nova.objects.base [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Object Instance<6aecacc3-577d-4b36-9223-8446afe54e26> lazy-loaded attributes: resources,vcpu_model {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Calling os-brick to attach iSCSI Volume {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RabfjIkA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:21:15 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:21:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:21:15 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:21:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:21:15 user nova-compute[74743]: INFO os_brick.initiator.connectors.iscsi [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 -p 172.16.0.220:3260 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5984493-efd3-4b50-ba16-7fa5e1451821]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 17:21:15 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 -p 172.16.0.220:3260 --interface default --op new {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[43215a3c-ea9d-4d8d-a0d1-5c6e223434e8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76] added\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Acquiring lock "daaf907c-9a7f-417e-a44c-383ba0e74224" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Lock "daaf907c-9a7f-417e-a44c-383ba0e74224" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76] added
Nov 18 17:21:15 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG nova.compute.manager [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] Starting instance... {{(pid=74743) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d292e94-6fba-42ee-8297-2b9c1c8d6639]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec2f7aa-96da-426a-8e9b-66176a15203e]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RabfjIkA {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RabfjIkA" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[8325eabf-1634-4814-9ad5-7832b3770529]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RabfjIkA'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[96151f2b-819e-4058-8e4a-1f3ab72627a2]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74743) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 17:21:15 user nova-compute[74743]: INFO nova.compute.claims [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] Claim successful on node user
Nov 18 17:21:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cac88db-5007-4126-a585-ebd710beda68]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:21:15 user nova-compute[74743]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)
Nov 18 17:21:15 user nova-compute[74743]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 (non-flash)
Nov 18 17:21:15 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:21:15 user nova-compute[74743]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)
Nov 18 17:21:15 user nova-compute[74743]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 (non-flash)
Nov 18 17:21:15 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 -p 172.16.0.220:3260 --login {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[086c48f6-20e5-4619-aff0-1d97b6df38c1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76, portal: 172.16.0.220,3260]
Nov 18 17:21:15 user nova-compute[74743]: Login to [iface: default, target: iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76, portal: 172.16.0.220,3260] successful.
Nov 18 17:21:15 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac7ef76-f28a-492d-bcd2-4298645dea4f]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:21:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:16 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:16 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea100e0-7598-4e11-8021-c452aba3a659]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:21:16 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:21:16 user nova-compute[74743]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)
Nov 18 17:21:16 user nova-compute[74743]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 (non-flash)
Nov 18 17:21:16 user nova-compute[74743]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 (non-flash)
Nov 18 17:21:16 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:21:16 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:21:16 user nova-compute[74743]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)
Nov 18 17:21:16 user nova-compute[74743]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 (non-flash)
Nov 18 17:21:16 user nova-compute[74743]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 (non-flash)
Nov 18 17:21:16 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:21:16 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:21:16 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Connected to 172.16.0.220:3260 {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 17:21:16 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] HCTL ('35', '-', '-', 0) found on session 45 with lun 0 {{(pid=74743) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 17:21:16 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74743) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 17:21:16 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:16 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:16 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[75651b85-673f-4cf0-b50c-77d3b1e505f4]: (4, ('- - 0', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:21:16 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:21:16 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RabfjIkA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 17:21:16 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:21:16 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:21:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.466s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:21:16 user nova-compute[74743]: DEBUG nova.compute.manager [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] Start building networks asynchronously for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 17:21:16 user nova-compute[74743]: DEBUG nova.compute.manager [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] Allocating IP information in the background. {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 17:21:16 user nova-compute[74743]: DEBUG nova.network.neutron [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] allocate_for_instance() {{(pid=74743) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 17:21:16 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 17:21:16 user nova-compute[74743]: DEBUG nova.compute.manager [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] Start building block device mappings for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 17:21:16 user nova-compute[74743]: DEBUG nova.policy [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '86804e2b74184a82be1fd14f39047a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45549ed03a64f708739545dd21f03fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74743) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 17:21:16 user nova-compute[74743]: DEBUG nova.compute.manager [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] Start spawning the instance on the hypervisor. {{(pid=74743) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 17:21:16 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] Creating instance directory {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 17:21:16 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] Creating image(s)
Nov 18 17:21:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Acquiring lock "/opt/stack/data/nova/instances/daaf907c-9a7f-417e-a44c-383ba0e74224/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:21:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Lock "/opt/stack/data/nova/instances/daaf907c-9a7f-417e-a44c-383ba0e74224/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:21:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Lock "/opt/stack/data/nova/instances/daaf907c-9a7f-417e-a44c-383ba0e74224/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:21:16 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:16 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.189s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Acquiring lock "c188b3a997bfafa42fa341f9dcc326545681eed9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:21:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:21:16 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:16 user nova-compute[74743]: DEBUG nova.compute.manager [req-e8835cab-d861-4d5c-bc39-21576cffaca7 req-501b6e9e-2081-482d-b1ab-fe9fa405ca4e service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Received event network-vif-plugged-70799139-883d-4f9a-a2ba-e2fabf2871ec {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:21:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e8835cab-d861-4d5c-bc39-21576cffaca7 req-501b6e9e-2081-482d-b1ab-fe9fa405ca4e service nova] Acquiring lock "6aecacc3-577d-4b36-9223-8446afe54e26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:21:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e8835cab-d861-4d5c-bc39-21576cffaca7 req-501b6e9e-2081-482d-b1ab-fe9fa405ca4e service nova] Lock "6aecacc3-577d-4b36-9223-8446afe54e26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:21:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e8835cab-d861-4d5c-bc39-21576cffaca7 req-501b6e9e-2081-482d-b1ab-fe9fa405ca4e service nova] Lock "6aecacc3-577d-4b36-9223-8446afe54e26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:21:16 user nova-compute[74743]: DEBUG nova.compute.manager [req-e8835cab-d861-4d5c-bc39-21576cffaca7 req-501b6e9e-2081-482d-b1ab-fe9fa405ca4e service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] No waiting events found dispatching network-vif-plugged-70799139-883d-4f9a-a2ba-e2fabf2871ec {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:21:16 user nova-compute[74743]: WARNING nova.compute.manager [req-e8835cab-d861-4d5c-bc39-21576cffaca7 req-501b6e9e-2081-482d-b1ab-fe9fa405ca4e service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Received unexpected event network-vif-plugged-70799139-883d-4f9a-a2ba-e2fabf2871ec for instance with vm_state active and task_state reboot_started_hard.
Nov 18 17:21:16 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.165s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:16 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/daaf907c-9a7f-417e-a44c-383ba0e74224/disk 1073741824 {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:16 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/daaf907c-9a7f-417e-a44c-383ba0e74224/disk 1073741824" returned: 0 in 0.058s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:21:16 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:16 user nova-compute[74743]: DEBUG nova.network.neutron [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] Successfully created port: e810bf77-95d9-40d7-af0e-47f2346937f0 {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '23463376139613364', 'path': '/dev/sdd'} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463376139613364', 'path': '/dev/sdd'} {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:19:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-571016991',display_name='tempest-TestMinimumBasicScenario-server-571016991',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-571016991',id=34,image_ref='502d6d5f-7f9a-4b3b-af75-cf8915d0f14a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDhtFEpE8QQq5OQXk5qeUW0OP7QLpgRvDd9rkjiQBHiCfwQRKXXiuo4jCXffab0TYR+4YYJlJ/bv6z9gV1HPXH7ici9tntf4eAwrpJJu35hohZ9oXg0J27GRRsfKG9Xbw==',key_name='tempest-TestMinimumBasicScenario-597950928',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:19:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='38303e1b311044deb8c833ed3299ce88',ramdisk_id='',reservation_id='r-algq1rxa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='502d6d5f-7f9a-4b3b-af75-cf8915d0f14a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1229544582',owner_user_name='tempest-TestMinimumBasicScenario-1229544582-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:21:14Z,user_data=None,user_id='52673e9f58e44abc8f9bd60d066c4197',uuid=6aecacc3-577d-4b36-9223-8446afe54e26,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "70799139-883d-4f9a-a2ba-e2fabf2871ec", "address": "fa:16:3e:1f:4b:8a", "network": {"id": "cd6d2dbc-0950-412a-ab9d-cf7615c06eb8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1261309930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38303e1b311044deb8c833ed3299ce88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70799139-88", "ovs_interfaceid": "70799139-883d-4f9a-a2ba-e2fabf2871ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Converting VIF {"id": "70799139-883d-4f9a-a2ba-e2fabf2871ec", "address": "fa:16:3e:1f:4b:8a", "network": {"id": "cd6d2dbc-0950-412a-ab9d-cf7615c06eb8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1261309930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38303e1b311044deb8c833ed3299ce88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70799139-88", "ovs_interfaceid": "70799139-883d-4f9a-a2ba-e2fabf2871ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:4b:8a,bridge_name='br-int',has_traffic_filtering=True,id=70799139-883d-4f9a-a2ba-e2fabf2871ec,network=Network(cd6d2dbc-0950-412a-ab9d-cf7615c06eb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70799139-88') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG nova.objects.instance [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lazy-loading 'pci_devices' on Instance uuid 6aecacc3-577d-4b36-9223-8446afe54e26 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG nova.objects.base [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Object Instance<6aecacc3-577d-4b36-9223-8446afe54e26> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:21:17 user nova-compute[74743]:   <uuid>6aecacc3-577d-4b36-9223-8446afe54e26</uuid>
Nov 18 17:21:17 user nova-compute[74743]:   <name>instance-00000022</name>
Nov 18 17:21:17 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:21:17 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:21:17 user nova-compute[74743]:   <metadata>
Nov 18 17:21:17 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:21:17 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:21:17 user nova-compute[74743]:       <nova:name>tempest-TestMinimumBasicScenario-server-571016991</nova:name>
Nov 18 17:21:17 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:21:15</nova:creationTime>
Nov 18 17:21:17 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:21:17 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:21:17 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:21:17 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:21:17 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:21:17 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:21:17 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:21:17 user nova-compute[74743]:       <nova:owner>
Nov 18 17:21:17 user nova-compute[74743]:         <nova:user uuid="52673e9f58e44abc8f9bd60d066c4197">tempest-TestMinimumBasicScenario-1229544582-project-member</nova:user>
Nov 18 17:21:17 user nova-compute[74743]:         <nova:project uuid="38303e1b311044deb8c833ed3299ce88">tempest-TestMinimumBasicScenario-1229544582</nova:project>
Nov 18 17:21:17 user nova-compute[74743]:       </nova:owner>
Nov 18 17:21:17 user nova-compute[74743]:       <nova:root type="image" uuid="502d6d5f-7f9a-4b3b-af75-cf8915d0f14a"/>
Nov 18 17:21:17 user nova-compute[74743]:       <nova:ports>
Nov 18 17:21:17 user nova-compute[74743]:         <nova:port uuid="70799139-883d-4f9a-a2ba-e2fabf2871ec">
Nov 18 17:21:17 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 18 17:21:17 user nova-compute[74743]:         </nova:port>
Nov 18 17:21:17 user nova-compute[74743]:       </nova:ports>
Nov 18 17:21:17 user nova-compute[74743]:     </nova:instance>
Nov 18 17:21:17 user nova-compute[74743]:   </metadata>
Nov 18 17:21:17 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:21:17 user nova-compute[74743]:     <system>
Nov 18 17:21:17 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:21:17 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:21:17 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:21:17 user nova-compute[74743]:       <entry name="serial">6aecacc3-577d-4b36-9223-8446afe54e26</entry>
Nov 18 17:21:17 user nova-compute[74743]:       <entry name="uuid">6aecacc3-577d-4b36-9223-8446afe54e26</entry>
Nov 18 17:21:17 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:21:17 user nova-compute[74743]:     </system>
Nov 18 17:21:17 user nova-compute[74743]:   </sysinfo>
Nov 18 17:21:17 user nova-compute[74743]:   <os>
Nov 18 17:21:17 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:21:17 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:21:17 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:21:17 user nova-compute[74743]:   </os>
Nov 18 17:21:17 user nova-compute[74743]:   <features>
Nov 18 17:21:17 user nova-compute[74743]:     <acpi/>
Nov 18 17:21:17 user nova-compute[74743]:     <apic/>
Nov 18 17:21:17 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:21:17 user nova-compute[74743]:   </features>
Nov 18 17:21:17 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:21:17 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:21:17 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:21:17 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:21:17 user nova-compute[74743]:   </clock>
Nov 18 17:21:17 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:21:17 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:21:17 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:21:17 user nova-compute[74743]:   </cpu>
Nov 18 17:21:17 user nova-compute[74743]:   <devices>
Nov 18 17:21:17 user nova-compute[74743]:     <disk type="file" device="disk">
Nov 18 17:21:17 user nova-compute[74743]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 17:21:17 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/6aecacc3-577d-4b36-9223-8446afe54e26/disk"/>
Nov 18 17:21:17 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:21:17 user nova-compute[74743]:     </disk>
Nov 18 17:21:17 user nova-compute[74743]:     <disk type="block" device="disk">
Nov 18 17:21:17 user nova-compute[74743]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:21:17 user nova-compute[74743]:       <source dev="/dev/sdd"/>
Nov 18 17:21:17 user nova-compute[74743]:       <target dev="vdb" bus="virtio"/>
Nov 18 17:21:17 user nova-compute[74743]:       <serial>0fbaeb5b-46d6-4d34-918f-48160528ae76</serial>
Nov 18 17:21:17 user nova-compute[74743]:     </disk>
Nov 18 17:21:17 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:21:17 user nova-compute[74743]:       <mac address="fa:16:3e:1f:4b:8a"/>
Nov 18 17:21:17 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:21:17 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:21:17 user nova-compute[74743]:       <target dev="tap70799139-88"/>
Nov 18 17:21:17 user nova-compute[74743]:     </interface>
Nov 18 17:21:17 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:21:17 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/6aecacc3-577d-4b36-9223-8446afe54e26/console.log" append="off"/>
Nov 18 17:21:17 user nova-compute[74743]:     </serial>
Nov 18 17:21:17 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:21:17 user nova-compute[74743]:     <video>
Nov 18 17:21:17 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:21:17 user nova-compute[74743]:     </video>
Nov 18 17:21:17 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:21:17 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:21:17 user nova-compute[74743]:     </rng>
Nov 18 17:21:17 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:21:17 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:21:17 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:21:17 user nova-compute[74743]:     </memballoon>
Nov 18 17:21:17 user nova-compute[74743]:   </devices>
Nov 18 17:21:17 user nova-compute[74743]: </domain>
Nov 18 17:21:17 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aecacc3-577d-4b36-9223-8446afe54e26/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.206s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Checking if we can resize image /opt/stack/data/nova/instances/daaf907c-9a7f-417e-a44c-383ba0e74224/disk. size=1073741824 {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daaf907c-9a7f-417e-a44c-383ba0e74224/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aecacc3-577d-4b36-9223-8446afe54e26/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aecacc3-577d-4b36-9223-8446afe54e26/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daaf907c-9a7f-417e-a44c-383ba0e74224/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Cannot resize image /opt/stack/data/nova/instances/daaf907c-9a7f-417e-a44c-383ba0e74224/disk to a smaller size. {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] Created local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] Ensure instance console log exists: /opt/stack/data/nova/instances/daaf907c-9a7f-417e-a44c-383ba0e74224/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aecacc3-577d-4b36-9223-8446afe54e26/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG nova.objects.instance [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6aecacc3-577d-4b36-9223-8446afe54e26 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG nova.objects.base [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Object Instance<6aecacc3-577d-4b36-9223-8446afe54e26> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6086defff6dc78d9c8c0985e5535c7c38331c8a6 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG nova.network.neutron [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] Successfully updated port: e810bf77-95d9-40d7-af0e-47f2346937f0 {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Acquiring lock "refresh_cache-daaf907c-9a7f-417e-a44c-383ba0e74224" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Acquired lock "refresh_cache-daaf907c-9a7f-417e-a44c-383ba0e74224" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG nova.network.neutron [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG nova.network.neutron [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6086defff6dc78d9c8c0985e5535c7c38331c8a6 --force-share --output=json" returned: 0 in 0.189s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6aecacc3-577d-4b36-9223-8446afe54e26/disk. size=1073741824 {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aecacc3-577d-4b36-9223-8446afe54e26/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aecacc3-577d-4b36-9223-8446afe54e26/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Cannot resize image /opt/stack/data/nova/instances/6aecacc3-577d-4b36-9223-8446afe54e26/disk to a smaller size. {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG nova.objects.instance [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lazy-loading 'migration_context' on Instance uuid 6aecacc3-577d-4b36-9223-8446afe54e26 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG nova.objects.base [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Object Instance<6aecacc3-577d-4b36-9223-8446afe54e26> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:19:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-571016991',display_name='tempest-TestMinimumBasicScenario-server-571016991',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-571016991',id=34,image_ref='502d6d5f-7f9a-4b3b-af75-cf8915d0f14a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDhtFEpE8QQq5OQXk5qeUW0OP7QLpgRvDd9rkjiQBHiCfwQRKXXiuo4jCXffab0TYR+4YYJlJ/bv6z9gV1HPXH7ici9tntf4eAwrpJJu35hohZ9oXg0J27GRRsfKG9Xbw==',key_name='tempest-TestMinimumBasicScenario-597950928',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:19:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='38303e1b311044deb8c833ed3299ce88',ramdisk_id='',reservation_id='r-algq1rxa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='502d6d5f-7f9a-4b3b-af75-cf8915d0f14a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1229544582',owner_user_name='tempest-TestMinimumBasicScenario-1229544582-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:21:14Z,user_data=None,user_id='52673e9f58e44abc8f9bd60d066c4197',uuid=6aecacc3-577d-4b36-9223-8446afe54e26,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "70799139-883d-4f9a-a2ba-e2fabf2871ec", "address": "fa:16:3e:1f:4b:8a", "network": {"id": "cd6d2dbc-0950-412a-ab9d-cf7615c06eb8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1261309930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38303e1b311044deb8c833ed3299ce88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70799139-88", "ovs_interfaceid": "70799139-883d-4f9a-a2ba-e2fabf2871ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Converting VIF {"id": "70799139-883d-4f9a-a2ba-e2fabf2871ec", "address": "fa:16:3e:1f:4b:8a", "network": {"id": "cd6d2dbc-0950-412a-ab9d-cf7615c06eb8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1261309930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38303e1b311044deb8c833ed3299ce88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70799139-88", "ovs_interfaceid": "70799139-883d-4f9a-a2ba-e2fabf2871ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:4b:8a,bridge_name='br-int',has_traffic_filtering=True,id=70799139-883d-4f9a-a2ba-e2fabf2871ec,network=Network(cd6d2dbc-0950-412a-ab9d-cf7615c06eb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70799139-88') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG os_vif [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:4b:8a,bridge_name='br-int',has_traffic_filtering=True,id=70799139-883d-4f9a-a2ba-e2fabf2871ec,network=Network(cd6d2dbc-0950-412a-ab9d-cf7615c06eb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70799139-88') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ff6c50ab-7d05-5305-acf2-a628d81dcb0c', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap70799139-88, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap70799139-88, col_values=(('qos', UUID('57f72fc6-a687-4b41-9ecd-8cea09a444a2')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap70799139-88, col_values=(('external_ids', {'iface-id': '70799139-883d-4f9a-a2ba-e2fabf2871ec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:4b:8a', 'vm-uuid': '6aecacc3-577d-4b36-9223-8446afe54e26'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG nova.network.neutron [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] Updating instance_info_cache with network_info: [{"id": "e810bf77-95d9-40d7-af0e-47f2346937f0", "address": "fa:16:3e:b0:df:de", "network": {"id": "1f0e532b-39a9-4594-815f-98e76055e70e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1884285850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a45549ed03a64f708739545dd21f03fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape810bf77-95", "ovs_interfaceid": "e810bf77-95d9-40d7-af0e-47f2346937f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:17 user nova-compute[74743]: INFO os_vif [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:4b:8a,bridge_name='br-int',has_traffic_filtering=True,id=70799139-883d-4f9a-a2ba-e2fabf2871ec,network=Network(cd6d2dbc-0950-412a-ab9d-cf7615c06eb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70799139-88')
Nov 18 17:21:17 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Releasing lock "refresh_cache-daaf907c-9a7f-417e-a44c-383ba0e74224" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG nova.compute.manager [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] Instance network_info: |[{"id": "e810bf77-95d9-40d7-af0e-47f2346937f0", "address": "fa:16:3e:b0:df:de", "network": {"id": "1f0e532b-39a9-4594-815f-98e76055e70e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1884285850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a45549ed03a64f708739545dd21f03fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape810bf77-95", "ovs_interfaceid": "e810bf77-95d9-40d7-af0e-47f2346937f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] Start _get_guest_xml network_info=[{"id": "e810bf77-95d9-40d7-af0e-47f2346937f0", "address": "fa:16:3e:b0:df:de", "network": {"id": "1f0e532b-39a9-4594-815f-98e76055e70e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1884285850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a45549ed03a64f708739545dd21f03fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape810bf77-95", "ovs_interfaceid": "e810bf77-95d9-40d7-af0e-47f2346937f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '9536f6cf-95c4-40e2-864a-09a91525678a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:21:17 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:21:17 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:21:17 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:21:17 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:21:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:21:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1788644458',display_name='tempest-VolumesActionsTest-instance-1788644458',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1788644458',id=38,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a45549ed03a64f708739545dd21f03fa',ramdisk_id='',reservation_id='r-dog19b6n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1748636445',owner_user_name='tempest-VolumesActionsTest-1748636445-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:21:16Z,user_data=None,user_id='86804e2b74184a82be1fd14f39047a41',uuid=daaf907c-9a7f-417e-a44c-383ba0e74224,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e810bf77-95d9-40d7-af0e-47f2346937f0", "address": "fa:16:3e:b0:df:de", "network": {"id": "1f0e532b-39a9-4594-815f-98e76055e70e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1884285850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a45549ed03a64f708739545dd21f03fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape810bf77-95", "ovs_interfaceid": "e810bf77-95d9-40d7-af0e-47f2346937f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:21:18 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Converting VIF {"id": "e810bf77-95d9-40d7-af0e-47f2346937f0", "address": "fa:16:3e:b0:df:de", "network": {"id": "1f0e532b-39a9-4594-815f-98e76055e70e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1884285850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a45549ed03a64f708739545dd21f03fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape810bf77-95", "ovs_interfaceid": "e810bf77-95d9-40d7-af0e-47f2346937f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:21:18 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:df:de,bridge_name='br-int',has_traffic_filtering=True,id=e810bf77-95d9-40d7-af0e-47f2346937f0,network=Network(1f0e532b-39a9-4594-815f-98e76055e70e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape810bf77-95') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:21:18 user nova-compute[74743]: DEBUG nova.objects.instance [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Lazy-loading 'pci_devices' on Instance uuid daaf907c-9a7f-417e-a44c-383ba0e74224 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:21:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:21:18 user nova-compute[74743]:   <uuid>daaf907c-9a7f-417e-a44c-383ba0e74224</uuid>
Nov 18 17:21:18 user nova-compute[74743]:   <name>instance-00000026</name>
Nov 18 17:21:18 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:21:18 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:21:18 user nova-compute[74743]:   <metadata>
Nov 18 17:21:18 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:21:18 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:21:18 user nova-compute[74743]:       <nova:name>tempest-VolumesActionsTest-instance-1788644458</nova:name>
Nov 18 17:21:18 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:21:17</nova:creationTime>
Nov 18 17:21:18 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:21:18 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:21:18 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:21:18 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:21:18 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:21:18 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:21:18 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:21:18 user nova-compute[74743]:       <nova:owner>
Nov 18 17:21:18 user nova-compute[74743]:         <nova:user uuid="86804e2b74184a82be1fd14f39047a41">tempest-VolumesActionsTest-1748636445-project-member</nova:user>
Nov 18 17:21:18 user nova-compute[74743]:         <nova:project uuid="a45549ed03a64f708739545dd21f03fa">tempest-VolumesActionsTest-1748636445</nova:project>
Nov 18 17:21:18 user nova-compute[74743]:       </nova:owner>
Nov 18 17:21:18 user nova-compute[74743]:       <nova:root type="image" uuid="9536f6cf-95c4-40e2-864a-09a91525678a"/>
Nov 18 17:21:18 user nova-compute[74743]:       <nova:ports>
Nov 18 17:21:18 user nova-compute[74743]:         <nova:port uuid="e810bf77-95d9-40d7-af0e-47f2346937f0">
Nov 18 17:21:18 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 18 17:21:18 user nova-compute[74743]:         </nova:port>
Nov 18 17:21:18 user nova-compute[74743]:       </nova:ports>
Nov 18 17:21:18 user nova-compute[74743]:     </nova:instance>
Nov 18 17:21:18 user nova-compute[74743]:   </metadata>
Nov 18 17:21:18 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:21:18 user nova-compute[74743]:     <system>
Nov 18 17:21:18 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:21:18 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:21:18 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:21:18 user nova-compute[74743]:       <entry name="serial">daaf907c-9a7f-417e-a44c-383ba0e74224</entry>
Nov 18 17:21:18 user nova-compute[74743]:       <entry name="uuid">daaf907c-9a7f-417e-a44c-383ba0e74224</entry>
Nov 18 17:21:18 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:21:18 user nova-compute[74743]:     </system>
Nov 18 17:21:18 user nova-compute[74743]:   </sysinfo>
Nov 18 17:21:18 user nova-compute[74743]:   <os>
Nov 18 17:21:18 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:21:18 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:21:18 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:21:18 user nova-compute[74743]:   </os>
Nov 18 17:21:18 user nova-compute[74743]:   <features>
Nov 18 17:21:18 user nova-compute[74743]:     <acpi/>
Nov 18 17:21:18 user nova-compute[74743]:     <apic/>
Nov 18 17:21:18 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:21:18 user nova-compute[74743]:   </features>
Nov 18 17:21:18 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:21:18 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:21:18 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:21:18 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:21:18 user nova-compute[74743]:   </clock>
Nov 18 17:21:18 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:21:18 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:21:18 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:21:18 user nova-compute[74743]:   </cpu>
Nov 18 17:21:18 user nova-compute[74743]:   <devices>
Nov 18 17:21:18 user nova-compute[74743]:     <disk type="file" device="disk">
Nov 18 17:21:18 user nova-compute[74743]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 17:21:18 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/daaf907c-9a7f-417e-a44c-383ba0e74224/disk"/>
Nov 18 17:21:18 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:21:18 user nova-compute[74743]:     </disk>
Nov 18 17:21:18 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:21:18 user nova-compute[74743]:       <mac address="fa:16:3e:b0:df:de"/>
Nov 18 17:21:18 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:21:18 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:21:18 user nova-compute[74743]:       <target dev="tape810bf77-95"/>
Nov 18 17:21:18 user nova-compute[74743]:     </interface>
Nov 18 17:21:18 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:21:18 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/daaf907c-9a7f-417e-a44c-383ba0e74224/console.log" append="off"/>
Nov 18 17:21:18 user nova-compute[74743]:     </serial>
Nov 18 17:21:18 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:21:18 user nova-compute[74743]:     <video>
Nov 18 17:21:18 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:21:18 user nova-compute[74743]:     </video>
Nov 18 17:21:18 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:21:18 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:21:18 user nova-compute[74743]:     </rng>
Nov 18 17:21:18 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:21:18 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:21:18 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:21:18 user nova-compute[74743]:     </memballoon>
Nov 18 17:21:18 user nova-compute[74743]:   </devices>
Nov 18 17:21:18 user nova-compute[74743]: </domain>
Nov 18 17:21:18 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:21:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:21:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1788644458',display_name='tempest-VolumesActionsTest-instance-1788644458',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1788644458',id=38,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a45549ed03a64f708739545dd21f03fa',ramdisk_id='',reservation_id='r-dog19b6n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1748636445',owner_user_name='tempest-VolumesActionsTest-1748636445-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:21:16Z,user_data=None,user_id='86804e2b74184a82be1fd14f39047a41',uuid=daaf907c-9a7f-417e-a44c-383ba0e74224,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e810bf77-95d9-40d7-af0e-47f2346937f0", "address": "fa:16:3e:b0:df:de", "network": {"id": "1f0e532b-39a9-4594-815f-98e76055e70e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1884285850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a45549ed03a64f708739545dd21f03fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape810bf77-95", "ovs_interfaceid": "e810bf77-95d9-40d7-af0e-47f2346937f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:21:18 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Converting VIF {"id": "e810bf77-95d9-40d7-af0e-47f2346937f0", "address": "fa:16:3e:b0:df:de", "network": {"id": "1f0e532b-39a9-4594-815f-98e76055e70e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1884285850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a45549ed03a64f708739545dd21f03fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape810bf77-95", "ovs_interfaceid": "e810bf77-95d9-40d7-af0e-47f2346937f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:21:18 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:df:de,bridge_name='br-int',has_traffic_filtering=True,id=e810bf77-95d9-40d7-af0e-47f2346937f0,network=Network(1f0e532b-39a9-4594-815f-98e76055e70e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape810bf77-95') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:21:18 user nova-compute[74743]: DEBUG os_vif [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:df:de,bridge_name='br-int',has_traffic_filtering=True,id=e810bf77-95d9-40d7-af0e-47f2346937f0,network=Network(1f0e532b-39a9-4594-815f-98e76055e70e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape810bf77-95') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:21:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:21:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:21:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a522154a-2856-5392-a14a-469740508413', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:21:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:21:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape810bf77-95, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:21:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape810bf77-95, col_values=(('qos', UUID('f91e9a56-97f5-40f2-b6da-8ef2fc20032f')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:21:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape810bf77-95, col_values=(('external_ids', {'iface-id': 'e810bf77-95d9-40d7-af0e-47f2346937f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:df:de', 'vm-uuid': 'daaf907c-9a7f-417e-a44c-383ba0e74224'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:21:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:21:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:18 user nova-compute[74743]: INFO os_vif [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:df:de,bridge_name='br-int',has_traffic_filtering=True,id=e810bf77-95d9-40d7-af0e-47f2346937f0,network=Network(1f0e532b-39a9-4594-815f-98e76055e70e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape810bf77-95')
Nov 18 17:21:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:21:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] No VIF found with MAC fa:16:3e:b0:df:de, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:21:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-dfb6743a-fb01-4b4b-8e12-dc49d9fbca89 req-b7641395-8d44-4fe1-b875-09770c3fd331 service nova] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] Received event network-changed-e810bf77-95d9-40d7-af0e-47f2346937f0 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:21:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-dfb6743a-fb01-4b4b-8e12-dc49d9fbca89 req-b7641395-8d44-4fe1-b875-09770c3fd331 service nova] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] Refreshing instance network info cache due to event network-changed-e810bf77-95d9-40d7-af0e-47f2346937f0. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:21:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-dfb6743a-fb01-4b4b-8e12-dc49d9fbca89 req-b7641395-8d44-4fe1-b875-09770c3fd331 service nova] Acquiring lock "refresh_cache-daaf907c-9a7f-417e-a44c-383ba0e74224" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:21:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-dfb6743a-fb01-4b4b-8e12-dc49d9fbca89 req-b7641395-8d44-4fe1-b875-09770c3fd331 service nova] Acquired lock "refresh_cache-daaf907c-9a7f-417e-a44c-383ba0e74224" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:21:18 user nova-compute[74743]: DEBUG nova.network.neutron [req-dfb6743a-fb01-4b4b-8e12-dc49d9fbca89 req-b7641395-8d44-4fe1-b875-09770c3fd331 service nova] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] Refreshing network info cache for port e810bf77-95d9-40d7-af0e-47f2346937f0 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:21:19 user nova-compute[74743]: DEBUG nova.network.neutron [req-dfb6743a-fb01-4b4b-8e12-dc49d9fbca89 req-b7641395-8d44-4fe1-b875-09770c3fd331 service nova] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] Updated VIF entry in instance network info cache for port e810bf77-95d9-40d7-af0e-47f2346937f0. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:21:19 user nova-compute[74743]: DEBUG nova.network.neutron [req-dfb6743a-fb01-4b4b-8e12-dc49d9fbca89 req-b7641395-8d44-4fe1-b875-09770c3fd331 service nova] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] Updating instance_info_cache with network_info: [{"id": "e810bf77-95d9-40d7-af0e-47f2346937f0", "address": "fa:16:3e:b0:df:de", "network": {"id": "1f0e532b-39a9-4594-815f-98e76055e70e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1884285850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a45549ed03a64f708739545dd21f03fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape810bf77-95", "ovs_interfaceid": "e810bf77-95d9-40d7-af0e-47f2346937f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:21:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-dfb6743a-fb01-4b4b-8e12-dc49d9fbca89 req-b7641395-8d44-4fe1-b875-09770c3fd331 service nova] Releasing lock "refresh_cache-daaf907c-9a7f-417e-a44c-383ba0e74224" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:21:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:20 user nova-compute[74743]: DEBUG nova.compute.manager [req-ac504c43-e8f9-4682-969a-fcb27d2264d9 req-39f68e4f-271f-4248-8d29-970b3e49fee1 service nova] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] Received event network-vif-plugged-e810bf77-95d9-40d7-af0e-47f2346937f0 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:21:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ac504c43-e8f9-4682-969a-fcb27d2264d9 req-39f68e4f-271f-4248-8d29-970b3e49fee1 service nova] Acquiring lock "daaf907c-9a7f-417e-a44c-383ba0e74224-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:21:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ac504c43-e8f9-4682-969a-fcb27d2264d9 req-39f68e4f-271f-4248-8d29-970b3e49fee1 service nova] Lock "daaf907c-9a7f-417e-a44c-383ba0e74224-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:21:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ac504c43-e8f9-4682-969a-fcb27d2264d9 req-39f68e4f-271f-4248-8d29-970b3e49fee1 service nova] Lock "daaf907c-9a7f-417e-a44c-383ba0e74224-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:21:20 user nova-compute[74743]: DEBUG nova.compute.manager [req-ac504c43-e8f9-4682-969a-fcb27d2264d9 req-39f68e4f-271f-4248-8d29-970b3e49fee1 service nova] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] No waiting events found dispatching network-vif-plugged-e810bf77-95d9-40d7-af0e-47f2346937f0 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:21:20 user nova-compute[74743]: WARNING nova.compute.manager [req-ac504c43-e8f9-4682-969a-fcb27d2264d9 req-39f68e4f-271f-4248-8d29-970b3e49fee1 service nova] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] Received unexpected event network-vif-plugged-e810bf77-95d9-40d7-af0e-47f2346937f0 for instance with vm_state building and task_state spawning.
Nov 18 17:21:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:20 user nova-compute[74743]: DEBUG nova.compute.manager [req-08cc4b64-9bc8-458d-b74f-b8e56350a697 req-4a6c74f6-d94c-4141-b7af-bf495c7f0f6b service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Received event network-vif-plugged-70799139-883d-4f9a-a2ba-e2fabf2871ec {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:21:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-08cc4b64-9bc8-458d-b74f-b8e56350a697 req-4a6c74f6-d94c-4141-b7af-bf495c7f0f6b service nova] Acquiring lock "6aecacc3-577d-4b36-9223-8446afe54e26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:21:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-08cc4b64-9bc8-458d-b74f-b8e56350a697 req-4a6c74f6-d94c-4141-b7af-bf495c7f0f6b service nova] Lock "6aecacc3-577d-4b36-9223-8446afe54e26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:21:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-08cc4b64-9bc8-458d-b74f-b8e56350a697 req-4a6c74f6-d94c-4141-b7af-bf495c7f0f6b service nova] Lock "6aecacc3-577d-4b36-9223-8446afe54e26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:21:20 user nova-compute[74743]: DEBUG nova.compute.manager [req-08cc4b64-9bc8-458d-b74f-b8e56350a697 req-4a6c74f6-d94c-4141-b7af-bf495c7f0f6b service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] No waiting events found dispatching network-vif-plugged-70799139-883d-4f9a-a2ba-e2fabf2871ec {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:21:20 user nova-compute[74743]: WARNING nova.compute.manager [req-08cc4b64-9bc8-458d-b74f-b8e56350a697 req-4a6c74f6-d94c-4141-b7af-bf495c7f0f6b service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Received unexpected event network-vif-plugged-70799139-883d-4f9a-a2ba-e2fabf2871ec for instance with vm_state active and task_state reboot_started_hard.
Nov 18 17:21:20 user nova-compute[74743]: DEBUG nova.compute.manager [req-08cc4b64-9bc8-458d-b74f-b8e56350a697 req-4a6c74f6-d94c-4141-b7af-bf495c7f0f6b service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Received event network-vif-plugged-70799139-883d-4f9a-a2ba-e2fabf2871ec {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:21:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-08cc4b64-9bc8-458d-b74f-b8e56350a697 req-4a6c74f6-d94c-4141-b7af-bf495c7f0f6b service nova] Acquiring lock "6aecacc3-577d-4b36-9223-8446afe54e26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:21:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-08cc4b64-9bc8-458d-b74f-b8e56350a697 req-4a6c74f6-d94c-4141-b7af-bf495c7f0f6b service nova] Lock "6aecacc3-577d-4b36-9223-8446afe54e26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:21:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-08cc4b64-9bc8-458d-b74f-b8e56350a697 req-4a6c74f6-d94c-4141-b7af-bf495c7f0f6b service nova] Lock "6aecacc3-577d-4b36-9223-8446afe54e26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:21:20 user nova-compute[74743]: DEBUG nova.compute.manager [req-08cc4b64-9bc8-458d-b74f-b8e56350a697 req-4a6c74f6-d94c-4141-b7af-bf495c7f0f6b service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] No waiting events found dispatching network-vif-plugged-70799139-883d-4f9a-a2ba-e2fabf2871ec {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:21:20 user nova-compute[74743]: WARNING nova.compute.manager [req-08cc4b64-9bc8-458d-b74f-b8e56350a697 req-4a6c74f6-d94c-4141-b7af-bf495c7f0f6b service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Received unexpected event network-vif-plugged-70799139-883d-4f9a-a2ba-e2fabf2871ec for instance with vm_state active and task_state reboot_started_hard.
Nov 18 17:21:20 user nova-compute[74743]: DEBUG nova.compute.manager [req-dd6ce85d-3f8c-4da0-a725-e83c13ad6db4 req-2519a39a-96cb-4ad1-ba89-6b7309bc8ed6 service nova] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Received event network-changed-7936ec1c-0408-417f-8c26-f6c43264ac5f {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:21:20 user nova-compute[74743]: DEBUG nova.compute.manager [req-dd6ce85d-3f8c-4da0-a725-e83c13ad6db4 req-2519a39a-96cb-4ad1-ba89-6b7309bc8ed6 service nova] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Refreshing instance network info cache due to event network-changed-7936ec1c-0408-417f-8c26-f6c43264ac5f. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:21:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-dd6ce85d-3f8c-4da0-a725-e83c13ad6db4 req-2519a39a-96cb-4ad1-ba89-6b7309bc8ed6 service nova] Acquiring lock "refresh_cache-2b67d5fc-3753-4c5a-8477-e46315d9b2c2" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:21:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-dd6ce85d-3f8c-4da0-a725-e83c13ad6db4 req-2519a39a-96cb-4ad1-ba89-6b7309bc8ed6 service nova] Acquired lock "refresh_cache-2b67d5fc-3753-4c5a-8477-e46315d9b2c2" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:21:20 user nova-compute[74743]: DEBUG nova.network.neutron [req-dd6ce85d-3f8c-4da0-a725-e83c13ad6db4 req-2519a39a-96cb-4ad1-ba89-6b7309bc8ed6 service nova] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Refreshing network info cache for port 7936ec1c-0408-417f-8c26-f6c43264ac5f {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:21:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a60c08ff-e847-4458-b825-ca2cb7fdcabe tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Acquiring lock "2b67d5fc-3753-4c5a-8477-e46315d9b2c2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:21:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a60c08ff-e847-4458-b825-ca2cb7fdcabe tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Lock "2b67d5fc-3753-4c5a-8477-e46315d9b2c2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:21:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a60c08ff-e847-4458-b825-ca2cb7fdcabe tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Acquiring lock "2b67d5fc-3753-4c5a-8477-e46315d9b2c2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:21:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a60c08ff-e847-4458-b825-ca2cb7fdcabe tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Lock "2b67d5fc-3753-4c5a-8477-e46315d9b2c2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:21:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a60c08ff-e847-4458-b825-ca2cb7fdcabe tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Lock "2b67d5fc-3753-4c5a-8477-e46315d9b2c2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:21:21 user nova-compute[74743]: INFO nova.compute.manager [None req-a60c08ff-e847-4458-b825-ca2cb7fdcabe tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Terminating instance
Nov 18 17:21:21 user nova-compute[74743]: DEBUG nova.compute.manager [None req-a60c08ff-e847-4458-b825-ca2cb7fdcabe tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Start destroying the instance on the hypervisor. {{(pid=74743) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 17:21:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:21 user nova-compute[74743]: DEBUG nova.network.neutron [req-dd6ce85d-3f8c-4da0-a725-e83c13ad6db4 req-2519a39a-96cb-4ad1-ba89-6b7309bc8ed6 service nova] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Updated VIF entry in instance network info cache for port 7936ec1c-0408-417f-8c26-f6c43264ac5f. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:21:21 user nova-compute[74743]: DEBUG nova.network.neutron [req-dd6ce85d-3f8c-4da0-a725-e83c13ad6db4 req-2519a39a-96cb-4ad1-ba89-6b7309bc8ed6 service nova] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Updating instance_info_cache with network_info: [{"id": "7936ec1c-0408-417f-8c26-f6c43264ac5f", "address": "fa:16:3e:c1:3d:26", "network": {"id": "d8f4040b-7308-4136-af25-acea3f9b7319", "bridge": "br-int", "label": "tempest-TestStampPattern-304681565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "072a19c68f7643c4bd227345b698bede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7936ec1c-04", "ovs_interfaceid": "7936ec1c-0408-417f-8c26-f6c43264ac5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:21:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-dd6ce85d-3f8c-4da0-a725-e83c13ad6db4 req-2519a39a-96cb-4ad1-ba89-6b7309bc8ed6 service nova] Releasing lock "refresh_cache-2b67d5fc-3753-4c5a-8477-e46315d9b2c2" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:21:21 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Instance destroyed successfully.
Nov 18 17:21:21 user nova-compute[74743]: DEBUG nova.objects.instance [None req-a60c08ff-e847-4458-b825-ca2cb7fdcabe tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Lazy-loading 'resources' on Instance uuid 2b67d5fc-3753-4c5a-8477-e46315d9b2c2 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:21:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-a60c08ff-e847-4458-b825-ca2cb7fdcabe tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:16:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-18915004',display_name='tempest-TestStampPattern-server-18915004',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-18915004',id=32,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIeJWqc/RpISD+eFEyUiucd29+D2+xTQFgQsJ5SoI7DLsQ5ykkCfc2YtdLTQr/OFkooGS0c/xKImvR2ShUEPtqOyxJHjD4YWOrQFxEUaRxezTFDuvczqvCIHxapLoqI2zA==',key_name='tempest-TestStampPattern-360928616',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:16:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='072a19c68f7643c4bd227345b698bede',ramdisk_id='',reservation_id='r-y822adyc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1373079607',owner_user_name='tempest-TestStampPattern-1373079607-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:16:18Z,user_data=None,user_id='6627b15dc436496aa77d96301162268a',uuid=2b67d5fc-3753-4c5a-8477-e46315d9b2c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7936ec1c-0408-417f-8c26-f6c43264ac5f", "address": "fa:16:3e:c1:3d:26", "network": {"id": "d8f4040b-7308-4136-af25-acea3f9b7319", "bridge": "br-int", "label": "tempest-TestStampPattern-304681565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "072a19c68f7643c4bd227345b698bede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7936ec1c-04", "ovs_interfaceid": "7936ec1c-0408-417f-8c26-f6c43264ac5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:21:21 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-a60c08ff-e847-4458-b825-ca2cb7fdcabe tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Converting VIF {"id": "7936ec1c-0408-417f-8c26-f6c43264ac5f", "address": "fa:16:3e:c1:3d:26", "network": {"id": "d8f4040b-7308-4136-af25-acea3f9b7319", "bridge": "br-int", "label": "tempest-TestStampPattern-304681565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "072a19c68f7643c4bd227345b698bede", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7936ec1c-04", "ovs_interfaceid": "7936ec1c-0408-417f-8c26-f6c43264ac5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:21:21 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-a60c08ff-e847-4458-b825-ca2cb7fdcabe tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:3d:26,bridge_name='br-int',has_traffic_filtering=True,id=7936ec1c-0408-417f-8c26-f6c43264ac5f,network=Network(d8f4040b-7308-4136-af25-acea3f9b7319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7936ec1c-04') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:21:21 user nova-compute[74743]: DEBUG os_vif [None req-a60c08ff-e847-4458-b825-ca2cb7fdcabe tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:3d:26,bridge_name='br-int',has_traffic_filtering=True,id=7936ec1c-0408-417f-8c26-f6c43264ac5f,network=Network(d8f4040b-7308-4136-af25-acea3f9b7319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7936ec1c-04') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:21:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7936ec1c-04, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:21:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:21:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0bbdef66-368d-4c3b-b283-2bbd315f3f79) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:21:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:21:21 user nova-compute[74743]: INFO os_vif [None req-a60c08ff-e847-4458-b825-ca2cb7fdcabe tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:3d:26,bridge_name='br-int',has_traffic_filtering=True,id=7936ec1c-0408-417f-8c26-f6c43264ac5f,network=Network(d8f4040b-7308-4136-af25-acea3f9b7319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7936ec1c-04')
Nov 18 17:21:21 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-a60c08ff-e847-4458-b825-ca2cb7fdcabe tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Deleting instance files /opt/stack/data/nova/instances/2b67d5fc-3753-4c5a-8477-e46315d9b2c2_del
Nov 18 17:21:21 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-a60c08ff-e847-4458-b825-ca2cb7fdcabe tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Deletion of /opt/stack/data/nova/instances/2b67d5fc-3753-4c5a-8477-e46315d9b2c2_del complete
Nov 18 17:21:21 user nova-compute[74743]: INFO nova.compute.manager [None req-a60c08ff-e847-4458-b825-ca2cb7fdcabe tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 18 17:21:21 user nova-compute[74743]: DEBUG oslo.service.loopingcall [None req-a60c08ff-e847-4458-b825-ca2cb7fdcabe tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74743) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 17:21:21 user nova-compute[74743]: DEBUG nova.compute.manager [-] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Deallocating network for instance {{(pid=74743) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 17:21:21 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] deallocate_for_instance() {{(pid=74743) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 17:21:22 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:21:22 user nova-compute[74743]: INFO nova.compute.manager [-] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Took 0.38 seconds to deallocate network for instance.
Nov 18 17:21:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a60c08ff-e847-4458-b825-ca2cb7fdcabe tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:21:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a60c08ff-e847-4458-b825-ca2cb7fdcabe tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:21:22 user nova-compute[74743]: DEBUG nova.compute.manager [req-6eec163e-3105-4062-ab43-92dce0b20758 req-6fd3ec19-e39b-46b7-9a76-878cb24149e9 service nova] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] Received event network-vif-plugged-e810bf77-95d9-40d7-af0e-47f2346937f0 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:21:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-6eec163e-3105-4062-ab43-92dce0b20758 req-6fd3ec19-e39b-46b7-9a76-878cb24149e9 service nova] Acquiring lock "daaf907c-9a7f-417e-a44c-383ba0e74224-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:21:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-6eec163e-3105-4062-ab43-92dce0b20758 req-6fd3ec19-e39b-46b7-9a76-878cb24149e9 service nova] Lock "daaf907c-9a7f-417e-a44c-383ba0e74224-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:21:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-6eec163e-3105-4062-ab43-92dce0b20758 req-6fd3ec19-e39b-46b7-9a76-878cb24149e9 service nova] Lock "daaf907c-9a7f-417e-a44c-383ba0e74224-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:21:22 user nova-compute[74743]: DEBUG nova.compute.manager [req-6eec163e-3105-4062-ab43-92dce0b20758 req-6fd3ec19-e39b-46b7-9a76-878cb24149e9 service nova] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] No waiting events found dispatching network-vif-plugged-e810bf77-95d9-40d7-af0e-47f2346937f0 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:21:22 user nova-compute[74743]: WARNING nova.compute.manager [req-6eec163e-3105-4062-ab43-92dce0b20758 req-6fd3ec19-e39b-46b7-9a76-878cb24149e9 service nova] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] Received unexpected event network-vif-plugged-e810bf77-95d9-40d7-af0e-47f2346937f0 for instance with vm_state building and task_state spawning.
Nov 18 17:21:22 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-a60c08ff-e847-4458-b825-ca2cb7fdcabe tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:21:22 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-a60c08ff-e847-4458-b825-ca2cb7fdcabe tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:21:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a60c08ff-e847-4458-b825-ca2cb7fdcabe tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.353s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:21:22 user nova-compute[74743]: INFO nova.scheduler.client.report [None req-a60c08ff-e847-4458-b825-ca2cb7fdcabe tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Deleted allocations for instance 2b67d5fc-3753-4c5a-8477-e46315d9b2c2
Nov 18 17:21:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a60c08ff-e847-4458-b825-ca2cb7fdcabe tempest-TestStampPattern-1373079607 tempest-TestStampPattern-1373079607-project-member] Lock "2b67d5fc-3753-4c5a-8477-e46315d9b2c2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.790s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:21:22 user nova-compute[74743]: DEBUG nova.compute.manager [req-42394dec-36fb-40c9-bd22-3f7b2f666035 req-3f69ce72-58f1-4be1-866f-00367ff5647f service nova] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Received event network-vif-unplugged-7936ec1c-0408-417f-8c26-f6c43264ac5f {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:21:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-42394dec-36fb-40c9-bd22-3f7b2f666035 req-3f69ce72-58f1-4be1-866f-00367ff5647f service nova] Acquiring lock "2b67d5fc-3753-4c5a-8477-e46315d9b2c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:21:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-42394dec-36fb-40c9-bd22-3f7b2f666035 req-3f69ce72-58f1-4be1-866f-00367ff5647f service nova] Lock "2b67d5fc-3753-4c5a-8477-e46315d9b2c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:21:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-42394dec-36fb-40c9-bd22-3f7b2f666035 req-3f69ce72-58f1-4be1-866f-00367ff5647f service nova] Lock "2b67d5fc-3753-4c5a-8477-e46315d9b2c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:21:22 user nova-compute[74743]: DEBUG nova.compute.manager [req-42394dec-36fb-40c9-bd22-3f7b2f666035 req-3f69ce72-58f1-4be1-866f-00367ff5647f service nova] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] No waiting events found dispatching network-vif-unplugged-7936ec1c-0408-417f-8c26-f6c43264ac5f {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:21:22 user nova-compute[74743]: WARNING nova.compute.manager [req-42394dec-36fb-40c9-bd22-3f7b2f666035 req-3f69ce72-58f1-4be1-866f-00367ff5647f service nova] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Received unexpected event network-vif-unplugged-7936ec1c-0408-417f-8c26-f6c43264ac5f for instance with vm_state deleted and task_state None.
Nov 18 17:21:22 user nova-compute[74743]: DEBUG nova.compute.manager [req-42394dec-36fb-40c9-bd22-3f7b2f666035 req-3f69ce72-58f1-4be1-866f-00367ff5647f service nova] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Received event network-vif-plugged-7936ec1c-0408-417f-8c26-f6c43264ac5f {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:21:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-42394dec-36fb-40c9-bd22-3f7b2f666035 req-3f69ce72-58f1-4be1-866f-00367ff5647f service nova] Acquiring lock "2b67d5fc-3753-4c5a-8477-e46315d9b2c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:21:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-42394dec-36fb-40c9-bd22-3f7b2f666035 req-3f69ce72-58f1-4be1-866f-00367ff5647f service nova] Lock "2b67d5fc-3753-4c5a-8477-e46315d9b2c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:21:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-42394dec-36fb-40c9-bd22-3f7b2f666035 req-3f69ce72-58f1-4be1-866f-00367ff5647f service nova] Lock "2b67d5fc-3753-4c5a-8477-e46315d9b2c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:21:22 user nova-compute[74743]: DEBUG nova.compute.manager [req-42394dec-36fb-40c9-bd22-3f7b2f666035 req-3f69ce72-58f1-4be1-866f-00367ff5647f service nova] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] No waiting events found dispatching network-vif-plugged-7936ec1c-0408-417f-8c26-f6c43264ac5f {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:21:22 user nova-compute[74743]: WARNING nova.compute.manager [req-42394dec-36fb-40c9-bd22-3f7b2f666035 req-3f69ce72-58f1-4be1-866f-00367ff5647f service nova] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Received unexpected event network-vif-plugged-7936ec1c-0408-417f-8c26-f6c43264ac5f for instance with vm_state deleted and task_state None.
Nov 18 17:21:22 user nova-compute[74743]: DEBUG nova.compute.manager [req-42394dec-36fb-40c9-bd22-3f7b2f666035 req-3f69ce72-58f1-4be1-866f-00367ff5647f service nova] [instance: 2b67d5fc-3753-4c5a-8477-e46315d9b2c2] Received event network-vif-deleted-7936ec1c-0408-417f-8c26-f6c43264ac5f {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:21:22 user nova-compute[74743]: DEBUG nova.compute.manager [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:21:22 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] Guest created on hypervisor {{(pid=74743) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 17:21:22 user nova-compute[74743]: DEBUG nova.compute.manager [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:21:22 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] Instance spawned successfully.
Nov 18 17:21:22 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 17:21:22 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Instance rebooted successfully.
Nov 18 17:21:22 user nova-compute[74743]: DEBUG nova.compute.manager [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:21:23 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] Found default for hw_cdrom_bus of ide {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:21:23 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] Found default for hw_disk_bus of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:21:23 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] Found default for hw_input_bus of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:21:23 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] Found default for hw_pointer_model of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:21:23 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] Found default for hw_video_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:21:23 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] Found default for hw_vif_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:21:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-3e9badd0-5d04-4a50-9a20-b7438d6ed7fb tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "6aecacc3-577d-4b36-9223-8446afe54e26" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 9.804s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:21:23 user nova-compute[74743]: INFO nova.compute.manager [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] Took 6.58 seconds to spawn the instance on the hypervisor.
Nov 18 17:21:23 user nova-compute[74743]: DEBUG nova.compute.manager [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:21:23 user nova-compute[74743]: INFO nova.compute.manager [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] Took 7.36 seconds to build instance.
Nov 18 17:21:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-92cce9c4-7a7f-45d0-a82c-073a4e9214f6 tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Lock "daaf907c-9a7f-417e-a44c-383ba0e74224" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.449s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:21:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:31 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:21:31 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:21:31 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:21:31 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:21:31 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74743) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 17:21:31 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:33 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:21:33 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:21:33 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Starting heal instance info cache {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 17:21:33 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Rebuilding the list of instances to heal {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 17:21:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "refresh_cache-c006a4ad-a8e2-4108-9af1-dec4dd53fcda" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:21:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquired lock "refresh_cache-c006a4ad-a8e2-4108-9af1-dec4dd53fcda" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:21:33 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Forcefully refreshing network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 17:21:33 user nova-compute[74743]: DEBUG nova.objects.instance [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lazy-loading 'info_cache' on Instance uuid c006a4ad-a8e2-4108-9af1-dec4dd53fcda {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:21:33 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Updating instance_info_cache with network_info: [{"id": "999980cf-efd0-4b78-aa42-f4e80073b5a9", "address": "fa:16:3e:e4:7e:f3", "network": {"id": "fd98f398-6576-449b-a737-887906eb6656", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668610993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb8f5850162c479b8d185e48c03be7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap999980cf-ef", "ovs_interfaceid": "999980cf-efd0-4b78-aa42-f4e80073b5a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:21:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Releasing lock "refresh_cache-c006a4ad-a8e2-4108-9af1-dec4dd53fcda" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:21:33 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Updated the network info_cache for instance {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 17:21:33 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:21:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d3d163ce-e72d-41aa-80e3-99c75880fb91 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquiring lock "69d78ecf-740d-492a-be5b-ffd064e36f00" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:21:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d3d163ce-e72d-41aa-80e3-99c75880fb91 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "69d78ecf-740d-492a-be5b-ffd064e36f00" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:21:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d3d163ce-e72d-41aa-80e3-99c75880fb91 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquiring lock "69d78ecf-740d-492a-be5b-ffd064e36f00-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:21:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d3d163ce-e72d-41aa-80e3-99c75880fb91 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "69d78ecf-740d-492a-be5b-ffd064e36f00-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:21:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d3d163ce-e72d-41aa-80e3-99c75880fb91 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "69d78ecf-740d-492a-be5b-ffd064e36f00-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:21:34 user nova-compute[74743]: INFO nova.compute.manager [None req-d3d163ce-e72d-41aa-80e3-99c75880fb91 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Terminating instance
Nov 18 17:21:34 user nova-compute[74743]: DEBUG nova.compute.manager [None req-d3d163ce-e72d-41aa-80e3-99c75880fb91 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Start destroying the instance on the hypervisor. {{(pid=74743) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 17:21:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:34 user nova-compute[74743]: DEBUG nova.compute.manager [req-8803d670-9fd5-4dcf-8f30-850b93d95705 req-1449ee0a-2dbf-4b79-a4ca-ef53d45bc92c service nova] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Received event network-vif-unplugged-4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:21:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-8803d670-9fd5-4dcf-8f30-850b93d95705 req-1449ee0a-2dbf-4b79-a4ca-ef53d45bc92c service nova] Acquiring lock "69d78ecf-740d-492a-be5b-ffd064e36f00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:21:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-8803d670-9fd5-4dcf-8f30-850b93d95705 req-1449ee0a-2dbf-4b79-a4ca-ef53d45bc92c service nova] Lock "69d78ecf-740d-492a-be5b-ffd064e36f00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:21:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-8803d670-9fd5-4dcf-8f30-850b93d95705 req-1449ee0a-2dbf-4b79-a4ca-ef53d45bc92c service nova] Lock "69d78ecf-740d-492a-be5b-ffd064e36f00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:21:34 user nova-compute[74743]: DEBUG nova.compute.manager [req-8803d670-9fd5-4dcf-8f30-850b93d95705 req-1449ee0a-2dbf-4b79-a4ca-ef53d45bc92c service nova] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] No waiting events found dispatching network-vif-unplugged-4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:21:34 user nova-compute[74743]: DEBUG nova.compute.manager [req-8803d670-9fd5-4dcf-8f30-850b93d95705 req-1449ee0a-2dbf-4b79-a4ca-ef53d45bc92c service nova] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Received event network-vif-unplugged-4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8 for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:35 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Instance destroyed successfully.
Nov 18 17:21:35 user nova-compute[74743]: DEBUG nova.objects.instance [None req-d3d163ce-e72d-41aa-80e3-99c75880fb91 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lazy-loading 'resources' on Instance uuid 69d78ecf-740d-492a-be5b-ffd064e36f00 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-d3d163ce-e72d-41aa-80e3-99c75880fb91 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:14:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-403226732',display_name='tempest-ServerActionsTestOtherA-server-403226732',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-403226732',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEVphqV0ovLOhWV5c4OtZaZAghiX4KqdCUzcXRNxI8zWTbqX3YOGnG7iLQKSTFxu3amDks//fytVOc70uGuSKqNKUeaE/kY0CmyGU71j0ZYQPWjJeA0I0UUP+FZUS4MWQ==',key_name='tempest-keypair-1212996543',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:17:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fb8f5850162c479b8d185e48c03be7d3',ramdisk_id='',reservation_id='r-elyg0ort',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-128885625',owner_user_name='tempest-ServerActionsTestOtherA-128885625-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:18:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce3e4cef47114a7c9327db639460d923',uuid=69d78ecf-740d-492a-be5b-ffd064e36f00,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8", "address": "fa:16:3e:93:d9:fc", "network": {"id": "fd98f398-6576-449b-a737-887906eb6656", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668610993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb8f5850162c479b8d185e48c03be7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd5a403-19", "ovs_interfaceid": "4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-d3d163ce-e72d-41aa-80e3-99c75880fb91 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Converting VIF {"id": "4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8", "address": "fa:16:3e:93:d9:fc", "network": {"id": "fd98f398-6576-449b-a737-887906eb6656", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668610993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb8f5850162c479b8d185e48c03be7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd5a403-19", "ovs_interfaceid": "4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-d3d163ce-e72d-41aa-80e3-99c75880fb91 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:93:d9:fc,bridge_name='br-int',has_traffic_filtering=True,id=4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8,network=Network(fd98f398-6576-449b-a737-887906eb6656),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cd5a403-19') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG os_vif [None req-d3d163ce-e72d-41aa-80e3-99c75880fb91 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:d9:fc,bridge_name='br-int',has_traffic_filtering=True,id=4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8,network=Network(fd98f398-6576-449b-a737-887906eb6656),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cd5a403-19') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4cd5a403-19, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=19eff6e8-8d07-429c-943b-942498607a68) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:35 user nova-compute[74743]: INFO os_vif [None req-d3d163ce-e72d-41aa-80e3-99c75880fb91 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:d9:fc,bridge_name='br-int',has_traffic_filtering=True,id=4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8,network=Network(fd98f398-6576-449b-a737-887906eb6656),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cd5a403-19')
Nov 18 17:21:35 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3d163ce-e72d-41aa-80e3-99c75880fb91 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] calling os-brick to detach iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3d163ce-e72d-41aa-80e3-99c75880fb91 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, {'target_iqn': 'iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xBLIUkZY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:21:35 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-d3d163ce-e72d-41aa-80e3-99c75880fb91 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:21:35 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-d3d163ce-e72d-41aa-80e3-99c75880fb91 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-d3d163ce-e72d-41aa-80e3-99c75880fb91 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[85727c1d-c2dc-483b-9107-f3d56ffdaee4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3d163ce-e72d-41aa-80e3-99c75880fb91 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 17:21:35 user nova-compute[74743]: No targets found.
Nov 18 17:21:35 user nova-compute[74743]: iSNS:
Nov 18 17:21:35 user nova-compute[74743]: No targets found.
Nov 18 17:21:35 user nova-compute[74743]: STATIC:
Nov 18 17:21:35 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f
Nov 18 17:21:35 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:21:35 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:21:35 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127
Nov 18 17:21:35 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:21:35 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:21:35 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76
Nov 18 17:21:35 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:21:35 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:21:35 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2
Nov 18 17:21:35 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:21:35 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:21:35 user nova-compute[74743]: FIRMWARE:
Nov 18 17:21:35 user nova-compute[74743]: No targets found.
Nov 18 17:21:35 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3d163ce-e72d-41aa-80e3-99c75880fb91 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 17:21:35 user nova-compute[74743]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 17:21:35 user nova-compute[74743]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74743) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3d163ce-e72d-41aa-80e3-99c75880fb91 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f', 0)] {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[4762b7ed-45ad-4cf5-984d-ba99b644361f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[71058b63-bb7c-4005-bacb-6a0b60c9cd4a]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3d163ce-e72d-41aa-80e3-99c75880fb91 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:21:35 user nova-compute[74743]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)
Nov 18 17:21:35 user nova-compute[74743]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 (non-flash)
Nov 18 17:21:35 user nova-compute[74743]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 (non-flash)
Nov 18 17:21:35 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3d163ce-e72d-41aa-80e3-99c75880fb91 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:21:35 user nova-compute[74743]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f (non-flash)
Nov 18 17:21:35 user nova-compute[74743]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 (non-flash)
Nov 18 17:21:35 user nova-compute[74743]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 (non-flash)
Nov 18 17:21:35 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3d163ce-e72d-41aa-80e3-99c75880fb91 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb081be680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f'): ({'sdc'}, set())}) {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-d3d163ce-e72d-41aa-80e3-99c75880fb91 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Removing single pathed devices sdc {{(pid=74743) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8ecb48-dfa6-450a-8622-b98546142533]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[73deb8fb-3847-404b-9d1e-6270772ca344]: (4, ('ok\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-d3d163ce-e72d-41aa-80e3-99c75880fb91 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Flushing IO for device /dev/sdc {{(pid=74743) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ef42ea-8b76-4db0-99d0-e67a10c445b9]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-d3d163ce-e72d-41aa-80e3-99c75880fb91 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74743) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.134s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc2599c-ad1d-43c9-93dd-aa7239330d84]: (4, ('1', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-d3d163ce-e72d-41aa-80e3-99c75880fb91 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-d3d163ce-e72d-41aa-80e3-99c75880fb91 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] SCSI volumes sdc have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_7ececc36', '/dev/disk/by-id/scsi-23939376165633061', '/dev/disk/by-id/scsi-1SCST_BIO7ececc36-997aec0a3e985d59') {{(pid=85244) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e673ce4-bb49-4f9c-9e58-0a5d518fb347]: (4, None) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3d163ce-e72d-41aa-80e3-99c75880fb91 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f')] {{(pid=74743) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49bcb21-9635-4c26-95b3-d8eac9b0a736]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3d163ce-e72d-41aa-80e3-99c75880fb91 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f -p 172.16.0.220:3260 --logout {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2c270e-6f17-4c41-be68-fd34d1d176e6]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3d163ce-e72d-41aa-80e3-99c75880fb91 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f, portal: 172.16.0.220,3260]
Nov 18 17:21:35 user nova-compute[74743]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f, portal: 172.16.0.220,3260] successful.
Nov 18 17:21:35 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f -p 172.16.0.220:3260 --op delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c12dbe72-19df-4534-bbb2-53dbc61fd87f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c30985-8fa2-47a6-bb90-b5419696f830]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3d163ce-e72d-41aa-80e3-99c75880fb91 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-d3d163ce-e72d-41aa-80e3-99c75880fb91 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.463s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3d163ce-e72d-41aa-80e3-99c75880fb91 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] <== disconnect_volume: return (464ms) None {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3d163ce-e72d-41aa-80e3-99c75880fb91 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Disconnected iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 17:21:35 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-d3d163ce-e72d-41aa-80e3-99c75880fb91 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Deleting instance files /opt/stack/data/nova/instances/69d78ecf-740d-492a-be5b-ffd064e36f00_del
Nov 18 17:21:35 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-d3d163ce-e72d-41aa-80e3-99c75880fb91 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Deletion of /opt/stack/data/nova/instances/69d78ecf-740d-492a-be5b-ffd064e36f00_del complete
Nov 18 17:21:35 user nova-compute[74743]: INFO nova.compute.manager [None req-d3d163ce-e72d-41aa-80e3-99c75880fb91 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Took 1.33 seconds to destroy the instance on the hypervisor.
Nov 18 17:21:35 user nova-compute[74743]: DEBUG oslo.service.loopingcall [None req-d3d163ce-e72d-41aa-80e3-99c75880fb91 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74743) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG nova.compute.manager [-] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Deallocating network for instance {{(pid=74743) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] deallocate_for_instance() {{(pid=74743) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 17:21:35 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:36 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:21:36 user nova-compute[74743]: INFO nova.compute.manager [-] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Took 0.78 seconds to deallocate network for instance.
Nov 18 17:21:36 user nova-compute[74743]: DEBUG nova.compute.manager [req-99d0ea86-424a-44cb-8b4b-2b76d038ea4c req-1baf27a3-6d50-45c2-b4a0-a273e55dccee service nova] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Received event network-vif-deleted-4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:21:36 user nova-compute[74743]: DEBUG nova.compute.manager [req-4282382d-f797-4500-b7f9-488540222c4e req-d3bed16b-6953-40cd-a38d-899bbe369760 service nova] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Received event network-vif-plugged-4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:21:36 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4282382d-f797-4500-b7f9-488540222c4e req-d3bed16b-6953-40cd-a38d-899bbe369760 service nova] Acquiring lock "69d78ecf-740d-492a-be5b-ffd064e36f00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:21:36 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4282382d-f797-4500-b7f9-488540222c4e req-d3bed16b-6953-40cd-a38d-899bbe369760 service nova] Lock "69d78ecf-740d-492a-be5b-ffd064e36f00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:21:36 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4282382d-f797-4500-b7f9-488540222c4e req-d3bed16b-6953-40cd-a38d-899bbe369760 service nova] Lock "69d78ecf-740d-492a-be5b-ffd064e36f00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:21:36 user nova-compute[74743]: DEBUG nova.compute.manager [req-4282382d-f797-4500-b7f9-488540222c4e req-d3bed16b-6953-40cd-a38d-899bbe369760 service nova] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] No waiting events found dispatching network-vif-plugged-4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:21:36 user nova-compute[74743]: WARNING nova.compute.manager [req-4282382d-f797-4500-b7f9-488540222c4e req-d3bed16b-6953-40cd-a38d-899bbe369760 service nova] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Received unexpected event network-vif-plugged-4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8 for instance with vm_state active and task_state deleting.
Nov 18 17:21:36 user nova-compute[74743]: DEBUG nova.compute.manager [req-4282382d-f797-4500-b7f9-488540222c4e req-d3bed16b-6953-40cd-a38d-899bbe369760 service nova] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Received event network-vif-plugged-4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:21:36 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4282382d-f797-4500-b7f9-488540222c4e req-d3bed16b-6953-40cd-a38d-899bbe369760 service nova] Acquiring lock "69d78ecf-740d-492a-be5b-ffd064e36f00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:21:36 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4282382d-f797-4500-b7f9-488540222c4e req-d3bed16b-6953-40cd-a38d-899bbe369760 service nova] Lock "69d78ecf-740d-492a-be5b-ffd064e36f00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:21:36 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4282382d-f797-4500-b7f9-488540222c4e req-d3bed16b-6953-40cd-a38d-899bbe369760 service nova] Lock "69d78ecf-740d-492a-be5b-ffd064e36f00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:21:36 user nova-compute[74743]: DEBUG nova.compute.manager [req-4282382d-f797-4500-b7f9-488540222c4e req-d3bed16b-6953-40cd-a38d-899bbe369760 service nova] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] No waiting events found dispatching network-vif-plugged-4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:21:36 user nova-compute[74743]: WARNING nova.compute.manager [req-4282382d-f797-4500-b7f9-488540222c4e req-d3bed16b-6953-40cd-a38d-899bbe369760 service nova] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Received unexpected event network-vif-plugged-4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8 for instance with vm_state active and task_state deleting.
Nov 18 17:21:36 user nova-compute[74743]: DEBUG nova.compute.manager [req-4282382d-f797-4500-b7f9-488540222c4e req-d3bed16b-6953-40cd-a38d-899bbe369760 service nova] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Received event network-vif-plugged-4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:21:36 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4282382d-f797-4500-b7f9-488540222c4e req-d3bed16b-6953-40cd-a38d-899bbe369760 service nova] Acquiring lock "69d78ecf-740d-492a-be5b-ffd064e36f00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:21:36 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4282382d-f797-4500-b7f9-488540222c4e req-d3bed16b-6953-40cd-a38d-899bbe369760 service nova] Lock "69d78ecf-740d-492a-be5b-ffd064e36f00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:21:36 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4282382d-f797-4500-b7f9-488540222c4e req-d3bed16b-6953-40cd-a38d-899bbe369760 service nova] Lock "69d78ecf-740d-492a-be5b-ffd064e36f00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:21:36 user nova-compute[74743]: DEBUG nova.compute.manager [req-4282382d-f797-4500-b7f9-488540222c4e req-d3bed16b-6953-40cd-a38d-899bbe369760 service nova] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] No waiting events found dispatching network-vif-plugged-4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:21:36 user nova-compute[74743]: WARNING nova.compute.manager [req-4282382d-f797-4500-b7f9-488540222c4e req-d3bed16b-6953-40cd-a38d-899bbe369760 service nova] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Received unexpected event network-vif-plugged-4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8 for instance with vm_state active and task_state deleting.
Nov 18 17:21:36 user nova-compute[74743]: DEBUG nova.compute.manager [req-4282382d-f797-4500-b7f9-488540222c4e req-d3bed16b-6953-40cd-a38d-899bbe369760 service nova] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Received event network-vif-unplugged-4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:21:36 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4282382d-f797-4500-b7f9-488540222c4e req-d3bed16b-6953-40cd-a38d-899bbe369760 service nova] Acquiring lock "69d78ecf-740d-492a-be5b-ffd064e36f00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:21:36 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4282382d-f797-4500-b7f9-488540222c4e req-d3bed16b-6953-40cd-a38d-899bbe369760 service nova] Lock "69d78ecf-740d-492a-be5b-ffd064e36f00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:21:36 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4282382d-f797-4500-b7f9-488540222c4e req-d3bed16b-6953-40cd-a38d-899bbe369760 service nova] Lock "69d78ecf-740d-492a-be5b-ffd064e36f00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:21:36 user nova-compute[74743]: DEBUG nova.compute.manager [req-4282382d-f797-4500-b7f9-488540222c4e req-d3bed16b-6953-40cd-a38d-899bbe369760 service nova] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] No waiting events found dispatching network-vif-unplugged-4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:21:36 user nova-compute[74743]: DEBUG nova.compute.manager [req-4282382d-f797-4500-b7f9-488540222c4e req-d3bed16b-6953-40cd-a38d-899bbe369760 service nova] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Received event network-vif-unplugged-4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8 for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:21:36 user nova-compute[74743]: DEBUG nova.compute.manager [req-4282382d-f797-4500-b7f9-488540222c4e req-d3bed16b-6953-40cd-a38d-899bbe369760 service nova] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Received event network-vif-plugged-4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:21:36 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4282382d-f797-4500-b7f9-488540222c4e req-d3bed16b-6953-40cd-a38d-899bbe369760 service nova] Acquiring lock "69d78ecf-740d-492a-be5b-ffd064e36f00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:21:36 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4282382d-f797-4500-b7f9-488540222c4e req-d3bed16b-6953-40cd-a38d-899bbe369760 service nova] Lock "69d78ecf-740d-492a-be5b-ffd064e36f00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:21:36 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4282382d-f797-4500-b7f9-488540222c4e req-d3bed16b-6953-40cd-a38d-899bbe369760 service nova] Lock "69d78ecf-740d-492a-be5b-ffd064e36f00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:21:36 user nova-compute[74743]: DEBUG nova.compute.manager [req-4282382d-f797-4500-b7f9-488540222c4e req-d3bed16b-6953-40cd-a38d-899bbe369760 service nova] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] No waiting events found dispatching network-vif-plugged-4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:21:36 user nova-compute[74743]: WARNING nova.compute.manager [req-4282382d-f797-4500-b7f9-488540222c4e req-d3bed16b-6953-40cd-a38d-899bbe369760 service nova] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Received unexpected event network-vif-plugged-4cd5a403-19a8-41a5-810a-d6bdbf2cc4e8 for instance with vm_state active and task_state deleting.
Nov 18 17:21:37 user nova-compute[74743]: INFO nova.compute.manager [None req-d3d163ce-e72d-41aa-80e3-99c75880fb91 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Took 0.75 seconds to detach 1 volumes for instance.
Nov 18 17:21:37 user nova-compute[74743]: DEBUG nova.compute.manager [None req-d3d163ce-e72d-41aa-80e3-99c75880fb91 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: 69d78ecf-740d-492a-be5b-ffd064e36f00] Deleting volume: c12dbe72-19df-4534-bbb2-53dbc61fd87f {{(pid=74743) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 18 17:21:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d3d163ce-e72d-41aa-80e3-99c75880fb91 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:21:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d3d163ce-e72d-41aa-80e3-99c75880fb91 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:21:37 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:21:37 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:21:37 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:21:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:21:37 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-d3d163ce-e72d-41aa-80e3-99c75880fb91 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:21:37 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-d3d163ce-e72d-41aa-80e3-99c75880fb91 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:21:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d3d163ce-e72d-41aa-80e3-99c75880fb91 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.334s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:21:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.214s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:21:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:21:37 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Auditing locally available compute resources for user (node: user) {{(pid=74743) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 17:21:37 user nova-compute[74743]: INFO nova.scheduler.client.report [None req-d3d163ce-e72d-41aa-80e3-99c75880fb91 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Deleted allocations for instance 69d78ecf-740d-492a-be5b-ffd064e36f00
Nov 18 17:21:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d3d163ce-e72d-41aa-80e3-99c75880fb91 tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "69d78ecf-740d-492a-be5b-ffd064e36f00" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.448s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:21:37 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daaf907c-9a7f-417e-a44c-383ba0e74224/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daaf907c-9a7f-417e-a44c-383ba0e74224/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daaf907c-9a7f-417e-a44c-383ba0e74224/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daaf907c-9a7f-417e-a44c-383ba0e74224/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/789583c2-1c04-4510-a37e-0e9b7d3a0971/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/789583c2-1c04-4510-a37e-0e9b7d3a0971/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/789583c2-1c04-4510-a37e-0e9b7d3a0971/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/789583c2-1c04-4510-a37e-0e9b7d3a0971/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c58db905-7030-44d1-80ca-91e0cd746218/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c58db905-7030-44d1-80ca-91e0cd746218/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c58db905-7030-44d1-80ca-91e0cd746218/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c58db905-7030-44d1-80ca-91e0cd746218/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:39 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:21:39 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:21:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aecacc3-577d-4b36-9223-8446afe54e26/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aecacc3-577d-4b36-9223-8446afe54e26/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aecacc3-577d-4b36-9223-8446afe54e26/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:21:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aecacc3-577d-4b36-9223-8446afe54e26/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:21:40 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:21:40 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:40 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:21:40 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:21:40 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:21:40 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Hypervisor/Node resource view: name=user free_ram=7760MB free_disk=25.20568084716797GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74743) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 17:21:40 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:21:40 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:21:40 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance c006a4ad-a8e2-4108-9af1-dec4dd53fcda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:21:40 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance aefe3db1-b9bb-4cce-aa31-d0b6684ad791 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:21:40 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance f649143e-f7db-475a-bbe5-d5e7316caac3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:21:40 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 6aecacc3-577d-4b36-9223-8446afe54e26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:21:40 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 789583c2-1c04-4510-a37e-0e9b7d3a0971 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:21:40 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance c58db905-7030-44d1-80ca-91e0cd746218 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:21:40 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 9cbdffd6-df57-4bab-b69c-b41a2718fd68 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:21:40 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance daaf907c-9a7f-417e-a44c-383ba0e74224 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:21:40 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 17:21:40 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 17:21:40 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:21:40 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:21:40 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Compute_service record updated for user:user {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 17:21:40 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.441s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:21:45 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:45 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:50 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:50 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:21:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquiring lock "93772071-cb21-4f4e-8b07-c55be8cf7bea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:22:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "93772071-cb21-4f4e-8b07-c55be8cf7bea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:22:04 user nova-compute[74743]: DEBUG nova.compute.manager [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Starting instance... {{(pid=74743) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 17:22:05 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:22:05 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:22:05 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74743) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 17:22:05 user nova-compute[74743]: INFO nova.compute.claims [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Claim successful on node user
Nov 18 17:22:05 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:22:05 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:22:05 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.336s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:22:05 user nova-compute[74743]: DEBUG nova.compute.manager [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Start building networks asynchronously for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 17:22:05 user nova-compute[74743]: DEBUG nova.compute.manager [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Allocating IP information in the background. {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 17:22:05 user nova-compute[74743]: DEBUG nova.network.neutron [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] allocate_for_instance() {{(pid=74743) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 17:22:05 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 17:22:05 user nova-compute[74743]: DEBUG nova.compute.manager [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Start building block device mappings for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 17:22:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:22:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74743) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 17:22:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:22:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:22:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:05 user nova-compute[74743]: DEBUG nova.policy [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5639bd2666534fdca04d0958dcdc9f54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0fda74575d488a94e2dcfdc016598c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74743) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 17:22:05 user nova-compute[74743]: INFO nova.virt.block_device [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Booting with volume-backed-image 9536f6cf-95c4-40e2-864a-09a91525678a at /dev/vda
Nov 18 17:22:06 user nova-compute[74743]: DEBUG nova.network.neutron [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Successfully created port: 8aa1f220-b71a-4dce-b48a-cbef38e01517 {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:22:06 user nova-compute[74743]: DEBUG nova.network.neutron [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Successfully updated port: 8aa1f220-b71a-4dce-b48a-cbef38e01517 {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:22:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquiring lock "refresh_cache-93772071-cb21-4f4e-8b07-c55be8cf7bea" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:22:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquired lock "refresh_cache-93772071-cb21-4f4e-8b07-c55be8cf7bea" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:22:06 user nova-compute[74743]: DEBUG nova.network.neutron [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:22:06 user nova-compute[74743]: DEBUG nova.compute.manager [req-8e90548c-9f1a-4ab0-b634-43c752507f4e req-a4e01e5a-e5a4-4050-b072-4396a5d62062 service nova] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Received event network-changed-8aa1f220-b71a-4dce-b48a-cbef38e01517 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:22:06 user nova-compute[74743]: DEBUG nova.compute.manager [req-8e90548c-9f1a-4ab0-b634-43c752507f4e req-a4e01e5a-e5a4-4050-b072-4396a5d62062 service nova] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Refreshing instance network info cache due to event network-changed-8aa1f220-b71a-4dce-b48a-cbef38e01517. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:22:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-8e90548c-9f1a-4ab0-b634-43c752507f4e req-a4e01e5a-e5a4-4050-b072-4396a5d62062 service nova] Acquiring lock "refresh_cache-93772071-cb21-4f4e-8b07-c55be8cf7bea" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:22:06 user nova-compute[74743]: DEBUG nova.network.neutron [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:22:07 user nova-compute[74743]: DEBUG nova.network.neutron [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Updating instance_info_cache with network_info: [{"id": "8aa1f220-b71a-4dce-b48a-cbef38e01517", "address": "fa:16:3e:c9:74:4b", "network": {"id": "1bbf6aff-4048-4212-a716-d0628575bfd0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc0fda74575d488a94e2dcfdc016598c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8aa1f220-b7", "ovs_interfaceid": "8aa1f220-b71a-4dce-b48a-cbef38e01517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:22:07 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Releasing lock "refresh_cache-93772071-cb21-4f4e-8b07-c55be8cf7bea" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:22:07 user nova-compute[74743]: DEBUG nova.compute.manager [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Instance network_info: |[{"id": "8aa1f220-b71a-4dce-b48a-cbef38e01517", "address": "fa:16:3e:c9:74:4b", "network": {"id": "1bbf6aff-4048-4212-a716-d0628575bfd0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc0fda74575d488a94e2dcfdc016598c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8aa1f220-b7", "ovs_interfaceid": "8aa1f220-b71a-4dce-b48a-cbef38e01517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 17:22:07 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-8e90548c-9f1a-4ab0-b634-43c752507f4e req-a4e01e5a-e5a4-4050-b072-4396a5d62062 service nova] Acquired lock "refresh_cache-93772071-cb21-4f4e-8b07-c55be8cf7bea" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:22:07 user nova-compute[74743]: DEBUG nova.network.neutron [req-8e90548c-9f1a-4ab0-b634-43c752507f4e req-a4e01e5a-e5a4-4050-b072-4396a5d62062 service nova] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Refreshing network info cache for port 8aa1f220-b71a-4dce-b48a-cbef38e01517 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:22:07 user nova-compute[74743]: DEBUG nova.network.neutron [req-8e90548c-9f1a-4ab0-b634-43c752507f4e req-a4e01e5a-e5a4-4050-b072-4396a5d62062 service nova] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Updated VIF entry in instance network info cache for port 8aa1f220-b71a-4dce-b48a-cbef38e01517. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:22:07 user nova-compute[74743]: DEBUG nova.network.neutron [req-8e90548c-9f1a-4ab0-b634-43c752507f4e req-a4e01e5a-e5a4-4050-b072-4396a5d62062 service nova] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Updating instance_info_cache with network_info: [{"id": "8aa1f220-b71a-4dce-b48a-cbef38e01517", "address": "fa:16:3e:c9:74:4b", "network": {"id": "1bbf6aff-4048-4212-a716-d0628575bfd0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc0fda74575d488a94e2dcfdc016598c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8aa1f220-b7", "ovs_interfaceid": "8aa1f220-b71a-4dce-b48a-cbef38e01517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:22:07 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-8e90548c-9f1a-4ab0-b634-43c752507f4e req-a4e01e5a-e5a4-4050-b072-4396a5d62062 service nova] Releasing lock "refresh_cache-93772071-cb21-4f4e-8b07-c55be8cf7bea" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:22:08 user nova-compute[74743]: DEBUG nova.compute.manager [req-01fbc200-99ff-4529-bccb-0083be9698f7 req-7467b509-02c7-420d-84a2-c3ebbf52bfa0 service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Received event network-changed-2dc327a1-177d-4d19-9fb1-ce60b5367a7e {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:22:08 user nova-compute[74743]: DEBUG nova.compute.manager [req-01fbc200-99ff-4529-bccb-0083be9698f7 req-7467b509-02c7-420d-84a2-c3ebbf52bfa0 service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Refreshing instance network info cache due to event network-changed-2dc327a1-177d-4d19-9fb1-ce60b5367a7e. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:22:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-01fbc200-99ff-4529-bccb-0083be9698f7 req-7467b509-02c7-420d-84a2-c3ebbf52bfa0 service nova] Acquiring lock "refresh_cache-c58db905-7030-44d1-80ca-91e0cd746218" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:22:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-01fbc200-99ff-4529-bccb-0083be9698f7 req-7467b509-02c7-420d-84a2-c3ebbf52bfa0 service nova] Acquired lock "refresh_cache-c58db905-7030-44d1-80ca-91e0cd746218" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:22:08 user nova-compute[74743]: DEBUG nova.network.neutron [req-01fbc200-99ff-4529-bccb-0083be9698f7 req-7467b509-02c7-420d-84a2-c3ebbf52bfa0 service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Refreshing network info cache for port 2dc327a1-177d-4d19-9fb1-ce60b5367a7e {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:22:09 user nova-compute[74743]: DEBUG nova.network.neutron [req-01fbc200-99ff-4529-bccb-0083be9698f7 req-7467b509-02c7-420d-84a2-c3ebbf52bfa0 service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Updated VIF entry in instance network info cache for port 2dc327a1-177d-4d19-9fb1-ce60b5367a7e. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:22:09 user nova-compute[74743]: DEBUG nova.network.neutron [req-01fbc200-99ff-4529-bccb-0083be9698f7 req-7467b509-02c7-420d-84a2-c3ebbf52bfa0 service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Updating instance_info_cache with network_info: [{"id": "2dc327a1-177d-4d19-9fb1-ce60b5367a7e", "address": "fa:16:3e:05:b8:d4", "network": {"id": "e1c28f74-c9c1-4eb3-931e-003332ff6243", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-453481916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a17803c613c4ef299c797bba85c1a4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc327a1-17", "ovs_interfaceid": "2dc327a1-177d-4d19-9fb1-ce60b5367a7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:22:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-01fbc200-99ff-4529-bccb-0083be9698f7 req-7467b509-02c7-420d-84a2-c3ebbf52bfa0 service nova] Releasing lock "refresh_cache-c58db905-7030-44d1-80ca-91e0cd746218" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:22:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:11 user nova-compute[74743]: DEBUG os_brick.utils [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:22:11 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:22:11 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:22:11 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[82330262-2771-4100-9f24-285a398ff4e1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1116acd8874d\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:22:11 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:22:11 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:22:11 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19680e9-c6d0-47d0-b0d5-fa7adbb0836a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:22:11 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:22:11 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:22:11 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[16dc8902-08bf-46b7-b1a1-8b6a1ca954d8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:22:11 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[825d9c9b-b0dc-4db1-88e6-6ab4209fa863]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:22:11 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Running cmd (subprocess): nvme version {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:22:11 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] 'nvme version' failed. Not Retrying. {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:22:11 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] nvme not present on system {{(pid=74743) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 17:22:11 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:22:11 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:22:11 user nova-compute[74743]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 17:22:11 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[e721db4e-41e6-4afb-bf80-78f76d64c8f8]: (4, '') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:22:11 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74743) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 17:22:11 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 17:22:11 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] LIGHTOS: no hostnqn found. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 17:22:11 user nova-compute[74743]: DEBUG os_brick.utils [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1116acd8874d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:22:11 user nova-compute[74743]: DEBUG nova.virt.block_device [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Updating existing volume attachment record: 53f49d9d-7bcc-4aa5-9f68-fdd1a7a18faa {{(pid=74743) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 17:22:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-abe6544a-f17b-479f-b174-b0829d78ad85 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Acquiring lock "c58db905-7030-44d1-80ca-91e0cd746218" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:22:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-abe6544a-f17b-479f-b174-b0829d78ad85 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "c58db905-7030-44d1-80ca-91e0cd746218" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:22:12 user nova-compute[74743]: INFO nova.compute.manager [None req-abe6544a-f17b-479f-b174-b0829d78ad85 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Shelving
Nov 18 17:22:12 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:12 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:12 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:12 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:12 user nova-compute[74743]: DEBUG nova.compute.manager [req-80184b0a-9643-48b1-aa5a-f3bf7fc1ff1c req-e1f93174-2694-4b52-9ebc-d5d9f0b91430 service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Received event network-vif-unplugged-2dc327a1-177d-4d19-9fb1-ce60b5367a7e {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:22:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-80184b0a-9643-48b1-aa5a-f3bf7fc1ff1c req-e1f93174-2694-4b52-9ebc-d5d9f0b91430 service nova] Acquiring lock "c58db905-7030-44d1-80ca-91e0cd746218-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:22:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-80184b0a-9643-48b1-aa5a-f3bf7fc1ff1c req-e1f93174-2694-4b52-9ebc-d5d9f0b91430 service nova] Lock "c58db905-7030-44d1-80ca-91e0cd746218-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:22:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-80184b0a-9643-48b1-aa5a-f3bf7fc1ff1c req-e1f93174-2694-4b52-9ebc-d5d9f0b91430 service nova] Lock "c58db905-7030-44d1-80ca-91e0cd746218-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:22:12 user nova-compute[74743]: DEBUG nova.compute.manager [req-80184b0a-9643-48b1-aa5a-f3bf7fc1ff1c req-e1f93174-2694-4b52-9ebc-d5d9f0b91430 service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] No waiting events found dispatching network-vif-unplugged-2dc327a1-177d-4d19-9fb1-ce60b5367a7e {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:22:12 user nova-compute[74743]: WARNING nova.compute.manager [req-80184b0a-9643-48b1-aa5a-f3bf7fc1ff1c req-e1f93174-2694-4b52-9ebc-d5d9f0b91430 service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Received unexpected event network-vif-unplugged-2dc327a1-177d-4d19-9fb1-ce60b5367a7e for instance with vm_state active and task_state shelving.
Nov 18 17:22:13 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Instance destroyed successfully.
Nov 18 17:22:13 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-abe6544a-f17b-479f-b174-b0829d78ad85 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Beginning cold snapshot process
Nov 18 17:22:13 user nova-compute[74743]: DEBUG nova.privsep.utils [None req-abe6544a-f17b-479f-b174-b0829d78ad85 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74743) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 18 17:22:13 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-abe6544a-f17b-479f-b174-b0829d78ad85 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/c58db905-7030-44d1-80ca-91e0cd746218/disk /opt/stack/data/nova/instances/snapshots/tmpwmgf3khv/f340f9ed183943609fe72d804576a9b3 {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:22:14 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-abe6544a-f17b-479f-b174-b0829d78ad85 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/c58db905-7030-44d1-80ca-91e0cd746218/disk /opt/stack/data/nova/instances/snapshots/tmpwmgf3khv/f340f9ed183943609fe72d804576a9b3" returned: 0 in 0.717s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:22:14 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-abe6544a-f17b-479f-b174-b0829d78ad85 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Snapshot extracted, beginning image upload
Nov 18 17:22:14 user nova-compute[74743]: DEBUG nova.compute.manager [req-09ad73ee-5757-46db-a4e1-4d807bba4026 req-1626b323-c985-4d6a-a54d-eadadf16b46a service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Received event network-vif-plugged-2dc327a1-177d-4d19-9fb1-ce60b5367a7e {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:22:14 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-09ad73ee-5757-46db-a4e1-4d807bba4026 req-1626b323-c985-4d6a-a54d-eadadf16b46a service nova] Acquiring lock "c58db905-7030-44d1-80ca-91e0cd746218-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:22:14 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-09ad73ee-5757-46db-a4e1-4d807bba4026 req-1626b323-c985-4d6a-a54d-eadadf16b46a service nova] Lock "c58db905-7030-44d1-80ca-91e0cd746218-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:22:14 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-09ad73ee-5757-46db-a4e1-4d807bba4026 req-1626b323-c985-4d6a-a54d-eadadf16b46a service nova] Lock "c58db905-7030-44d1-80ca-91e0cd746218-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:22:14 user nova-compute[74743]: DEBUG nova.compute.manager [req-09ad73ee-5757-46db-a4e1-4d807bba4026 req-1626b323-c985-4d6a-a54d-eadadf16b46a service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] No waiting events found dispatching network-vif-plugged-2dc327a1-177d-4d19-9fb1-ce60b5367a7e {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:22:14 user nova-compute[74743]: WARNING nova.compute.manager [req-09ad73ee-5757-46db-a4e1-4d807bba4026 req-1626b323-c985-4d6a-a54d-eadadf16b46a service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Received unexpected event network-vif-plugged-2dc327a1-177d-4d19-9fb1-ce60b5367a7e for instance with vm_state active and task_state shelving_image_uploading.
Nov 18 17:22:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:16 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-abe6544a-f17b-479f-b174-b0829d78ad85 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Snapshot image upload complete
Nov 18 17:22:16 user nova-compute[74743]: DEBUG nova.compute.manager [None req-abe6544a-f17b-479f-b174-b0829d78ad85 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:22:16 user nova-compute[74743]: INFO nova.compute.manager [None req-abe6544a-f17b-479f-b174-b0829d78ad85 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Shelve offloading
Nov 18 17:22:16 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Instance destroyed successfully.
Nov 18 17:22:16 user nova-compute[74743]: DEBUG nova.compute.manager [None req-abe6544a-f17b-479f-b174-b0829d78ad85 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:22:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-abe6544a-f17b-479f-b174-b0829d78ad85 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Acquiring lock "refresh_cache-c58db905-7030-44d1-80ca-91e0cd746218" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:22:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-abe6544a-f17b-479f-b174-b0829d78ad85 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Acquired lock "refresh_cache-c58db905-7030-44d1-80ca-91e0cd746218" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:22:16 user nova-compute[74743]: DEBUG nova.network.neutron [None req-abe6544a-f17b-479f-b174-b0829d78ad85 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG nova.compute.manager [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Start spawning the instance on the hypervisor. {{(pid=74743) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Creating instance directory {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 17:22:17 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Creating image(s)
Nov 18 17:22:17 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Did not create local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Ensure instance console log exists: /opt/stack/data/nova/instances/93772071-cb21-4f4e-8b07-c55be8cf7bea/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Start _get_guest_xml network_info=[{"id": "8aa1f220-b71a-4dce-b48a-cbef38e01517", "address": "fa:16:3e:c9:74:4b", "network": {"id": "1bbf6aff-4048-4212-a716-d0628575bfd0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc0fda74575d488a94e2dcfdc016598c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8aa1f220-b7", "ovs_interfaceid": "8aa1f220-b71a-4dce-b48a-cbef38e01517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '53f49d9d-7bcc-4aa5-9f68-fdd1a7a18faa', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EBGDNSIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '93772071-cb21-4f4e-8b07-c55be8cf7bea', 'attached_at': '', 'detached_at': '', 'volume_id': '410ff800-e826-4b57-8396-11316cec6abb', 'serial': '410ff800-e826-4b57-8396-11316cec6abb'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:22:17 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:22:17 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:22:17 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Calling os-brick to attach iSCSI Volume {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EBGDNSIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:22:17 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:22:17 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:22:17 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:22:17 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:22:17 user nova-compute[74743]: INFO os_brick.initiator.connectors.iscsi [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 17:22:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb -p 172.16.0.220:3260 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96e768d-9b01-4326-b763-7d3af1ca78b8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 17:22:17 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb -p 172.16.0.220:3260 --interface default --op new {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6422c8b-faac-4697-9385-0ee377eb9862]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb] added\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb] added
Nov 18 17:22:17 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[97060999-afa9-4744-ab14-a8db3b05b0d7]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[49549678-1bf0-4346-be08-5b1870b77197]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EBGDNSIq {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EBGDNSIq" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[975c6cd4-4bc5-4f2e-887d-24a11a156293]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EBGDNSIq'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG nova.network.neutron [None req-abe6544a-f17b-479f-b174-b0829d78ad85 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Updating instance_info_cache with network_info: [{"id": "2dc327a1-177d-4d19-9fb1-ce60b5367a7e", "address": "fa:16:3e:05:b8:d4", "network": {"id": "e1c28f74-c9c1-4eb3-931e-003332ff6243", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-453481916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a17803c613c4ef299c797bba85c1a4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc327a1-17", "ovs_interfaceid": "2dc327a1-177d-4d19-9fb1-ce60b5367a7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[9079cfa8-044d-43de-804b-78d77ff28169]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-abe6544a-f17b-479f-b174-b0829d78ad85 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Releasing lock "refresh_cache-c58db905-7030-44d1-80ca-91e0cd746218" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ce9298-2229-4b2a-9c0d-e2b54d656730]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:22:17 user nova-compute[74743]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 (non-flash)
Nov 18 17:22:17 user nova-compute[74743]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 (non-flash)
Nov 18 17:22:17 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:22:17 user nova-compute[74743]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 (non-flash)
Nov 18 17:22:17 user nova-compute[74743]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 (non-flash)
Nov 18 17:22:17 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb -p 172.16.0.220:3260 --login {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ceb3319-acd9-468f-a482-876aba6d41a9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb, portal: 172.16.0.220,3260]
Nov 18 17:22:17 user nova-compute[74743]: Login to [iface: default, target: iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb, portal: 172.16.0.220,3260] successful.
Nov 18 17:22:17 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[7569f942-d853-4da1-a2c7-d7c5d33c28f5]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[824cadd0-f6f3-459c-8599-323a4b2159ce]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:22:17 user nova-compute[74743]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 (non-flash)
Nov 18 17:22:17 user nova-compute[74743]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 (non-flash)
Nov 18 17:22:17 user nova-compute[74743]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb (non-flash)
Nov 18 17:22:17 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:22:17 user nova-compute[74743]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 (non-flash)
Nov 18 17:22:17 user nova-compute[74743]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 (non-flash)
Nov 18 17:22:17 user nova-compute[74743]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb (non-flash)
Nov 18 17:22:17 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Connected to 172.16.0.220:3260 {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=74743) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74743) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[2983097d-7017-47a7-a629-42c3ff528b28]: (4, ('- - 0', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EBGDNSIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 17:22:17 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Instance destroyed successfully.
Nov 18 17:22:17 user nova-compute[74743]: DEBUG nova.objects.instance [None req-abe6544a-f17b-479f-b174-b0829d78ad85 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lazy-loading 'resources' on Instance uuid c58db905-7030-44d1-80ca-91e0cd746218 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-abe6544a-f17b-479f-b174-b0829d78ad85 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:20:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1999190186',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1999190186',id=36,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAVdZsN+DFKrCPNzanPHBqWs091OcQHgphg4iBlSfWRqz7epu6i3jKz8RNDrRHwUSaEHm/Cp6vRBJpFWpKEkvK3bZeVx7cY08vXJaHPMBdOZ7gBw6/rmmlh7AEdXEtEhkA==',key_name='tempest-keypair-405514316',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:20:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0a17803c613c4ef299c797bba85c1a4b',ramdisk_id='',reservation_id='r-p5x4eoy0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-13499029',owner_user_name='tempest-AttachVolumeShelveTestJSON-13499029-project-member',shelved_at='2023-11-18T17:22:16.681707',shelved_host='user',shelved_image_id='ffbc4e03-bfcb-4b7d-94bc-eec36ade870a'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:22:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18483ad6106b4d95afbbed450d625b53',uuid=c58db905-7030-44d1-80ca-91e0cd746218,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "2dc327a1-177d-4d19-9fb1-ce60b5367a7e", "address": "fa:16:3e:05:b8:d4", "network": {"id": "e1c28f74-c9c1-4eb3-931e-003332ff6243", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-453481916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a17803c613c4ef299c797bba85c1a4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc327a1-17", "ovs_interfaceid": "2dc327a1-177d-4d19-9fb1-ce60b5367a7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-abe6544a-f17b-479f-b174-b0829d78ad85 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Converting VIF {"id": "2dc327a1-177d-4d19-9fb1-ce60b5367a7e", "address": "fa:16:3e:05:b8:d4", "network": {"id": "e1c28f74-c9c1-4eb3-931e-003332ff6243", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-453481916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a17803c613c4ef299c797bba85c1a4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc327a1-17", "ovs_interfaceid": "2dc327a1-177d-4d19-9fb1-ce60b5367a7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-abe6544a-f17b-479f-b174-b0829d78ad85 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:b8:d4,bridge_name='br-int',has_traffic_filtering=True,id=2dc327a1-177d-4d19-9fb1-ce60b5367a7e,network=Network(e1c28f74-c9c1-4eb3-931e-003332ff6243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dc327a1-17') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG os_vif [None req-abe6544a-f17b-479f-b174-b0829d78ad85 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:b8:d4,bridge_name='br-int',has_traffic_filtering=True,id=2dc327a1-177d-4d19-9fb1-ce60b5367a7e,network=Network(e1c28f74-c9c1-4eb3-931e-003332ff6243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dc327a1-17') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2dc327a1-17, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG nova.compute.manager [req-88000a67-4cb6-442b-a8f5-6e00d2546acd req-aee36c31-01ee-44af-b956-10f04ffd66fe service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Received event network-changed-2dc327a1-177d-4d19-9fb1-ce60b5367a7e {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG nova.compute.manager [req-88000a67-4cb6-442b-a8f5-6e00d2546acd req-aee36c31-01ee-44af-b956-10f04ffd66fe service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Refreshing instance network info cache due to event network-changed-2dc327a1-177d-4d19-9fb1-ce60b5367a7e. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-88000a67-4cb6-442b-a8f5-6e00d2546acd req-aee36c31-01ee-44af-b956-10f04ffd66fe service nova] Acquiring lock "refresh_cache-c58db905-7030-44d1-80ca-91e0cd746218" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-88000a67-4cb6-442b-a8f5-6e00d2546acd req-aee36c31-01ee-44af-b956-10f04ffd66fe service nova] Acquired lock "refresh_cache-c58db905-7030-44d1-80ca-91e0cd746218" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG nova.network.neutron [req-88000a67-4cb6-442b-a8f5-6e00d2546acd req-aee36c31-01ee-44af-b956-10f04ffd66fe service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Refreshing network info cache for port 2dc327a1-177d-4d19-9fb1-ce60b5367a7e {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=366393c6-0d7c-421d-8846-00d2d129d538) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:22:17 user nova-compute[74743]: INFO os_vif [None req-abe6544a-f17b-479f-b174-b0829d78ad85 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:b8:d4,bridge_name='br-int',has_traffic_filtering=True,id=2dc327a1-177d-4d19-9fb1-ce60b5367a7e,network=Network(e1c28f74-c9c1-4eb3-931e-003332ff6243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dc327a1-17')
Nov 18 17:22:17 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-abe6544a-f17b-479f-b174-b0829d78ad85 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Deleting instance files /opt/stack/data/nova/instances/c58db905-7030-44d1-80ca-91e0cd746218_del
Nov 18 17:22:17 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-abe6544a-f17b-479f-b174-b0829d78ad85 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Deletion of /opt/stack/data/nova/instances/c58db905-7030-44d1-80ca-91e0cd746218_del complete
Nov 18 17:22:17 user nova-compute[74743]: INFO nova.scheduler.client.report [None req-abe6544a-f17b-479f-b174-b0829d78ad85 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Deleted allocations for instance c58db905-7030-44d1-80ca-91e0cd746218
Nov 18 17:22:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-abe6544a-f17b-479f-b174-b0829d78ad85 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:22:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-abe6544a-f17b-479f-b174-b0829d78ad85 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:22:18 user nova-compute[74743]: DEBUG nova.objects.instance [None req-abe6544a-f17b-479f-b174-b0829d78ad85 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lazy-loading 'numa_topology' on Instance uuid c58db905-7030-44d1-80ca-91e0cd746218 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:22:18 user nova-compute[74743]: DEBUG nova.objects.base [None req-abe6544a-f17b-479f-b174-b0829d78ad85 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Object Instance<c58db905-7030-44d1-80ca-91e0cd746218> lazy-loaded attributes: resources,numa_topology {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:22:18 user nova-compute[74743]: DEBUG nova.network.neutron [req-88000a67-4cb6-442b-a8f5-6e00d2546acd req-aee36c31-01ee-44af-b956-10f04ffd66fe service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Updated VIF entry in instance network info cache for port 2dc327a1-177d-4d19-9fb1-ce60b5367a7e. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:22:18 user nova-compute[74743]: DEBUG nova.network.neutron [req-88000a67-4cb6-442b-a8f5-6e00d2546acd req-aee36c31-01ee-44af-b956-10f04ffd66fe service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Updating instance_info_cache with network_info: [{"id": "2dc327a1-177d-4d19-9fb1-ce60b5367a7e", "address": "fa:16:3e:05:b8:d4", "network": {"id": "e1c28f74-c9c1-4eb3-931e-003332ff6243", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-453481916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a17803c613c4ef299c797bba85c1a4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap2dc327a1-17", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:22:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:18 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-abe6544a-f17b-479f-b174-b0829d78ad85 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:22:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-88000a67-4cb6-442b-a8f5-6e00d2546acd req-aee36c31-01ee-44af-b956-10f04ffd66fe service nova] Releasing lock "refresh_cache-c58db905-7030-44d1-80ca-91e0cd746218" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:22:18 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-abe6544a-f17b-479f-b174-b0829d78ad85 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:22:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-abe6544a-f17b-479f-b174-b0829d78ad85 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.301s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:22:18 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:22:18 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '26436303765386431', 'path': '/dev/sdc'} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:22:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436303765386431', 'path': '/dev/sdc'} {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 17:22:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-abe6544a-f17b-479f-b174-b0829d78ad85 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "c58db905-7030-44d1-80ca-91e0cd746218" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.066s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:22:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:22:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-483967353',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-483967353',id=39,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc0fda74575d488a94e2dcfdc016598c',ramdisk_id='',reservation_id='r-qzba9c41',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-633893051',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:22:06Z,user_data=None,user_id='5639bd2666534fdca04d0958dcdc9f54',uuid=93772071-cb21-4f4e-8b07-c55be8cf7bea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8aa1f220-b71a-4dce-b48a-cbef38e01517", "address": "fa:16:3e:c9:74:4b", "network": {"id": "1bbf6aff-4048-4212-a716-d0628575bfd0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc0fda74575d488a94e2dcfdc016598c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8aa1f220-b7", "ovs_interfaceid": "8aa1f220-b71a-4dce-b48a-cbef38e01517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:22:18 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Converting VIF {"id": "8aa1f220-b71a-4dce-b48a-cbef38e01517", "address": "fa:16:3e:c9:74:4b", "network": {"id": "1bbf6aff-4048-4212-a716-d0628575bfd0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc0fda74575d488a94e2dcfdc016598c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8aa1f220-b7", "ovs_interfaceid": "8aa1f220-b71a-4dce-b48a-cbef38e01517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:22:18 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:74:4b,bridge_name='br-int',has_traffic_filtering=True,id=8aa1f220-b71a-4dce-b48a-cbef38e01517,network=Network(1bbf6aff-4048-4212-a716-d0628575bfd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8aa1f220-b7') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:22:18 user nova-compute[74743]: DEBUG nova.objects.instance [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lazy-loading 'pci_devices' on Instance uuid 93772071-cb21-4f4e-8b07-c55be8cf7bea {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:22:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:22:18 user nova-compute[74743]:   <uuid>93772071-cb21-4f4e-8b07-c55be8cf7bea</uuid>
Nov 18 17:22:18 user nova-compute[74743]:   <name>instance-00000027</name>
Nov 18 17:22:18 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:22:18 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:22:18 user nova-compute[74743]:   <metadata>
Nov 18 17:22:18 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:22:18 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:22:18 user nova-compute[74743]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-483967353</nova:name>
Nov 18 17:22:18 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:22:17</nova:creationTime>
Nov 18 17:22:18 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:22:18 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:22:18 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:22:18 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:22:18 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:22:18 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:22:18 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:22:18 user nova-compute[74743]:       <nova:owner>
Nov 18 17:22:18 user nova-compute[74743]:         <nova:user uuid="5639bd2666534fdca04d0958dcdc9f54">tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member</nova:user>
Nov 18 17:22:18 user nova-compute[74743]:         <nova:project uuid="bc0fda74575d488a94e2dcfdc016598c">tempest-ServerBootFromVolumeStableRescueTest-633893051</nova:project>
Nov 18 17:22:18 user nova-compute[74743]:       </nova:owner>
Nov 18 17:22:18 user nova-compute[74743]:       <nova:root type="image" uuid="9536f6cf-95c4-40e2-864a-09a91525678a"/>
Nov 18 17:22:18 user nova-compute[74743]:       <nova:ports>
Nov 18 17:22:18 user nova-compute[74743]:         <nova:port uuid="8aa1f220-b71a-4dce-b48a-cbef38e01517">
Nov 18 17:22:18 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 18 17:22:18 user nova-compute[74743]:         </nova:port>
Nov 18 17:22:18 user nova-compute[74743]:       </nova:ports>
Nov 18 17:22:18 user nova-compute[74743]:     </nova:instance>
Nov 18 17:22:18 user nova-compute[74743]:   </metadata>
Nov 18 17:22:18 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:22:18 user nova-compute[74743]:     <system>
Nov 18 17:22:18 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:22:18 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:22:18 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:22:18 user nova-compute[74743]:       <entry name="serial">93772071-cb21-4f4e-8b07-c55be8cf7bea</entry>
Nov 18 17:22:18 user nova-compute[74743]:       <entry name="uuid">93772071-cb21-4f4e-8b07-c55be8cf7bea</entry>
Nov 18 17:22:18 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:22:18 user nova-compute[74743]:     </system>
Nov 18 17:22:18 user nova-compute[74743]:   </sysinfo>
Nov 18 17:22:18 user nova-compute[74743]:   <os>
Nov 18 17:22:18 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:22:18 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:22:18 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:22:18 user nova-compute[74743]:   </os>
Nov 18 17:22:18 user nova-compute[74743]:   <features>
Nov 18 17:22:18 user nova-compute[74743]:     <acpi/>
Nov 18 17:22:18 user nova-compute[74743]:     <apic/>
Nov 18 17:22:18 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:22:18 user nova-compute[74743]:   </features>
Nov 18 17:22:18 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:22:18 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:22:18 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:22:18 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:22:18 user nova-compute[74743]:   </clock>
Nov 18 17:22:18 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:22:18 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:22:18 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:22:18 user nova-compute[74743]:   </cpu>
Nov 18 17:22:18 user nova-compute[74743]:   <devices>
Nov 18 17:22:18 user nova-compute[74743]:     <disk type="block" device="disk">
Nov 18 17:22:18 user nova-compute[74743]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:22:18 user nova-compute[74743]:       <source dev="/dev/sdc"/>
Nov 18 17:22:18 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:22:18 user nova-compute[74743]:       <serial>410ff800-e826-4b57-8396-11316cec6abb</serial>
Nov 18 17:22:18 user nova-compute[74743]:     </disk>
Nov 18 17:22:18 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:22:18 user nova-compute[74743]:       <mac address="fa:16:3e:c9:74:4b"/>
Nov 18 17:22:18 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:22:18 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:22:18 user nova-compute[74743]:       <target dev="tap8aa1f220-b7"/>
Nov 18 17:22:18 user nova-compute[74743]:     </interface>
Nov 18 17:22:18 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:22:18 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/93772071-cb21-4f4e-8b07-c55be8cf7bea/console.log" append="off"/>
Nov 18 17:22:18 user nova-compute[74743]:     </serial>
Nov 18 17:22:18 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:22:18 user nova-compute[74743]:     <video>
Nov 18 17:22:18 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:22:18 user nova-compute[74743]:     </video>
Nov 18 17:22:18 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:22:18 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:22:18 user nova-compute[74743]:     </rng>
Nov 18 17:22:18 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:22:18 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:22:18 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:22:18 user nova-compute[74743]:     </memballoon>
Nov 18 17:22:18 user nova-compute[74743]:   </devices>
Nov 18 17:22:18 user nova-compute[74743]: </domain>
Nov 18 17:22:18 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:22:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:22:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-483967353',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-483967353',id=39,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc0fda74575d488a94e2dcfdc016598c',ramdisk_id='',reservation_id='r-qzba9c41',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-633893051',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:22:06Z,user_data=None,user_id='5639bd2666534fdca04d0958dcdc9f54',uuid=93772071-cb21-4f4e-8b07-c55be8cf7bea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8aa1f220-b71a-4dce-b48a-cbef38e01517", "address": "fa:16:3e:c9:74:4b", "network": {"id": "1bbf6aff-4048-4212-a716-d0628575bfd0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc0fda74575d488a94e2dcfdc016598c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8aa1f220-b7", "ovs_interfaceid": "8aa1f220-b71a-4dce-b48a-cbef38e01517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:22:18 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Converting VIF {"id": "8aa1f220-b71a-4dce-b48a-cbef38e01517", "address": "fa:16:3e:c9:74:4b", "network": {"id": "1bbf6aff-4048-4212-a716-d0628575bfd0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc0fda74575d488a94e2dcfdc016598c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8aa1f220-b7", "ovs_interfaceid": "8aa1f220-b71a-4dce-b48a-cbef38e01517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:22:18 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:74:4b,bridge_name='br-int',has_traffic_filtering=True,id=8aa1f220-b71a-4dce-b48a-cbef38e01517,network=Network(1bbf6aff-4048-4212-a716-d0628575bfd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8aa1f220-b7') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:22:18 user nova-compute[74743]: DEBUG os_vif [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:74:4b,bridge_name='br-int',has_traffic_filtering=True,id=8aa1f220-b71a-4dce-b48a-cbef38e01517,network=Network(1bbf6aff-4048-4212-a716-d0628575bfd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8aa1f220-b7') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:22:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:22:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:22:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e13158fb-e7e2-51de-8655-f6680b13dfd1', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:22:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8aa1f220-b7, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:22:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8aa1f220-b7, col_values=(('qos', UUID('0b6f5efd-9036-4f9c-8803-a879ca58f1a9')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:22:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8aa1f220-b7, col_values=(('external_ids', {'iface-id': '8aa1f220-b71a-4dce-b48a-cbef38e01517', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:74:4b', 'vm-uuid': '93772071-cb21-4f4e-8b07-c55be8cf7bea'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:22:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:22:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:18 user nova-compute[74743]: INFO os_vif [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:74:4b,bridge_name='br-int',has_traffic_filtering=True,id=8aa1f220-b71a-4dce-b48a-cbef38e01517,network=Network(1bbf6aff-4048-4212-a716-d0628575bfd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8aa1f220-b7')
Nov 18 17:22:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:22:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] No VIF found with MAC fa:16:3e:c9:74:4b, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:22:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:20 user nova-compute[74743]: DEBUG nova.compute.manager [req-a775a643-ad1e-470f-8468-2f28f390a809 req-a62a180e-8d37-46a5-a2f2-bddc466832b9 service nova] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Received event network-vif-plugged-8aa1f220-b71a-4dce-b48a-cbef38e01517 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:22:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a775a643-ad1e-470f-8468-2f28f390a809 req-a62a180e-8d37-46a5-a2f2-bddc466832b9 service nova] Acquiring lock "93772071-cb21-4f4e-8b07-c55be8cf7bea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:22:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a775a643-ad1e-470f-8468-2f28f390a809 req-a62a180e-8d37-46a5-a2f2-bddc466832b9 service nova] Lock "93772071-cb21-4f4e-8b07-c55be8cf7bea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:22:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a775a643-ad1e-470f-8468-2f28f390a809 req-a62a180e-8d37-46a5-a2f2-bddc466832b9 service nova] Lock "93772071-cb21-4f4e-8b07-c55be8cf7bea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:22:20 user nova-compute[74743]: DEBUG nova.compute.manager [req-a775a643-ad1e-470f-8468-2f28f390a809 req-a62a180e-8d37-46a5-a2f2-bddc466832b9 service nova] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] No waiting events found dispatching network-vif-plugged-8aa1f220-b71a-4dce-b48a-cbef38e01517 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:22:20 user nova-compute[74743]: WARNING nova.compute.manager [req-a775a643-ad1e-470f-8468-2f28f390a809 req-a62a180e-8d37-46a5-a2f2-bddc466832b9 service nova] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Received unexpected event network-vif-plugged-8aa1f220-b71a-4dce-b48a-cbef38e01517 for instance with vm_state building and task_state spawning.
Nov 18 17:22:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:21 user nova-compute[74743]: DEBUG nova.compute.manager [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:22:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Guest created on hypervisor {{(pid=74743) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 17:22:21 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Instance spawned successfully.
Nov 18 17:22:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 17:22:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Found default for hw_cdrom_bus of ide {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:22:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Found default for hw_disk_bus of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:22:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Found default for hw_input_bus of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:22:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Found default for hw_pointer_model of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:22:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Found default for hw_video_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:22:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Found default for hw_vif_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:22:22 user nova-compute[74743]: INFO nova.compute.manager [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Took 5.03 seconds to spawn the instance on the hypervisor.
Nov 18 17:22:22 user nova-compute[74743]: DEBUG nova.compute.manager [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:22:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:22 user nova-compute[74743]: DEBUG nova.compute.manager [req-e7890716-60e8-4f8d-8717-257f78ea6909 req-cb6ed671-8542-468d-bd56-aad7d84b9894 service nova] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Received event network-vif-plugged-8aa1f220-b71a-4dce-b48a-cbef38e01517 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:22:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e7890716-60e8-4f8d-8717-257f78ea6909 req-cb6ed671-8542-468d-bd56-aad7d84b9894 service nova] Acquiring lock "93772071-cb21-4f4e-8b07-c55be8cf7bea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:22:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e7890716-60e8-4f8d-8717-257f78ea6909 req-cb6ed671-8542-468d-bd56-aad7d84b9894 service nova] Lock "93772071-cb21-4f4e-8b07-c55be8cf7bea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:22:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e7890716-60e8-4f8d-8717-257f78ea6909 req-cb6ed671-8542-468d-bd56-aad7d84b9894 service nova] Lock "93772071-cb21-4f4e-8b07-c55be8cf7bea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:22:22 user nova-compute[74743]: DEBUG nova.compute.manager [req-e7890716-60e8-4f8d-8717-257f78ea6909 req-cb6ed671-8542-468d-bd56-aad7d84b9894 service nova] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] No waiting events found dispatching network-vif-plugged-8aa1f220-b71a-4dce-b48a-cbef38e01517 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:22:22 user nova-compute[74743]: WARNING nova.compute.manager [req-e7890716-60e8-4f8d-8717-257f78ea6909 req-cb6ed671-8542-468d-bd56-aad7d84b9894 service nova] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Received unexpected event network-vif-plugged-8aa1f220-b71a-4dce-b48a-cbef38e01517 for instance with vm_state building and task_state spawning.
Nov 18 17:22:22 user nova-compute[74743]: INFO nova.compute.manager [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Took 17.10 seconds to build instance.
Nov 18 17:22:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e3e70ba8-450f-4cd2-a4ab-5f3a0141aca9 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "93772071-cb21-4f4e-8b07-c55be8cf7bea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.187s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:22:23 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:26 user nova-compute[74743]: DEBUG nova.compute.manager [req-d078472d-29d6-4f96-baf8-c4f1993e8d35 req-addf0a25-18d9-4f81-8605-2e8a15a3cee9 service nova] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Received event network-changed-55c54294-3f4d-4199-a9fa-a273016b376b {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:22:26 user nova-compute[74743]: DEBUG nova.compute.manager [req-d078472d-29d6-4f96-baf8-c4f1993e8d35 req-addf0a25-18d9-4f81-8605-2e8a15a3cee9 service nova] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Refreshing instance network info cache due to event network-changed-55c54294-3f4d-4199-a9fa-a273016b376b. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:22:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d078472d-29d6-4f96-baf8-c4f1993e8d35 req-addf0a25-18d9-4f81-8605-2e8a15a3cee9 service nova] Acquiring lock "refresh_cache-9cbdffd6-df57-4bab-b69c-b41a2718fd68" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:22:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d078472d-29d6-4f96-baf8-c4f1993e8d35 req-addf0a25-18d9-4f81-8605-2e8a15a3cee9 service nova] Acquired lock "refresh_cache-9cbdffd6-df57-4bab-b69c-b41a2718fd68" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:22:26 user nova-compute[74743]: DEBUG nova.network.neutron [req-d078472d-29d6-4f96-baf8-c4f1993e8d35 req-addf0a25-18d9-4f81-8605-2e8a15a3cee9 service nova] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Refreshing network info cache for port 55c54294-3f4d-4199-a9fa-a273016b376b {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:22:27 user nova-compute[74743]: DEBUG nova.network.neutron [req-d078472d-29d6-4f96-baf8-c4f1993e8d35 req-addf0a25-18d9-4f81-8605-2e8a15a3cee9 service nova] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Updated VIF entry in instance network info cache for port 55c54294-3f4d-4199-a9fa-a273016b376b. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:22:27 user nova-compute[74743]: DEBUG nova.network.neutron [req-d078472d-29d6-4f96-baf8-c4f1993e8d35 req-addf0a25-18d9-4f81-8605-2e8a15a3cee9 service nova] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Updating instance_info_cache with network_info: [{"id": "55c54294-3f4d-4199-a9fa-a273016b376b", "address": "fa:16:3e:70:96:90", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55c54294-3f", "ovs_interfaceid": "55c54294-3f4d-4199-a9fa-a273016b376b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:22:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d078472d-29d6-4f96-baf8-c4f1993e8d35 req-addf0a25-18d9-4f81-8605-2e8a15a3cee9 service nova] Releasing lock "refresh_cache-9cbdffd6-df57-4bab-b69c-b41a2718fd68" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:22:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-920871bc-9f35-4d07-a96b-940dd947d40a tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquiring lock "c006a4ad-a8e2-4108-9af1-dec4dd53fcda" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:22:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-920871bc-9f35-4d07-a96b-940dd947d40a tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "c006a4ad-a8e2-4108-9af1-dec4dd53fcda" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:22:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-920871bc-9f35-4d07-a96b-940dd947d40a tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquiring lock "c006a4ad-a8e2-4108-9af1-dec4dd53fcda-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:22:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-920871bc-9f35-4d07-a96b-940dd947d40a tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "c006a4ad-a8e2-4108-9af1-dec4dd53fcda-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:22:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-920871bc-9f35-4d07-a96b-940dd947d40a tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "c006a4ad-a8e2-4108-9af1-dec4dd53fcda-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:22:28 user nova-compute[74743]: INFO nova.compute.manager [None req-920871bc-9f35-4d07-a96b-940dd947d40a tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Terminating instance
Nov 18 17:22:28 user nova-compute[74743]: DEBUG nova.compute.manager [None req-920871bc-9f35-4d07-a96b-940dd947d40a tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Start destroying the instance on the hypervisor. {{(pid=74743) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 17:22:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:28 user nova-compute[74743]: DEBUG nova.compute.manager [req-3ab17e80-e7c2-4fd8-bfca-1455d2d8c33d req-e2d060f7-4245-4bad-a6fe-72e012cd2233 service nova] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Received event network-vif-unplugged-999980cf-efd0-4b78-aa42-f4e80073b5a9 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:22:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3ab17e80-e7c2-4fd8-bfca-1455d2d8c33d req-e2d060f7-4245-4bad-a6fe-72e012cd2233 service nova] Acquiring lock "c006a4ad-a8e2-4108-9af1-dec4dd53fcda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:22:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3ab17e80-e7c2-4fd8-bfca-1455d2d8c33d req-e2d060f7-4245-4bad-a6fe-72e012cd2233 service nova] Lock "c006a4ad-a8e2-4108-9af1-dec4dd53fcda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:22:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3ab17e80-e7c2-4fd8-bfca-1455d2d8c33d req-e2d060f7-4245-4bad-a6fe-72e012cd2233 service nova] Lock "c006a4ad-a8e2-4108-9af1-dec4dd53fcda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:22:28 user nova-compute[74743]: DEBUG nova.compute.manager [req-3ab17e80-e7c2-4fd8-bfca-1455d2d8c33d req-e2d060f7-4245-4bad-a6fe-72e012cd2233 service nova] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] No waiting events found dispatching network-vif-unplugged-999980cf-efd0-4b78-aa42-f4e80073b5a9 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:22:28 user nova-compute[74743]: DEBUG nova.compute.manager [req-3ab17e80-e7c2-4fd8-bfca-1455d2d8c33d req-e2d060f7-4245-4bad-a6fe-72e012cd2233 service nova] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Received event network-vif-unplugged-999980cf-efd0-4b78-aa42-f4e80073b5a9 for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:22:29 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Instance destroyed successfully.
Nov 18 17:22:29 user nova-compute[74743]: DEBUG nova.objects.instance [None req-920871bc-9f35-4d07-a96b-940dd947d40a tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lazy-loading 'resources' on Instance uuid c006a4ad-a8e2-4108-9af1-dec4dd53fcda {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:22:29 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-920871bc-9f35-4d07-a96b-940dd947d40a tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:03:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-712226846',display_name='tempest-ServerActionsTestOtherA-server-712226846',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-712226846',id=4,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEVphqV0ovLOhWV5c4OtZaZAghiX4KqdCUzcXRNxI8zWTbqX3YOGnG7iLQKSTFxu3amDks//fytVOc70uGuSKqNKUeaE/kY0CmyGU71j0ZYQPWjJeA0I0UUP+FZUS4MWQ==',key_name='tempest-keypair-1212996543',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:03:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fb8f5850162c479b8d185e48c03be7d3',ramdisk_id='',reservation_id='r-642m5qx1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-128885625',owner_user_name='tempest-ServerActionsTestOtherA-128885625-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:03:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce3e4cef47114a7c9327db639460d923',uuid=c006a4ad-a8e2-4108-9af1-dec4dd53fcda,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "999980cf-efd0-4b78-aa42-f4e80073b5a9", "address": "fa:16:3e:e4:7e:f3", "network": {"id": "fd98f398-6576-449b-a737-887906eb6656", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668610993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb8f5850162c479b8d185e48c03be7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap999980cf-ef", "ovs_interfaceid": "999980cf-efd0-4b78-aa42-f4e80073b5a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:22:29 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-920871bc-9f35-4d07-a96b-940dd947d40a tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Converting VIF {"id": "999980cf-efd0-4b78-aa42-f4e80073b5a9", "address": "fa:16:3e:e4:7e:f3", "network": {"id": "fd98f398-6576-449b-a737-887906eb6656", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668610993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb8f5850162c479b8d185e48c03be7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap999980cf-ef", "ovs_interfaceid": "999980cf-efd0-4b78-aa42-f4e80073b5a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:22:29 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-920871bc-9f35-4d07-a96b-940dd947d40a tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:7e:f3,bridge_name='br-int',has_traffic_filtering=True,id=999980cf-efd0-4b78-aa42-f4e80073b5a9,network=Network(fd98f398-6576-449b-a737-887906eb6656),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap999980cf-ef') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:22:29 user nova-compute[74743]: DEBUG os_vif [None req-920871bc-9f35-4d07-a96b-940dd947d40a tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:7e:f3,bridge_name='br-int',has_traffic_filtering=True,id=999980cf-efd0-4b78-aa42-f4e80073b5a9,network=Network(fd98f398-6576-449b-a737-887906eb6656),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap999980cf-ef') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:22:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap999980cf-ef, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:22:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:22:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5058523e-72f2-49b3-9b16-b6d64728aaa9) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:22:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:22:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:29 user nova-compute[74743]: INFO os_vif [None req-920871bc-9f35-4d07-a96b-940dd947d40a tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:7e:f3,bridge_name='br-int',has_traffic_filtering=True,id=999980cf-efd0-4b78-aa42-f4e80073b5a9,network=Network(fd98f398-6576-449b-a737-887906eb6656),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap999980cf-ef')
Nov 18 17:22:29 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-920871bc-9f35-4d07-a96b-940dd947d40a tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Deleting instance files /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda_del
Nov 18 17:22:29 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-920871bc-9f35-4d07-a96b-940dd947d40a tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Deletion of /opt/stack/data/nova/instances/c006a4ad-a8e2-4108-9af1-dec4dd53fcda_del complete
Nov 18 17:22:29 user nova-compute[74743]: INFO nova.compute.manager [None req-920871bc-9f35-4d07-a96b-940dd947d40a tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Took 0.73 seconds to destroy the instance on the hypervisor.
Nov 18 17:22:29 user nova-compute[74743]: DEBUG oslo.service.loopingcall [None req-920871bc-9f35-4d07-a96b-940dd947d40a tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74743) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 17:22:29 user nova-compute[74743]: DEBUG nova.compute.manager [-] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Deallocating network for instance {{(pid=74743) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 17:22:29 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] deallocate_for_instance() {{(pid=74743) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 17:22:29 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:22:29 user nova-compute[74743]: INFO nova.compute.manager [-] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Took 0.55 seconds to deallocate network for instance.
Nov 18 17:22:29 user nova-compute[74743]: DEBUG nova.compute.manager [req-d80ba435-a9e7-462b-9585-b85e68f7072f req-df4743dc-1497-4ea7-8ae9-40f470bee6ac service nova] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Received event network-vif-deleted-999980cf-efd0-4b78-aa42-f4e80073b5a9 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:22:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-920871bc-9f35-4d07-a96b-940dd947d40a tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:22:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-920871bc-9f35-4d07-a96b-940dd947d40a tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:22:30 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-920871bc-9f35-4d07-a96b-940dd947d40a tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:22:30 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-920871bc-9f35-4d07-a96b-940dd947d40a tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:22:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-920871bc-9f35-4d07-a96b-940dd947d40a tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.303s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:22:30 user nova-compute[74743]: INFO nova.scheduler.client.report [None req-920871bc-9f35-4d07-a96b-940dd947d40a tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Deleted allocations for instance c006a4ad-a8e2-4108-9af1-dec4dd53fcda
Nov 18 17:22:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-920871bc-9f35-4d07-a96b-940dd947d40a tempest-ServerActionsTestOtherA-128885625 tempest-ServerActionsTestOtherA-128885625-project-member] Lock "c006a4ad-a8e2-4108-9af1-dec4dd53fcda" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.784s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:22:31 user nova-compute[74743]: DEBUG nova.compute.manager [req-607e8b74-7ecb-48a2-b440-6ce9942fdc09 req-388e19c3-cb68-46f2-83a6-a757498f5ed7 service nova] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Received event network-vif-plugged-999980cf-efd0-4b78-aa42-f4e80073b5a9 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:22:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-607e8b74-7ecb-48a2-b440-6ce9942fdc09 req-388e19c3-cb68-46f2-83a6-a757498f5ed7 service nova] Acquiring lock "c006a4ad-a8e2-4108-9af1-dec4dd53fcda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:22:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-607e8b74-7ecb-48a2-b440-6ce9942fdc09 req-388e19c3-cb68-46f2-83a6-a757498f5ed7 service nova] Lock "c006a4ad-a8e2-4108-9af1-dec4dd53fcda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:22:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-607e8b74-7ecb-48a2-b440-6ce9942fdc09 req-388e19c3-cb68-46f2-83a6-a757498f5ed7 service nova] Lock "c006a4ad-a8e2-4108-9af1-dec4dd53fcda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:22:31 user nova-compute[74743]: DEBUG nova.compute.manager [req-607e8b74-7ecb-48a2-b440-6ce9942fdc09 req-388e19c3-cb68-46f2-83a6-a757498f5ed7 service nova] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] No waiting events found dispatching network-vif-plugged-999980cf-efd0-4b78-aa42-f4e80073b5a9 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:22:31 user nova-compute[74743]: WARNING nova.compute.manager [req-607e8b74-7ecb-48a2-b440-6ce9942fdc09 req-388e19c3-cb68-46f2-83a6-a757498f5ed7 service nova] [instance: c006a4ad-a8e2-4108-9af1-dec4dd53fcda] Received unexpected event network-vif-plugged-999980cf-efd0-4b78-aa42-f4e80073b5a9 for instance with vm_state deleted and task_state None.
Nov 18 17:22:31 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:22:31 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:22:31 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:22:31 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74743) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 17:22:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "0d0a7608-0050-4e0e-a9d3-aa884a716aa8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:22:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "0d0a7608-0050-4e0e-a9d3-aa884a716aa8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:22:32 user nova-compute[74743]: DEBUG nova.compute.manager [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Starting instance... {{(pid=74743) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 17:22:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:22:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:22:32 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74743) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 17:22:32 user nova-compute[74743]: INFO nova.compute.claims [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Claim successful on node user
Nov 18 17:22:32 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:22:32 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:22:32 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:22:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.388s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:22:32 user nova-compute[74743]: DEBUG nova.compute.manager [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Start building networks asynchronously for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 17:22:32 user nova-compute[74743]: DEBUG nova.compute.manager [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Allocating IP information in the background. {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 17:22:32 user nova-compute[74743]: DEBUG nova.network.neutron [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] allocate_for_instance() {{(pid=74743) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 17:22:32 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 17:22:32 user nova-compute[74743]: DEBUG nova.compute.manager [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Start building block device mappings for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 17:22:32 user nova-compute[74743]: DEBUG nova.policy [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '89ce0d4bf7234c348b9b1a8979609c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a956c4d6e4304d34872ecf989279c886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74743) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 17:22:32 user nova-compute[74743]: INFO nova.virt.block_device [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Booting with volume 4b49c858-89a8-401d-bb73-d4ee0c2f4539 at /dev/vda
Nov 18 17:22:32 user nova-compute[74743]: DEBUG os_brick.utils [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:22:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:22:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:22:33 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a57a637-43eb-4469-a505-f8de4c351685]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1116acd8874d\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:22:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:22:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:22:33 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[583d5480-06ab-4352-9c0c-4e32a0ddfe3a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:22:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:22:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:22:33 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[85defd76-3a72-4864-a20f-d9fb30fc17e9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:22:33 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[88989c55-068a-4fb6-bba4-cfce7b6d563f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:22:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Running cmd (subprocess): nvme version {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:22:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] 'nvme version' failed. Not Retrying. {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:22:33 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] nvme not present on system {{(pid=74743) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 17:22:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:22:33 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:22:33 user nova-compute[74743]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 17:22:33 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1b662a-e9bb-4682-9195-75b3c5b2d211]: (4, '') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:22:33 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74743) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 17:22:33 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 17:22:33 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] LIGHTOS: no hostnqn found. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 17:22:33 user nova-compute[74743]: DEBUG os_brick.utils [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1116acd8874d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:22:33 user nova-compute[74743]: DEBUG nova.virt.block_device [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Updating existing volume attachment record: c654074e-e4e4-4495-9f43-ed75988cc384 {{(pid=74743) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 17:22:33 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:22:33 user nova-compute[74743]: DEBUG nova.network.neutron [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Successfully created port: 1db2129d-7ee3-4c25-9b9a-3cc962555092 {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:22:34 user nova-compute[74743]: DEBUG nova.network.neutron [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Successfully updated port: 1db2129d-7ee3-4c25-9b9a-3cc962555092 {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:22:34 user nova-compute[74743]: DEBUG nova.compute.manager [req-461ccfa8-f23c-4ee6-9b25-ffa6fcf12c8f req-de193ab7-3095-429a-84f4-ab6f6bf5ca65 service nova] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Received event network-changed-1db2129d-7ee3-4c25-9b9a-3cc962555092 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:22:34 user nova-compute[74743]: DEBUG nova.compute.manager [req-461ccfa8-f23c-4ee6-9b25-ffa6fcf12c8f req-de193ab7-3095-429a-84f4-ab6f6bf5ca65 service nova] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Refreshing instance network info cache due to event network-changed-1db2129d-7ee3-4c25-9b9a-3cc962555092. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:22:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-461ccfa8-f23c-4ee6-9b25-ffa6fcf12c8f req-de193ab7-3095-429a-84f4-ab6f6bf5ca65 service nova] Acquiring lock "refresh_cache-0d0a7608-0050-4e0e-a9d3-aa884a716aa8" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:22:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-461ccfa8-f23c-4ee6-9b25-ffa6fcf12c8f req-de193ab7-3095-429a-84f4-ab6f6bf5ca65 service nova] Acquired lock "refresh_cache-0d0a7608-0050-4e0e-a9d3-aa884a716aa8" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:22:34 user nova-compute[74743]: DEBUG nova.network.neutron [req-461ccfa8-f23c-4ee6-9b25-ffa6fcf12c8f req-de193ab7-3095-429a-84f4-ab6f6bf5ca65 service nova] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Refreshing network info cache for port 1db2129d-7ee3-4c25-9b9a-3cc962555092 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:22:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "refresh_cache-0d0a7608-0050-4e0e-a9d3-aa884a716aa8" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:22:34 user nova-compute[74743]: DEBUG nova.network.neutron [req-461ccfa8-f23c-4ee6-9b25-ffa6fcf12c8f req-de193ab7-3095-429a-84f4-ab6f6bf5ca65 service nova] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:22:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:34 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:22:34 user nova-compute[74743]: DEBUG nova.network.neutron [req-461ccfa8-f23c-4ee6-9b25-ffa6fcf12c8f req-de193ab7-3095-429a-84f4-ab6f6bf5ca65 service nova] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:22:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-461ccfa8-f23c-4ee6-9b25-ffa6fcf12c8f req-de193ab7-3095-429a-84f4-ab6f6bf5ca65 service nova] Releasing lock "refresh_cache-0d0a7608-0050-4e0e-a9d3-aa884a716aa8" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:22:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquired lock "refresh_cache-0d0a7608-0050-4e0e-a9d3-aa884a716aa8" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:22:34 user nova-compute[74743]: DEBUG nova.network.neutron [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:22:34 user nova-compute[74743]: DEBUG nova.network.neutron [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:22:34 user nova-compute[74743]: DEBUG nova.network.neutron [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Updating instance_info_cache with network_info: [{"id": "1db2129d-7ee3-4c25-9b9a-3cc962555092", "address": "fa:16:3e:b5:02:28", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db2129d-7e", "ovs_interfaceid": "1db2129d-7ee3-4c25-9b9a-3cc962555092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:22:34 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Releasing lock "refresh_cache-0d0a7608-0050-4e0e-a9d3-aa884a716aa8" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:22:34 user nova-compute[74743]: DEBUG nova.compute.manager [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Instance network_info: |[{"id": "1db2129d-7ee3-4c25-9b9a-3cc962555092", "address": "fa:16:3e:b5:02:28", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db2129d-7e", "ovs_interfaceid": "1db2129d-7ee3-4c25-9b9a-3cc962555092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 17:22:35 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:35 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:22:35 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Starting heal instance info cache {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 17:22:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "refresh_cache-aefe3db1-b9bb-4cce-aa31-d0b6684ad791" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:22:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquired lock "refresh_cache-aefe3db1-b9bb-4cce-aa31-d0b6684ad791" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:22:35 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Forcefully refreshing network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 17:22:35 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Updating instance_info_cache with network_info: [{"id": "7bc10485-32b0-44a5-8813-2fa64d1dfbba", "address": "fa:16:3e:47:96:7f", "network": {"id": "1bbf6aff-4048-4212-a716-d0628575bfd0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc0fda74575d488a94e2dcfdc016598c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc10485-32", "ovs_interfaceid": "7bc10485-32b0-44a5-8813-2fa64d1dfbba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:22:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Releasing lock "refresh_cache-aefe3db1-b9bb-4cce-aa31-d0b6684ad791" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:22:35 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Updated the network info_cache for instance {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 17:22:37 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:22:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:22:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:22:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:22:37 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Auditing locally available compute resources for user (node: user) {{(pid=74743) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 17:22:37 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daaf907c-9a7f-417e-a44c-383ba0e74224/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:22:37 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daaf907c-9a7f-417e-a44c-383ba0e74224/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:22:37 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daaf907c-9a7f-417e-a44c-383ba0e74224/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:22:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daaf907c-9a7f-417e-a44c-383ba0e74224/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:22:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/789583c2-1c04-4510-a37e-0e9b7d3a0971/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:22:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/789583c2-1c04-4510-a37e-0e9b7d3a0971/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:22:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/789583c2-1c04-4510-a37e-0e9b7d3a0971/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:22:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/789583c2-1c04-4510-a37e-0e9b7d3a0971/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:22:38 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:22:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:22:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:22:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:22:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:22:38 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:22:38 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:22:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aecacc3-577d-4b36-9223-8446afe54e26/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aecacc3-577d-4b36-9223-8446afe54e26/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aecacc3-577d-4b36-9223-8446afe54e26/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aecacc3-577d-4b36-9223-8446afe54e26/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG nova.compute.manager [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Start spawning the instance on the hypervisor. {{(pid=74743) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Creating instance directory {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 17:22:39 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Creating image(s)
Nov 18 17:22:39 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Did not create local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Ensure instance console log exists: /opt/stack/data/nova/instances/0d0a7608-0050-4e0e-a9d3-aa884a716aa8/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Start _get_guest_xml network_info=[{"id": "1db2129d-7ee3-4c25-9b9a-3cc962555092", "address": "fa:16:3e:b5:02:28", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db2129d-7e", "ovs_interfaceid": "1db2129d-7ee3-4c25-9b9a-3cc962555092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': 'c654074e-e4e4-4495-9f43-ed75988cc384', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NZwdmOVj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0d0a7608-0050-4e0e-a9d3-aa884a716aa8', 'attached_at': '', 'detached_at': '', 'volume_id': '4b49c858-89a8-401d-bb73-d4ee0c2f4539', 'serial': '4b49c858-89a8-401d-bb73-d4ee0c2f4539'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:22:39 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:22:39 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:22:39 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Hypervisor/Node resource view: name=user free_ram=8072MB free_disk=25.205707550048828GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74743) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:22:39 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:22:39 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:22:39 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Calling os-brick to attach iSCSI Volume {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NZwdmOVj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:22:39 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:22:39 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:22:39 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:22:39 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:22:39 user nova-compute[74743]: INFO os_brick.initiator.connectors.iscsi [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 17:22:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539 -p 172.16.0.220:3260 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc353e32-55dd-47da-8016-7d37fd54cbc3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 17:22:39 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539 -p 172.16.0.220:3260 --interface default --op new {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[46953695-6aca-4fc2-9a8f-9baeb71bb383]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539] added\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539] added
Nov 18 17:22:39 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[65967d4a-179e-443d-a065-6f74cd418380]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance aefe3db1-b9bb-4cce-aa31-d0b6684ad791 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance f649143e-f7db-475a-bbe5-d5e7316caac3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 6aecacc3-577d-4b36-9223-8446afe54e26 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 789583c2-1c04-4510-a37e-0e9b7d3a0971 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 9cbdffd6-df57-4bab-b69c-b41a2718fd68 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance daaf907c-9a7f-417e-a44c-383ba0e74224 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 93772071-cb21-4f4e-8b07-c55be8cf7bea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 0d0a7608-0050-4e0e-a9d3-aa884a716aa8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9befaf1-1f18-4ac7-b60d-12c16fcdf5e1]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NZwdmOVj {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NZwdmOVj" returned: 0 in 0.024s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b605e7b6-22f0-42ce-9d95-a9313cf879c9]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NZwdmOVj'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1d4b0e-5a2e-4175-8e2f-84aca25efd73]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[152f7d95-f642-4543-895f-dd7946a7ae76]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:22:39 user nova-compute[74743]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 (non-flash)
Nov 18 17:22:39 user nova-compute[74743]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 (non-flash)
Nov 18 17:22:39 user nova-compute[74743]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb (non-flash)
Nov 18 17:22:39 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:22:39 user nova-compute[74743]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 (non-flash)
Nov 18 17:22:39 user nova-compute[74743]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 (non-flash)
Nov 18 17:22:39 user nova-compute[74743]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb (non-flash)
Nov 18 17:22:39 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539 -p 172.16.0.220:3260 --login {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba50942-2a4f-4b46-9859-2ecc0ef93442]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539, portal: 172.16.0.220,3260]
Nov 18 17:22:39 user nova-compute[74743]: Login to [iface: default, target: iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539, portal: 172.16.0.220,3260] successful.
Nov 18 17:22:39 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb1247e-ef34-4e71-b250-723a4b7c350d]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[1578a92b-2a9d-4aee-855c-5b4818af9946]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:22:39 user nova-compute[74743]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 (non-flash)
Nov 18 17:22:39 user nova-compute[74743]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 (non-flash)
Nov 18 17:22:39 user nova-compute[74743]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb (non-flash)
Nov 18 17:22:39 user nova-compute[74743]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539 (non-flash)
Nov 18 17:22:39 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:22:39 user nova-compute[74743]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 (non-flash)
Nov 18 17:22:39 user nova-compute[74743]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 (non-flash)
Nov 18 17:22:39 user nova-compute[74743]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb (non-flash)
Nov 18 17:22:39 user nova-compute[74743]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539 (non-flash)
Nov 18 17:22:39 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Connected to 172.16.0.220:3260 {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] HCTL ('36', '-', '-', 0) found on session 47 with lun 0 {{(pid=74743) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74743) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 17:22:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:22:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:22:40 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c167624-4093-4aa9-80ba-a9770f0b2907]: (4, ('- - 0', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:22:40 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Searching for a device in session 47 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:22:40 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NZwdmOVj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 17:22:40 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:22:40 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:22:40 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Compute_service record updated for user:user {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 17:22:40 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.500s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:22:40 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.415s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:22:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] <== connect_volume: return (1417ms) {'type': 'block', 'scsi_wwn': '26161346136636364', 'path': '/dev/sde'} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:22:41 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161346136636364', 'path': '/dev/sde'} {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 17:22:41 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:22:41 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:22:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1956519765',display_name='tempest-TestVolumeBootPattern-server-1956519765',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1956519765',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOLvs8QktAbg6ubYzS1yyIzjK6/SEgIlSEhHuVaKm0b6bpmV4klO8yadOBEcp58HtUXwfad9vILFBUP0iHELOBhABjjRYYSI0ECkBhwEERqTkNNauBgT8rgOot2Bwx6w0A==',key_name='tempest-TestVolumeBootPattern-2140749553',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a956c4d6e4304d34872ecf989279c886',ramdisk_id='',reservation_id='r-4tnngg14',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1373443944',owner_user_name='tempest-TestVolumeBootPattern-1373443944-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:22:33Z,user_data=None,user_id='89ce0d4bf7234c348b9b1a8979609c7b',uuid=0d0a7608-0050-4e0e-a9d3-aa884a716aa8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1db2129d-7ee3-4c25-9b9a-3cc962555092", "address": "fa:16:3e:b5:02:28", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db2129d-7e", "ovs_interfaceid": "1db2129d-7ee3-4c25-9b9a-3cc962555092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:22:41 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Converting VIF {"id": "1db2129d-7ee3-4c25-9b9a-3cc962555092", "address": "fa:16:3e:b5:02:28", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db2129d-7e", "ovs_interfaceid": "1db2129d-7ee3-4c25-9b9a-3cc962555092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:22:41 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:02:28,bridge_name='br-int',has_traffic_filtering=True,id=1db2129d-7ee3-4c25-9b9a-3cc962555092,network=Network(fc55f18a-b779-4b04-8828-278ecd62211a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1db2129d-7e') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:22:41 user nova-compute[74743]: DEBUG nova.objects.instance [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lazy-loading 'pci_devices' on Instance uuid 0d0a7608-0050-4e0e-a9d3-aa884a716aa8 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:22:41 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:22:41 user nova-compute[74743]:   <uuid>0d0a7608-0050-4e0e-a9d3-aa884a716aa8</uuid>
Nov 18 17:22:41 user nova-compute[74743]:   <name>instance-00000028</name>
Nov 18 17:22:41 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:22:41 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:22:41 user nova-compute[74743]:   <metadata>
Nov 18 17:22:41 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:22:41 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:22:41 user nova-compute[74743]:       <nova:name>tempest-TestVolumeBootPattern-server-1956519765</nova:name>
Nov 18 17:22:41 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:22:39</nova:creationTime>
Nov 18 17:22:41 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:22:41 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:22:41 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:22:41 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:22:41 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:22:41 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:22:41 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:22:41 user nova-compute[74743]:       <nova:owner>
Nov 18 17:22:41 user nova-compute[74743]:         <nova:user uuid="89ce0d4bf7234c348b9b1a8979609c7b">tempest-TestVolumeBootPattern-1373443944-project-member</nova:user>
Nov 18 17:22:41 user nova-compute[74743]:         <nova:project uuid="a956c4d6e4304d34872ecf989279c886">tempest-TestVolumeBootPattern-1373443944</nova:project>
Nov 18 17:22:41 user nova-compute[74743]:       </nova:owner>
Nov 18 17:22:41 user nova-compute[74743]:       <nova:ports>
Nov 18 17:22:41 user nova-compute[74743]:         <nova:port uuid="1db2129d-7ee3-4c25-9b9a-3cc962555092">
Nov 18 17:22:41 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 18 17:22:41 user nova-compute[74743]:         </nova:port>
Nov 18 17:22:41 user nova-compute[74743]:       </nova:ports>
Nov 18 17:22:41 user nova-compute[74743]:     </nova:instance>
Nov 18 17:22:41 user nova-compute[74743]:   </metadata>
Nov 18 17:22:41 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:22:41 user nova-compute[74743]:     <system>
Nov 18 17:22:41 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:22:41 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:22:41 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:22:41 user nova-compute[74743]:       <entry name="serial">0d0a7608-0050-4e0e-a9d3-aa884a716aa8</entry>
Nov 18 17:22:41 user nova-compute[74743]:       <entry name="uuid">0d0a7608-0050-4e0e-a9d3-aa884a716aa8</entry>
Nov 18 17:22:41 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:22:41 user nova-compute[74743]:     </system>
Nov 18 17:22:41 user nova-compute[74743]:   </sysinfo>
Nov 18 17:22:41 user nova-compute[74743]:   <os>
Nov 18 17:22:41 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:22:41 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:22:41 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:22:41 user nova-compute[74743]:   </os>
Nov 18 17:22:41 user nova-compute[74743]:   <features>
Nov 18 17:22:41 user nova-compute[74743]:     <acpi/>
Nov 18 17:22:41 user nova-compute[74743]:     <apic/>
Nov 18 17:22:41 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:22:41 user nova-compute[74743]:   </features>
Nov 18 17:22:41 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:22:41 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:22:41 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:22:41 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:22:41 user nova-compute[74743]:   </clock>
Nov 18 17:22:41 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:22:41 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:22:41 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:22:41 user nova-compute[74743]:   </cpu>
Nov 18 17:22:41 user nova-compute[74743]:   <devices>
Nov 18 17:22:41 user nova-compute[74743]:     <disk type="block" device="disk">
Nov 18 17:22:41 user nova-compute[74743]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:22:41 user nova-compute[74743]:       <source dev="/dev/sde"/>
Nov 18 17:22:41 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:22:41 user nova-compute[74743]:       <serial>4b49c858-89a8-401d-bb73-d4ee0c2f4539</serial>
Nov 18 17:22:41 user nova-compute[74743]:     </disk>
Nov 18 17:22:41 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:22:41 user nova-compute[74743]:       <mac address="fa:16:3e:b5:02:28"/>
Nov 18 17:22:41 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:22:41 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:22:41 user nova-compute[74743]:       <target dev="tap1db2129d-7e"/>
Nov 18 17:22:41 user nova-compute[74743]:     </interface>
Nov 18 17:22:41 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:22:41 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/0d0a7608-0050-4e0e-a9d3-aa884a716aa8/console.log" append="off"/>
Nov 18 17:22:41 user nova-compute[74743]:     </serial>
Nov 18 17:22:41 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:22:41 user nova-compute[74743]:     <video>
Nov 18 17:22:41 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:22:41 user nova-compute[74743]:     </video>
Nov 18 17:22:41 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:22:41 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:22:41 user nova-compute[74743]:     </rng>
Nov 18 17:22:41 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:22:41 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:22:41 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:22:41 user nova-compute[74743]:     </memballoon>
Nov 18 17:22:41 user nova-compute[74743]:   </devices>
Nov 18 17:22:41 user nova-compute[74743]: </domain>
Nov 18 17:22:41 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:22:41 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:22:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1956519765',display_name='tempest-TestVolumeBootPattern-server-1956519765',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1956519765',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOLvs8QktAbg6ubYzS1yyIzjK6/SEgIlSEhHuVaKm0b6bpmV4klO8yadOBEcp58HtUXwfad9vILFBUP0iHELOBhABjjRYYSI0ECkBhwEERqTkNNauBgT8rgOot2Bwx6w0A==',key_name='tempest-TestVolumeBootPattern-2140749553',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a956c4d6e4304d34872ecf989279c886',ramdisk_id='',reservation_id='r-4tnngg14',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1373443944',owner_user_name='tempest-TestVolumeBootPattern-1373443944-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:22:33Z,user_data=None,user_id='89ce0d4bf7234c348b9b1a8979609c7b',uuid=0d0a7608-0050-4e0e-a9d3-aa884a716aa8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1db2129d-7ee3-4c25-9b9a-3cc962555092", "address": "fa:16:3e:b5:02:28", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db2129d-7e", "ovs_interfaceid": "1db2129d-7ee3-4c25-9b9a-3cc962555092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:22:41 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Converting VIF {"id": "1db2129d-7ee3-4c25-9b9a-3cc962555092", "address": "fa:16:3e:b5:02:28", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db2129d-7e", "ovs_interfaceid": "1db2129d-7ee3-4c25-9b9a-3cc962555092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:22:41 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:02:28,bridge_name='br-int',has_traffic_filtering=True,id=1db2129d-7ee3-4c25-9b9a-3cc962555092,network=Network(fc55f18a-b779-4b04-8828-278ecd62211a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1db2129d-7e') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:22:41 user nova-compute[74743]: DEBUG os_vif [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:02:28,bridge_name='br-int',has_traffic_filtering=True,id=1db2129d-7ee3-4c25-9b9a-3cc962555092,network=Network(fc55f18a-b779-4b04-8828-278ecd62211a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1db2129d-7e') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:22:41 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:41 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:22:41 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:22:41 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:41 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4fc0ed63-a97d-5f58-a37f-a8abfdcf2d62', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:22:41 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:41 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:22:41 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:41 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1db2129d-7e, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:22:41 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1db2129d-7e, col_values=(('qos', UUID('0a76b1fb-6a34-492d-bcaa-43750da53d66')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:22:41 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1db2129d-7e, col_values=(('external_ids', {'iface-id': '1db2129d-7ee3-4c25-9b9a-3cc962555092', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:02:28', 'vm-uuid': '0d0a7608-0050-4e0e-a9d3-aa884a716aa8'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:22:41 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:41 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:22:41 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:41 user nova-compute[74743]: INFO os_vif [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:02:28,bridge_name='br-int',has_traffic_filtering=True,id=1db2129d-7ee3-4c25-9b9a-3cc962555092,network=Network(fc55f18a-b779-4b04-8828-278ecd62211a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1db2129d-7e')
Nov 18 17:22:41 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:22:41 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] No VIF found with MAC fa:16:3e:b5:02:28, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:22:42 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:42 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:42 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:42 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:42 user nova-compute[74743]: DEBUG nova.compute.manager [req-8563c2ac-9f2e-4529-b9d2-40c03ed6bc58 req-b6e726f9-781d-4a5a-8b51-93e5143f1cc1 service nova] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Received event network-vif-plugged-1db2129d-7ee3-4c25-9b9a-3cc962555092 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:22:42 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-8563c2ac-9f2e-4529-b9d2-40c03ed6bc58 req-b6e726f9-781d-4a5a-8b51-93e5143f1cc1 service nova] Acquiring lock "0d0a7608-0050-4e0e-a9d3-aa884a716aa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:22:42 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-8563c2ac-9f2e-4529-b9d2-40c03ed6bc58 req-b6e726f9-781d-4a5a-8b51-93e5143f1cc1 service nova] Lock "0d0a7608-0050-4e0e-a9d3-aa884a716aa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:22:42 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-8563c2ac-9f2e-4529-b9d2-40c03ed6bc58 req-b6e726f9-781d-4a5a-8b51-93e5143f1cc1 service nova] Lock "0d0a7608-0050-4e0e-a9d3-aa884a716aa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:22:42 user nova-compute[74743]: DEBUG nova.compute.manager [req-8563c2ac-9f2e-4529-b9d2-40c03ed6bc58 req-b6e726f9-781d-4a5a-8b51-93e5143f1cc1 service nova] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] No waiting events found dispatching network-vif-plugged-1db2129d-7ee3-4c25-9b9a-3cc962555092 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:22:42 user nova-compute[74743]: WARNING nova.compute.manager [req-8563c2ac-9f2e-4529-b9d2-40c03ed6bc58 req-b6e726f9-781d-4a5a-8b51-93e5143f1cc1 service nova] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Received unexpected event network-vif-plugged-1db2129d-7ee3-4c25-9b9a-3cc962555092 for instance with vm_state building and task_state spawning.
Nov 18 17:22:44 user nova-compute[74743]: DEBUG nova.compute.manager [req-234db781-3bde-493e-86ca-a38bad026839 req-da7325b8-445d-4c46-b380-94278686e798 service nova] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Received event network-vif-plugged-1db2129d-7ee3-4c25-9b9a-3cc962555092 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:22:44 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-234db781-3bde-493e-86ca-a38bad026839 req-da7325b8-445d-4c46-b380-94278686e798 service nova] Acquiring lock "0d0a7608-0050-4e0e-a9d3-aa884a716aa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:22:44 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-234db781-3bde-493e-86ca-a38bad026839 req-da7325b8-445d-4c46-b380-94278686e798 service nova] Lock "0d0a7608-0050-4e0e-a9d3-aa884a716aa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:22:44 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-234db781-3bde-493e-86ca-a38bad026839 req-da7325b8-445d-4c46-b380-94278686e798 service nova] Lock "0d0a7608-0050-4e0e-a9d3-aa884a716aa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:22:44 user nova-compute[74743]: DEBUG nova.compute.manager [req-234db781-3bde-493e-86ca-a38bad026839 req-da7325b8-445d-4c46-b380-94278686e798 service nova] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] No waiting events found dispatching network-vif-plugged-1db2129d-7ee3-4c25-9b9a-3cc962555092 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:22:44 user nova-compute[74743]: WARNING nova.compute.manager [req-234db781-3bde-493e-86ca-a38bad026839 req-da7325b8-445d-4c46-b380-94278686e798 service nova] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Received unexpected event network-vif-plugged-1db2129d-7ee3-4c25-9b9a-3cc962555092 for instance with vm_state building and task_state spawning.
Nov 18 17:22:44 user nova-compute[74743]: DEBUG nova.compute.manager [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:22:44 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Guest created on hypervisor {{(pid=74743) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 17:22:44 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Instance spawned successfully.
Nov 18 17:22:44 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 17:22:44 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Found default for hw_cdrom_bus of ide {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:22:44 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Found default for hw_disk_bus of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:22:44 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Found default for hw_input_bus of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:22:44 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Found default for hw_pointer_model of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:22:44 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Found default for hw_video_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:22:44 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Found default for hw_vif_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:22:45 user nova-compute[74743]: INFO nova.compute.manager [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Took 5.47 seconds to spawn the instance on the hypervisor.
Nov 18 17:22:45 user nova-compute[74743]: DEBUG nova.compute.manager [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:22:45 user nova-compute[74743]: INFO nova.compute.manager [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Took 12.78 seconds to build instance.
Nov 18 17:22:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-aecd940a-5709-4185-85d1-9780d1c826a5 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "0d0a7608-0050-4e0e-a9d3-aa884a716aa8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.875s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:22:45 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:50 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:51 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:22:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:23:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:23:01 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:23:05 user nova-compute[74743]: DEBUG nova.compute.manager [req-e84d4467-5ec7-45ec-a063-7769a23018e4 req-e16c49bf-07ae-466b-8b76-70560e68c01e service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Received event network-changed-70799139-883d-4f9a-a2ba-e2fabf2871ec {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:23:05 user nova-compute[74743]: DEBUG nova.compute.manager [req-e84d4467-5ec7-45ec-a063-7769a23018e4 req-e16c49bf-07ae-466b-8b76-70560e68c01e service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Refreshing instance network info cache due to event network-changed-70799139-883d-4f9a-a2ba-e2fabf2871ec. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:23:05 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e84d4467-5ec7-45ec-a063-7769a23018e4 req-e16c49bf-07ae-466b-8b76-70560e68c01e service nova] Acquiring lock "refresh_cache-6aecacc3-577d-4b36-9223-8446afe54e26" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:23:05 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e84d4467-5ec7-45ec-a063-7769a23018e4 req-e16c49bf-07ae-466b-8b76-70560e68c01e service nova] Acquired lock "refresh_cache-6aecacc3-577d-4b36-9223-8446afe54e26" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:23:05 user nova-compute[74743]: DEBUG nova.network.neutron [req-e84d4467-5ec7-45ec-a063-7769a23018e4 req-e16c49bf-07ae-466b-8b76-70560e68c01e service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Refreshing network info cache for port 70799139-883d-4f9a-a2ba-e2fabf2871ec {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:23:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:23:05 user nova-compute[74743]: DEBUG nova.network.neutron [req-e84d4467-5ec7-45ec-a063-7769a23018e4 req-e16c49bf-07ae-466b-8b76-70560e68c01e service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Updated VIF entry in instance network info cache for port 70799139-883d-4f9a-a2ba-e2fabf2871ec. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:23:05 user nova-compute[74743]: DEBUG nova.network.neutron [req-e84d4467-5ec7-45ec-a063-7769a23018e4 req-e16c49bf-07ae-466b-8b76-70560e68c01e service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Updating instance_info_cache with network_info: [{"id": "70799139-883d-4f9a-a2ba-e2fabf2871ec", "address": "fa:16:3e:1f:4b:8a", "network": {"id": "cd6d2dbc-0950-412a-ab9d-cf7615c06eb8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1261309930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38303e1b311044deb8c833ed3299ce88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70799139-88", "ovs_interfaceid": "70799139-883d-4f9a-a2ba-e2fabf2871ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:23:05 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e84d4467-5ec7-45ec-a063-7769a23018e4 req-e16c49bf-07ae-466b-8b76-70560e68c01e service nova] Releasing lock "refresh_cache-6aecacc3-577d-4b36-9223-8446afe54e26" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:23:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:23:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ea22929a-c957-4e50-968c-600c4905793c tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Acquiring lock "6aecacc3-577d-4b36-9223-8446afe54e26" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:23:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ea22929a-c957-4e50-968c-600c4905793c tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "6aecacc3-577d-4b36-9223-8446afe54e26" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:23:06 user nova-compute[74743]: INFO nova.compute.manager [None req-ea22929a-c957-4e50-968c-600c4905793c tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Detaching volume 0fbaeb5b-46d6-4d34-918f-48160528ae76
Nov 18 17:23:06 user nova-compute[74743]: INFO nova.virt.block_device [None req-ea22929a-c957-4e50-968c-600c4905793c tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Attempting to driver detach volume 0fbaeb5b-46d6-4d34-918f-48160528ae76 from mountpoint /dev/vdb
Nov 18 17:23:06 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-ea22929a-c957-4e50-968c-600c4905793c tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Attempting to detach device vdb from instance 6aecacc3-577d-4b36-9223-8446afe54e26 from the persistent domain config. {{(pid=74743) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 17:23:06 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-ea22929a-c957-4e50-968c-600c4905793c tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 17:23:06 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:23:06 user nova-compute[74743]:   <source dev="/dev/sdd"/>
Nov 18 17:23:06 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:23:06 user nova-compute[74743]:   <serial>0fbaeb5b-46d6-4d34-918f-48160528ae76</serial>
Nov 18 17:23:06 user nova-compute[74743]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 18 17:23:06 user nova-compute[74743]: </disk>
Nov 18 17:23:06 user nova-compute[74743]:  {{(pid=74743) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 17:23:06 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-ea22929a-c957-4e50-968c-600c4905793c tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Successfully detached device vdb from instance 6aecacc3-577d-4b36-9223-8446afe54e26 from the persistent domain config.
Nov 18 17:23:06 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-ea22929a-c957-4e50-968c-600c4905793c tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6aecacc3-577d-4b36-9223-8446afe54e26 from the live domain config. {{(pid=74743) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 17:23:06 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-ea22929a-c957-4e50-968c-600c4905793c tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 17:23:06 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:23:06 user nova-compute[74743]:   <source dev="/dev/sdd"/>
Nov 18 17:23:06 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:23:06 user nova-compute[74743]:   <serial>0fbaeb5b-46d6-4d34-918f-48160528ae76</serial>
Nov 18 17:23:06 user nova-compute[74743]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 18 17:23:06 user nova-compute[74743]: </disk>
Nov 18 17:23:06 user nova-compute[74743]:  {{(pid=74743) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 17:23:06 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-ea22929a-c957-4e50-968c-600c4905793c tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6aecacc3-577d-4b36-9223-8446afe54e26 {{(pid=74743) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 17:23:07 user nova-compute[74743]: DEBUG nova.compute.manager [req-7c270278-d26f-4a03-8b44-3728182cf692 req-864c3ac4-91e0-42d2-ae6d-91dbb57845d7 service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Received event network-changed-70799139-883d-4f9a-a2ba-e2fabf2871ec {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:23:07 user nova-compute[74743]: DEBUG nova.compute.manager [req-7c270278-d26f-4a03-8b44-3728182cf692 req-864c3ac4-91e0-42d2-ae6d-91dbb57845d7 service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Refreshing instance network info cache due to event network-changed-70799139-883d-4f9a-a2ba-e2fabf2871ec. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:23:07 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-7c270278-d26f-4a03-8b44-3728182cf692 req-864c3ac4-91e0-42d2-ae6d-91dbb57845d7 service nova] Acquiring lock "refresh_cache-6aecacc3-577d-4b36-9223-8446afe54e26" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:23:07 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-7c270278-d26f-4a03-8b44-3728182cf692 req-864c3ac4-91e0-42d2-ae6d-91dbb57845d7 service nova] Acquired lock "refresh_cache-6aecacc3-577d-4b36-9223-8446afe54e26" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:23:07 user nova-compute[74743]: DEBUG nova.network.neutron [req-7c270278-d26f-4a03-8b44-3728182cf692 req-864c3ac4-91e0-42d2-ae6d-91dbb57845d7 service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Refreshing network info cache for port 70799139-883d-4f9a-a2ba-e2fabf2871ec {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:23:07 user nova-compute[74743]: DEBUG nova.network.neutron [req-7c270278-d26f-4a03-8b44-3728182cf692 req-864c3ac4-91e0-42d2-ae6d-91dbb57845d7 service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Updated VIF entry in instance network info cache for port 70799139-883d-4f9a-a2ba-e2fabf2871ec. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:23:07 user nova-compute[74743]: DEBUG nova.network.neutron [req-7c270278-d26f-4a03-8b44-3728182cf692 req-864c3ac4-91e0-42d2-ae6d-91dbb57845d7 service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Updating instance_info_cache with network_info: [{"id": "70799139-883d-4f9a-a2ba-e2fabf2871ec", "address": "fa:16:3e:1f:4b:8a", "network": {"id": "cd6d2dbc-0950-412a-ab9d-cf7615c06eb8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1261309930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38303e1b311044deb8c833ed3299ce88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70799139-88", "ovs_interfaceid": "70799139-883d-4f9a-a2ba-e2fabf2871ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:23:07 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-7c270278-d26f-4a03-8b44-3728182cf692 req-864c3ac4-91e0-42d2-ae6d-91dbb57845d7 service nova] Releasing lock "refresh_cache-6aecacc3-577d-4b36-9223-8446afe54e26" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:23:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:23:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:23:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-957fb98d-bbf3-4e81-90db-28f17229fadb tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Acquiring lock "daaf907c-9a7f-417e-a44c-383ba0e74224" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:23:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-957fb98d-bbf3-4e81-90db-28f17229fadb tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Lock "daaf907c-9a7f-417e-a44c-383ba0e74224" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:23:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-957fb98d-bbf3-4e81-90db-28f17229fadb tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Acquiring lock "daaf907c-9a7f-417e-a44c-383ba0e74224-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:23:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-957fb98d-bbf3-4e81-90db-28f17229fadb tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Lock "daaf907c-9a7f-417e-a44c-383ba0e74224-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:23:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-957fb98d-bbf3-4e81-90db-28f17229fadb tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Lock "daaf907c-9a7f-417e-a44c-383ba0e74224-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:23:12 user nova-compute[74743]: INFO nova.compute.manager [None req-957fb98d-bbf3-4e81-90db-28f17229fadb tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] Terminating instance
Nov 18 17:23:12 user nova-compute[74743]: DEBUG nova.compute.manager [None req-957fb98d-bbf3-4e81-90db-28f17229fadb tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] Start destroying the instance on the hypervisor. {{(pid=74743) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 17:23:12 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:23:12 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:23:12 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:23:12 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:23:13 user nova-compute[74743]: DEBUG nova.compute.manager [req-f3afaa73-cb89-4401-9166-f165086c3ea7 req-1cb72594-9a2b-4c57-a80f-3c8855c6453a service nova] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] Received event network-vif-unplugged-e810bf77-95d9-40d7-af0e-47f2346937f0 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:23:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f3afaa73-cb89-4401-9166-f165086c3ea7 req-1cb72594-9a2b-4c57-a80f-3c8855c6453a service nova] Acquiring lock "daaf907c-9a7f-417e-a44c-383ba0e74224-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:23:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f3afaa73-cb89-4401-9166-f165086c3ea7 req-1cb72594-9a2b-4c57-a80f-3c8855c6453a service nova] Lock "daaf907c-9a7f-417e-a44c-383ba0e74224-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:23:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f3afaa73-cb89-4401-9166-f165086c3ea7 req-1cb72594-9a2b-4c57-a80f-3c8855c6453a service nova] Lock "daaf907c-9a7f-417e-a44c-383ba0e74224-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:23:13 user nova-compute[74743]: DEBUG nova.compute.manager [req-f3afaa73-cb89-4401-9166-f165086c3ea7 req-1cb72594-9a2b-4c57-a80f-3c8855c6453a service nova] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] No waiting events found dispatching network-vif-unplugged-e810bf77-95d9-40d7-af0e-47f2346937f0 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:23:13 user nova-compute[74743]: DEBUG nova.compute.manager [req-f3afaa73-cb89-4401-9166-f165086c3ea7 req-1cb72594-9a2b-4c57-a80f-3c8855c6453a service nova] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] Received event network-vif-unplugged-e810bf77-95d9-40d7-af0e-47f2346937f0 for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:23:13 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] Instance destroyed successfully.
Nov 18 17:23:13 user nova-compute[74743]: DEBUG nova.objects.instance [None req-957fb98d-bbf3-4e81-90db-28f17229fadb tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Lazy-loading 'resources' on Instance uuid daaf907c-9a7f-417e-a44c-383ba0e74224 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:23:13 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-957fb98d-bbf3-4e81-90db-28f17229fadb tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:21:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1788644458',display_name='tempest-VolumesActionsTest-instance-1788644458',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1788644458',id=38,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:21:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a45549ed03a64f708739545dd21f03fa',ramdisk_id='',reservation_id='r-dog19b6n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1748636445',owner_user_name='tempest-VolumesActionsTest-1748636445-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:21:23Z,user_data=None,user_id='86804e2b74184a82be1fd14f39047a41',uuid=daaf907c-9a7f-417e-a44c-383ba0e74224,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e810bf77-95d9-40d7-af0e-47f2346937f0", "address": "fa:16:3e:b0:df:de", "network": {"id": "1f0e532b-39a9-4594-815f-98e76055e70e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1884285850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a45549ed03a64f708739545dd21f03fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape810bf77-95", "ovs_interfaceid": "e810bf77-95d9-40d7-af0e-47f2346937f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:23:13 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-957fb98d-bbf3-4e81-90db-28f17229fadb tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Converting VIF {"id": "e810bf77-95d9-40d7-af0e-47f2346937f0", "address": "fa:16:3e:b0:df:de", "network": {"id": "1f0e532b-39a9-4594-815f-98e76055e70e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1884285850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a45549ed03a64f708739545dd21f03fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape810bf77-95", "ovs_interfaceid": "e810bf77-95d9-40d7-af0e-47f2346937f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:23:13 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-957fb98d-bbf3-4e81-90db-28f17229fadb tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:df:de,bridge_name='br-int',has_traffic_filtering=True,id=e810bf77-95d9-40d7-af0e-47f2346937f0,network=Network(1f0e532b-39a9-4594-815f-98e76055e70e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape810bf77-95') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:23:13 user nova-compute[74743]: DEBUG os_vif [None req-957fb98d-bbf3-4e81-90db-28f17229fadb tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:df:de,bridge_name='br-int',has_traffic_filtering=True,id=e810bf77-95d9-40d7-af0e-47f2346937f0,network=Network(1f0e532b-39a9-4594-815f-98e76055e70e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape810bf77-95') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:23:13 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:23:13 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape810bf77-95, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:23:13 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:23:13 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:23:13 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:23:13 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f91e9a56-97f5-40f2-b6da-8ef2fc20032f) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:23:13 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:23:13 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:23:13 user nova-compute[74743]: INFO os_vif [None req-957fb98d-bbf3-4e81-90db-28f17229fadb tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:df:de,bridge_name='br-int',has_traffic_filtering=True,id=e810bf77-95d9-40d7-af0e-47f2346937f0,network=Network(1f0e532b-39a9-4594-815f-98e76055e70e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape810bf77-95')
Nov 18 17:23:13 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-957fb98d-bbf3-4e81-90db-28f17229fadb tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] Deleting instance files /opt/stack/data/nova/instances/daaf907c-9a7f-417e-a44c-383ba0e74224_del
Nov 18 17:23:13 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-957fb98d-bbf3-4e81-90db-28f17229fadb tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] Deletion of /opt/stack/data/nova/instances/daaf907c-9a7f-417e-a44c-383ba0e74224_del complete
Nov 18 17:23:13 user nova-compute[74743]: INFO nova.compute.manager [None req-957fb98d-bbf3-4e81-90db-28f17229fadb tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] Took 0.65 seconds to destroy the instance on the hypervisor.
Nov 18 17:23:13 user nova-compute[74743]: DEBUG oslo.service.loopingcall [None req-957fb98d-bbf3-4e81-90db-28f17229fadb tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74743) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 17:23:13 user nova-compute[74743]: DEBUG nova.compute.manager [-] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] Deallocating network for instance {{(pid=74743) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 17:23:13 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] deallocate_for_instance() {{(pid=74743) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 17:23:13 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:23:13 user nova-compute[74743]: INFO nova.compute.manager [-] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] Took 0.45 seconds to deallocate network for instance.
Nov 18 17:23:13 user nova-compute[74743]: DEBUG nova.compute.manager [req-c752aeaa-f9ed-40b4-a5f0-b95d426a3eeb req-97c8600c-2490-49b8-a9a8-eade7df35a9e service nova] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] Received event network-vif-deleted-e810bf77-95d9-40d7-af0e-47f2346937f0 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:23:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-957fb98d-bbf3-4e81-90db-28f17229fadb tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:23:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-957fb98d-bbf3-4e81-90db-28f17229fadb tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:23:14 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-957fb98d-bbf3-4e81-90db-28f17229fadb tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:23:14 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-957fb98d-bbf3-4e81-90db-28f17229fadb tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:23:14 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-957fb98d-bbf3-4e81-90db-28f17229fadb tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.255s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:23:14 user nova-compute[74743]: INFO nova.scheduler.client.report [None req-957fb98d-bbf3-4e81-90db-28f17229fadb tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Deleted allocations for instance daaf907c-9a7f-417e-a44c-383ba0e74224
Nov 18 17:23:14 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-957fb98d-bbf3-4e81-90db-28f17229fadb tempest-VolumesActionsTest-1748636445 tempest-VolumesActionsTest-1748636445-project-member] Lock "daaf907c-9a7f-417e-a44c-383ba0e74224" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.525s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:23:15 user nova-compute[74743]: DEBUG nova.compute.manager [req-b1e887fb-d5a7-427e-a6fd-b52cc8ae9775 req-8b53a1fa-6ff3-495e-b11d-42c3f54239b4 service nova] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] Received event network-vif-plugged-e810bf77-95d9-40d7-af0e-47f2346937f0 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:23:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b1e887fb-d5a7-427e-a6fd-b52cc8ae9775 req-8b53a1fa-6ff3-495e-b11d-42c3f54239b4 service nova] Acquiring lock "daaf907c-9a7f-417e-a44c-383ba0e74224-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:23:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b1e887fb-d5a7-427e-a6fd-b52cc8ae9775 req-8b53a1fa-6ff3-495e-b11d-42c3f54239b4 service nova] Lock "daaf907c-9a7f-417e-a44c-383ba0e74224-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:23:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b1e887fb-d5a7-427e-a6fd-b52cc8ae9775 req-8b53a1fa-6ff3-495e-b11d-42c3f54239b4 service nova] Lock "daaf907c-9a7f-417e-a44c-383ba0e74224-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:23:15 user nova-compute[74743]: DEBUG nova.compute.manager [req-b1e887fb-d5a7-427e-a6fd-b52cc8ae9775 req-8b53a1fa-6ff3-495e-b11d-42c3f54239b4 service nova] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] No waiting events found dispatching network-vif-plugged-e810bf77-95d9-40d7-af0e-47f2346937f0 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:23:15 user nova-compute[74743]: WARNING nova.compute.manager [req-b1e887fb-d5a7-427e-a6fd-b52cc8ae9775 req-8b53a1fa-6ff3-495e-b11d-42c3f54239b4 service nova] [instance: daaf907c-9a7f-417e-a44c-383ba0e74224] Received unexpected event network-vif-plugged-e810bf77-95d9-40d7-af0e-47f2346937f0 for instance with vm_state deleted and task_state None.
Nov 18 17:23:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:23:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:23:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:23:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:23:23 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:23:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:23:26 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-ea22929a-c957-4e50-968c-600c4905793c tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6aecacc3-577d-4b36-9223-8446afe54e26 is timed out.
Nov 18 17:23:26 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-ea22929a-c957-4e50-968c-600c4905793c tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Successfully detached device vdb from instance 6aecacc3-577d-4b36-9223-8446afe54e26 from the live domain config.
Nov 18 17:23:26 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea22929a-c957-4e50-968c-600c4905793c tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] calling os-brick to detach iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 17:23:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea22929a-c957-4e50-968c-600c4905793c tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, {'target_iqn': 'iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RabfjIkA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:23:26 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-ea22929a-c957-4e50-968c-600c4905793c tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:23:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-ea22929a-c957-4e50-968c-600c4905793c tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:23:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-ea22929a-c957-4e50-968c-600c4905793c tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:23:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:23:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:23:26 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7097423-a8a0-4377-bc66-ab2346fb715a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:23:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea22929a-c957-4e50-968c-600c4905793c tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 17:23:26 user nova-compute[74743]: No targets found.
Nov 18 17:23:26 user nova-compute[74743]: iSNS:
Nov 18 17:23:26 user nova-compute[74743]: No targets found.
Nov 18 17:23:26 user nova-compute[74743]: STATIC:
Nov 18 17:23:26 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539
Nov 18 17:23:26 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:23:26 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:23:26 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127
Nov 18 17:23:26 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:23:26 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:23:26 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76
Nov 18 17:23:26 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:23:26 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:23:26 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2
Nov 18 17:23:26 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:23:26 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:23:26 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb
Nov 18 17:23:26 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:23:26 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:23:26 user nova-compute[74743]: FIRMWARE:
Nov 18 17:23:26 user nova-compute[74743]: No targets found.
Nov 18 17:23:26 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:23:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea22929a-c957-4e50-968c-600c4905793c tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 17:23:26 user nova-compute[74743]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 17:23:26 user nova-compute[74743]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74743) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 17:23:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea22929a-c957-4e50-968c-600c4905793c tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76', 0)] {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 17:23:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:23:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:23:26 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[50abad0a-38b1-459a-83c4-f4da3187b967]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:23:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:23:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:23:26 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2851c33-16d0-4b55-8599-8adc3ec95432]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:23:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea22929a-c957-4e50-968c-600c4905793c tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:23:26 user nova-compute[74743]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 (non-flash)
Nov 18 17:23:26 user nova-compute[74743]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 (non-flash)
Nov 18 17:23:26 user nova-compute[74743]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb (non-flash)
Nov 18 17:23:26 user nova-compute[74743]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539 (non-flash)
Nov 18 17:23:26 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:23:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea22929a-c957-4e50-968c-600c4905793c tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:23:26 user nova-compute[74743]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 (non-flash)
Nov 18 17:23:26 user nova-compute[74743]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 (non-flash)
Nov 18 17:23:26 user nova-compute[74743]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb (non-flash)
Nov 18 17:23:26 user nova-compute[74743]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539 (non-flash)
Nov 18 17:23:26 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:23:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea22929a-c957-4e50-968c-600c4905793c tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb08267b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76'): ({'sdd'}, set())}) {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 17:23:26 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-ea22929a-c957-4e50-968c-600c4905793c tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Removing single pathed devices sdd {{(pid=74743) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 17:23:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:23:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:23:27 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de0c271-ddd3-4787-aed7-dbd2921ef4c4]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:23:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:23:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:23:27 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d69c741-5696-4cd2-8ed2-a48643e7d399]: (4, ('ok\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:23:27 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-ea22929a-c957-4e50-968c-600c4905793c tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Flushing IO for device /dev/sdd {{(pid=74743) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 17:23:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:23:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:23:27 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da5a0d0-1c55-48b9-a420-8b57d80f731f]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:23:27 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-ea22929a-c957-4e50-968c-600c4905793c tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74743) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 17:23:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:23:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.055s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:23:27 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c35994-2bba-481b-a5ed-8719a32dc543]: (4, ('1', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:23:27 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-ea22929a-c957-4e50-968c-600c4905793c tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 17:23:27 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-ea22929a-c957-4e50-968c-600c4905793c tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] SCSI volumes sdd have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 17:23:27 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea22929a-c957-4e50-968c-600c4905793c tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76')] {{(pid=74743) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 17:23:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:23:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:23:27 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f76ff43-830e-4420-9b36-c0b48dfa445e]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:23:27 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea22929a-c957-4e50-968c-600c4905793c tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:23:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 -p 172.16.0.220:3260 --logout {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:23:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:23:27 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d178ae-16a7-450c-a136-c40b67e781a4]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:23:27 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea22929a-c957-4e50-968c-600c4905793c tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76, portal: 172.16.0.220,3260]
Nov 18 17:23:27 user nova-compute[74743]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76, portal: 172.16.0.220,3260] successful.
Nov 18 17:23:27 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:23:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 -p 172.16.0.220:3260 --op delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:23:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fbaeb5b-46d6-4d34-918f-48160528ae76 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:23:27 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[578fd024-8cca-407d-82f8-4713d86b0daf]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:23:27 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea22929a-c957-4e50-968c-600c4905793c tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:23:27 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-ea22929a-c957-4e50-968c-600c4905793c tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:23:27 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea22929a-c957-4e50-968c-600c4905793c tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] <== disconnect_volume: return (340ms) None {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:23:27 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea22929a-c957-4e50-968c-600c4905793c tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Disconnected iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 17:23:27 user nova-compute[74743]: DEBUG nova.objects.instance [None req-ea22929a-c957-4e50-968c-600c4905793c tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lazy-loading 'flavor' on Instance uuid 6aecacc3-577d-4b36-9223-8446afe54e26 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:23:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ea22929a-c957-4e50-968c-600c4905793c tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "6aecacc3-577d-4b36-9223-8446afe54e26" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.663s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:23:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:23:28 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:23:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:23:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:23:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquiring lock "1fd86416-72c2-45e5-814d-9195b4cfcc61" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:23:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "1fd86416-72c2-45e5-814d-9195b4cfcc61" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:23:31 user nova-compute[74743]: DEBUG nova.compute.manager [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Starting instance... {{(pid=74743) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 17:23:31 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:23:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:23:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:23:31 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74743) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 17:23:31 user nova-compute[74743]: INFO nova.compute.claims [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Claim successful on node user
Nov 18 17:23:31 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:23:31 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:23:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.348s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:23:31 user nova-compute[74743]: DEBUG nova.compute.manager [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Start building networks asynchronously for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 17:23:31 user nova-compute[74743]: DEBUG nova.compute.manager [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Allocating IP information in the background. {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 17:23:31 user nova-compute[74743]: DEBUG nova.network.neutron [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] allocate_for_instance() {{(pid=74743) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 17:23:31 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 17:23:31 user nova-compute[74743]: DEBUG nova.compute.manager [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Start building block device mappings for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 17:23:32 user nova-compute[74743]: DEBUG nova.policy [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '35aedc702bc4444eb3802772a523ba79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5502edf6a6b94cb59d58d52494efc90d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74743) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 17:23:32 user nova-compute[74743]: DEBUG nova.compute.manager [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Start spawning the instance on the hypervisor. {{(pid=74743) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 17:23:32 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Creating instance directory {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 17:23:32 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Creating image(s)
Nov 18 17:23:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquiring lock "/opt/stack/data/nova/instances/1fd86416-72c2-45e5-814d-9195b4cfcc61/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:23:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "/opt/stack/data/nova/instances/1fd86416-72c2-45e5-814d-9195b4cfcc61/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:23:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "/opt/stack/data/nova/instances/1fd86416-72c2-45e5-814d-9195b4cfcc61/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:23:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:23:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.167s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:23:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquiring lock "c188b3a997bfafa42fa341f9dcc326545681eed9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:23:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:23:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:23:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.179s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:23:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/1fd86416-72c2-45e5-814d-9195b4cfcc61/disk 1073741824 {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:23:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/1fd86416-72c2-45e5-814d-9195b4cfcc61/disk 1073741824" returned: 0 in 0.054s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:23:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:23:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:23:32 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:23:32 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74743) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 17:23:32 user nova-compute[74743]: DEBUG nova.network.neutron [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Successfully created port: 044dbd97-bde5-4feb-a5fb-801f22043ae4 {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:23:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.172s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:23:32 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1fd86416-72c2-45e5-814d-9195b4cfcc61/disk. size=1073741824 {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 17:23:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fd86416-72c2-45e5-814d-9195b4cfcc61/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:23:32 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fd86416-72c2-45e5-814d-9195b4cfcc61/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:23:32 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Cannot resize image /opt/stack/data/nova/instances/1fd86416-72c2-45e5-814d-9195b4cfcc61/disk to a smaller size. {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 17:23:32 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Created local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 17:23:32 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Ensure instance console log exists: /opt/stack/data/nova/instances/1fd86416-72c2-45e5-814d-9195b4cfcc61/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:23:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:23:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:23:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG nova.network.neutron [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Successfully updated port: 044dbd97-bde5-4feb-a5fb-801f22043ae4 {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquiring lock "refresh_cache-1fd86416-72c2-45e5-814d-9195b4cfcc61" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquired lock "refresh_cache-1fd86416-72c2-45e5-814d-9195b4cfcc61" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG nova.network.neutron [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG nova.compute.manager [req-d3bf2962-ec99-4ef0-9dc8-c5bb28e1346f req-7f20c4e1-a38c-42ac-b35c-9fdd94ffb59a service nova] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Received event network-changed-044dbd97-bde5-4feb-a5fb-801f22043ae4 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG nova.compute.manager [req-d3bf2962-ec99-4ef0-9dc8-c5bb28e1346f req-7f20c4e1-a38c-42ac-b35c-9fdd94ffb59a service nova] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Refreshing instance network info cache due to event network-changed-044dbd97-bde5-4feb-a5fb-801f22043ae4. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d3bf2962-ec99-4ef0-9dc8-c5bb28e1346f req-7f20c4e1-a38c-42ac-b35c-9fdd94ffb59a service nova] Acquiring lock "refresh_cache-1fd86416-72c2-45e5-814d-9195b4cfcc61" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG nova.network.neutron [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG nova.network.neutron [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Updating instance_info_cache with network_info: [{"id": "044dbd97-bde5-4feb-a5fb-801f22043ae4", "address": "fa:16:3e:3f:13:af", "network": {"id": "b03d3355-7704-43de-8af7-7a5dc1ee490d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1492507432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5502edf6a6b94cb59d58d52494efc90d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap044dbd97-bd", "ovs_interfaceid": "044dbd97-bde5-4feb-a5fb-801f22043ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Releasing lock "refresh_cache-1fd86416-72c2-45e5-814d-9195b4cfcc61" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG nova.compute.manager [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Instance network_info: |[{"id": "044dbd97-bde5-4feb-a5fb-801f22043ae4", "address": "fa:16:3e:3f:13:af", "network": {"id": "b03d3355-7704-43de-8af7-7a5dc1ee490d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1492507432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5502edf6a6b94cb59d58d52494efc90d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap044dbd97-bd", "ovs_interfaceid": "044dbd97-bde5-4feb-a5fb-801f22043ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d3bf2962-ec99-4ef0-9dc8-c5bb28e1346f req-7f20c4e1-a38c-42ac-b35c-9fdd94ffb59a service nova] Acquired lock "refresh_cache-1fd86416-72c2-45e5-814d-9195b4cfcc61" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG nova.network.neutron [req-d3bf2962-ec99-4ef0-9dc8-c5bb28e1346f req-7f20c4e1-a38c-42ac-b35c-9fdd94ffb59a service nova] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Refreshing network info cache for port 044dbd97-bde5-4feb-a5fb-801f22043ae4 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Start _get_guest_xml network_info=[{"id": "044dbd97-bde5-4feb-a5fb-801f22043ae4", "address": "fa:16:3e:3f:13:af", "network": {"id": "b03d3355-7704-43de-8af7-7a5dc1ee490d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1492507432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5502edf6a6b94cb59d58d52494efc90d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap044dbd97-bd", "ovs_interfaceid": "044dbd97-bde5-4feb-a5fb-801f22043ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '9536f6cf-95c4-40e2-864a-09a91525678a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:23:33 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:23:33 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:23:33 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:23:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1795284009',display_name='tempest-AttachVolumeNegativeTest-server-1795284009',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1795284009',id=41,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHLZZBRZDOsPrMzZxlejBLPVGSwic0dkjfAZPtWgp6tO9pGlomYd/HfxiUTCYOzmij5XPCWHsiDkJdoWkRwen2oYYy1v2REZx95HgWDOcWfszeCEXxuqpLbaYOr1UlVf6g==',key_name='tempest-keypair-981794856',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5502edf6a6b94cb59d58d52494efc90d',ramdisk_id='',reservation_id='r-ao6ywubh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1149732113',owner_user_name='tempest-AttachVolumeNegativeTest-1149732113-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:23:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35aedc702bc4444eb3802772a523ba79',uuid=1fd86416-72c2-45e5-814d-9195b4cfcc61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "044dbd97-bde5-4feb-a5fb-801f22043ae4", "address": "fa:16:3e:3f:13:af", "network": {"id": "b03d3355-7704-43de-8af7-7a5dc1ee490d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1492507432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5502edf6a6b94cb59d58d52494efc90d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap044dbd97-bd", "ovs_interfaceid": "044dbd97-bde5-4feb-a5fb-801f22043ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Converting VIF {"id": "044dbd97-bde5-4feb-a5fb-801f22043ae4", "address": "fa:16:3e:3f:13:af", "network": {"id": "b03d3355-7704-43de-8af7-7a5dc1ee490d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1492507432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5502edf6a6b94cb59d58d52494efc90d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap044dbd97-bd", "ovs_interfaceid": "044dbd97-bde5-4feb-a5fb-801f22043ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:13:af,bridge_name='br-int',has_traffic_filtering=True,id=044dbd97-bde5-4feb-a5fb-801f22043ae4,network=Network(b03d3355-7704-43de-8af7-7a5dc1ee490d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap044dbd97-bd') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG nova.objects.instance [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lazy-loading 'pci_devices' on Instance uuid 1fd86416-72c2-45e5-814d-9195b4cfcc61 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:23:33 user nova-compute[74743]:   <uuid>1fd86416-72c2-45e5-814d-9195b4cfcc61</uuid>
Nov 18 17:23:33 user nova-compute[74743]:   <name>instance-00000029</name>
Nov 18 17:23:33 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:23:33 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:23:33 user nova-compute[74743]:   <metadata>
Nov 18 17:23:33 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:23:33 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:23:33 user nova-compute[74743]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1795284009</nova:name>
Nov 18 17:23:33 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:23:33</nova:creationTime>
Nov 18 17:23:33 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:23:33 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:23:33 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:23:33 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:23:33 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:23:33 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:23:33 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:23:33 user nova-compute[74743]:       <nova:owner>
Nov 18 17:23:33 user nova-compute[74743]:         <nova:user uuid="35aedc702bc4444eb3802772a523ba79">tempest-AttachVolumeNegativeTest-1149732113-project-member</nova:user>
Nov 18 17:23:33 user nova-compute[74743]:         <nova:project uuid="5502edf6a6b94cb59d58d52494efc90d">tempest-AttachVolumeNegativeTest-1149732113</nova:project>
Nov 18 17:23:33 user nova-compute[74743]:       </nova:owner>
Nov 18 17:23:33 user nova-compute[74743]:       <nova:root type="image" uuid="9536f6cf-95c4-40e2-864a-09a91525678a"/>
Nov 18 17:23:33 user nova-compute[74743]:       <nova:ports>
Nov 18 17:23:33 user nova-compute[74743]:         <nova:port uuid="044dbd97-bde5-4feb-a5fb-801f22043ae4">
Nov 18 17:23:33 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 18 17:23:33 user nova-compute[74743]:         </nova:port>
Nov 18 17:23:33 user nova-compute[74743]:       </nova:ports>
Nov 18 17:23:33 user nova-compute[74743]:     </nova:instance>
Nov 18 17:23:33 user nova-compute[74743]:   </metadata>
Nov 18 17:23:33 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:23:33 user nova-compute[74743]:     <system>
Nov 18 17:23:33 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:23:33 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:23:33 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:23:33 user nova-compute[74743]:       <entry name="serial">1fd86416-72c2-45e5-814d-9195b4cfcc61</entry>
Nov 18 17:23:33 user nova-compute[74743]:       <entry name="uuid">1fd86416-72c2-45e5-814d-9195b4cfcc61</entry>
Nov 18 17:23:33 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:23:33 user nova-compute[74743]:     </system>
Nov 18 17:23:33 user nova-compute[74743]:   </sysinfo>
Nov 18 17:23:33 user nova-compute[74743]:   <os>
Nov 18 17:23:33 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:23:33 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:23:33 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:23:33 user nova-compute[74743]:   </os>
Nov 18 17:23:33 user nova-compute[74743]:   <features>
Nov 18 17:23:33 user nova-compute[74743]:     <acpi/>
Nov 18 17:23:33 user nova-compute[74743]:     <apic/>
Nov 18 17:23:33 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:23:33 user nova-compute[74743]:   </features>
Nov 18 17:23:33 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:23:33 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:23:33 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:23:33 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:23:33 user nova-compute[74743]:   </clock>
Nov 18 17:23:33 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:23:33 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:23:33 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:23:33 user nova-compute[74743]:   </cpu>
Nov 18 17:23:33 user nova-compute[74743]:   <devices>
Nov 18 17:23:33 user nova-compute[74743]:     <disk type="file" device="disk">
Nov 18 17:23:33 user nova-compute[74743]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 17:23:33 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/1fd86416-72c2-45e5-814d-9195b4cfcc61/disk"/>
Nov 18 17:23:33 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:23:33 user nova-compute[74743]:     </disk>
Nov 18 17:23:33 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:23:33 user nova-compute[74743]:       <mac address="fa:16:3e:3f:13:af"/>
Nov 18 17:23:33 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:23:33 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:23:33 user nova-compute[74743]:       <target dev="tap044dbd97-bd"/>
Nov 18 17:23:33 user nova-compute[74743]:     </interface>
Nov 18 17:23:33 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:23:33 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/1fd86416-72c2-45e5-814d-9195b4cfcc61/console.log" append="off"/>
Nov 18 17:23:33 user nova-compute[74743]:     </serial>
Nov 18 17:23:33 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:23:33 user nova-compute[74743]:     <video>
Nov 18 17:23:33 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:23:33 user nova-compute[74743]:     </video>
Nov 18 17:23:33 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:23:33 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:23:33 user nova-compute[74743]:     </rng>
Nov 18 17:23:33 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:23:33 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:23:33 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:23:33 user nova-compute[74743]:     </memballoon>
Nov 18 17:23:33 user nova-compute[74743]:   </devices>
Nov 18 17:23:33 user nova-compute[74743]: </domain>
Nov 18 17:23:33 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:23:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1795284009',display_name='tempest-AttachVolumeNegativeTest-server-1795284009',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1795284009',id=41,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHLZZBRZDOsPrMzZxlejBLPVGSwic0dkjfAZPtWgp6tO9pGlomYd/HfxiUTCYOzmij5XPCWHsiDkJdoWkRwen2oYYy1v2REZx95HgWDOcWfszeCEXxuqpLbaYOr1UlVf6g==',key_name='tempest-keypair-981794856',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5502edf6a6b94cb59d58d52494efc90d',ramdisk_id='',reservation_id='r-ao6ywubh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1149732113',owner_user_name='tempest-AttachVolumeNegativeTest-1149732113-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:23:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35aedc702bc4444eb3802772a523ba79',uuid=1fd86416-72c2-45e5-814d-9195b4cfcc61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "044dbd97-bde5-4feb-a5fb-801f22043ae4", "address": "fa:16:3e:3f:13:af", "network": {"id": "b03d3355-7704-43de-8af7-7a5dc1ee490d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1492507432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5502edf6a6b94cb59d58d52494efc90d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap044dbd97-bd", "ovs_interfaceid": "044dbd97-bde5-4feb-a5fb-801f22043ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Converting VIF {"id": "044dbd97-bde5-4feb-a5fb-801f22043ae4", "address": "fa:16:3e:3f:13:af", "network": {"id": "b03d3355-7704-43de-8af7-7a5dc1ee490d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1492507432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5502edf6a6b94cb59d58d52494efc90d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap044dbd97-bd", "ovs_interfaceid": "044dbd97-bde5-4feb-a5fb-801f22043ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:13:af,bridge_name='br-int',has_traffic_filtering=True,id=044dbd97-bde5-4feb-a5fb-801f22043ae4,network=Network(b03d3355-7704-43de-8af7-7a5dc1ee490d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap044dbd97-bd') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG os_vif [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:13:af,bridge_name='br-int',has_traffic_filtering=True,id=044dbd97-bde5-4feb-a5fb-801f22043ae4,network=Network(b03d3355-7704-43de-8af7-7a5dc1ee490d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap044dbd97-bd') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a0e9e652-0bba-5143-9c00-c06a4fdebb47', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap044dbd97-bd, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap044dbd97-bd, col_values=(('qos', UUID('2f0edae0-812b-4f6d-8caa-13e32fd7b633')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap044dbd97-bd, col_values=(('external_ids', {'iface-id': '044dbd97-bde5-4feb-a5fb-801f22043ae4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:13:af', 'vm-uuid': '1fd86416-72c2-45e5-814d-9195b4cfcc61'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:23:33 user nova-compute[74743]: INFO os_vif [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:13:af,bridge_name='br-int',has_traffic_filtering=True,id=044dbd97-bde5-4feb-a5fb-801f22043ae4,network=Network(b03d3355-7704-43de-8af7-7a5dc1ee490d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap044dbd97-bd')
Nov 18 17:23:33 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] No VIF found with MAC fa:16:3e:3f:13:af, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG nova.network.neutron [req-d3bf2962-ec99-4ef0-9dc8-c5bb28e1346f req-7f20c4e1-a38c-42ac-b35c-9fdd94ffb59a service nova] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Updated VIF entry in instance network info cache for port 044dbd97-bde5-4feb-a5fb-801f22043ae4. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG nova.network.neutron [req-d3bf2962-ec99-4ef0-9dc8-c5bb28e1346f req-7f20c4e1-a38c-42ac-b35c-9fdd94ffb59a service nova] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Updating instance_info_cache with network_info: [{"id": "044dbd97-bde5-4feb-a5fb-801f22043ae4", "address": "fa:16:3e:3f:13:af", "network": {"id": "b03d3355-7704-43de-8af7-7a5dc1ee490d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1492507432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5502edf6a6b94cb59d58d52494efc90d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap044dbd97-bd", "ovs_interfaceid": "044dbd97-bde5-4feb-a5fb-801f22043ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:23:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-d3bf2962-ec99-4ef0-9dc8-c5bb28e1346f req-7f20c4e1-a38c-42ac-b35c-9fdd94ffb59a service nova] Releasing lock "refresh_cache-1fd86416-72c2-45e5-814d-9195b4cfcc61" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:23:34 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:23:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:23:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:23:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:23:35 user nova-compute[74743]: DEBUG nova.compute.manager [req-c2e0578f-aa18-40da-9013-62f07eeefea0 req-520a2da0-7bd5-4b4c-b199-6c6956d831ba service nova] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Received event network-vif-plugged-044dbd97-bde5-4feb-a5fb-801f22043ae4 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:23:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-c2e0578f-aa18-40da-9013-62f07eeefea0 req-520a2da0-7bd5-4b4c-b199-6c6956d831ba service nova] Acquiring lock "1fd86416-72c2-45e5-814d-9195b4cfcc61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:23:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-c2e0578f-aa18-40da-9013-62f07eeefea0 req-520a2da0-7bd5-4b4c-b199-6c6956d831ba service nova] Lock "1fd86416-72c2-45e5-814d-9195b4cfcc61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:23:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-c2e0578f-aa18-40da-9013-62f07eeefea0 req-520a2da0-7bd5-4b4c-b199-6c6956d831ba service nova] Lock "1fd86416-72c2-45e5-814d-9195b4cfcc61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:23:35 user nova-compute[74743]: DEBUG nova.compute.manager [req-c2e0578f-aa18-40da-9013-62f07eeefea0 req-520a2da0-7bd5-4b4c-b199-6c6956d831ba service nova] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] No waiting events found dispatching network-vif-plugged-044dbd97-bde5-4feb-a5fb-801f22043ae4 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:23:35 user nova-compute[74743]: WARNING nova.compute.manager [req-c2e0578f-aa18-40da-9013-62f07eeefea0 req-520a2da0-7bd5-4b4c-b199-6c6956d831ba service nova] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Received unexpected event network-vif-plugged-044dbd97-bde5-4feb-a5fb-801f22043ae4 for instance with vm_state building and task_state spawning.
Nov 18 17:23:35 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:23:35 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:23:35 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Starting heal instance info cache {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 17:23:35 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:23:35 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:23:35 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:23:35 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:23:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "refresh_cache-f649143e-f7db-475a-bbe5-d5e7316caac3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:23:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquired lock "refresh_cache-f649143e-f7db-475a-bbe5-d5e7316caac3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:23:35 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Forcefully refreshing network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 17:23:35 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Updating instance_info_cache with network_info: [{"id": "494b363a-ab2e-4efc-9331-d2b303860a08", "address": "fa:16:3e:e7:77:41", "network": {"id": "1bbf6aff-4048-4212-a716-d0628575bfd0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc0fda74575d488a94e2dcfdc016598c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494b363a-ab", "ovs_interfaceid": "494b363a-ab2e-4efc-9331-d2b303860a08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:23:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Releasing lock "refresh_cache-f649143e-f7db-475a-bbe5-d5e7316caac3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:23:35 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Updated the network info_cache for instance {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 17:23:36 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:23:37 user nova-compute[74743]: DEBUG nova.compute.manager [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:23:37 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Guest created on hypervisor {{(pid=74743) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 17:23:37 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Instance spawned successfully.
Nov 18 17:23:37 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 17:23:37 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Found default for hw_cdrom_bus of ide {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:23:37 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Found default for hw_disk_bus of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:23:37 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Found default for hw_input_bus of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:23:37 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Found default for hw_pointer_model of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:23:37 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Found default for hw_video_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:23:37 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Found default for hw_vif_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:23:37 user nova-compute[74743]: INFO nova.compute.manager [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Took 5.09 seconds to spawn the instance on the hypervisor.
Nov 18 17:23:37 user nova-compute[74743]: DEBUG nova.compute.manager [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:23:37 user nova-compute[74743]: INFO nova.compute.manager [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Took 5.79 seconds to build instance.
Nov 18 17:23:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-67c9f93d-7610-48ce-9165-d945199b35ec tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "1fd86416-72c2-45e5-814d-9195b4cfcc61" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.884s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:23:37 user nova-compute[74743]: DEBUG nova.compute.manager [req-98a7d7e6-0677-4077-a17b-837b28821510 req-61ffe995-3818-4ad2-b9f8-cdbb7bcd24ab service nova] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Received event network-vif-plugged-044dbd97-bde5-4feb-a5fb-801f22043ae4 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:23:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-98a7d7e6-0677-4077-a17b-837b28821510 req-61ffe995-3818-4ad2-b9f8-cdbb7bcd24ab service nova] Acquiring lock "1fd86416-72c2-45e5-814d-9195b4cfcc61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:23:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-98a7d7e6-0677-4077-a17b-837b28821510 req-61ffe995-3818-4ad2-b9f8-cdbb7bcd24ab service nova] Lock "1fd86416-72c2-45e5-814d-9195b4cfcc61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:23:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-98a7d7e6-0677-4077-a17b-837b28821510 req-61ffe995-3818-4ad2-b9f8-cdbb7bcd24ab service nova] Lock "1fd86416-72c2-45e5-814d-9195b4cfcc61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:23:37 user nova-compute[74743]: DEBUG nova.compute.manager [req-98a7d7e6-0677-4077-a17b-837b28821510 req-61ffe995-3818-4ad2-b9f8-cdbb7bcd24ab service nova] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] No waiting events found dispatching network-vif-plugged-044dbd97-bde5-4feb-a5fb-801f22043ae4 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:23:37 user nova-compute[74743]: WARNING nova.compute.manager [req-98a7d7e6-0677-4077-a17b-837b28821510 req-61ffe995-3818-4ad2-b9f8-cdbb7bcd24ab service nova] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Received unexpected event network-vif-plugged-044dbd97-bde5-4feb-a5fb-801f22043ae4 for instance with vm_state active and task_state None.
Nov 18 17:23:38 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:23:38 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:23:38 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:23:38 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:23:38 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:23:38 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Auditing locally available compute resources for user (node: user) {{(pid=74743) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 17:23:38 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:23:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/789583c2-1c04-4510-a37e-0e9b7d3a0971/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:23:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/789583c2-1c04-4510-a37e-0e9b7d3a0971/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:23:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/789583c2-1c04-4510-a37e-0e9b7d3a0971/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:23:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/789583c2-1c04-4510-a37e-0e9b7d3a0971/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:23:39 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:23:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:23:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:23:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:23:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:23:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fd86416-72c2-45e5-814d-9195b4cfcc61/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:23:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fd86416-72c2-45e5-814d-9195b4cfcc61/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:23:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fd86416-72c2-45e5-814d-9195b4cfcc61/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:23:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fd86416-72c2-45e5-814d-9195b4cfcc61/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:23:39 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:23:39 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:23:39 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:23:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aecacc3-577d-4b36-9223-8446afe54e26/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:23:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aecacc3-577d-4b36-9223-8446afe54e26/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:23:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aecacc3-577d-4b36-9223-8446afe54e26/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:23:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aecacc3-577d-4b36-9223-8446afe54e26/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:23:40 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:23:40 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:23:40 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:23:40 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Hypervisor/Node resource view: name=user free_ram=8076MB free_disk=25.221538543701172GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74743) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 17:23:40 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:23:40 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:23:40 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance aefe3db1-b9bb-4cce-aa31-d0b6684ad791 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:23:40 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance f649143e-f7db-475a-bbe5-d5e7316caac3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:23:40 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 6aecacc3-577d-4b36-9223-8446afe54e26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:23:40 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 789583c2-1c04-4510-a37e-0e9b7d3a0971 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:23:40 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 9cbdffd6-df57-4bab-b69c-b41a2718fd68 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:23:40 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 93772071-cb21-4f4e-8b07-c55be8cf7bea actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:23:40 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 0d0a7608-0050-4e0e-a9d3-aa884a716aa8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:23:40 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 1fd86416-72c2-45e5-814d-9195b4cfcc61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:23:40 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 17:23:40 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 17:23:40 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:23:40 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:23:40 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Compute_service record updated for user:user {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 17:23:40 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.449s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:23:43 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:23:43 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:23:45 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:23:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:23:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:23:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:23:55 user nova-compute[74743]: INFO nova.compute.manager [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Rescuing
Nov 18 17:23:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquiring lock "refresh_cache-93772071-cb21-4f4e-8b07-c55be8cf7bea" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:23:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquired lock "refresh_cache-93772071-cb21-4f4e-8b07-c55be8cf7bea" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:23:55 user nova-compute[74743]: DEBUG nova.network.neutron [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:23:56 user nova-compute[74743]: DEBUG nova.network.neutron [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Updating instance_info_cache with network_info: [{"id": "8aa1f220-b71a-4dce-b48a-cbef38e01517", "address": "fa:16:3e:c9:74:4b", "network": {"id": "1bbf6aff-4048-4212-a716-d0628575bfd0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc0fda74575d488a94e2dcfdc016598c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8aa1f220-b7", "ovs_interfaceid": "8aa1f220-b71a-4dce-b48a-cbef38e01517", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:23:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Releasing lock "refresh_cache-93772071-cb21-4f4e-8b07-c55be8cf7bea" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:23:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:23:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:23:56 user nova-compute[74743]: DEBUG nova.compute.manager [req-aa1f2ec0-4092-4952-8d65-b3025768d4c6 req-ea8ffd71-d802-4d9d-96c3-ec2be44cc780 service nova] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Received event network-vif-unplugged-8aa1f220-b71a-4dce-b48a-cbef38e01517 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:23:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-aa1f2ec0-4092-4952-8d65-b3025768d4c6 req-ea8ffd71-d802-4d9d-96c3-ec2be44cc780 service nova] Acquiring lock "93772071-cb21-4f4e-8b07-c55be8cf7bea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:23:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-aa1f2ec0-4092-4952-8d65-b3025768d4c6 req-ea8ffd71-d802-4d9d-96c3-ec2be44cc780 service nova] Lock "93772071-cb21-4f4e-8b07-c55be8cf7bea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:23:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-aa1f2ec0-4092-4952-8d65-b3025768d4c6 req-ea8ffd71-d802-4d9d-96c3-ec2be44cc780 service nova] Lock "93772071-cb21-4f4e-8b07-c55be8cf7bea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:23:56 user nova-compute[74743]: DEBUG nova.compute.manager [req-aa1f2ec0-4092-4952-8d65-b3025768d4c6 req-ea8ffd71-d802-4d9d-96c3-ec2be44cc780 service nova] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] No waiting events found dispatching network-vif-unplugged-8aa1f220-b71a-4dce-b48a-cbef38e01517 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:23:56 user nova-compute[74743]: WARNING nova.compute.manager [req-aa1f2ec0-4092-4952-8d65-b3025768d4c6 req-ea8ffd71-d802-4d9d-96c3-ec2be44cc780 service nova] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Received unexpected event network-vif-unplugged-8aa1f220-b71a-4dce-b48a-cbef38e01517 for instance with vm_state active and task_state rescuing.
Nov 18 17:23:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:23:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:23:57 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Instance destroyed successfully.
Nov 18 17:23:57 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Attempting a stable device rescue
Nov 18 17:23:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74743) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 18 17:23:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Instance directory exists: not creating {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 18 17:23:57 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Creating image(s)
Nov 18 17:23:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquiring lock "/opt/stack/data/nova/instances/93772071-cb21-4f4e-8b07-c55be8cf7bea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:23:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "/opt/stack/data/nova/instances/93772071-cb21-4f4e-8b07-c55be8cf7bea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:23:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "/opt/stack/data/nova/instances/93772071-cb21-4f4e-8b07-c55be8cf7bea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:23:57 user nova-compute[74743]: DEBUG nova.objects.instance [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lazy-loading 'trusted_certs' on Instance uuid 93772071-cb21-4f4e-8b07-c55be8cf7bea {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:23:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquiring lock "2a0437643255c3c4876da1282beff5d98c3df9ca" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:23:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "2a0437643255c3c4876da1282beff5d98c3df9ca" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:23:58 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a0437643255c3c4876da1282beff5d98c3df9ca.part --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:23:58 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a0437643255c3c4876da1282beff5d98c3df9ca.part --force-share --output=json" returned: 0 in 0.182s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:23:58 user nova-compute[74743]: DEBUG nova.virt.images [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] 0a49f62d-0981-4dfe-b2c6-c184d9199bad was qcow2, converting to raw {{(pid=74743) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 18 17:23:58 user nova-compute[74743]: DEBUG nova.privsep.utils [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74743) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 18 17:23:58 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2a0437643255c3c4876da1282beff5d98c3df9ca.part /opt/stack/data/nova/instances/_base/2a0437643255c3c4876da1282beff5d98c3df9ca.converted {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:23:58 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2a0437643255c3c4876da1282beff5d98c3df9ca.part /opt/stack/data/nova/instances/_base/2a0437643255c3c4876da1282beff5d98c3df9ca.converted" returned: 0 in 0.344s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:23:58 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a0437643255c3c4876da1282beff5d98c3df9ca.converted --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:23:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:23:58 user nova-compute[74743]: DEBUG nova.compute.manager [req-a7b451ed-3cf8-49dd-86ab-d912001a0f53 req-721a547b-e7e2-4537-b178-83ca19496b0c service nova] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Received event network-vif-plugged-8aa1f220-b71a-4dce-b48a-cbef38e01517 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:23:58 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a7b451ed-3cf8-49dd-86ab-d912001a0f53 req-721a547b-e7e2-4537-b178-83ca19496b0c service nova] Acquiring lock "93772071-cb21-4f4e-8b07-c55be8cf7bea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:23:58 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a7b451ed-3cf8-49dd-86ab-d912001a0f53 req-721a547b-e7e2-4537-b178-83ca19496b0c service nova] Lock "93772071-cb21-4f4e-8b07-c55be8cf7bea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:23:58 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a7b451ed-3cf8-49dd-86ab-d912001a0f53 req-721a547b-e7e2-4537-b178-83ca19496b0c service nova] Lock "93772071-cb21-4f4e-8b07-c55be8cf7bea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:23:58 user nova-compute[74743]: DEBUG nova.compute.manager [req-a7b451ed-3cf8-49dd-86ab-d912001a0f53 req-721a547b-e7e2-4537-b178-83ca19496b0c service nova] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] No waiting events found dispatching network-vif-plugged-8aa1f220-b71a-4dce-b48a-cbef38e01517 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:23:58 user nova-compute[74743]: WARNING nova.compute.manager [req-a7b451ed-3cf8-49dd-86ab-d912001a0f53 req-721a547b-e7e2-4537-b178-83ca19496b0c service nova] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Received unexpected event network-vif-plugged-8aa1f220-b71a-4dce-b48a-cbef38e01517 for instance with vm_state active and task_state rescuing.
Nov 18 17:23:58 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a0437643255c3c4876da1282beff5d98c3df9ca.converted --force-share --output=json" returned: 0 in 0.182s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:23:58 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "2a0437643255c3c4876da1282beff5d98c3df9ca" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.609s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:23:58 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquiring lock "2a0437643255c3c4876da1282beff5d98c3df9ca" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:23:58 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "2a0437643255c3c4876da1282beff5d98c3df9ca" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:23:58 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a0437643255c3c4876da1282beff5d98c3df9ca --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:23:58 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a0437643255c3c4876da1282beff5d98c3df9ca --force-share --output=json" returned: 0 in 0.181s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:23:58 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a0437643255c3c4876da1282beff5d98c3df9ca,backing_fmt=raw /opt/stack/data/nova/instances/93772071-cb21-4f4e-8b07-c55be8cf7bea/disk.rescue {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a0437643255c3c4876da1282beff5d98c3df9ca,backing_fmt=raw /opt/stack/data/nova/instances/93772071-cb21-4f4e-8b07-c55be8cf7bea/disk.rescue" returned: 0 in 0.054s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "2a0437643255c3c4876da1282beff5d98c3df9ca" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG nova.objects.instance [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lazy-loading 'migration_context' on Instance uuid 93772071-cb21-4f4e-8b07-c55be8cf7bea {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG nova.objects.base [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Object Instance<93772071-cb21-4f4e-8b07-c55be8cf7bea> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Created local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Start _get_guest_xml network_info=[{"id": "8aa1f220-b71a-4dce-b48a-cbef38e01517", "address": "fa:16:3e:c9:74:4b", "network": {"id": "1bbf6aff-4048-4212-a716-d0628575bfd0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "vif_mac": "fa:16:3e:c9:74:4b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc0fda74575d488a94e2dcfdc016598c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8aa1f220-b7", "ovs_interfaceid": "8aa1f220-b71a-4dce-b48a-cbef38e01517", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '0a49f62d-0981-4dfe-b2c6-c184d9199bad', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '53f49d9d-7bcc-4aa5-9f68-fdd1a7a18faa', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EBGDNSIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '93772071-cb21-4f4e-8b07-c55be8cf7bea', 'attached_at': '', 'detached_at': '', 'volume_id': '410ff800-e826-4b57-8396-11316cec6abb', 'serial': '410ff800-e826-4b57-8396-11316cec6abb'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG nova.objects.instance [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lazy-loading 'resources' on Instance uuid 93772071-cb21-4f4e-8b07-c55be8cf7bea {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG nova.objects.base [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Object Instance<93772071-cb21-4f4e-8b07-c55be8cf7bea> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG nova.objects.instance [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lazy-loading 'numa_topology' on Instance uuid 93772071-cb21-4f4e-8b07-c55be8cf7bea {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG nova.objects.base [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Object Instance<93772071-cb21-4f4e-8b07-c55be8cf7bea> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:23:59 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:23:59 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:23:59 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG nova.objects.instance [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lazy-loading 'vcpu_model' on Instance uuid 93772071-cb21-4f4e-8b07-c55be8cf7bea {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG nova.objects.base [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Object Instance<93772071-cb21-4f4e-8b07-c55be8cf7bea> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Calling os-brick to attach iSCSI Volume {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EBGDNSIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:23:59 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:23:59 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:23:59 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:23:59 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:23:59 user nova-compute[74743]: INFO os_brick.initiator.connectors.iscsi [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 17:23:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb -p 172.16.0.220:3260 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7c5dcf-8e2e-4d05-841c-99bd1b79b72a]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = EBGDNSIq\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 18 17:23:59 user nova-compute[74743]: node.name = iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb
Nov 18 17:23:59 user nova-compute[74743]: node.tpgt = -1
Nov 18 17:23:59 user nova-compute[74743]: node.startup = automatic
Nov 18 17:23:59 user nova-compute[74743]: node.leading_login = No
Nov 18 17:23:59 user nova-compute[74743]: iface.iscsi_ifacename = default
Nov 18 17:23:59 user nova-compute[74743]: iface.net_ifacename = <empty>
Nov 18 17:23:59 user nova-compute[74743]: iface.ipaddress = <empty>
Nov 18 17:23:59 user nova-compute[74743]: iface.prefix_len = 0
Nov 18 17:23:59 user nova-compute[74743]: iface.hwaddress = <empty>
Nov 18 17:23:59 user nova-compute[74743]: iface.transport_name = tcp
Nov 18 17:23:59 user nova-compute[74743]: iface.initiatorname = <empty>
Nov 18 17:23:59 user nova-compute[74743]: iface.state = <empty>
Nov 18 17:23:59 user nova-compute[74743]: iface.vlan_id = 0
Nov 18 17:23:59 user nova-compute[74743]: iface.vlan_priority = 0
Nov 18 17:23:59 user nova-compute[74743]: iface.vlan_state = <empty>
Nov 18 17:23:59 user nova-compute[74743]: iface.iface_num = 0
Nov 18 17:23:59 user nova-compute[74743]: iface.mtu = 0
Nov 18 17:23:59 user nova-compute[74743]: iface.port = 0
Nov 18 17:23:59 user nova-compute[74743]: iface.bootproto = <empty>
Nov 18 17:23:59 user nova-compute[74743]: iface.subnet_mask = <empty>
Nov 18 17:23:59 user nova-compute[74743]: iface.gateway = <empty>
Nov 18 17:23:59 user nova-compute[74743]: iface.dhcp_alt_client_id_state = <empty>
Nov 18 17:23:59 user nova-compute[74743]: iface.dhcp_alt_client_id = <empty>
Nov 18 17:23:59 user nova-compute[74743]: iface.dhcp_dns = <empty>
Nov 18 17:23:59 user nova-compute[74743]: iface.dhcp_learn_iqn = <empty>
Nov 18 17:23:59 user nova-compute[74743]: iface.dhcp_req_vendor_id_state = <empty>
Nov 18 17:23:59 user nova-compute[74743]: iface.dhcp_vendor_id_state = <empty>
Nov 18 17:23:59 user nova-compute[74743]: iface.dhcp_vendor_id = <empty>
Nov 18 17:23:59 user nova-compute[74743]: iface.dhcp_slp_da = <empty>
Nov 18 17:23:59 user nova-compute[74743]: iface.fragmentation = <empty>
Nov 18 17:23:59 user nova-compute[74743]: iface.gratuitous_arp = <empty>
Nov 18 17:23:59 user nova-compute[74743]: iface.incoming_forwarding = <empty>
Nov 18 17:23:59 user nova-compute[74743]: iface.tos_state = <empty>
Nov 18 17:23:59 user nova-compute[74743]: iface.tos = 0
Nov 18 17:23:59 user nova-compute[74743]: iface.ttl = 0
Nov 18 17:23:59 user nova-compute[74743]: iface.delayed_ack = <empty>
Nov 18 17:23:59 user nova-compute[74743]: iface.tcp_nagle = <empty>
Nov 18 17:23:59 user nova-compute[74743]: iface.tcp_wsf_state = <empty>
Nov 18 17:23:59 user nova-compute[74743]: iface.tcp_wsf = 0
Nov 18 17:23:59 user nova-compute[74743]: iface.tcp_timer_scale = 0
Nov 18 17:23:59 user nova-compute[74743]: iface.tcp_timestamp = <empty>
Nov 18 17:23:59 user nova-compute[74743]: iface.redirect = <empty>
Nov 18 17:23:59 user nova-compute[74743]: iface.def_task_mgmt_timeout = 0
Nov 18 17:23:59 user nova-compute[74743]: iface.header_digest = <empty>
Nov 18 17:23:59 user nova-compute[74743]: iface.data_digest = <empty>
Nov 18 17:23:59 user nova-compute[74743]: iface.immediate_data = <empty>
Nov 18 17:23:59 user nova-compute[74743]: iface.initial_r2t = <empty>
Nov 18 17:23:59 user nova-compute[74743]: iface.data_seq_inorder = <empty>
Nov 18 17:23:59 user nova-compute[74743]: iface.data_pdu_inorder = <empty>
Nov 18 17:23:59 user nova-compute[74743]: iface.erl = 0
Nov 18 17:23:59 user nova-compute[74743]: iface.max_receive_data_len = 0
Nov 18 17:23:59 user nova-compute[74743]: iface.first_burst_len = 0
Nov 18 17:23:59 user nova-compute[74743]: iface.max_outstanding_r2t = 0
Nov 18 17:23:59 user nova-compute[74743]: iface.max_burst_len = 0
Nov 18 17:23:59 user nova-compute[74743]: iface.chap_auth = <empty>
Nov 18 17:23:59 user nova-compute[74743]: iface.bidi_chap = <empty>
Nov 18 17:23:59 user nova-compute[74743]: iface.strict_login_compliance = <empty>
Nov 18 17:23:59 user nova-compute[74743]: iface.discovery_auth = <empty>
Nov 18 17:23:59 user nova-compute[74743]: iface.discovery_logout = <empty>
Nov 18 17:23:59 user nova-compute[74743]: node.discovery_address = <empty>
Nov 18 17:23:59 user nova-compute[74743]: node.discovery_port = 0
Nov 18 17:23:59 user nova-compute[74743]: node.discovery_type = static
Nov 18 17:23:59 user nova-compute[74743]: node.session.initial_cmdsn = 0
Nov 18 17:23:59 user nova-compute[74743]: node.session.initial_login_retry_max = 8
Nov 18 17:23:59 user nova-compute[74743]: node.session.xmit_thread_priority = -20
Nov 18 17:23:59 user nova-compute[74743]: node.session.cmds_max = 128
Nov 18 17:23:59 user nova-compute[74743]: node.session.queue_depth = 32
Nov 18 17:23:59 user nova-compute[74743]: node.session.nr_sessions = 1
Nov 18 17:23:59 user nova-compute[74743]: node.session.auth.authmethod = CHAP
Nov 18 17:23:59 user nova-compute[74743]: node.session.auth.username = EBGDNSIq
Nov 18 17:23:59 user nova-compute[74743]: node.session.auth.password = ***
Nov 18 17:23:59 user nova-compute[74743]: node.session.auth.username_in = <empty>
Nov 18 17:23:59 user nova-compute[74743]: node.session.auth.password_in = <empty>
Nov 18 17:23:59 user nova-compute[74743]: node.session.auth.chap_algs = MD5
Nov 18 17:23:59 user nova-compute[74743]: node.session.timeo.replacement_timeout = 120
Nov 18 17:23:59 user nova-compute[74743]: node.session.err_timeo.abort_timeout = 15
Nov 18 17:23:59 user nova-compute[74743]: node.session.err_timeo.lu_reset_timeout = 30
Nov 18 17:23:59 user nova-compute[74743]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 18 17:23:59 user nova-compute[74743]: node.session.err_timeo.host_reset_timeout = 60
Nov 18 17:23:59 user nova-compute[74743]: node.session.iscsi.FastAbort = Yes
Nov 18 17:23:59 user nova-compute[74743]: node.session.iscsi.InitialR2T = No
Nov 18 17:23:59 user nova-compute[74743]: node.session.iscsi.ImmediateData = Yes
Nov 18 17:23:59 user nova-compute[74743]: node.session.iscsi.FirstBurstLength = 262144
Nov 18 17:23:59 user nova-compute[74743]: node.session.iscsi.MaxBurstLength = 16776192
Nov 18 17:23:59 user nova-compute[74743]: node.session.iscsi.DefaultTime2Retain = 0
Nov 18 17:23:59 user nova-compute[74743]: node.session.iscsi.DefaultTime2Wait = 2
Nov 18 17:23:59 user nova-compute[74743]: node.session.iscsi.MaxConnections = 1
Nov 18 17:23:59 user nova-compute[74743]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 18 17:23:59 user nova-compute[74743]: node.session.iscsi.ERL = 0
Nov 18 17:23:59 user nova-compute[74743]: node.session.scan = manual
Nov 18 17:23:59 user nova-compute[74743]: node.session.reopen_max = 0
Nov 18 17:23:59 user nova-compute[74743]: node.conn[0].address = 172.16.0.220
Nov 18 17:23:59 user nova-compute[74743]: node.conn[0].port = 3260
Nov 18 17:23:59 user nova-compute[74743]: node.conn[0].startup = manual
Nov 18 17:23:59 user nova-compute[74743]: node.conn[0].tcp.window_size = 524288
Nov 18 17:23:59 user nova-compute[74743]: node.conn[0].tcp.type_of_service = 0
Nov 18 17:23:59 user nova-compute[74743]: node.conn[0].timeo.logout_timeout = 15
Nov 18 17:23:59 user nova-compute[74743]: node.conn[0].timeo.login_timeout = 15
Nov 18 17:23:59 user nova-compute[74743]: node.conn[0].timeo.auth_timeout = 45
Nov 18 17:23:59 user nova-compute[74743]: node.conn[0].timeo.noop_out_interval = 5
Nov 18 17:23:59 user nova-compute[74743]: node.conn[0].timeo.noop_out_timeout = 5
Nov 18 17:23:59 user nova-compute[74743]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 18 17:23:59 user nova-compute[74743]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 18 17:23:59 user nova-compute[74743]: node.conn[0].iscsi.HeaderDigest = None
Nov 18 17:23:59 user nova-compute[74743]: node.conn[0].iscsi.DataDigest = None
Nov 18 17:23:59 user nova-compute[74743]: node.conn[0].iscsi.IFMarker = No
Nov 18 17:23:59 user nova-compute[74743]: node.conn[0].iscsi.OFMarker = No
Nov 18 17:23:59 user nova-compute[74743]: # END RECORD
Nov 18 17:23:59 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4c1c7e-f16e-45a8-a7ea-6a0e49615c2a]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb49cf2-a9de-4e19-b935-32fdcc3268c7]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EBGDNSIq {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EBGDNSIq" returned: 0 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3bfdd0-6dcb-4dee-b0eb-e81c184189e8]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EBGDNSIq'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93a1a45-4e9d-4f83-8891-7a1634b82eb0]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[95627ad5-b8a4-4525-8ee6-04a0f71ca833]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:23:59 user nova-compute[74743]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 (non-flash)
Nov 18 17:23:59 user nova-compute[74743]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb (non-flash)
Nov 18 17:23:59 user nova-compute[74743]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539 (non-flash)
Nov 18 17:23:59 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:23:59 user nova-compute[74743]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 (non-flash)
Nov 18 17:23:59 user nova-compute[74743]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb (non-flash)
Nov 18 17:23:59 user nova-compute[74743]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539 (non-flash)
Nov 18 17:23:59 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.160s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Connected to 172.16.0.220:3260 {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] HCTL ('34', '0', '0', 0) found on session 46 with lun 0 {{(pid=74743) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=74743) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc208484-59b1-4396-8fbf-6679d723524c]: (4, ('0 0 0', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Searching for a device in session 46 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EBGDNSIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.192s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] <== connect_volume: return (194ms) {'type': 'block', 'scsi_wwn': '26436303765386431', 'path': '/dev/sdc'} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436303765386431', 'path': '/dev/sdc'} {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a7594b66-07e9-44a2-b123-d28ad61aa4b6 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Acquiring lock "6aecacc3-577d-4b36-9223-8446afe54e26" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a7594b66-07e9-44a2-b123-d28ad61aa4b6 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "6aecacc3-577d-4b36-9223-8446afe54e26" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a7594b66-07e9-44a2-b123-d28ad61aa4b6 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Acquiring lock "6aecacc3-577d-4b36-9223-8446afe54e26-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a7594b66-07e9-44a2-b123-d28ad61aa4b6 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "6aecacc3-577d-4b36-9223-8446afe54e26-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a7594b66-07e9-44a2-b123-d28ad61aa4b6 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "6aecacc3-577d-4b36-9223-8446afe54e26-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:23:59 user nova-compute[74743]: INFO nova.compute.manager [None req-a7594b66-07e9-44a2-b123-d28ad61aa4b6 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Terminating instance
Nov 18 17:23:59 user nova-compute[74743]: DEBUG nova.compute.manager [None req-a7594b66-07e9-44a2-b123-d28ad61aa4b6 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Start destroying the instance on the hypervisor. {{(pid=74743) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:22:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-483967353',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-483967353',id=39,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:22:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc0fda74575d488a94e2dcfdc016598c',ramdisk_id='',reservation_id='r-qzba9c41',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-633893051',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:22:22Z,user_data=None,user_id='5639bd2666534fdca04d0958dcdc9f54',uuid=93772071-cb21-4f4e-8b07-c55be8cf7bea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8aa1f220-b71a-4dce-b48a-cbef38e01517", "address": "fa:16:3e:c9:74:4b", "network": {"id": "1bbf6aff-4048-4212-a716-d0628575bfd0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "vif_mac": "fa:16:3e:c9:74:4b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc0fda74575d488a94e2dcfdc016598c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8aa1f220-b7", "ovs_interfaceid": "8aa1f220-b71a-4dce-b48a-cbef38e01517", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Converting VIF {"id": "8aa1f220-b71a-4dce-b48a-cbef38e01517", "address": "fa:16:3e:c9:74:4b", "network": {"id": "1bbf6aff-4048-4212-a716-d0628575bfd0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "vif_mac": "fa:16:3e:c9:74:4b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc0fda74575d488a94e2dcfdc016598c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8aa1f220-b7", "ovs_interfaceid": "8aa1f220-b71a-4dce-b48a-cbef38e01517", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:74:4b,bridge_name='br-int',has_traffic_filtering=True,id=8aa1f220-b71a-4dce-b48a-cbef38e01517,network=Network(1bbf6aff-4048-4212-a716-d0628575bfd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8aa1f220-b7') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG nova.objects.instance [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lazy-loading 'pci_devices' on Instance uuid 93772071-cb21-4f4e-8b07-c55be8cf7bea {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG nova.objects.base [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Object Instance<93772071-cb21-4f4e-8b07-c55be8cf7bea> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:23:59 user nova-compute[74743]:   <uuid>93772071-cb21-4f4e-8b07-c55be8cf7bea</uuid>
Nov 18 17:23:59 user nova-compute[74743]:   <name>instance-00000027</name>
Nov 18 17:23:59 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:23:59 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:23:59 user nova-compute[74743]:   <metadata>
Nov 18 17:23:59 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:23:59 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:23:59 user nova-compute[74743]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-483967353</nova:name>
Nov 18 17:23:59 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:23:59</nova:creationTime>
Nov 18 17:23:59 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:23:59 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:23:59 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:23:59 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:23:59 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:23:59 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:23:59 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:23:59 user nova-compute[74743]:       <nova:owner>
Nov 18 17:23:59 user nova-compute[74743]:         <nova:user uuid="5639bd2666534fdca04d0958dcdc9f54">tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member</nova:user>
Nov 18 17:23:59 user nova-compute[74743]:         <nova:project uuid="bc0fda74575d488a94e2dcfdc016598c">tempest-ServerBootFromVolumeStableRescueTest-633893051</nova:project>
Nov 18 17:23:59 user nova-compute[74743]:       </nova:owner>
Nov 18 17:23:59 user nova-compute[74743]:       <nova:root type="image" uuid="9536f6cf-95c4-40e2-864a-09a91525678a"/>
Nov 18 17:23:59 user nova-compute[74743]:       <nova:ports>
Nov 18 17:23:59 user nova-compute[74743]:         <nova:port uuid="8aa1f220-b71a-4dce-b48a-cbef38e01517">
Nov 18 17:23:59 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 18 17:23:59 user nova-compute[74743]:         </nova:port>
Nov 18 17:23:59 user nova-compute[74743]:       </nova:ports>
Nov 18 17:23:59 user nova-compute[74743]:     </nova:instance>
Nov 18 17:23:59 user nova-compute[74743]:   </metadata>
Nov 18 17:23:59 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:23:59 user nova-compute[74743]:     <system>
Nov 18 17:23:59 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:23:59 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:23:59 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:23:59 user nova-compute[74743]:       <entry name="serial">93772071-cb21-4f4e-8b07-c55be8cf7bea</entry>
Nov 18 17:23:59 user nova-compute[74743]:       <entry name="uuid">93772071-cb21-4f4e-8b07-c55be8cf7bea</entry>
Nov 18 17:23:59 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:23:59 user nova-compute[74743]:     </system>
Nov 18 17:23:59 user nova-compute[74743]:   </sysinfo>
Nov 18 17:23:59 user nova-compute[74743]:   <os>
Nov 18 17:23:59 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:23:59 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:23:59 user nova-compute[74743]:   </os>
Nov 18 17:23:59 user nova-compute[74743]:   <features>
Nov 18 17:23:59 user nova-compute[74743]:     <acpi/>
Nov 18 17:23:59 user nova-compute[74743]:     <apic/>
Nov 18 17:23:59 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:23:59 user nova-compute[74743]:   </features>
Nov 18 17:23:59 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:23:59 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:23:59 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:23:59 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:23:59 user nova-compute[74743]:   </clock>
Nov 18 17:23:59 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:23:59 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:23:59 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:23:59 user nova-compute[74743]:   </cpu>
Nov 18 17:23:59 user nova-compute[74743]:   <devices>
Nov 18 17:23:59 user nova-compute[74743]:     <disk type="block" device="disk">
Nov 18 17:23:59 user nova-compute[74743]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:23:59 user nova-compute[74743]:       <source dev="/dev/sdc"/>
Nov 18 17:23:59 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:23:59 user nova-compute[74743]:       <serial>410ff800-e826-4b57-8396-11316cec6abb</serial>
Nov 18 17:23:59 user nova-compute[74743]:     </disk>
Nov 18 17:23:59 user nova-compute[74743]:     <disk type="file" device="disk">
Nov 18 17:23:59 user nova-compute[74743]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 17:23:59 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/93772071-cb21-4f4e-8b07-c55be8cf7bea/disk.rescue"/>
Nov 18 17:23:59 user nova-compute[74743]:       <target dev="vdb" bus="virtio"/>
Nov 18 17:23:59 user nova-compute[74743]:       <boot order="1"/>
Nov 18 17:23:59 user nova-compute[74743]:     </disk>
Nov 18 17:23:59 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:23:59 user nova-compute[74743]:       <mac address="fa:16:3e:c9:74:4b"/>
Nov 18 17:23:59 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:23:59 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:23:59 user nova-compute[74743]:       <target dev="tap8aa1f220-b7"/>
Nov 18 17:23:59 user nova-compute[74743]:     </interface>
Nov 18 17:23:59 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:23:59 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/93772071-cb21-4f4e-8b07-c55be8cf7bea/console.log" append="off"/>
Nov 18 17:23:59 user nova-compute[74743]:     </serial>
Nov 18 17:23:59 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:23:59 user nova-compute[74743]:     <video>
Nov 18 17:23:59 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:23:59 user nova-compute[74743]:     </video>
Nov 18 17:23:59 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:23:59 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:23:59 user nova-compute[74743]:     </rng>
Nov 18 17:23:59 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:23:59 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:23:59 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:23:59 user nova-compute[74743]:     </memballoon>
Nov 18 17:23:59 user nova-compute[74743]:   </devices>
Nov 18 17:23:59 user nova-compute[74743]: </domain>
Nov 18 17:23:59 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:23:59 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Instance destroyed successfully.
Nov 18 17:23:59 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] No VIF found with MAC fa:16:3e:c9:74:4b, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:23:59 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:00 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Instance destroyed successfully.
Nov 18 17:24:00 user nova-compute[74743]: DEBUG nova.objects.instance [None req-a7594b66-07e9-44a2-b123-d28ad61aa4b6 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lazy-loading 'resources' on Instance uuid 6aecacc3-577d-4b36-9223-8446afe54e26 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:24:00 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-a7594b66-07e9-44a2-b123-d28ad61aa4b6 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:19:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-571016991',display_name='tempest-TestMinimumBasicScenario-server-571016991',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-571016991',id=34,image_ref='502d6d5f-7f9a-4b3b-af75-cf8915d0f14a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDhtFEpE8QQq5OQXk5qeUW0OP7QLpgRvDd9rkjiQBHiCfwQRKXXiuo4jCXffab0TYR+4YYJlJ/bv6z9gV1HPXH7ici9tntf4eAwrpJJu35hohZ9oXg0J27GRRsfKG9Xbw==',key_name='tempest-TestMinimumBasicScenario-597950928',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:19:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='38303e1b311044deb8c833ed3299ce88',ramdisk_id='',reservation_id='r-algq1rxa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='502d6d5f-7f9a-4b3b-af75-cf8915d0f14a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1229544582',owner_user_name='tempest-TestMinimumBasicScenario-1229544582-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:21:23Z,user_data=None,user_id='52673e9f58e44abc8f9bd60d066c4197',uuid=6aecacc3-577d-4b36-9223-8446afe54e26,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "70799139-883d-4f9a-a2ba-e2fabf2871ec", "address": "fa:16:3e:1f:4b:8a", "network": {"id": "cd6d2dbc-0950-412a-ab9d-cf7615c06eb8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1261309930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38303e1b311044deb8c833ed3299ce88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70799139-88", "ovs_interfaceid": "70799139-883d-4f9a-a2ba-e2fabf2871ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:24:00 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-a7594b66-07e9-44a2-b123-d28ad61aa4b6 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Converting VIF {"id": "70799139-883d-4f9a-a2ba-e2fabf2871ec", "address": "fa:16:3e:1f:4b:8a", "network": {"id": "cd6d2dbc-0950-412a-ab9d-cf7615c06eb8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1261309930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38303e1b311044deb8c833ed3299ce88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70799139-88", "ovs_interfaceid": "70799139-883d-4f9a-a2ba-e2fabf2871ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:24:00 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-a7594b66-07e9-44a2-b123-d28ad61aa4b6 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:4b:8a,bridge_name='br-int',has_traffic_filtering=True,id=70799139-883d-4f9a-a2ba-e2fabf2871ec,network=Network(cd6d2dbc-0950-412a-ab9d-cf7615c06eb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70799139-88') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:24:00 user nova-compute[74743]: DEBUG os_vif [None req-a7594b66-07e9-44a2-b123-d28ad61aa4b6 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:4b:8a,bridge_name='br-int',has_traffic_filtering=True,id=70799139-883d-4f9a-a2ba-e2fabf2871ec,network=Network(cd6d2dbc-0950-412a-ab9d-cf7615c06eb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70799139-88') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:24:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap70799139-88, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:24:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:24:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=57f72fc6-a687-4b41-9ecd-8cea09a444a2) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:24:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:24:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:00 user nova-compute[74743]: INFO os_vif [None req-a7594b66-07e9-44a2-b123-d28ad61aa4b6 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:4b:8a,bridge_name='br-int',has_traffic_filtering=True,id=70799139-883d-4f9a-a2ba-e2fabf2871ec,network=Network(cd6d2dbc-0950-412a-ab9d-cf7615c06eb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70799139-88')
Nov 18 17:24:00 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-a7594b66-07e9-44a2-b123-d28ad61aa4b6 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Deleting instance files /opt/stack/data/nova/instances/6aecacc3-577d-4b36-9223-8446afe54e26_del
Nov 18 17:24:00 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-a7594b66-07e9-44a2-b123-d28ad61aa4b6 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Deletion of /opt/stack/data/nova/instances/6aecacc3-577d-4b36-9223-8446afe54e26_del complete
Nov 18 17:24:00 user nova-compute[74743]: DEBUG nova.compute.manager [req-812d6d41-5901-4132-9201-527e26894588 req-bd9d7d6f-04c1-4861-9a53-02d45dbec20a service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Received event network-vif-unplugged-70799139-883d-4f9a-a2ba-e2fabf2871ec {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:24:00 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-812d6d41-5901-4132-9201-527e26894588 req-bd9d7d6f-04c1-4861-9a53-02d45dbec20a service nova] Acquiring lock "6aecacc3-577d-4b36-9223-8446afe54e26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:24:00 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-812d6d41-5901-4132-9201-527e26894588 req-bd9d7d6f-04c1-4861-9a53-02d45dbec20a service nova] Lock "6aecacc3-577d-4b36-9223-8446afe54e26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:24:00 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-812d6d41-5901-4132-9201-527e26894588 req-bd9d7d6f-04c1-4861-9a53-02d45dbec20a service nova] Lock "6aecacc3-577d-4b36-9223-8446afe54e26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:24:00 user nova-compute[74743]: DEBUG nova.compute.manager [req-812d6d41-5901-4132-9201-527e26894588 req-bd9d7d6f-04c1-4861-9a53-02d45dbec20a service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] No waiting events found dispatching network-vif-unplugged-70799139-883d-4f9a-a2ba-e2fabf2871ec {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:24:00 user nova-compute[74743]: DEBUG nova.compute.manager [req-812d6d41-5901-4132-9201-527e26894588 req-bd9d7d6f-04c1-4861-9a53-02d45dbec20a service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Received event network-vif-unplugged-70799139-883d-4f9a-a2ba-e2fabf2871ec for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:24:00 user nova-compute[74743]: DEBUG nova.compute.manager [req-812d6d41-5901-4132-9201-527e26894588 req-bd9d7d6f-04c1-4861-9a53-02d45dbec20a service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Received event network-vif-plugged-70799139-883d-4f9a-a2ba-e2fabf2871ec {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:24:00 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-812d6d41-5901-4132-9201-527e26894588 req-bd9d7d6f-04c1-4861-9a53-02d45dbec20a service nova] Acquiring lock "6aecacc3-577d-4b36-9223-8446afe54e26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:24:00 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-812d6d41-5901-4132-9201-527e26894588 req-bd9d7d6f-04c1-4861-9a53-02d45dbec20a service nova] Lock "6aecacc3-577d-4b36-9223-8446afe54e26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:24:00 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-812d6d41-5901-4132-9201-527e26894588 req-bd9d7d6f-04c1-4861-9a53-02d45dbec20a service nova] Lock "6aecacc3-577d-4b36-9223-8446afe54e26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:24:00 user nova-compute[74743]: DEBUG nova.compute.manager [req-812d6d41-5901-4132-9201-527e26894588 req-bd9d7d6f-04c1-4861-9a53-02d45dbec20a service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] No waiting events found dispatching network-vif-plugged-70799139-883d-4f9a-a2ba-e2fabf2871ec {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:24:00 user nova-compute[74743]: WARNING nova.compute.manager [req-812d6d41-5901-4132-9201-527e26894588 req-bd9d7d6f-04c1-4861-9a53-02d45dbec20a service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Received unexpected event network-vif-plugged-70799139-883d-4f9a-a2ba-e2fabf2871ec for instance with vm_state active and task_state deleting.
Nov 18 17:24:00 user nova-compute[74743]: DEBUG nova.compute.manager [req-812d6d41-5901-4132-9201-527e26894588 req-bd9d7d6f-04c1-4861-9a53-02d45dbec20a service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Received event network-vif-plugged-70799139-883d-4f9a-a2ba-e2fabf2871ec {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:24:00 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-812d6d41-5901-4132-9201-527e26894588 req-bd9d7d6f-04c1-4861-9a53-02d45dbec20a service nova] Acquiring lock "6aecacc3-577d-4b36-9223-8446afe54e26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:24:00 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-812d6d41-5901-4132-9201-527e26894588 req-bd9d7d6f-04c1-4861-9a53-02d45dbec20a service nova] Lock "6aecacc3-577d-4b36-9223-8446afe54e26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:24:00 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-812d6d41-5901-4132-9201-527e26894588 req-bd9d7d6f-04c1-4861-9a53-02d45dbec20a service nova] Lock "6aecacc3-577d-4b36-9223-8446afe54e26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:24:00 user nova-compute[74743]: DEBUG nova.compute.manager [req-812d6d41-5901-4132-9201-527e26894588 req-bd9d7d6f-04c1-4861-9a53-02d45dbec20a service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] No waiting events found dispatching network-vif-plugged-70799139-883d-4f9a-a2ba-e2fabf2871ec {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:24:00 user nova-compute[74743]: WARNING nova.compute.manager [req-812d6d41-5901-4132-9201-527e26894588 req-bd9d7d6f-04c1-4861-9a53-02d45dbec20a service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Received unexpected event network-vif-plugged-70799139-883d-4f9a-a2ba-e2fabf2871ec for instance with vm_state active and task_state deleting.
Nov 18 17:24:00 user nova-compute[74743]: DEBUG nova.compute.manager [req-812d6d41-5901-4132-9201-527e26894588 req-bd9d7d6f-04c1-4861-9a53-02d45dbec20a service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Received event network-vif-plugged-70799139-883d-4f9a-a2ba-e2fabf2871ec {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:24:00 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-812d6d41-5901-4132-9201-527e26894588 req-bd9d7d6f-04c1-4861-9a53-02d45dbec20a service nova] Acquiring lock "6aecacc3-577d-4b36-9223-8446afe54e26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:24:00 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-812d6d41-5901-4132-9201-527e26894588 req-bd9d7d6f-04c1-4861-9a53-02d45dbec20a service nova] Lock "6aecacc3-577d-4b36-9223-8446afe54e26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:24:00 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-812d6d41-5901-4132-9201-527e26894588 req-bd9d7d6f-04c1-4861-9a53-02d45dbec20a service nova] Lock "6aecacc3-577d-4b36-9223-8446afe54e26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:24:00 user nova-compute[74743]: DEBUG nova.compute.manager [req-812d6d41-5901-4132-9201-527e26894588 req-bd9d7d6f-04c1-4861-9a53-02d45dbec20a service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] No waiting events found dispatching network-vif-plugged-70799139-883d-4f9a-a2ba-e2fabf2871ec {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:24:00 user nova-compute[74743]: WARNING nova.compute.manager [req-812d6d41-5901-4132-9201-527e26894588 req-bd9d7d6f-04c1-4861-9a53-02d45dbec20a service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Received unexpected event network-vif-plugged-70799139-883d-4f9a-a2ba-e2fabf2871ec for instance with vm_state active and task_state deleting.
Nov 18 17:24:00 user nova-compute[74743]: INFO nova.compute.manager [None req-a7594b66-07e9-44a2-b123-d28ad61aa4b6 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Took 1.36 seconds to destroy the instance on the hypervisor.
Nov 18 17:24:00 user nova-compute[74743]: DEBUG oslo.service.loopingcall [None req-a7594b66-07e9-44a2-b123-d28ad61aa4b6 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74743) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 17:24:00 user nova-compute[74743]: DEBUG nova.compute.manager [-] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Deallocating network for instance {{(pid=74743) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 17:24:00 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] deallocate_for_instance() {{(pid=74743) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 17:24:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:01 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:01 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:01 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:24:01 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:01 user nova-compute[74743]: INFO nova.compute.manager [-] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Took 0.54 seconds to deallocate network for instance.
Nov 18 17:24:01 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:01 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a7594b66-07e9-44a2-b123-d28ad61aa4b6 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:24:01 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a7594b66-07e9-44a2-b123-d28ad61aa4b6 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:24:01 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:01 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-a7594b66-07e9-44a2-b123-d28ad61aa4b6 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:24:01 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-a7594b66-07e9-44a2-b123-d28ad61aa4b6 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:24:01 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a7594b66-07e9-44a2-b123-d28ad61aa4b6 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.304s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:24:01 user nova-compute[74743]: INFO nova.scheduler.client.report [None req-a7594b66-07e9-44a2-b123-d28ad61aa4b6 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Deleted allocations for instance 6aecacc3-577d-4b36-9223-8446afe54e26
Nov 18 17:24:01 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a7594b66-07e9-44a2-b123-d28ad61aa4b6 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "6aecacc3-577d-4b36-9223-8446afe54e26" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.394s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:24:02 user nova-compute[74743]: DEBUG nova.compute.manager [req-bf5378d2-801a-47b3-b353-24cd8762e757 req-f3ab02d7-e766-4224-91f6-eef0375e9e53 service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Received event network-vif-unplugged-70799139-883d-4f9a-a2ba-e2fabf2871ec {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:24:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-bf5378d2-801a-47b3-b353-24cd8762e757 req-f3ab02d7-e766-4224-91f6-eef0375e9e53 service nova] Acquiring lock "6aecacc3-577d-4b36-9223-8446afe54e26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:24:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-bf5378d2-801a-47b3-b353-24cd8762e757 req-f3ab02d7-e766-4224-91f6-eef0375e9e53 service nova] Lock "6aecacc3-577d-4b36-9223-8446afe54e26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:24:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-bf5378d2-801a-47b3-b353-24cd8762e757 req-f3ab02d7-e766-4224-91f6-eef0375e9e53 service nova] Lock "6aecacc3-577d-4b36-9223-8446afe54e26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:24:02 user nova-compute[74743]: DEBUG nova.compute.manager [req-bf5378d2-801a-47b3-b353-24cd8762e757 req-f3ab02d7-e766-4224-91f6-eef0375e9e53 service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] No waiting events found dispatching network-vif-unplugged-70799139-883d-4f9a-a2ba-e2fabf2871ec {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:24:02 user nova-compute[74743]: WARNING nova.compute.manager [req-bf5378d2-801a-47b3-b353-24cd8762e757 req-f3ab02d7-e766-4224-91f6-eef0375e9e53 service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Received unexpected event network-vif-unplugged-70799139-883d-4f9a-a2ba-e2fabf2871ec for instance with vm_state deleted and task_state None.
Nov 18 17:24:02 user nova-compute[74743]: DEBUG nova.compute.manager [req-bf5378d2-801a-47b3-b353-24cd8762e757 req-f3ab02d7-e766-4224-91f6-eef0375e9e53 service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Received event network-vif-plugged-70799139-883d-4f9a-a2ba-e2fabf2871ec {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:24:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-bf5378d2-801a-47b3-b353-24cd8762e757 req-f3ab02d7-e766-4224-91f6-eef0375e9e53 service nova] Acquiring lock "6aecacc3-577d-4b36-9223-8446afe54e26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:24:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-bf5378d2-801a-47b3-b353-24cd8762e757 req-f3ab02d7-e766-4224-91f6-eef0375e9e53 service nova] Lock "6aecacc3-577d-4b36-9223-8446afe54e26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:24:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-bf5378d2-801a-47b3-b353-24cd8762e757 req-f3ab02d7-e766-4224-91f6-eef0375e9e53 service nova] Lock "6aecacc3-577d-4b36-9223-8446afe54e26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:24:02 user nova-compute[74743]: DEBUG nova.compute.manager [req-bf5378d2-801a-47b3-b353-24cd8762e757 req-f3ab02d7-e766-4224-91f6-eef0375e9e53 service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] No waiting events found dispatching network-vif-plugged-70799139-883d-4f9a-a2ba-e2fabf2871ec {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:24:02 user nova-compute[74743]: WARNING nova.compute.manager [req-bf5378d2-801a-47b3-b353-24cd8762e757 req-f3ab02d7-e766-4224-91f6-eef0375e9e53 service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Received unexpected event network-vif-plugged-70799139-883d-4f9a-a2ba-e2fabf2871ec for instance with vm_state deleted and task_state None.
Nov 18 17:24:02 user nova-compute[74743]: DEBUG nova.compute.manager [req-bf5378d2-801a-47b3-b353-24cd8762e757 req-f3ab02d7-e766-4224-91f6-eef0375e9e53 service nova] [instance: 6aecacc3-577d-4b36-9223-8446afe54e26] Received event network-vif-deleted-70799139-883d-4f9a-a2ba-e2fabf2871ec {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:24:02 user nova-compute[74743]: DEBUG nova.compute.manager [req-bf5378d2-801a-47b3-b353-24cd8762e757 req-f3ab02d7-e766-4224-91f6-eef0375e9e53 service nova] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Received event network-vif-plugged-8aa1f220-b71a-4dce-b48a-cbef38e01517 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:24:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-bf5378d2-801a-47b3-b353-24cd8762e757 req-f3ab02d7-e766-4224-91f6-eef0375e9e53 service nova] Acquiring lock "93772071-cb21-4f4e-8b07-c55be8cf7bea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:24:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-bf5378d2-801a-47b3-b353-24cd8762e757 req-f3ab02d7-e766-4224-91f6-eef0375e9e53 service nova] Lock "93772071-cb21-4f4e-8b07-c55be8cf7bea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:24:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-bf5378d2-801a-47b3-b353-24cd8762e757 req-f3ab02d7-e766-4224-91f6-eef0375e9e53 service nova] Lock "93772071-cb21-4f4e-8b07-c55be8cf7bea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:24:02 user nova-compute[74743]: DEBUG nova.compute.manager [req-bf5378d2-801a-47b3-b353-24cd8762e757 req-f3ab02d7-e766-4224-91f6-eef0375e9e53 service nova] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] No waiting events found dispatching network-vif-plugged-8aa1f220-b71a-4dce-b48a-cbef38e01517 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:24:02 user nova-compute[74743]: WARNING nova.compute.manager [req-bf5378d2-801a-47b3-b353-24cd8762e757 req-f3ab02d7-e766-4224-91f6-eef0375e9e53 service nova] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Received unexpected event network-vif-plugged-8aa1f220-b71a-4dce-b48a-cbef38e01517 for instance with vm_state active and task_state rescuing.
Nov 18 17:24:02 user nova-compute[74743]: DEBUG nova.compute.manager [req-bf5378d2-801a-47b3-b353-24cd8762e757 req-f3ab02d7-e766-4224-91f6-eef0375e9e53 service nova] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Received event network-vif-plugged-8aa1f220-b71a-4dce-b48a-cbef38e01517 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:24:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-bf5378d2-801a-47b3-b353-24cd8762e757 req-f3ab02d7-e766-4224-91f6-eef0375e9e53 service nova] Acquiring lock "93772071-cb21-4f4e-8b07-c55be8cf7bea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:24:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-bf5378d2-801a-47b3-b353-24cd8762e757 req-f3ab02d7-e766-4224-91f6-eef0375e9e53 service nova] Lock "93772071-cb21-4f4e-8b07-c55be8cf7bea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:24:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-bf5378d2-801a-47b3-b353-24cd8762e757 req-f3ab02d7-e766-4224-91f6-eef0375e9e53 service nova] Lock "93772071-cb21-4f4e-8b07-c55be8cf7bea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:24:02 user nova-compute[74743]: DEBUG nova.compute.manager [req-bf5378d2-801a-47b3-b353-24cd8762e757 req-f3ab02d7-e766-4224-91f6-eef0375e9e53 service nova] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] No waiting events found dispatching network-vif-plugged-8aa1f220-b71a-4dce-b48a-cbef38e01517 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:24:02 user nova-compute[74743]: WARNING nova.compute.manager [req-bf5378d2-801a-47b3-b353-24cd8762e757 req-f3ab02d7-e766-4224-91f6-eef0375e9e53 service nova] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Received unexpected event network-vif-plugged-8aa1f220-b71a-4dce-b48a-cbef38e01517 for instance with vm_state active and task_state rescuing.
Nov 18 17:24:03 user nova-compute[74743]: DEBUG nova.compute.manager [None req-2bdaf824-46ba-4d4a-8c27-8e021f2e83b8 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:24:05 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Acquiring lock "c58db905-7030-44d1-80ca-91e0cd746218" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:24:05 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "c58db905-7030-44d1-80ca-91e0cd746218" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:24:05 user nova-compute[74743]: INFO nova.compute.manager [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Unshelving
Nov 18 17:24:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:05 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:24:05 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:24:05 user nova-compute[74743]: DEBUG nova.objects.instance [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lazy-loading 'pci_requests' on Instance uuid c58db905-7030-44d1-80ca-91e0cd746218 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:24:05 user nova-compute[74743]: DEBUG nova.objects.instance [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lazy-loading 'numa_topology' on Instance uuid c58db905-7030-44d1-80ca-91e0cd746218 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:24:05 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74743) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 17:24:05 user nova-compute[74743]: INFO nova.compute.claims [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Claim successful on node user
Nov 18 17:24:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:05 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:24:05 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:24:05 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.389s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:24:05 user nova-compute[74743]: INFO nova.network.neutron [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Updating port 2dc327a1-177d-4d19-9fb1-ce60b5367a7e with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 18 17:24:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Acquiring lock "refresh_cache-c58db905-7030-44d1-80ca-91e0cd746218" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:24:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Acquired lock "refresh_cache-c58db905-7030-44d1-80ca-91e0cd746218" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:24:06 user nova-compute[74743]: DEBUG nova.network.neutron [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:24:06 user nova-compute[74743]: DEBUG nova.compute.manager [req-8ca55a2d-4c18-420b-9ff0-ab2aff7348cb req-73081c64-bd34-46b0-b6d9-44d78f6004a5 service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Received event network-changed-2dc327a1-177d-4d19-9fb1-ce60b5367a7e {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:24:06 user nova-compute[74743]: DEBUG nova.compute.manager [req-8ca55a2d-4c18-420b-9ff0-ab2aff7348cb req-73081c64-bd34-46b0-b6d9-44d78f6004a5 service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Refreshing instance network info cache due to event network-changed-2dc327a1-177d-4d19-9fb1-ce60b5367a7e. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:24:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-8ca55a2d-4c18-420b-9ff0-ab2aff7348cb req-73081c64-bd34-46b0-b6d9-44d78f6004a5 service nova] Acquiring lock "refresh_cache-c58db905-7030-44d1-80ca-91e0cd746218" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:24:07 user nova-compute[74743]: DEBUG nova.network.neutron [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Updating instance_info_cache with network_info: [{"id": "2dc327a1-177d-4d19-9fb1-ce60b5367a7e", "address": "fa:16:3e:05:b8:d4", "network": {"id": "e1c28f74-c9c1-4eb3-931e-003332ff6243", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-453481916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a17803c613c4ef299c797bba85c1a4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc327a1-17", "ovs_interfaceid": "2dc327a1-177d-4d19-9fb1-ce60b5367a7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:24:07 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Releasing lock "refresh_cache-c58db905-7030-44d1-80ca-91e0cd746218" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:24:07 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Creating instance directory {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 17:24:07 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Creating image(s)
Nov 18 17:24:07 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Acquiring lock "/opt/stack/data/nova/instances/c58db905-7030-44d1-80ca-91e0cd746218/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:24:07 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "/opt/stack/data/nova/instances/c58db905-7030-44d1-80ca-91e0cd746218/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:24:07 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "/opt/stack/data/nova/instances/c58db905-7030-44d1-80ca-91e0cd746218/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:24:07 user nova-compute[74743]: DEBUG nova.objects.instance [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lazy-loading 'trusted_certs' on Instance uuid c58db905-7030-44d1-80ca-91e0cd746218 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:24:07 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-8ca55a2d-4c18-420b-9ff0-ab2aff7348cb req-73081c64-bd34-46b0-b6d9-44d78f6004a5 service nova] Acquired lock "refresh_cache-c58db905-7030-44d1-80ca-91e0cd746218" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:24:07 user nova-compute[74743]: DEBUG nova.network.neutron [req-8ca55a2d-4c18-420b-9ff0-ab2aff7348cb req-73081c64-bd34-46b0-b6d9-44d78f6004a5 service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Refreshing network info cache for port 2dc327a1-177d-4d19-9fb1-ce60b5367a7e {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:24:07 user nova-compute[74743]: DEBUG nova.objects.base [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Object Instance<c58db905-7030-44d1-80ca-91e0cd746218> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:24:07 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Acquiring lock "4e4d7148a71162e7fd60233b84a0b98b5235793c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:24:07 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "4e4d7148a71162e7fd60233b84a0b98b5235793c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:24:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e4d7148a71162e7fd60233b84a0b98b5235793c.part --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:24:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e4d7148a71162e7fd60233b84a0b98b5235793c.part --force-share --output=json" returned: 0 in 0.203s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:24:08 user nova-compute[74743]: DEBUG nova.virt.images [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] ffbc4e03-bfcb-4b7d-94bc-eec36ade870a was qcow2, converting to raw {{(pid=74743) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 18 17:24:08 user nova-compute[74743]: DEBUG nova.privsep.utils [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74743) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 18 17:24:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4e4d7148a71162e7fd60233b84a0b98b5235793c.part /opt/stack/data/nova/instances/_base/4e4d7148a71162e7fd60233b84a0b98b5235793c.converted {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:24:08 user nova-compute[74743]: DEBUG nova.network.neutron [req-8ca55a2d-4c18-420b-9ff0-ab2aff7348cb req-73081c64-bd34-46b0-b6d9-44d78f6004a5 service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Updated VIF entry in instance network info cache for port 2dc327a1-177d-4d19-9fb1-ce60b5367a7e. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:24:08 user nova-compute[74743]: DEBUG nova.network.neutron [req-8ca55a2d-4c18-420b-9ff0-ab2aff7348cb req-73081c64-bd34-46b0-b6d9-44d78f6004a5 service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Updating instance_info_cache with network_info: [{"id": "2dc327a1-177d-4d19-9fb1-ce60b5367a7e", "address": "fa:16:3e:05:b8:d4", "network": {"id": "e1c28f74-c9c1-4eb3-931e-003332ff6243", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-453481916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a17803c613c4ef299c797bba85c1a4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc327a1-17", "ovs_interfaceid": "2dc327a1-177d-4d19-9fb1-ce60b5367a7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:24:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-8ca55a2d-4c18-420b-9ff0-ab2aff7348cb req-73081c64-bd34-46b0-b6d9-44d78f6004a5 service nova] Releasing lock "refresh_cache-c58db905-7030-44d1-80ca-91e0cd746218" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:24:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4e4d7148a71162e7fd60233b84a0b98b5235793c.part /opt/stack/data/nova/instances/_base/4e4d7148a71162e7fd60233b84a0b98b5235793c.converted" returned: 0 in 0.479s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:24:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e4d7148a71162e7fd60233b84a0b98b5235793c.converted --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:24:09 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e4d7148a71162e7fd60233b84a0b98b5235793c.converted --force-share --output=json" returned: 0 in 0.173s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:24:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "4e4d7148a71162e7fd60233b84a0b98b5235793c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.965s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:24:09 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e4d7148a71162e7fd60233b84a0b98b5235793c --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:24:09 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e4d7148a71162e7fd60233b84a0b98b5235793c --force-share --output=json" returned: 0 in 0.178s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:24:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Acquiring lock "4e4d7148a71162e7fd60233b84a0b98b5235793c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:24:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "4e4d7148a71162e7fd60233b84a0b98b5235793c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:24:09 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e4d7148a71162e7fd60233b84a0b98b5235793c --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:24:09 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e4d7148a71162e7fd60233b84a0b98b5235793c --force-share --output=json" returned: 0 in 0.190s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:24:09 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e4d7148a71162e7fd60233b84a0b98b5235793c,backing_fmt=raw /opt/stack/data/nova/instances/c58db905-7030-44d1-80ca-91e0cd746218/disk 1073741824 {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:24:09 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e4d7148a71162e7fd60233b84a0b98b5235793c,backing_fmt=raw /opt/stack/data/nova/instances/c58db905-7030-44d1-80ca-91e0cd746218/disk 1073741824" returned: 0 in 0.055s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:24:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "4e4d7148a71162e7fd60233b84a0b98b5235793c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:24:09 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e4d7148a71162e7fd60233b84a0b98b5235793c --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:24:09 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e4d7148a71162e7fd60233b84a0b98b5235793c --force-share --output=json" returned: 0 in 0.192s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:24:09 user nova-compute[74743]: DEBUG nova.objects.instance [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lazy-loading 'migration_context' on Instance uuid c58db905-7030-44d1-80ca-91e0cd746218 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:24:09 user nova-compute[74743]: DEBUG nova.objects.base [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Object Instance<c58db905-7030-44d1-80ca-91e0cd746218> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:24:09 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Rebasing disk image.
Nov 18 17:24:09 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:24:09 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.172s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:24:09 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 -F raw /opt/stack/data/nova/instances/c58db905-7030-44d1-80ca-91e0cd746218/disk {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:24:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:24:11 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 -F raw /opt/stack/data/nova/instances/c58db905-7030-44d1-80ca-91e0cd746218/disk" returned: 0 in 1.982s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:24:11 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Created local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 17:24:11 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Ensure instance console log exists: /opt/stack/data/nova/instances/c58db905-7030-44d1-80ca-91e0cd746218/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:24:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:24:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:24:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:24:11 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Start _get_guest_xml network_info=[{"id": "2dc327a1-177d-4d19-9fb1-ce60b5367a7e", "address": "fa:16:3e:05:b8:d4", "network": {"id": "e1c28f74-c9c1-4eb3-931e-003332ff6243", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-453481916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a17803c613c4ef299c797bba85c1a4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc327a1-17", "ovs_interfaceid": "2dc327a1-177d-4d19-9fb1-ce60b5367a7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='616ecd58be888fadf154a7acc968b8fd',container_format='bare',created_at=2023-11-18T17:22:12Z,direct_url=<?>,disk_format='qcow2',id=ffbc4e03-bfcb-4b7d-94bc-eec36ade870a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1999190186-shelved',owner='0a17803c613c4ef299c797bba85c1a4b',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-18T17:22:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '9536f6cf-95c4-40e2-864a-09a91525678a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:24:11 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:24:11 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:24:11 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:24:11 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:24:11 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:24:11 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:24:11 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:24:11 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='616ecd58be888fadf154a7acc968b8fd',container_format='bare',created_at=2023-11-18T17:22:12Z,direct_url=<?>,disk_format='qcow2',id=ffbc4e03-bfcb-4b7d-94bc-eec36ade870a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1999190186-shelved',owner='0a17803c613c4ef299c797bba85c1a4b',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-18T17:22:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:24:11 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:24:11 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:24:11 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:24:11 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:24:11 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:24:11 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:24:11 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:24:11 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:24:11 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:24:11 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:24:11 user nova-compute[74743]: DEBUG nova.objects.instance [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lazy-loading 'vcpu_model' on Instance uuid c58db905-7030-44d1-80ca-91e0cd746218 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:24:11 user nova-compute[74743]: DEBUG nova.objects.base [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Object Instance<c58db905-7030-44d1-80ca-91e0cd746218> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:24:11 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-18T17:20:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1999190186',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1999190186',id=36,image_ref='ffbc4e03-bfcb-4b7d-94bc-eec36ade870a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-405514316',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:20:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0a17803c613c4ef299c797bba85c1a4b',ramdisk_id='',reservation_id='r-p5x4eoy0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-13499029',owner_user_name='tempest-AttachVolumeShelveTestJSON-13499029-project-member',shelved_at='2023-11-18T17:22:16.681707',shelved_host='user',shelved_image_id='ffbc4e03-bfcb-4b7d-94bc-eec36ade870a'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:24:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18483ad6106b4d95afbbed450d625b53',uuid=c58db905-7030-44d1-80ca-91e0cd746218,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "2dc327a1-177d-4d19-9fb1-ce60b5367a7e", "address": "fa:16:3e:05:b8:d4", "network": {"id": "e1c28f74-c9c1-4eb3-931e-003332ff6243", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-453481916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a17803c613c4ef299c797bba85c1a4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc327a1-17", "ovs_interfaceid": "2dc327a1-177d-4d19-9fb1-ce60b5367a7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:24:11 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Converting VIF {"id": "2dc327a1-177d-4d19-9fb1-ce60b5367a7e", "address": "fa:16:3e:05:b8:d4", "network": {"id": "e1c28f74-c9c1-4eb3-931e-003332ff6243", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-453481916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a17803c613c4ef299c797bba85c1a4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc327a1-17", "ovs_interfaceid": "2dc327a1-177d-4d19-9fb1-ce60b5367a7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:24:11 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:b8:d4,bridge_name='br-int',has_traffic_filtering=True,id=2dc327a1-177d-4d19-9fb1-ce60b5367a7e,network=Network(e1c28f74-c9c1-4eb3-931e-003332ff6243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dc327a1-17') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:24:11 user nova-compute[74743]: DEBUG nova.objects.instance [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lazy-loading 'pci_devices' on Instance uuid c58db905-7030-44d1-80ca-91e0cd746218 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:24:11 user nova-compute[74743]: DEBUG nova.objects.base [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Object Instance<c58db905-7030-44d1-80ca-91e0cd746218> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:24:11 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:24:11 user nova-compute[74743]:   <uuid>c58db905-7030-44d1-80ca-91e0cd746218</uuid>
Nov 18 17:24:11 user nova-compute[74743]:   <name>instance-00000024</name>
Nov 18 17:24:11 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:24:11 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:24:11 user nova-compute[74743]:   <metadata>
Nov 18 17:24:11 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:24:11 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:24:11 user nova-compute[74743]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1999190186</nova:name>
Nov 18 17:24:11 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:24:11</nova:creationTime>
Nov 18 17:24:11 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:24:11 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:24:11 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:24:11 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:24:11 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:24:11 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:24:11 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:24:11 user nova-compute[74743]:       <nova:owner>
Nov 18 17:24:11 user nova-compute[74743]:         <nova:user uuid="18483ad6106b4d95afbbed450d625b53">tempest-AttachVolumeShelveTestJSON-13499029-project-member</nova:user>
Nov 18 17:24:11 user nova-compute[74743]:         <nova:project uuid="0a17803c613c4ef299c797bba85c1a4b">tempest-AttachVolumeShelveTestJSON-13499029</nova:project>
Nov 18 17:24:11 user nova-compute[74743]:       </nova:owner>
Nov 18 17:24:11 user nova-compute[74743]:       <nova:root type="image" uuid="ffbc4e03-bfcb-4b7d-94bc-eec36ade870a"/>
Nov 18 17:24:11 user nova-compute[74743]:       <nova:ports>
Nov 18 17:24:11 user nova-compute[74743]:         <nova:port uuid="2dc327a1-177d-4d19-9fb1-ce60b5367a7e">
Nov 18 17:24:11 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 18 17:24:11 user nova-compute[74743]:         </nova:port>
Nov 18 17:24:11 user nova-compute[74743]:       </nova:ports>
Nov 18 17:24:11 user nova-compute[74743]:     </nova:instance>
Nov 18 17:24:11 user nova-compute[74743]:   </metadata>
Nov 18 17:24:11 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:24:11 user nova-compute[74743]:     <system>
Nov 18 17:24:11 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:24:11 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:24:11 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:24:11 user nova-compute[74743]:       <entry name="serial">c58db905-7030-44d1-80ca-91e0cd746218</entry>
Nov 18 17:24:11 user nova-compute[74743]:       <entry name="uuid">c58db905-7030-44d1-80ca-91e0cd746218</entry>
Nov 18 17:24:11 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:24:11 user nova-compute[74743]:     </system>
Nov 18 17:24:11 user nova-compute[74743]:   </sysinfo>
Nov 18 17:24:11 user nova-compute[74743]:   <os>
Nov 18 17:24:11 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:24:11 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:24:11 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:24:11 user nova-compute[74743]:   </os>
Nov 18 17:24:11 user nova-compute[74743]:   <features>
Nov 18 17:24:11 user nova-compute[74743]:     <acpi/>
Nov 18 17:24:11 user nova-compute[74743]:     <apic/>
Nov 18 17:24:11 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:24:11 user nova-compute[74743]:   </features>
Nov 18 17:24:11 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:24:11 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:24:11 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:24:11 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:24:11 user nova-compute[74743]:   </clock>
Nov 18 17:24:11 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:24:11 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:24:11 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:24:11 user nova-compute[74743]:   </cpu>
Nov 18 17:24:11 user nova-compute[74743]:   <devices>
Nov 18 17:24:11 user nova-compute[74743]:     <disk type="file" device="disk">
Nov 18 17:24:11 user nova-compute[74743]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 17:24:11 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/c58db905-7030-44d1-80ca-91e0cd746218/disk"/>
Nov 18 17:24:11 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:24:11 user nova-compute[74743]:     </disk>
Nov 18 17:24:11 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:24:11 user nova-compute[74743]:       <mac address="fa:16:3e:05:b8:d4"/>
Nov 18 17:24:11 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:24:11 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:24:11 user nova-compute[74743]:       <target dev="tap2dc327a1-17"/>
Nov 18 17:24:11 user nova-compute[74743]:     </interface>
Nov 18 17:24:11 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:24:11 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/c58db905-7030-44d1-80ca-91e0cd746218/console.log" append="off"/>
Nov 18 17:24:11 user nova-compute[74743]:     </serial>
Nov 18 17:24:11 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:24:11 user nova-compute[74743]:     <video>
Nov 18 17:24:11 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:24:11 user nova-compute[74743]:     </video>
Nov 18 17:24:11 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:24:11 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:24:11 user nova-compute[74743]:     </rng>
Nov 18 17:24:11 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:24:11 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:24:11 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:24:11 user nova-compute[74743]:     </memballoon>
Nov 18 17:24:11 user nova-compute[74743]:   </devices>
Nov 18 17:24:11 user nova-compute[74743]: </domain>
Nov 18 17:24:11 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:24:11 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-18T17:20:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1999190186',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1999190186',id=36,image_ref='ffbc4e03-bfcb-4b7d-94bc-eec36ade870a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-405514316',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:20:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0a17803c613c4ef299c797bba85c1a4b',ramdisk_id='',reservation_id='r-p5x4eoy0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-13499029',owner_user_name='tempest-AttachVolumeShelveTestJSON-13499029-project-member',shelved_at='2023-11-18T17:22:16.681707',shelved_host='user',shelved_image_id='ffbc4e03-bfcb-4b7d-94bc-eec36ade870a'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:24:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18483ad6106b4d95afbbed450d625b53',uuid=c58db905-7030-44d1-80ca-91e0cd746218,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "2dc327a1-177d-4d19-9fb1-ce60b5367a7e", "address": "fa:16:3e:05:b8:d4", "network": {"id": "e1c28f74-c9c1-4eb3-931e-003332ff6243", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-453481916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a17803c613c4ef299c797bba85c1a4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc327a1-17", "ovs_interfaceid": "2dc327a1-177d-4d19-9fb1-ce60b5367a7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:24:11 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Converting VIF {"id": "2dc327a1-177d-4d19-9fb1-ce60b5367a7e", "address": "fa:16:3e:05:b8:d4", "network": {"id": "e1c28f74-c9c1-4eb3-931e-003332ff6243", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-453481916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a17803c613c4ef299c797bba85c1a4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc327a1-17", "ovs_interfaceid": "2dc327a1-177d-4d19-9fb1-ce60b5367a7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:24:11 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:b8:d4,bridge_name='br-int',has_traffic_filtering=True,id=2dc327a1-177d-4d19-9fb1-ce60b5367a7e,network=Network(e1c28f74-c9c1-4eb3-931e-003332ff6243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dc327a1-17') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:24:11 user nova-compute[74743]: DEBUG os_vif [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:b8:d4,bridge_name='br-int',has_traffic_filtering=True,id=2dc327a1-177d-4d19-9fb1-ce60b5367a7e,network=Network(e1c28f74-c9c1-4eb3-931e-003332ff6243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dc327a1-17') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:24:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:24:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:24:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fa48dc30-dce9-541e-ac10-95bcc16363fd', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:24:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:12 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:12 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2dc327a1-17, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:24:12 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2dc327a1-17, col_values=(('qos', UUID('3f20bdb0-0e96-40fc-97c1-80bad833b88f')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:24:12 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2dc327a1-17, col_values=(('external_ids', {'iface-id': '2dc327a1-177d-4d19-9fb1-ce60b5367a7e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:b8:d4', 'vm-uuid': 'c58db905-7030-44d1-80ca-91e0cd746218'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:24:12 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:12 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:24:12 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:12 user nova-compute[74743]: INFO os_vif [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:b8:d4,bridge_name='br-int',has_traffic_filtering=True,id=2dc327a1-177d-4d19-9fb1-ce60b5367a7e,network=Network(e1c28f74-c9c1-4eb3-931e-003332ff6243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dc327a1-17')
Nov 18 17:24:12 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:24:12 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] No VIF found with MAC fa:16:3e:05:b8:d4, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:24:13 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:13 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:13 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:13 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:13 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:13 user nova-compute[74743]: DEBUG nova.compute.manager [req-67737eab-b3e8-4e19-8508-5317369b731c req-3b1e3606-2d69-47ed-a15b-55a3dd1fa902 service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Received event network-vif-plugged-2dc327a1-177d-4d19-9fb1-ce60b5367a7e {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:24:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-67737eab-b3e8-4e19-8508-5317369b731c req-3b1e3606-2d69-47ed-a15b-55a3dd1fa902 service nova] Acquiring lock "c58db905-7030-44d1-80ca-91e0cd746218-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:24:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-67737eab-b3e8-4e19-8508-5317369b731c req-3b1e3606-2d69-47ed-a15b-55a3dd1fa902 service nova] Lock "c58db905-7030-44d1-80ca-91e0cd746218-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:24:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-67737eab-b3e8-4e19-8508-5317369b731c req-3b1e3606-2d69-47ed-a15b-55a3dd1fa902 service nova] Lock "c58db905-7030-44d1-80ca-91e0cd746218-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:24:13 user nova-compute[74743]: DEBUG nova.compute.manager [req-67737eab-b3e8-4e19-8508-5317369b731c req-3b1e3606-2d69-47ed-a15b-55a3dd1fa902 service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] No waiting events found dispatching network-vif-plugged-2dc327a1-177d-4d19-9fb1-ce60b5367a7e {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:24:13 user nova-compute[74743]: WARNING nova.compute.manager [req-67737eab-b3e8-4e19-8508-5317369b731c req-3b1e3606-2d69-47ed-a15b-55a3dd1fa902 service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Received unexpected event network-vif-plugged-2dc327a1-177d-4d19-9fb1-ce60b5367a7e for instance with vm_state shelved_offloaded and task_state spawning.
Nov 18 17:24:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:15 user nova-compute[74743]: DEBUG nova.compute.manager [req-b3dc161c-86fb-4d07-b7b0-6d06f63bb527 req-ccc7a16f-27e0-4721-8ce5-dbd2b87bab45 service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Received event network-vif-plugged-2dc327a1-177d-4d19-9fb1-ce60b5367a7e {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:24:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b3dc161c-86fb-4d07-b7b0-6d06f63bb527 req-ccc7a16f-27e0-4721-8ce5-dbd2b87bab45 service nova] Acquiring lock "c58db905-7030-44d1-80ca-91e0cd746218-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:24:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b3dc161c-86fb-4d07-b7b0-6d06f63bb527 req-ccc7a16f-27e0-4721-8ce5-dbd2b87bab45 service nova] Lock "c58db905-7030-44d1-80ca-91e0cd746218-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:24:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b3dc161c-86fb-4d07-b7b0-6d06f63bb527 req-ccc7a16f-27e0-4721-8ce5-dbd2b87bab45 service nova] Lock "c58db905-7030-44d1-80ca-91e0cd746218-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:24:15 user nova-compute[74743]: DEBUG nova.compute.manager [req-b3dc161c-86fb-4d07-b7b0-6d06f63bb527 req-ccc7a16f-27e0-4721-8ce5-dbd2b87bab45 service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] No waiting events found dispatching network-vif-plugged-2dc327a1-177d-4d19-9fb1-ce60b5367a7e {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:24:15 user nova-compute[74743]: WARNING nova.compute.manager [req-b3dc161c-86fb-4d07-b7b0-6d06f63bb527 req-ccc7a16f-27e0-4721-8ce5-dbd2b87bab45 service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Received unexpected event network-vif-plugged-2dc327a1-177d-4d19-9fb1-ce60b5367a7e for instance with vm_state shelved_offloaded and task_state spawning.
Nov 18 17:24:15 user nova-compute[74743]: DEBUG nova.compute.manager [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:24:15 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Guest created on hypervisor {{(pid=74743) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 17:24:15 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Instance spawned successfully.
Nov 18 17:24:16 user nova-compute[74743]: DEBUG nova.compute.manager [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:24:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-bf992e8e-9e66-48dd-aae0-cb0d4c629603 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "c58db905-7030-44d1-80ca-91e0cd746218" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.070s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:24:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:23 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:24 user nova-compute[74743]: DEBUG nova.compute.manager [req-f4165c0e-bd37-40dd-b45a-f6d93893d6e0 req-5510338c-82e9-4f09-8e97-e235d64331c4 service nova] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Received event network-changed-1db2129d-7ee3-4c25-9b9a-3cc962555092 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:24:24 user nova-compute[74743]: DEBUG nova.compute.manager [req-f4165c0e-bd37-40dd-b45a-f6d93893d6e0 req-5510338c-82e9-4f09-8e97-e235d64331c4 service nova] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Refreshing instance network info cache due to event network-changed-1db2129d-7ee3-4c25-9b9a-3cc962555092. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:24:24 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f4165c0e-bd37-40dd-b45a-f6d93893d6e0 req-5510338c-82e9-4f09-8e97-e235d64331c4 service nova] Acquiring lock "refresh_cache-0d0a7608-0050-4e0e-a9d3-aa884a716aa8" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:24:24 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f4165c0e-bd37-40dd-b45a-f6d93893d6e0 req-5510338c-82e9-4f09-8e97-e235d64331c4 service nova] Acquired lock "refresh_cache-0d0a7608-0050-4e0e-a9d3-aa884a716aa8" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:24:24 user nova-compute[74743]: DEBUG nova.network.neutron [req-f4165c0e-bd37-40dd-b45a-f6d93893d6e0 req-5510338c-82e9-4f09-8e97-e235d64331c4 service nova] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Refreshing network info cache for port 1db2129d-7ee3-4c25-9b9a-3cc962555092 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:24:24 user nova-compute[74743]: DEBUG nova.network.neutron [req-f4165c0e-bd37-40dd-b45a-f6d93893d6e0 req-5510338c-82e9-4f09-8e97-e235d64331c4 service nova] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Updated VIF entry in instance network info cache for port 1db2129d-7ee3-4c25-9b9a-3cc962555092. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:24:24 user nova-compute[74743]: DEBUG nova.network.neutron [req-f4165c0e-bd37-40dd-b45a-f6d93893d6e0 req-5510338c-82e9-4f09-8e97-e235d64331c4 service nova] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Updating instance_info_cache with network_info: [{"id": "1db2129d-7ee3-4c25-9b9a-3cc962555092", "address": "fa:16:3e:b5:02:28", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db2129d-7e", "ovs_interfaceid": "1db2129d-7ee3-4c25-9b9a-3cc962555092", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:24:24 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f4165c0e-bd37-40dd-b45a-f6d93893d6e0 req-5510338c-82e9-4f09-8e97-e235d64331c4 service nova] Releasing lock "refresh_cache-0d0a7608-0050-4e0e-a9d3-aa884a716aa8" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:24:25 user nova-compute[74743]: DEBUG nova.compute.manager [req-7eccc03a-b19b-43d0-b8c9-1d0b3acab892 req-d6945657-defb-4098-bb84-906ae81b6bcf service nova] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Received event network-changed-1db2129d-7ee3-4c25-9b9a-3cc962555092 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:24:25 user nova-compute[74743]: DEBUG nova.compute.manager [req-7eccc03a-b19b-43d0-b8c9-1d0b3acab892 req-d6945657-defb-4098-bb84-906ae81b6bcf service nova] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Refreshing instance network info cache due to event network-changed-1db2129d-7ee3-4c25-9b9a-3cc962555092. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:24:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-7eccc03a-b19b-43d0-b8c9-1d0b3acab892 req-d6945657-defb-4098-bb84-906ae81b6bcf service nova] Acquiring lock "refresh_cache-0d0a7608-0050-4e0e-a9d3-aa884a716aa8" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:24:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-7eccc03a-b19b-43d0-b8c9-1d0b3acab892 req-d6945657-defb-4098-bb84-906ae81b6bcf service nova] Acquired lock "refresh_cache-0d0a7608-0050-4e0e-a9d3-aa884a716aa8" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:24:25 user nova-compute[74743]: DEBUG nova.network.neutron [req-7eccc03a-b19b-43d0-b8c9-1d0b3acab892 req-d6945657-defb-4098-bb84-906ae81b6bcf service nova] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Refreshing network info cache for port 1db2129d-7ee3-4c25-9b9a-3cc962555092 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:24:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-add52eb9-6f48-43cf-b322-0895c1b9e089 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "0d0a7608-0050-4e0e-a9d3-aa884a716aa8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:24:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-add52eb9-6f48-43cf-b322-0895c1b9e089 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "0d0a7608-0050-4e0e-a9d3-aa884a716aa8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:24:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-add52eb9-6f48-43cf-b322-0895c1b9e089 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "0d0a7608-0050-4e0e-a9d3-aa884a716aa8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:24:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-add52eb9-6f48-43cf-b322-0895c1b9e089 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "0d0a7608-0050-4e0e-a9d3-aa884a716aa8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:24:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-add52eb9-6f48-43cf-b322-0895c1b9e089 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "0d0a7608-0050-4e0e-a9d3-aa884a716aa8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:24:25 user nova-compute[74743]: INFO nova.compute.manager [None req-add52eb9-6f48-43cf-b322-0895c1b9e089 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Terminating instance
Nov 18 17:24:25 user nova-compute[74743]: DEBUG nova.compute.manager [None req-add52eb9-6f48-43cf-b322-0895c1b9e089 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Start destroying the instance on the hypervisor. {{(pid=74743) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 17:24:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:25 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:24:25 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Cleaning up deleted instances {{(pid=74743) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 18 17:24:25 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] There are 0 instances to clean {{(pid=74743) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 18 17:24:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:25 user nova-compute[74743]: DEBUG nova.network.neutron [req-7eccc03a-b19b-43d0-b8c9-1d0b3acab892 req-d6945657-defb-4098-bb84-906ae81b6bcf service nova] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Updated VIF entry in instance network info cache for port 1db2129d-7ee3-4c25-9b9a-3cc962555092. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:24:25 user nova-compute[74743]: DEBUG nova.network.neutron [req-7eccc03a-b19b-43d0-b8c9-1d0b3acab892 req-d6945657-defb-4098-bb84-906ae81b6bcf service nova] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Updating instance_info_cache with network_info: [{"id": "1db2129d-7ee3-4c25-9b9a-3cc962555092", "address": "fa:16:3e:b5:02:28", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db2129d-7e", "ovs_interfaceid": "1db2129d-7ee3-4c25-9b9a-3cc962555092", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:24:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-7eccc03a-b19b-43d0-b8c9-1d0b3acab892 req-d6945657-defb-4098-bb84-906ae81b6bcf service nova] Releasing lock "refresh_cache-0d0a7608-0050-4e0e-a9d3-aa884a716aa8" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:24:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:26 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Instance destroyed successfully.
Nov 18 17:24:26 user nova-compute[74743]: DEBUG nova.objects.instance [None req-add52eb9-6f48-43cf-b322-0895c1b9e089 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lazy-loading 'resources' on Instance uuid 0d0a7608-0050-4e0e-a9d3-aa884a716aa8 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-add52eb9-6f48-43cf-b322-0895c1b9e089 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:22:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1956519765',display_name='tempest-TestVolumeBootPattern-server-1956519765',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1956519765',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOLvs8QktAbg6ubYzS1yyIzjK6/SEgIlSEhHuVaKm0b6bpmV4klO8yadOBEcp58HtUXwfad9vILFBUP0iHELOBhABjjRYYSI0ECkBhwEERqTkNNauBgT8rgOot2Bwx6w0A==',key_name='tempest-TestVolumeBootPattern-2140749553',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:22:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a956c4d6e4304d34872ecf989279c886',ramdisk_id='',reservation_id='r-4tnngg14',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1373443944',owner_user_name='tempest-TestVolumeBootPattern-1373443944-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:22:45Z,user_data=None,user_id='89ce0d4bf7234c348b9b1a8979609c7b',uuid=0d0a7608-0050-4e0e-a9d3-aa884a716aa8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1db2129d-7ee3-4c25-9b9a-3cc962555092", "address": "fa:16:3e:b5:02:28", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db2129d-7e", "ovs_interfaceid": "1db2129d-7ee3-4c25-9b9a-3cc962555092", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-add52eb9-6f48-43cf-b322-0895c1b9e089 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Converting VIF {"id": "1db2129d-7ee3-4c25-9b9a-3cc962555092", "address": "fa:16:3e:b5:02:28", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db2129d-7e", "ovs_interfaceid": "1db2129d-7ee3-4c25-9b9a-3cc962555092", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-add52eb9-6f48-43cf-b322-0895c1b9e089 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:02:28,bridge_name='br-int',has_traffic_filtering=True,id=1db2129d-7ee3-4c25-9b9a-3cc962555092,network=Network(fc55f18a-b779-4b04-8828-278ecd62211a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1db2129d-7e') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG os_vif [None req-add52eb9-6f48-43cf-b322-0895c1b9e089 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:02:28,bridge_name='br-int',has_traffic_filtering=True,id=1db2129d-7ee3-4c25-9b9a-3cc962555092,network=Network(fc55f18a-b779-4b04-8828-278ecd62211a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1db2129d-7e') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1db2129d-7e, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0a76b1fb-6a34-492d-bcaa-43750da53d66) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:24:26 user nova-compute[74743]: INFO os_vif [None req-add52eb9-6f48-43cf-b322-0895c1b9e089 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:02:28,bridge_name='br-int',has_traffic_filtering=True,id=1db2129d-7ee3-4c25-9b9a-3cc962555092,network=Network(fc55f18a-b779-4b04-8828-278ecd62211a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1db2129d-7e')
Nov 18 17:24:26 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-add52eb9-6f48-43cf-b322-0895c1b9e089 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] calling os-brick to detach iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-add52eb9-6f48-43cf-b322-0895c1b9e089 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, {'target_iqn': 'iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NZwdmOVj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:24:26 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-add52eb9-6f48-43cf-b322-0895c1b9e089 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:24:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-add52eb9-6f48-43cf-b322-0895c1b9e089 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-add52eb9-6f48-43cf-b322-0895c1b9e089 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[6070a938-07a2-4d18-8ed6-e49f02ad4451]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-add52eb9-6f48-43cf-b322-0895c1b9e089 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 17:24:26 user nova-compute[74743]: No targets found.
Nov 18 17:24:26 user nova-compute[74743]: iSNS:
Nov 18 17:24:26 user nova-compute[74743]: No targets found.
Nov 18 17:24:26 user nova-compute[74743]: STATIC:
Nov 18 17:24:26 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539
Nov 18 17:24:26 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:24:26 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:24:26 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127
Nov 18 17:24:26 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:24:26 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:24:26 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2
Nov 18 17:24:26 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:24:26 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:24:26 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb
Nov 18 17:24:26 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:24:26 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:24:26 user nova-compute[74743]: FIRMWARE:
Nov 18 17:24:26 user nova-compute[74743]: No targets found.
Nov 18 17:24:26 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-add52eb9-6f48-43cf-b322-0895c1b9e089 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 17:24:26 user nova-compute[74743]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 17:24:26 user nova-compute[74743]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74743) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-add52eb9-6f48-43cf-b322-0895c1b9e089 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539', 0)] {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a15d383-fa93-454f-b547-432eaa42e46a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[103d8ce9-72a6-4c97-9577-5b5843910cd6]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-add52eb9-6f48-43cf-b322-0895c1b9e089 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:24:26 user nova-compute[74743]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 (non-flash)
Nov 18 17:24:26 user nova-compute[74743]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb (non-flash)
Nov 18 17:24:26 user nova-compute[74743]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539 (non-flash)
Nov 18 17:24:26 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-add52eb9-6f48-43cf-b322-0895c1b9e089 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:24:26 user nova-compute[74743]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 (non-flash)
Nov 18 17:24:26 user nova-compute[74743]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb (non-flash)
Nov 18 17:24:26 user nova-compute[74743]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539 (non-flash)
Nov 18 17:24:26 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-add52eb9-6f48-43cf-b322-0895c1b9e089 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb082648b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539'): ({'sde'}, set())}) {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-add52eb9-6f48-43cf-b322-0895c1b9e089 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Removing single pathed devices sde {{(pid=74743) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG nova.compute.manager [req-680a24a8-711e-4d02-b5ed-5699bb178306 req-2a87639c-0049-4009-9144-59ab6afb2546 service nova] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Received event network-vif-unplugged-1db2129d-7ee3-4c25-9b9a-3cc962555092 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-680a24a8-711e-4d02-b5ed-5699bb178306 req-2a87639c-0049-4009-9144-59ab6afb2546 service nova] Acquiring lock "0d0a7608-0050-4e0e-a9d3-aa884a716aa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-680a24a8-711e-4d02-b5ed-5699bb178306 req-2a87639c-0049-4009-9144-59ab6afb2546 service nova] Lock "0d0a7608-0050-4e0e-a9d3-aa884a716aa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-680a24a8-711e-4d02-b5ed-5699bb178306 req-2a87639c-0049-4009-9144-59ab6afb2546 service nova] Lock "0d0a7608-0050-4e0e-a9d3-aa884a716aa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG nova.compute.manager [req-680a24a8-711e-4d02-b5ed-5699bb178306 req-2a87639c-0049-4009-9144-59ab6afb2546 service nova] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] No waiting events found dispatching network-vif-unplugged-1db2129d-7ee3-4c25-9b9a-3cc962555092 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG nova.compute.manager [req-680a24a8-711e-4d02-b5ed-5699bb178306 req-2a87639c-0049-4009-9144-59ab6afb2546 service nova] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Received event network-vif-unplugged-1db2129d-7ee3-4c25-9b9a-3cc962555092 for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG nova.compute.manager [req-680a24a8-711e-4d02-b5ed-5699bb178306 req-2a87639c-0049-4009-9144-59ab6afb2546 service nova] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Received event network-vif-plugged-1db2129d-7ee3-4c25-9b9a-3cc962555092 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-680a24a8-711e-4d02-b5ed-5699bb178306 req-2a87639c-0049-4009-9144-59ab6afb2546 service nova] Acquiring lock "0d0a7608-0050-4e0e-a9d3-aa884a716aa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-680a24a8-711e-4d02-b5ed-5699bb178306 req-2a87639c-0049-4009-9144-59ab6afb2546 service nova] Lock "0d0a7608-0050-4e0e-a9d3-aa884a716aa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-680a24a8-711e-4d02-b5ed-5699bb178306 req-2a87639c-0049-4009-9144-59ab6afb2546 service nova] Lock "0d0a7608-0050-4e0e-a9d3-aa884a716aa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG nova.compute.manager [req-680a24a8-711e-4d02-b5ed-5699bb178306 req-2a87639c-0049-4009-9144-59ab6afb2546 service nova] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] No waiting events found dispatching network-vif-plugged-1db2129d-7ee3-4c25-9b9a-3cc962555092 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:24:26 user nova-compute[74743]: WARNING nova.compute.manager [req-680a24a8-711e-4d02-b5ed-5699bb178306 req-2a87639c-0049-4009-9144-59ab6afb2546 service nova] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Received unexpected event network-vif-plugged-1db2129d-7ee3-4c25-9b9a-3cc962555092 for instance with vm_state active and task_state deleting.
Nov 18 17:24:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.045s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[892d6617-9cb5-4554-9d70-f88ca1f5b659]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96efcc2-5917-4bf4-ba37-fbec8f8c8ccb]: (4, ('ok\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-add52eb9-6f48-43cf-b322-0895c1b9e089 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Flushing IO for device /dev/sde {{(pid=74743) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e39367-98a5-429a-9cdd-b77e3ff92b6a]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-add52eb9-6f48-43cf-b322-0895c1b9e089 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74743) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46aff6d-be90-4868-bef9-c357d14c21a5]: (4, ('1', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-add52eb9-6f48-43cf-b322-0895c1b9e089 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-add52eb9-6f48-43cf-b322-0895c1b9e089 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] SCSI volumes sde have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26161346136636364', '/dev/disk/by-id/scsi-1SCST_BIO12d69e5f-aa4a6ccd0c66f484', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_12d69e5f') {{(pid=85244) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[4573b3c0-f67e-4a85-9064-7814cec733de]: (4, None) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-add52eb9-6f48-43cf-b322-0895c1b9e089 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539')] {{(pid=74743) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[25bbd65e-eed1-4a4a-9d24-2ef36b6c32cc]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-add52eb9-6f48-43cf-b322-0895c1b9e089 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539 -p 172.16.0.220:3260 --logout {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[063091f6-4b63-4bbd-bc6d-55f2f53a23b0]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-add52eb9-6f48-43cf-b322-0895c1b9e089 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539, portal: 172.16.0.220,3260]
Nov 18 17:24:26 user nova-compute[74743]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539, portal: 172.16.0.220,3260] successful.
Nov 18 17:24:26 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539 -p 172.16.0.220:3260 --op delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b49c858-89a8-401d-bb73-d4ee0c2f4539 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[504e4a18-887a-49ff-9c6c-c6c282269fbe]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-add52eb9-6f48-43cf-b322-0895c1b9e089 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-add52eb9-6f48-43cf-b322-0895c1b9e089 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.383s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-add52eb9-6f48-43cf-b322-0895c1b9e089 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] <== disconnect_volume: return (385ms) None {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-add52eb9-6f48-43cf-b322-0895c1b9e089 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Disconnected iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 17:24:26 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-add52eb9-6f48-43cf-b322-0895c1b9e089 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Deleting instance files /opt/stack/data/nova/instances/0d0a7608-0050-4e0e-a9d3-aa884a716aa8_del
Nov 18 17:24:26 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-add52eb9-6f48-43cf-b322-0895c1b9e089 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Deletion of /opt/stack/data/nova/instances/0d0a7608-0050-4e0e-a9d3-aa884a716aa8_del complete
Nov 18 17:24:26 user nova-compute[74743]: INFO nova.compute.manager [None req-add52eb9-6f48-43cf-b322-0895c1b9e089 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Took 1.32 seconds to destroy the instance on the hypervisor.
Nov 18 17:24:26 user nova-compute[74743]: DEBUG oslo.service.loopingcall [None req-add52eb9-6f48-43cf-b322-0895c1b9e089 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74743) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG nova.compute.manager [-] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Deallocating network for instance {{(pid=74743) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] deallocate_for_instance() {{(pid=74743) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 17:24:26 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:24:27 user nova-compute[74743]: INFO nova.compute.manager [-] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Took 0.46 seconds to deallocate network for instance.
Nov 18 17:24:27 user nova-compute[74743]: DEBUG nova.compute.manager [req-e7588b74-b494-48b1-8ee5-336c71f25df1 req-0b0ab3f2-ba80-4092-a9b3-5f5fc09a47a8 service nova] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Received event network-vif-deleted-1db2129d-7ee3-4c25-9b9a-3cc962555092 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:24:27 user nova-compute[74743]: INFO nova.compute.manager [None req-add52eb9-6f48-43cf-b322-0895c1b9e089 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 0d0a7608-0050-4e0e-a9d3-aa884a716aa8] Took 0.92 seconds to detach 1 volumes for instance.
Nov 18 17:24:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-add52eb9-6f48-43cf-b322-0895c1b9e089 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:24:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-add52eb9-6f48-43cf-b322-0895c1b9e089 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:24:28 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-add52eb9-6f48-43cf-b322-0895c1b9e089 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:24:28 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-add52eb9-6f48-43cf-b322-0895c1b9e089 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:24:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-add52eb9-6f48-43cf-b322-0895c1b9e089 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.292s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:24:28 user nova-compute[74743]: INFO nova.scheduler.client.report [None req-add52eb9-6f48-43cf-b322-0895c1b9e089 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Deleted allocations for instance 0d0a7608-0050-4e0e-a9d3-aa884a716aa8
Nov 18 17:24:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-add52eb9-6f48-43cf-b322-0895c1b9e089 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "0d0a7608-0050-4e0e-a9d3-aa884a716aa8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.182s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:24:28 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:24:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:31 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:32 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:24:32 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74743) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 17:24:33 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:24:33 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:24:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:35 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:35 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:24:35 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:24:36 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:37 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:24:37 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Starting heal instance info cache {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 17:24:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "refresh_cache-789583c2-1c04-4510-a37e-0e9b7d3a0971" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:24:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquired lock "refresh_cache-789583c2-1c04-4510-a37e-0e9b7d3a0971" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:24:37 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Forcefully refreshing network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 17:24:38 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Updating instance_info_cache with network_info: [{"id": "db8b331f-9b3f-472b-968a-2151da14f567", "address": "fa:16:3e:50:6a:16", "network": {"id": "1bbf6aff-4048-4212-a716-d0628575bfd0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc0fda74575d488a94e2dcfdc016598c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb8b331f-9b", "ovs_interfaceid": "db8b331f-9b3f-472b-968a-2151da14f567", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:24:38 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Releasing lock "refresh_cache-789583c2-1c04-4510-a37e-0e9b7d3a0971" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:24:38 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Updated the network info_cache for instance {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 17:24:38 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:24:38 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:24:38 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:24:38 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:24:38 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:24:38 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Auditing locally available compute resources for user (node: user) {{(pid=74743) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 17:24:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/789583c2-1c04-4510-a37e-0e9b7d3a0971/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:24:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/789583c2-1c04-4510-a37e-0e9b7d3a0971/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:24:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/789583c2-1c04-4510-a37e-0e9b7d3a0971/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:24:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/789583c2-1c04-4510-a37e-0e9b7d3a0971/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:24:39 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:24:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93772071-cb21-4f4e-8b07-c55be8cf7bea/disk.rescue --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:24:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93772071-cb21-4f4e-8b07-c55be8cf7bea/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:24:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93772071-cb21-4f4e-8b07-c55be8cf7bea/disk.rescue --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:24:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93772071-cb21-4f4e-8b07-c55be8cf7bea/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:24:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:24:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:24:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:24:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:24:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fd86416-72c2-45e5-814d-9195b4cfcc61/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:24:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fd86416-72c2-45e5-814d-9195b4cfcc61/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:24:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fd86416-72c2-45e5-814d-9195b4cfcc61/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:24:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fd86416-72c2-45e5-814d-9195b4cfcc61/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:24:40 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:24:40 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:24:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c58db905-7030-44d1-80ca-91e0cd746218/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:24:40 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c58db905-7030-44d1-80ca-91e0cd746218/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:24:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c58db905-7030-44d1-80ca-91e0cd746218/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:24:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c58db905-7030-44d1-80ca-91e0cd746218/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:24:41 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:24:41 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:24:41 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Hypervisor/Node resource view: name=user free_ram=8097MB free_disk=25.09769058227539GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74743) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 17:24:41 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:24:41 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:24:41 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:41 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance aefe3db1-b9bb-4cce-aa31-d0b6684ad791 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:24:41 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance f649143e-f7db-475a-bbe5-d5e7316caac3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:24:41 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 789583c2-1c04-4510-a37e-0e9b7d3a0971 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:24:41 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 9cbdffd6-df57-4bab-b69c-b41a2718fd68 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:24:41 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 93772071-cb21-4f4e-8b07-c55be8cf7bea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:24:41 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 1fd86416-72c2-45e5-814d-9195b4cfcc61 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:24:41 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance c58db905-7030-44d1-80ca-91e0cd746218 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:24:41 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 17:24:41 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 17:24:41 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Refreshing inventories for resource provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 18 17:24:41 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Updating ProviderTree inventory for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 18 17:24:41 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Updating inventory in ProviderTree for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 18 17:24:41 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Refreshing aggregate associations for resource provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8, aggregates: None {{(pid=74743) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 18 17:24:41 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Refreshing trait associations for resource provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=74743) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 18 17:24:41 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:24:41 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:24:41 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Compute_service record updated for user:user {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 17:24:41 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.587s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:24:41 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:24:41 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Cleaning up deleted instances with incomplete migration  {{(pid=74743) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 18 17:24:42 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:24:45 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:51 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:24:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Acquiring lock "7e0b7c0c-a4ad-4ccd-b60a-721070a57f98" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:24:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "7e0b7c0c-a4ad-4ccd-b60a-721070a57f98" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:24:53 user nova-compute[74743]: DEBUG nova.compute.manager [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Starting instance... {{(pid=74743) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 17:24:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:24:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:24:53 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74743) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 17:24:53 user nova-compute[74743]: INFO nova.compute.claims [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Claim successful on node user
Nov 18 17:24:53 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:24:53 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:24:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.358s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:24:53 user nova-compute[74743]: DEBUG nova.compute.manager [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Start building networks asynchronously for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 17:24:54 user nova-compute[74743]: DEBUG nova.compute.manager [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Allocating IP information in the background. {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 17:24:54 user nova-compute[74743]: DEBUG nova.network.neutron [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] allocate_for_instance() {{(pid=74743) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 17:24:54 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 17:24:54 user nova-compute[74743]: DEBUG nova.compute.manager [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Start building block device mappings for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 17:24:54 user nova-compute[74743]: DEBUG nova.policy [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '52673e9f58e44abc8f9bd60d066c4197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38303e1b311044deb8c833ed3299ce88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74743) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 17:24:54 user nova-compute[74743]: DEBUG nova.compute.manager [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Start spawning the instance on the hypervisor. {{(pid=74743) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 17:24:54 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Creating instance directory {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 17:24:54 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Creating image(s)
Nov 18 17:24:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Acquiring lock "/opt/stack/data/nova/instances/7e0b7c0c-a4ad-4ccd-b60a-721070a57f98/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:24:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "/opt/stack/data/nova/instances/7e0b7c0c-a4ad-4ccd-b60a-721070a57f98/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:24:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "/opt/stack/data/nova/instances/7e0b7c0c-a4ad-4ccd-b60a-721070a57f98/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:24:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Acquiring lock "9d921a6fc57b10891f00ee1869f3c43a4c3e34ab" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:24:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "9d921a6fc57b10891f00ee1869f3c43a4c3e34ab" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:24:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d921a6fc57b10891f00ee1869f3c43a4c3e34ab.part --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:24:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d921a6fc57b10891f00ee1869f3c43a4c3e34ab.part --force-share --output=json" returned: 0 in 0.172s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:24:54 user nova-compute[74743]: DEBUG nova.virt.images [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] 2cbdd988-3c92-4be4-9d1b-ab72b4bf2a9b was qcow2, converting to raw {{(pid=74743) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 18 17:24:54 user nova-compute[74743]: DEBUG nova.privsep.utils [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74743) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 18 17:24:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9d921a6fc57b10891f00ee1869f3c43a4c3e34ab.part /opt/stack/data/nova/instances/_base/9d921a6fc57b10891f00ee1869f3c43a4c3e34ab.converted {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:24:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9d921a6fc57b10891f00ee1869f3c43a4c3e34ab.part /opt/stack/data/nova/instances/_base/9d921a6fc57b10891f00ee1869f3c43a4c3e34ab.converted" returned: 0 in 0.161s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:24:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d921a6fc57b10891f00ee1869f3c43a4c3e34ab.converted --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:24:55 user nova-compute[74743]: DEBUG nova.network.neutron [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Successfully created port: 3387dc52-f4d5-438c-a2c4-cee4fd142694 {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:24:55 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d921a6fc57b10891f00ee1869f3c43a4c3e34ab.converted --force-share --output=json" returned: 0 in 0.202s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:24:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "9d921a6fc57b10891f00ee1869f3c43a4c3e34ab" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.917s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:24:55 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d921a6fc57b10891f00ee1869f3c43a4c3e34ab --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:24:55 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d921a6fc57b10891f00ee1869f3c43a4c3e34ab --force-share --output=json" returned: 0 in 0.184s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:24:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Acquiring lock "9d921a6fc57b10891f00ee1869f3c43a4c3e34ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:24:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "9d921a6fc57b10891f00ee1869f3c43a4c3e34ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:24:55 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d921a6fc57b10891f00ee1869f3c43a4c3e34ab --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:24:55 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d921a6fc57b10891f00ee1869f3c43a4c3e34ab --force-share --output=json" returned: 0 in 0.177s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:24:55 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d921a6fc57b10891f00ee1869f3c43a4c3e34ab,backing_fmt=raw /opt/stack/data/nova/instances/7e0b7c0c-a4ad-4ccd-b60a-721070a57f98/disk 1073741824 {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:24:55 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d921a6fc57b10891f00ee1869f3c43a4c3e34ab,backing_fmt=raw /opt/stack/data/nova/instances/7e0b7c0c-a4ad-4ccd-b60a-721070a57f98/disk 1073741824" returned: 0 in 0.048s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:24:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "9d921a6fc57b10891f00ee1869f3c43a4c3e34ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:24:55 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d921a6fc57b10891f00ee1869f3c43a4c3e34ab --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:24:55 user nova-compute[74743]: DEBUG nova.network.neutron [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Successfully updated port: 3387dc52-f4d5-438c-a2c4-cee4fd142694 {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:24:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Acquiring lock "refresh_cache-7e0b7c0c-a4ad-4ccd-b60a-721070a57f98" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:24:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Acquired lock "refresh_cache-7e0b7c0c-a4ad-4ccd-b60a-721070a57f98" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:24:55 user nova-compute[74743]: DEBUG nova.network.neutron [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:24:55 user nova-compute[74743]: DEBUG nova.compute.manager [req-48a75c5a-6535-47e2-ace7-bee44b626689 req-fa952c14-6a84-440c-9e8b-b5d1667ca09f service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Received event network-changed-3387dc52-f4d5-438c-a2c4-cee4fd142694 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:24:55 user nova-compute[74743]: DEBUG nova.compute.manager [req-48a75c5a-6535-47e2-ace7-bee44b626689 req-fa952c14-6a84-440c-9e8b-b5d1667ca09f service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Refreshing instance network info cache due to event network-changed-3387dc52-f4d5-438c-a2c4-cee4fd142694. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:24:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-48a75c5a-6535-47e2-ace7-bee44b626689 req-fa952c14-6a84-440c-9e8b-b5d1667ca09f service nova] Acquiring lock "refresh_cache-7e0b7c0c-a4ad-4ccd-b60a-721070a57f98" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:24:55 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d921a6fc57b10891f00ee1869f3c43a4c3e34ab --force-share --output=json" returned: 0 in 0.182s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:24:55 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7e0b7c0c-a4ad-4ccd-b60a-721070a57f98/disk. size=1073741824 {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 17:24:55 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0b7c0c-a4ad-4ccd-b60a-721070a57f98/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:24:55 user nova-compute[74743]: DEBUG nova.network.neutron [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:24:55 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0b7c0c-a4ad-4ccd-b60a-721070a57f98/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:24:55 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Cannot resize image /opt/stack/data/nova/instances/7e0b7c0c-a4ad-4ccd-b60a-721070a57f98/disk to a smaller size. {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 17:24:55 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Created local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 17:24:55 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Ensure instance console log exists: /opt/stack/data/nova/instances/7e0b7c0c-a4ad-4ccd-b60a-721070a57f98/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:24:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:24:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:24:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:24:56 user nova-compute[74743]: DEBUG nova.network.neutron [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Updating instance_info_cache with network_info: [{"id": "3387dc52-f4d5-438c-a2c4-cee4fd142694", "address": "fa:16:3e:a3:43:e6", "network": {"id": "cd6d2dbc-0950-412a-ab9d-cf7615c06eb8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1261309930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38303e1b311044deb8c833ed3299ce88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3387dc52-f4", "ovs_interfaceid": "3387dc52-f4d5-438c-a2c4-cee4fd142694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:24:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Releasing lock "refresh_cache-7e0b7c0c-a4ad-4ccd-b60a-721070a57f98" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:24:56 user nova-compute[74743]: DEBUG nova.compute.manager [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Instance network_info: |[{"id": "3387dc52-f4d5-438c-a2c4-cee4fd142694", "address": "fa:16:3e:a3:43:e6", "network": {"id": "cd6d2dbc-0950-412a-ab9d-cf7615c06eb8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1261309930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38303e1b311044deb8c833ed3299ce88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3387dc52-f4", "ovs_interfaceid": "3387dc52-f4d5-438c-a2c4-cee4fd142694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 17:24:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-48a75c5a-6535-47e2-ace7-bee44b626689 req-fa952c14-6a84-440c-9e8b-b5d1667ca09f service nova] Acquired lock "refresh_cache-7e0b7c0c-a4ad-4ccd-b60a-721070a57f98" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:24:56 user nova-compute[74743]: DEBUG nova.network.neutron [req-48a75c5a-6535-47e2-ace7-bee44b626689 req-fa952c14-6a84-440c-9e8b-b5d1667ca09f service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Refreshing network info cache for port 3387dc52-f4d5-438c-a2c4-cee4fd142694 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:24:56 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Start _get_guest_xml network_info=[{"id": "3387dc52-f4d5-438c-a2c4-cee4fd142694", "address": "fa:16:3e:a3:43:e6", "network": {"id": "cd6d2dbc-0950-412a-ab9d-cf7615c06eb8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1261309930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38303e1b311044deb8c833ed3299ce88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3387dc52-f4", "ovs_interfaceid": "3387dc52-f4d5-438c-a2c4-cee4fd142694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T17:24:51Z,direct_url=<?>,disk_format='qcow2',id=2cbdd988-3c92-4be4-9d1b-ab72b4bf2a9b,min_disk=0,min_ram=0,name='tempest-scenario-img--1708521592',owner='38303e1b311044deb8c833ed3299ce88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T17:24:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '2cbdd988-3c92-4be4-9d1b-ab72b4bf2a9b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:24:56 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:24:56 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:24:56 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:24:56 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:24:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:24:56 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:24:56 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:24:56 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:24:56 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T17:24:51Z,direct_url=<?>,disk_format='qcow2',id=2cbdd988-3c92-4be4-9d1b-ab72b4bf2a9b,min_disk=0,min_ram=0,name='tempest-scenario-img--1708521592',owner='38303e1b311044deb8c833ed3299ce88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T17:24:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:24:56 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:24:56 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:24:56 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:24:56 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:24:56 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:24:56 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:24:56 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:24:56 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:24:56 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:24:56 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:24:56 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:24:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1296422400',display_name='tempest-TestMinimumBasicScenario-server-1296422400',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1296422400',id=42,image_ref='2cbdd988-3c92-4be4-9d1b-ab72b4bf2a9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwUUdO9jGks9c0A+n2tPlxIhLsdYTWY5b8WeqvnSxjCnoV8hbKg77DG0ZRGZuFyZd3nlzF2C3svuUT1rFJGBTMgqPVD+oaxBIkZx8NfRTTe7QcqPyvElsE8fOGrni7t5w==',key_name='tempest-TestMinimumBasicScenario-1510836974',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='38303e1b311044deb8c833ed3299ce88',ramdisk_id='',reservation_id='r-fjs2drsc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2cbdd988-3c92-4be4-9d1b-ab72b4bf2a9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1229544582',owner_user_name='tempest-TestMinimumBasicScenario-1229544582-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:24:54Z,user_data=None,user_id='52673e9f58e44abc8f9bd60d066c4197',uuid=7e0b7c0c-a4ad-4ccd-b60a-721070a57f98,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3387dc52-f4d5-438c-a2c4-cee4fd142694", "address": "fa:16:3e:a3:43:e6", "network": {"id": "cd6d2dbc-0950-412a-ab9d-cf7615c06eb8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1261309930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38303e1b311044deb8c833ed3299ce88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3387dc52-f4", "ovs_interfaceid": "3387dc52-f4d5-438c-a2c4-cee4fd142694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:24:56 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Converting VIF {"id": "3387dc52-f4d5-438c-a2c4-cee4fd142694", "address": "fa:16:3e:a3:43:e6", "network": {"id": "cd6d2dbc-0950-412a-ab9d-cf7615c06eb8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1261309930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38303e1b311044deb8c833ed3299ce88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3387dc52-f4", "ovs_interfaceid": "3387dc52-f4d5-438c-a2c4-cee4fd142694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:24:56 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:43:e6,bridge_name='br-int',has_traffic_filtering=True,id=3387dc52-f4d5-438c-a2c4-cee4fd142694,network=Network(cd6d2dbc-0950-412a-ab9d-cf7615c06eb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3387dc52-f4') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:24:56 user nova-compute[74743]: DEBUG nova.objects.instance [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lazy-loading 'pci_devices' on Instance uuid 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:24:56 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:24:56 user nova-compute[74743]:   <uuid>7e0b7c0c-a4ad-4ccd-b60a-721070a57f98</uuid>
Nov 18 17:24:56 user nova-compute[74743]:   <name>instance-0000002a</name>
Nov 18 17:24:56 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:24:56 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:24:56 user nova-compute[74743]:   <metadata>
Nov 18 17:24:56 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:24:56 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:24:56 user nova-compute[74743]:       <nova:name>tempest-TestMinimumBasicScenario-server-1296422400</nova:name>
Nov 18 17:24:56 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:24:56</nova:creationTime>
Nov 18 17:24:56 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:24:56 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:24:56 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:24:56 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:24:56 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:24:56 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:24:56 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:24:56 user nova-compute[74743]:       <nova:owner>
Nov 18 17:24:56 user nova-compute[74743]:         <nova:user uuid="52673e9f58e44abc8f9bd60d066c4197">tempest-TestMinimumBasicScenario-1229544582-project-member</nova:user>
Nov 18 17:24:56 user nova-compute[74743]:         <nova:project uuid="38303e1b311044deb8c833ed3299ce88">tempest-TestMinimumBasicScenario-1229544582</nova:project>
Nov 18 17:24:56 user nova-compute[74743]:       </nova:owner>
Nov 18 17:24:56 user nova-compute[74743]:       <nova:root type="image" uuid="2cbdd988-3c92-4be4-9d1b-ab72b4bf2a9b"/>
Nov 18 17:24:56 user nova-compute[74743]:       <nova:ports>
Nov 18 17:24:56 user nova-compute[74743]:         <nova:port uuid="3387dc52-f4d5-438c-a2c4-cee4fd142694">
Nov 18 17:24:56 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 18 17:24:56 user nova-compute[74743]:         </nova:port>
Nov 18 17:24:56 user nova-compute[74743]:       </nova:ports>
Nov 18 17:24:56 user nova-compute[74743]:     </nova:instance>
Nov 18 17:24:56 user nova-compute[74743]:   </metadata>
Nov 18 17:24:56 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:24:56 user nova-compute[74743]:     <system>
Nov 18 17:24:56 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:24:56 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:24:56 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:24:56 user nova-compute[74743]:       <entry name="serial">7e0b7c0c-a4ad-4ccd-b60a-721070a57f98</entry>
Nov 18 17:24:56 user nova-compute[74743]:       <entry name="uuid">7e0b7c0c-a4ad-4ccd-b60a-721070a57f98</entry>
Nov 18 17:24:56 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:24:56 user nova-compute[74743]:     </system>
Nov 18 17:24:56 user nova-compute[74743]:   </sysinfo>
Nov 18 17:24:56 user nova-compute[74743]:   <os>
Nov 18 17:24:56 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:24:56 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:24:56 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:24:56 user nova-compute[74743]:   </os>
Nov 18 17:24:56 user nova-compute[74743]:   <features>
Nov 18 17:24:56 user nova-compute[74743]:     <acpi/>
Nov 18 17:24:56 user nova-compute[74743]:     <apic/>
Nov 18 17:24:56 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:24:56 user nova-compute[74743]:   </features>
Nov 18 17:24:56 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:24:56 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:24:56 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:24:56 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:24:56 user nova-compute[74743]:   </clock>
Nov 18 17:24:56 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:24:56 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:24:56 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:24:56 user nova-compute[74743]:   </cpu>
Nov 18 17:24:56 user nova-compute[74743]:   <devices>
Nov 18 17:24:56 user nova-compute[74743]:     <disk type="file" device="disk">
Nov 18 17:24:56 user nova-compute[74743]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 17:24:56 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/7e0b7c0c-a4ad-4ccd-b60a-721070a57f98/disk"/>
Nov 18 17:24:56 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:24:56 user nova-compute[74743]:     </disk>
Nov 18 17:24:56 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:24:56 user nova-compute[74743]:       <mac address="fa:16:3e:a3:43:e6"/>
Nov 18 17:24:56 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:24:56 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:24:56 user nova-compute[74743]:       <target dev="tap3387dc52-f4"/>
Nov 18 17:24:56 user nova-compute[74743]:     </interface>
Nov 18 17:24:56 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:24:56 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/7e0b7c0c-a4ad-4ccd-b60a-721070a57f98/console.log" append="off"/>
Nov 18 17:24:56 user nova-compute[74743]:     </serial>
Nov 18 17:24:56 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:24:56 user nova-compute[74743]:     <video>
Nov 18 17:24:56 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:24:56 user nova-compute[74743]:     </video>
Nov 18 17:24:56 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:24:56 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:24:56 user nova-compute[74743]:     </rng>
Nov 18 17:24:56 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:24:56 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:24:56 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:24:56 user nova-compute[74743]:     </memballoon>
Nov 18 17:24:56 user nova-compute[74743]:   </devices>
Nov 18 17:24:56 user nova-compute[74743]: </domain>
Nov 18 17:24:56 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:24:56 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:24:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1296422400',display_name='tempest-TestMinimumBasicScenario-server-1296422400',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1296422400',id=42,image_ref='2cbdd988-3c92-4be4-9d1b-ab72b4bf2a9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwUUdO9jGks9c0A+n2tPlxIhLsdYTWY5b8WeqvnSxjCnoV8hbKg77DG0ZRGZuFyZd3nlzF2C3svuUT1rFJGBTMgqPVD+oaxBIkZx8NfRTTe7QcqPyvElsE8fOGrni7t5w==',key_name='tempest-TestMinimumBasicScenario-1510836974',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='38303e1b311044deb8c833ed3299ce88',ramdisk_id='',reservation_id='r-fjs2drsc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2cbdd988-3c92-4be4-9d1b-ab72b4bf2a9b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1229544582',owner_user_name='tempest-TestMinimumBasicScenario-1229544582-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:24:54Z,user_data=None,user_id='52673e9f58e44abc8f9bd60d066c4197',uuid=7e0b7c0c-a4ad-4ccd-b60a-721070a57f98,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3387dc52-f4d5-438c-a2c4-cee4fd142694", "address": "fa:16:3e:a3:43:e6", "network": {"id": "cd6d2dbc-0950-412a-ab9d-cf7615c06eb8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1261309930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38303e1b311044deb8c833ed3299ce88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3387dc52-f4", "ovs_interfaceid": "3387dc52-f4d5-438c-a2c4-cee4fd142694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:24:56 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Converting VIF {"id": "3387dc52-f4d5-438c-a2c4-cee4fd142694", "address": "fa:16:3e:a3:43:e6", "network": {"id": "cd6d2dbc-0950-412a-ab9d-cf7615c06eb8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1261309930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38303e1b311044deb8c833ed3299ce88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3387dc52-f4", "ovs_interfaceid": "3387dc52-f4d5-438c-a2c4-cee4fd142694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:24:56 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:43:e6,bridge_name='br-int',has_traffic_filtering=True,id=3387dc52-f4d5-438c-a2c4-cee4fd142694,network=Network(cd6d2dbc-0950-412a-ab9d-cf7615c06eb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3387dc52-f4') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:24:56 user nova-compute[74743]: DEBUG os_vif [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:43:e6,bridge_name='br-int',has_traffic_filtering=True,id=3387dc52-f4d5-438c-a2c4-cee4fd142694,network=Network(cd6d2dbc-0950-412a-ab9d-cf7615c06eb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3387dc52-f4') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:24:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:24:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:24:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b442aeb5-faa4-5e85-976e-61ac700f8fd2', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:24:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3387dc52-f4, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:24:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3387dc52-f4, col_values=(('qos', UUID('58c89c21-1763-4438-bc63-41db457ede6c')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:24:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3387dc52-f4, col_values=(('external_ids', {'iface-id': '3387dc52-f4d5-438c-a2c4-cee4fd142694', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:43:e6', 'vm-uuid': '7e0b7c0c-a4ad-4ccd-b60a-721070a57f98'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:24:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:24:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:56 user nova-compute[74743]: INFO os_vif [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:43:e6,bridge_name='br-int',has_traffic_filtering=True,id=3387dc52-f4d5-438c-a2c4-cee4fd142694,network=Network(cd6d2dbc-0950-412a-ab9d-cf7615c06eb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3387dc52-f4')
Nov 18 17:24:56 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:24:56 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] No VIF found with MAC fa:16:3e:a3:43:e6, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:24:56 user nova-compute[74743]: DEBUG nova.network.neutron [req-48a75c5a-6535-47e2-ace7-bee44b626689 req-fa952c14-6a84-440c-9e8b-b5d1667ca09f service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Updated VIF entry in instance network info cache for port 3387dc52-f4d5-438c-a2c4-cee4fd142694. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:24:56 user nova-compute[74743]: DEBUG nova.network.neutron [req-48a75c5a-6535-47e2-ace7-bee44b626689 req-fa952c14-6a84-440c-9e8b-b5d1667ca09f service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Updating instance_info_cache with network_info: [{"id": "3387dc52-f4d5-438c-a2c4-cee4fd142694", "address": "fa:16:3e:a3:43:e6", "network": {"id": "cd6d2dbc-0950-412a-ab9d-cf7615c06eb8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1261309930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38303e1b311044deb8c833ed3299ce88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3387dc52-f4", "ovs_interfaceid": "3387dc52-f4d5-438c-a2c4-cee4fd142694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:24:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-48a75c5a-6535-47e2-ace7-bee44b626689 req-fa952c14-6a84-440c-9e8b-b5d1667ca09f service nova] Releasing lock "refresh_cache-7e0b7c0c-a4ad-4ccd-b60a-721070a57f98" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:24:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:57 user nova-compute[74743]: DEBUG nova.compute.manager [req-41767c6c-7cfe-454c-9a03-13b4ef4207dd req-145abab6-532e-4645-8f22-7782167156b5 service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Received event network-vif-plugged-3387dc52-f4d5-438c-a2c4-cee4fd142694 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:24:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-41767c6c-7cfe-454c-9a03-13b4ef4207dd req-145abab6-532e-4645-8f22-7782167156b5 service nova] Acquiring lock "7e0b7c0c-a4ad-4ccd-b60a-721070a57f98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:24:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-41767c6c-7cfe-454c-9a03-13b4ef4207dd req-145abab6-532e-4645-8f22-7782167156b5 service nova] Lock "7e0b7c0c-a4ad-4ccd-b60a-721070a57f98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:24:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-41767c6c-7cfe-454c-9a03-13b4ef4207dd req-145abab6-532e-4645-8f22-7782167156b5 service nova] Lock "7e0b7c0c-a4ad-4ccd-b60a-721070a57f98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:24:57 user nova-compute[74743]: DEBUG nova.compute.manager [req-41767c6c-7cfe-454c-9a03-13b4ef4207dd req-145abab6-532e-4645-8f22-7782167156b5 service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] No waiting events found dispatching network-vif-plugged-3387dc52-f4d5-438c-a2c4-cee4fd142694 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:24:57 user nova-compute[74743]: WARNING nova.compute.manager [req-41767c6c-7cfe-454c-9a03-13b4ef4207dd req-145abab6-532e-4645-8f22-7782167156b5 service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Received unexpected event network-vif-plugged-3387dc52-f4d5-438c-a2c4-cee4fd142694 for instance with vm_state building and task_state spawning.
Nov 18 17:24:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:24:59 user nova-compute[74743]: DEBUG nova.compute.manager [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:24:59 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Guest created on hypervisor {{(pid=74743) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 17:24:59 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Instance spawned successfully.
Nov 18 17:24:59 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 17:24:59 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Found default for hw_cdrom_bus of ide {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:24:59 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Found default for hw_disk_bus of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:24:59 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Found default for hw_input_bus of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:24:59 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Found default for hw_pointer_model of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:24:59 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Found default for hw_video_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:24:59 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Found default for hw_vif_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:24:59 user nova-compute[74743]: INFO nova.compute.manager [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Took 5.59 seconds to spawn the instance on the hypervisor.
Nov 18 17:24:59 user nova-compute[74743]: DEBUG nova.compute.manager [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:24:59 user nova-compute[74743]: INFO nova.compute.manager [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Took 6.28 seconds to build instance.
Nov 18 17:24:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-19281fbc-c038-47ee-b7e1-62ee5b7acc19 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "7e0b7c0c-a4ad-4ccd-b60a-721070a57f98" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.374s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:24:59 user nova-compute[74743]: DEBUG nova.compute.manager [req-a3443466-6183-49eb-a82a-e97c605df0bb req-c0d46c16-4b21-4a4b-8d52-7f3d21204014 service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Received event network-vif-plugged-3387dc52-f4d5-438c-a2c4-cee4fd142694 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:24:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a3443466-6183-49eb-a82a-e97c605df0bb req-c0d46c16-4b21-4a4b-8d52-7f3d21204014 service nova] Acquiring lock "7e0b7c0c-a4ad-4ccd-b60a-721070a57f98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:24:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a3443466-6183-49eb-a82a-e97c605df0bb req-c0d46c16-4b21-4a4b-8d52-7f3d21204014 service nova] Lock "7e0b7c0c-a4ad-4ccd-b60a-721070a57f98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:24:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a3443466-6183-49eb-a82a-e97c605df0bb req-c0d46c16-4b21-4a4b-8d52-7f3d21204014 service nova] Lock "7e0b7c0c-a4ad-4ccd-b60a-721070a57f98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:24:59 user nova-compute[74743]: DEBUG nova.compute.manager [req-a3443466-6183-49eb-a82a-e97c605df0bb req-c0d46c16-4b21-4a4b-8d52-7f3d21204014 service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] No waiting events found dispatching network-vif-plugged-3387dc52-f4d5-438c-a2c4-cee4fd142694 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:24:59 user nova-compute[74743]: WARNING nova.compute.manager [req-a3443466-6183-49eb-a82a-e97c605df0bb req-c0d46c16-4b21-4a4b-8d52-7f3d21204014 service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Received unexpected event network-vif-plugged-3387dc52-f4d5-438c-a2c4-cee4fd142694 for instance with vm_state active and task_state None.
Nov 18 17:25:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:01 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:21 user nova-compute[74743]: DEBUG nova.compute.manager [req-35f581ad-8d83-4513-aef0-2fe5044da93e req-c3368adf-3088-41c7-97a5-53d834351081 service nova] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Received event network-changed-55c54294-3f4d-4199-a9fa-a273016b376b {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:25:21 user nova-compute[74743]: DEBUG nova.compute.manager [req-35f581ad-8d83-4513-aef0-2fe5044da93e req-c3368adf-3088-41c7-97a5-53d834351081 service nova] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Refreshing instance network info cache due to event network-changed-55c54294-3f4d-4199-a9fa-a273016b376b. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:25:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-35f581ad-8d83-4513-aef0-2fe5044da93e req-c3368adf-3088-41c7-97a5-53d834351081 service nova] Acquiring lock "refresh_cache-9cbdffd6-df57-4bab-b69c-b41a2718fd68" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:25:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-35f581ad-8d83-4513-aef0-2fe5044da93e req-c3368adf-3088-41c7-97a5-53d834351081 service nova] Acquired lock "refresh_cache-9cbdffd6-df57-4bab-b69c-b41a2718fd68" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:25:21 user nova-compute[74743]: DEBUG nova.network.neutron [req-35f581ad-8d83-4513-aef0-2fe5044da93e req-c3368adf-3088-41c7-97a5-53d834351081 service nova] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Refreshing network info cache for port 55c54294-3f4d-4199-a9fa-a273016b376b {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:25:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e342f612-6607-4148-a981-2c07573bad38 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "9cbdffd6-df57-4bab-b69c-b41a2718fd68" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:25:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e342f612-6607-4148-a981-2c07573bad38 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "9cbdffd6-df57-4bab-b69c-b41a2718fd68" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:25:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e342f612-6607-4148-a981-2c07573bad38 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "9cbdffd6-df57-4bab-b69c-b41a2718fd68-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:25:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e342f612-6607-4148-a981-2c07573bad38 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "9cbdffd6-df57-4bab-b69c-b41a2718fd68-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:25:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e342f612-6607-4148-a981-2c07573bad38 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "9cbdffd6-df57-4bab-b69c-b41a2718fd68-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:25:21 user nova-compute[74743]: INFO nova.compute.manager [None req-e342f612-6607-4148-a981-2c07573bad38 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Terminating instance
Nov 18 17:25:21 user nova-compute[74743]: DEBUG nova.compute.manager [None req-e342f612-6607-4148-a981-2c07573bad38 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Start destroying the instance on the hypervisor. {{(pid=74743) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 17:25:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:22 user nova-compute[74743]: DEBUG nova.network.neutron [req-35f581ad-8d83-4513-aef0-2fe5044da93e req-c3368adf-3088-41c7-97a5-53d834351081 service nova] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Updated VIF entry in instance network info cache for port 55c54294-3f4d-4199-a9fa-a273016b376b. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:25:22 user nova-compute[74743]: DEBUG nova.network.neutron [req-35f581ad-8d83-4513-aef0-2fe5044da93e req-c3368adf-3088-41c7-97a5-53d834351081 service nova] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Updating instance_info_cache with network_info: [{"id": "55c54294-3f4d-4199-a9fa-a273016b376b", "address": "fa:16:3e:70:96:90", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55c54294-3f", "ovs_interfaceid": "55c54294-3f4d-4199-a9fa-a273016b376b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:25:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-35f581ad-8d83-4513-aef0-2fe5044da93e req-c3368adf-3088-41c7-97a5-53d834351081 service nova] Releasing lock "refresh_cache-9cbdffd6-df57-4bab-b69c-b41a2718fd68" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:25:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:22 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Instance destroyed successfully.
Nov 18 17:25:22 user nova-compute[74743]: DEBUG nova.objects.instance [None req-e342f612-6607-4148-a981-2c07573bad38 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lazy-loading 'resources' on Instance uuid 9cbdffd6-df57-4bab-b69c-b41a2718fd68 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:25:22 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-e342f612-6607-4148-a981-2c07573bad38 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:20:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-260240897',display_name='tempest-TestVolumeBootPattern-server-260240897',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-260240897',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOLvs8QktAbg6ubYzS1yyIzjK6/SEgIlSEhHuVaKm0b6bpmV4klO8yadOBEcp58HtUXwfad9vILFBUP0iHELOBhABjjRYYSI0ECkBhwEERqTkNNauBgT8rgOot2Bwx6w0A==',key_name='tempest-TestVolumeBootPattern-2140749553',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:20:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a956c4d6e4304d34872ecf989279c886',ramdisk_id='',reservation_id='r-pq273w0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1373443944',owner_user_name='tempest-TestVolumeBootPattern-1373443944-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:20:47Z,user_data=None,user_id='89ce0d4bf7234c348b9b1a8979609c7b',uuid=9cbdffd6-df57-4bab-b69c-b41a2718fd68,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "55c54294-3f4d-4199-a9fa-a273016b376b", "address": "fa:16:3e:70:96:90", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55c54294-3f", "ovs_interfaceid": "55c54294-3f4d-4199-a9fa-a273016b376b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:25:22 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-e342f612-6607-4148-a981-2c07573bad38 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Converting VIF {"id": "55c54294-3f4d-4199-a9fa-a273016b376b", "address": "fa:16:3e:70:96:90", "network": {"id": "fc55f18a-b779-4b04-8828-278ecd62211a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1453847100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a956c4d6e4304d34872ecf989279c886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55c54294-3f", "ovs_interfaceid": "55c54294-3f4d-4199-a9fa-a273016b376b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:25:22 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-e342f612-6607-4148-a981-2c07573bad38 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:96:90,bridge_name='br-int',has_traffic_filtering=True,id=55c54294-3f4d-4199-a9fa-a273016b376b,network=Network(fc55f18a-b779-4b04-8828-278ecd62211a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55c54294-3f') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:25:22 user nova-compute[74743]: DEBUG os_vif [None req-e342f612-6607-4148-a981-2c07573bad38 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:96:90,bridge_name='br-int',has_traffic_filtering=True,id=55c54294-3f4d-4199-a9fa-a273016b376b,network=Network(fc55f18a-b779-4b04-8828-278ecd62211a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55c54294-3f') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:25:22 user nova-compute[74743]: DEBUG nova.compute.manager [req-bd41d7db-7926-49e3-a34e-8282d7bbbdfd req-f03dd950-5d44-4716-be97-988f42a7dca4 service nova] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Received event network-changed-044dbd97-bde5-4feb-a5fb-801f22043ae4 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:25:22 user nova-compute[74743]: DEBUG nova.compute.manager [req-bd41d7db-7926-49e3-a34e-8282d7bbbdfd req-f03dd950-5d44-4716-be97-988f42a7dca4 service nova] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Refreshing instance network info cache due to event network-changed-044dbd97-bde5-4feb-a5fb-801f22043ae4. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:25:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-bd41d7db-7926-49e3-a34e-8282d7bbbdfd req-f03dd950-5d44-4716-be97-988f42a7dca4 service nova] Acquiring lock "refresh_cache-1fd86416-72c2-45e5-814d-9195b4cfcc61" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:25:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-bd41d7db-7926-49e3-a34e-8282d7bbbdfd req-f03dd950-5d44-4716-be97-988f42a7dca4 service nova] Acquired lock "refresh_cache-1fd86416-72c2-45e5-814d-9195b4cfcc61" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:25:22 user nova-compute[74743]: DEBUG nova.network.neutron [req-bd41d7db-7926-49e3-a34e-8282d7bbbdfd req-f03dd950-5d44-4716-be97-988f42a7dca4 service nova] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Refreshing network info cache for port 044dbd97-bde5-4feb-a5fb-801f22043ae4 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:25:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap55c54294-3f, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:25:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:25:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aec6ab24-9cc1-453b-b6de-a86c94b47294) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:25:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:22 user nova-compute[74743]: INFO os_vif [None req-e342f612-6607-4148-a981-2c07573bad38 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:96:90,bridge_name='br-int',has_traffic_filtering=True,id=55c54294-3f4d-4199-a9fa-a273016b376b,network=Network(fc55f18a-b779-4b04-8828-278ecd62211a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55c54294-3f')
Nov 18 17:25:22 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e342f612-6607-4148-a981-2c07573bad38 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] calling os-brick to detach iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 17:25:22 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e342f612-6607-4148-a981-2c07573bad38 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, {'target_iqn': 'iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cGqFNkMi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:25:22 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-e342f612-6607-4148-a981-2c07573bad38 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:25:22 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-e342f612-6607-4148-a981-2c07573bad38 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:25:22 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-e342f612-6607-4148-a981-2c07573bad38 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:25:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:25:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:25:22 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20b96bb-9fa8-42eb-b1c1-6f013b0a74fa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:25:22 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e342f612-6607-4148-a981-2c07573bad38 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 17:25:22 user nova-compute[74743]: No targets found.
Nov 18 17:25:22 user nova-compute[74743]: iSNS:
Nov 18 17:25:22 user nova-compute[74743]: No targets found.
Nov 18 17:25:22 user nova-compute[74743]: STATIC:
Nov 18 17:25:22 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127
Nov 18 17:25:22 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:25:22 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:25:22 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2
Nov 18 17:25:22 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:25:22 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:25:22 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb
Nov 18 17:25:22 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:25:22 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:25:22 user nova-compute[74743]: FIRMWARE:
Nov 18 17:25:22 user nova-compute[74743]: No targets found.
Nov 18 17:25:22 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:25:22 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e342f612-6607-4148-a981-2c07573bad38 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 17:25:22 user nova-compute[74743]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 17:25:22 user nova-compute[74743]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74743) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 17:25:22 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e342f612-6607-4148-a981-2c07573bad38 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2', 0)] {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 17:25:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:25:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:25:22 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc9df0f-54fa-4d73-9bfa-b2f74f640a19]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:25:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:25:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:25:22 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a039e639-5f72-4a6d-8f75-45aab1dfb9c1]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:25:22 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e342f612-6607-4148-a981-2c07573bad38 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:25:22 user nova-compute[74743]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 (non-flash)
Nov 18 17:25:22 user nova-compute[74743]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb (non-flash)
Nov 18 17:25:22 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:25:22 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e342f612-6607-4148-a981-2c07573bad38 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:25:22 user nova-compute[74743]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 (non-flash)
Nov 18 17:25:22 user nova-compute[74743]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb (non-flash)
Nov 18 17:25:22 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:25:22 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e342f612-6607-4148-a981-2c07573bad38 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb28298f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2'): ({'sdb'}, set())}) {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 17:25:22 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-e342f612-6607-4148-a981-2c07573bad38 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Removing single pathed devices sdb {{(pid=74743) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 17:25:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:25:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:25:22 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[9123461f-3ad0-47bf-8a4e-8d01801bfb63]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:25:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:25:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:25:23 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[840a1f6d-3672-4c5a-bfbe-bbc069c2d33a]: (4, ('ok\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:25:23 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-e342f612-6607-4148-a981-2c07573bad38 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Flushing IO for device /dev/sdb {{(pid=74743) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 17:25:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:25:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:25:23 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3dec0f8-71f0-4ec7-8d9a-fe4e0164bd04]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:25:23 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-e342f612-6607-4148-a981-2c07573bad38 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74743) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 17:25:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:25:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:25:23 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a498e479-b2a3-482f-af21-67d2d1534c40]: (4, ('1', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:25:23 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-e342f612-6607-4148-a981-2c07573bad38 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 17:25:23 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-e342f612-6607-4148-a981-2c07573bad38 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] SCSI volumes sdb have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 17:25:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e342f612-6607-4148-a981-2c07573bad38 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2')] {{(pid=74743) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 17:25:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:25:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:25:23 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[748cd281-b4dc-4d5e-9969-632720403b5d]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:25:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e342f612-6607-4148-a981-2c07573bad38 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:25:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 -p 172.16.0.220:3260 --logout {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:25:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:25:23 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8912969-dfaf-4f6a-af25-71f50a7f328c]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:25:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e342f612-6607-4148-a981-2c07573bad38 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2, portal: 172.16.0.220,3260]
Nov 18 17:25:23 user nova-compute[74743]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2, portal: 172.16.0.220,3260] successful.
Nov 18 17:25:23 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:25:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 -p 172.16.0.220:3260 --op delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:25:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36baaa29-2acc-4476-9f64-ec76a08f66f2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:25:23 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fccf5a8-371b-4a09-8b8e-1477a89ceb05]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:25:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e342f612-6607-4148-a981-2c07573bad38 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:25:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-e342f612-6607-4148-a981-2c07573bad38 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:25:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e342f612-6607-4148-a981-2c07573bad38 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] <== disconnect_volume: return (342ms) None {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:25:23 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e342f612-6607-4148-a981-2c07573bad38 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Disconnected iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 17:25:23 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-e342f612-6607-4148-a981-2c07573bad38 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Deleting instance files /opt/stack/data/nova/instances/9cbdffd6-df57-4bab-b69c-b41a2718fd68_del
Nov 18 17:25:23 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-e342f612-6607-4148-a981-2c07573bad38 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Deletion of /opt/stack/data/nova/instances/9cbdffd6-df57-4bab-b69c-b41a2718fd68_del complete
Nov 18 17:25:23 user nova-compute[74743]: INFO nova.compute.manager [None req-e342f612-6607-4148-a981-2c07573bad38 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Took 1.31 seconds to destroy the instance on the hypervisor.
Nov 18 17:25:23 user nova-compute[74743]: DEBUG oslo.service.loopingcall [None req-e342f612-6607-4148-a981-2c07573bad38 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74743) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 17:25:23 user nova-compute[74743]: DEBUG nova.compute.manager [-] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Deallocating network for instance {{(pid=74743) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 17:25:23 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] deallocate_for_instance() {{(pid=74743) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 17:25:23 user nova-compute[74743]: DEBUG nova.network.neutron [req-bd41d7db-7926-49e3-a34e-8282d7bbbdfd req-f03dd950-5d44-4716-be97-988f42a7dca4 service nova] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Updated VIF entry in instance network info cache for port 044dbd97-bde5-4feb-a5fb-801f22043ae4. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:25:23 user nova-compute[74743]: DEBUG nova.network.neutron [req-bd41d7db-7926-49e3-a34e-8282d7bbbdfd req-f03dd950-5d44-4716-be97-988f42a7dca4 service nova] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Updating instance_info_cache with network_info: [{"id": "044dbd97-bde5-4feb-a5fb-801f22043ae4", "address": "fa:16:3e:3f:13:af", "network": {"id": "b03d3355-7704-43de-8af7-7a5dc1ee490d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1492507432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5502edf6a6b94cb59d58d52494efc90d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap044dbd97-bd", "ovs_interfaceid": "044dbd97-bde5-4feb-a5fb-801f22043ae4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:25:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-bd41d7db-7926-49e3-a34e-8282d7bbbdfd req-f03dd950-5d44-4716-be97-988f42a7dca4 service nova] Releasing lock "refresh_cache-1fd86416-72c2-45e5-814d-9195b4cfcc61" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:25:23 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:23 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:23 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:23 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:23 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:25:23 user nova-compute[74743]: INFO nova.compute.manager [-] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Took 0.50 seconds to deallocate network for instance.
Nov 18 17:25:23 user nova-compute[74743]: DEBUG nova.compute.manager [req-ec8f1e68-a1ca-42ab-b909-6af30b9d9183 req-a1ec3ec1-66cf-43fd-9ea2-0b7fac340040 service nova] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Received event network-vif-unplugged-55c54294-3f4d-4199-a9fa-a273016b376b {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:25:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ec8f1e68-a1ca-42ab-b909-6af30b9d9183 req-a1ec3ec1-66cf-43fd-9ea2-0b7fac340040 service nova] Acquiring lock "9cbdffd6-df57-4bab-b69c-b41a2718fd68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:25:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ec8f1e68-a1ca-42ab-b909-6af30b9d9183 req-a1ec3ec1-66cf-43fd-9ea2-0b7fac340040 service nova] Lock "9cbdffd6-df57-4bab-b69c-b41a2718fd68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:25:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ec8f1e68-a1ca-42ab-b909-6af30b9d9183 req-a1ec3ec1-66cf-43fd-9ea2-0b7fac340040 service nova] Lock "9cbdffd6-df57-4bab-b69c-b41a2718fd68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:25:23 user nova-compute[74743]: DEBUG nova.compute.manager [req-ec8f1e68-a1ca-42ab-b909-6af30b9d9183 req-a1ec3ec1-66cf-43fd-9ea2-0b7fac340040 service nova] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] No waiting events found dispatching network-vif-unplugged-55c54294-3f4d-4199-a9fa-a273016b376b {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:25:23 user nova-compute[74743]: DEBUG nova.compute.manager [req-ec8f1e68-a1ca-42ab-b909-6af30b9d9183 req-a1ec3ec1-66cf-43fd-9ea2-0b7fac340040 service nova] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Received event network-vif-unplugged-55c54294-3f4d-4199-a9fa-a273016b376b for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:25:23 user nova-compute[74743]: DEBUG nova.compute.manager [req-ec8f1e68-a1ca-42ab-b909-6af30b9d9183 req-a1ec3ec1-66cf-43fd-9ea2-0b7fac340040 service nova] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Received event network-vif-plugged-55c54294-3f4d-4199-a9fa-a273016b376b {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:25:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ec8f1e68-a1ca-42ab-b909-6af30b9d9183 req-a1ec3ec1-66cf-43fd-9ea2-0b7fac340040 service nova] Acquiring lock "9cbdffd6-df57-4bab-b69c-b41a2718fd68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:25:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ec8f1e68-a1ca-42ab-b909-6af30b9d9183 req-a1ec3ec1-66cf-43fd-9ea2-0b7fac340040 service nova] Lock "9cbdffd6-df57-4bab-b69c-b41a2718fd68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:25:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ec8f1e68-a1ca-42ab-b909-6af30b9d9183 req-a1ec3ec1-66cf-43fd-9ea2-0b7fac340040 service nova] Lock "9cbdffd6-df57-4bab-b69c-b41a2718fd68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:25:23 user nova-compute[74743]: DEBUG nova.compute.manager [req-ec8f1e68-a1ca-42ab-b909-6af30b9d9183 req-a1ec3ec1-66cf-43fd-9ea2-0b7fac340040 service nova] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] No waiting events found dispatching network-vif-plugged-55c54294-3f4d-4199-a9fa-a273016b376b {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:25:23 user nova-compute[74743]: WARNING nova.compute.manager [req-ec8f1e68-a1ca-42ab-b909-6af30b9d9183 req-a1ec3ec1-66cf-43fd-9ea2-0b7fac340040 service nova] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Received unexpected event network-vif-plugged-55c54294-3f4d-4199-a9fa-a273016b376b for instance with vm_state active and task_state deleting.
Nov 18 17:25:23 user nova-compute[74743]: DEBUG nova.compute.manager [req-ec8f1e68-a1ca-42ab-b909-6af30b9d9183 req-a1ec3ec1-66cf-43fd-9ea2-0b7fac340040 service nova] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Received event network-vif-deleted-55c54294-3f4d-4199-a9fa-a273016b376b {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:25:24 user nova-compute[74743]: INFO nova.compute.manager [None req-e342f612-6607-4148-a981-2c07573bad38 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] [instance: 9cbdffd6-df57-4bab-b69c-b41a2718fd68] Took 0.79 seconds to detach 1 volumes for instance.
Nov 18 17:25:24 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e342f612-6607-4148-a981-2c07573bad38 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:25:24 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e342f612-6607-4148-a981-2c07573bad38 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:25:24 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-e342f612-6607-4148-a981-2c07573bad38 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:25:24 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-e342f612-6607-4148-a981-2c07573bad38 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:25:24 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e342f612-6607-4148-a981-2c07573bad38 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.327s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:25:25 user nova-compute[74743]: INFO nova.scheduler.client.report [None req-e342f612-6607-4148-a981-2c07573bad38 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Deleted allocations for instance 9cbdffd6-df57-4bab-b69c-b41a2718fd68
Nov 18 17:25:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e342f612-6607-4148-a981-2c07573bad38 tempest-TestVolumeBootPattern-1373443944 tempest-TestVolumeBootPattern-1373443944-project-member] Lock "9cbdffd6-df57-4bab-b69c-b41a2718fd68" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.106s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:25:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ea1ef1c0-e800-424c-a388-f0cd2fbc6173 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquiring lock "1fd86416-72c2-45e5-814d-9195b4cfcc61" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:25:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ea1ef1c0-e800-424c-a388-f0cd2fbc6173 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "1fd86416-72c2-45e5-814d-9195b4cfcc61" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:25:25 user nova-compute[74743]: DEBUG nova.objects.instance [None req-ea1ef1c0-e800-424c-a388-f0cd2fbc6173 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lazy-loading 'flavor' on Instance uuid 1fd86416-72c2-45e5-814d-9195b4cfcc61 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:25:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ea1ef1c0-e800-424c-a388-f0cd2fbc6173 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "1fd86416-72c2-45e5-814d-9195b4cfcc61" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:25:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ea1ef1c0-e800-424c-a388-f0cd2fbc6173 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquiring lock "1fd86416-72c2-45e5-814d-9195b4cfcc61" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:25:25 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ea1ef1c0-e800-424c-a388-f0cd2fbc6173 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "1fd86416-72c2-45e5-814d-9195b4cfcc61" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:25:25 user nova-compute[74743]: INFO nova.compute.manager [None req-ea1ef1c0-e800-424c-a388-f0cd2fbc6173 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Attaching volume 3935a32e-e6ba-494d-a04a-873f3f70a2eb to /dev/vdb
Nov 18 17:25:25 user nova-compute[74743]: DEBUG os_brick.utils [None req-ea1ef1c0-e800-424c-a388-f0cd2fbc6173 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:25:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:25:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:25:25 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1fd37ca-ddbb-4a71-86fd-2c46f18f8325]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1116acd8874d\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:25:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:25:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:25:25 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bba52f4-d660-4370-af92-0c55088c9f2a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:25:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:25:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:25:25 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[affadec7-eec1-4200-8a79-2e10c70464a2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:25:25 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[2349a96c-a890-4c5f-ad96-34d8d1fb6844]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:25:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-ea1ef1c0-e800-424c-a388-f0cd2fbc6173 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Running cmd (subprocess): nvme version {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:25:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-ea1ef1c0-e800-424c-a388-f0cd2fbc6173 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] 'nvme version' failed. Not Retrying. {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:25:25 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ea1ef1c0-e800-424c-a388-f0cd2fbc6173 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] nvme not present on system {{(pid=74743) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 17:25:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:25:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:25:25 user nova-compute[74743]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 17:25:25 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf907b5-ae16-4a0c-a0e8-bdd2db0f581c]: (4, '') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:25:25 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-ea1ef1c0-e800-424c-a388-f0cd2fbc6173 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74743) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 17:25:25 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-ea1ef1c0-e800-424c-a388-f0cd2fbc6173 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 17:25:25 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-ea1ef1c0-e800-424c-a388-f0cd2fbc6173 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] LIGHTOS: no hostnqn found. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 17:25:25 user nova-compute[74743]: DEBUG os_brick.utils [None req-ea1ef1c0-e800-424c-a388-f0cd2fbc6173 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1116acd8874d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:25:25 user nova-compute[74743]: DEBUG nova.virt.block_device [None req-ea1ef1c0-e800-424c-a388-f0cd2fbc6173 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Updating existing volume attachment record: 81a221ce-c904-4ebe-9560-33ec6781d2bc {{(pid=74743) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 17:25:27 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:27 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:29 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:25:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:31 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea1ef1c0-e800-424c-a388-f0cd2fbc6173 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Calling os-brick to attach iSCSI Volume {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 17:25:31 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea1ef1c0-e800-424c-a388-f0cd2fbc6173 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DAmHizka', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:25:31 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-ea1ef1c0-e800-424c-a388-f0cd2fbc6173 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:25:31 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-ea1ef1c0-e800-424c-a388-f0cd2fbc6173 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:25:31 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-ea1ef1c0-e800-424c-a388-f0cd2fbc6173 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:25:31 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-ea1ef1c0-e800-424c-a388-f0cd2fbc6173 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:25:31 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-ea1ef1c0-e800-424c-a388-f0cd2fbc6173 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:25:31 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-ea1ef1c0-e800-424c-a388-f0cd2fbc6173 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:25:31 user nova-compute[74743]: INFO os_brick.initiator.connectors.iscsi [None req-ea1ef1c0-e800-424c-a388-f0cd2fbc6173 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 17:25:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb -p 172.16.0.220:3260 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:25:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:25:31 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[55369190-a32d-4ddd-9a3a-813fbf197c1b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:25:31 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea1ef1c0-e800-424c-a388-f0cd2fbc6173 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 17:25:31 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:25:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb -p 172.16.0.220:3260 --interface default --op new {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:25:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:25:31 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4306a6-5296-4ffb-ab2b-babb1507afcf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb] added\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:25:31 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea1ef1c0-e800-424c-a388-f0cd2fbc6173 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb] added
Nov 18 17:25:31 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:25:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:25:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:25:31 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11720fb-19e5-4fad-bd65-a4cfffabe682]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:25:31 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea1ef1c0-e800-424c-a388-f0cd2fbc6173 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:25:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:25:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:25:31 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[034f7f0f-11f4-4e2e-84bc-c723dcff66ad]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:25:31 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea1ef1c0-e800-424c-a388-f0cd2fbc6173 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:25:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DAmHizka {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:25:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DAmHizka" returned: 0 in 0.023s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:25:31 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9257b9-1af2-4dd0-930e-361960153887]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:25:31 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea1ef1c0-e800-424c-a388-f0cd2fbc6173 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DAmHizka'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:25:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:25:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:25:31 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ccda8f-1fda-4674-aa7d-8c0ebeb16828]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:25:31 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea1ef1c0-e800-424c-a388-f0cd2fbc6173 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:25:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:25:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:25:31 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d8a8b9-e45b-400b-b8d2-c37d0dd13056]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:25:31 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea1ef1c0-e800-424c-a388-f0cd2fbc6173 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:25:31 user nova-compute[74743]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb (non-flash)
Nov 18 17:25:31 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:25:31 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea1ef1c0-e800-424c-a388-f0cd2fbc6173 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:25:31 user nova-compute[74743]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb (non-flash)
Nov 18 17:25:31 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:25:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb -p 172.16.0.220:3260 --login {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:25:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:25:31 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[6810495e-934e-472b-b8ff-a5ba95ade659]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:25:31 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea1ef1c0-e800-424c-a388-f0cd2fbc6173 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb, portal: 172.16.0.220,3260]
Nov 18 17:25:31 user nova-compute[74743]: Login to [iface: default, target: iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb, portal: 172.16.0.220,3260] successful.
Nov 18 17:25:31 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:25:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:25:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:25:31 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b90a366-4c6f-4722-a4ba-4dbe61cb2533]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:25:31 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea1ef1c0-e800-424c-a388-f0cd2fbc6173 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:25:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:25:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:25:31 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[19425a9f-64ad-427f-b6ef-acd6332f319e]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:25:31 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea1ef1c0-e800-424c-a388-f0cd2fbc6173 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:25:31 user nova-compute[74743]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb (non-flash)
Nov 18 17:25:31 user nova-compute[74743]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb (non-flash)
Nov 18 17:25:31 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:25:31 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea1ef1c0-e800-424c-a388-f0cd2fbc6173 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:25:31 user nova-compute[74743]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb (non-flash)
Nov 18 17:25:31 user nova-compute[74743]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb (non-flash)
Nov 18 17:25:31 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:25:31 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-ea1ef1c0-e800-424c-a388-f0cd2fbc6173 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:25:31 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea1ef1c0-e800-424c-a388-f0cd2fbc6173 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Connected to 172.16.0.220:3260 {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 17:25:31 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-ea1ef1c0-e800-424c-a388-f0cd2fbc6173 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=74743) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 17:25:31 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-ea1ef1c0-e800-424c-a388-f0cd2fbc6173 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74743) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 17:25:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:25:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:25:31 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d53005-5d3d-4f80-af34-1c03571e79d3]: (4, ('- - 0', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:25:31 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-ea1ef1c0-e800-424c-a388-f0cd2fbc6173 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:25:31 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea1ef1c0-e800-424c-a388-f0cd2fbc6173 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DAmHizka', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 17:25:32 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:25:32 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74743) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 17:25:32 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:32 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-ea1ef1c0-e800-424c-a388-f0cd2fbc6173 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:25:32 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea1ef1c0-e800-424c-a388-f0cd2fbc6173 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23064613766343661', 'path': '/dev/sdb'} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:25:32 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea1ef1c0-e800-424c-a388-f0cd2fbc6173 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23064613766343661', 'path': '/dev/sdb'} {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 17:25:32 user nova-compute[74743]: DEBUG nova.objects.instance [None req-ea1ef1c0-e800-424c-a388-f0cd2fbc6173 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lazy-loading 'flavor' on Instance uuid 1fd86416-72c2-45e5-814d-9195b4cfcc61 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:25:32 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-ea1ef1c0-e800-424c-a388-f0cd2fbc6173 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 17:25:32 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:25:32 user nova-compute[74743]:   <source dev="/dev/sdb"/>
Nov 18 17:25:32 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:25:32 user nova-compute[74743]:   <serial>3935a32e-e6ba-494d-a04a-873f3f70a2eb</serial>
Nov 18 17:25:32 user nova-compute[74743]: </disk>
Nov 18 17:25:32 user nova-compute[74743]:  {{(pid=74743) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 17:25:33 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:25:33 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:25:33 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-ea1ef1c0-e800-424c-a388-f0cd2fbc6173 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:25:33 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-ea1ef1c0-e800-424c-a388-f0cd2fbc6173 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:25:33 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-ea1ef1c0-e800-424c-a388-f0cd2fbc6173 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] No VIF found with MAC fa:16:3e:3f:13:af, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:25:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ea1ef1c0-e800-424c-a388-f0cd2fbc6173 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "1fd86416-72c2-45e5-814d-9195b4cfcc61" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.921s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:25:35 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:35 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:25:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquiring lock "b111f169-d737-4bbe-bad3-394a2bc57218" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:25:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "b111f169-d737-4bbe-bad3-394a2bc57218" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:25:37 user nova-compute[74743]: DEBUG nova.compute.manager [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Starting instance... {{(pid=74743) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 17:25:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:25:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:25:37 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74743) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 17:25:37 user nova-compute[74743]: INFO nova.compute.claims [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Claim successful on node user
Nov 18 17:25:37 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:25:37 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:25:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.388s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:25:37 user nova-compute[74743]: DEBUG nova.compute.manager [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Start building networks asynchronously for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 17:25:37 user nova-compute[74743]: DEBUG nova.compute.manager [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Allocating IP information in the background. {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 17:25:37 user nova-compute[74743]: DEBUG nova.network.neutron [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] allocate_for_instance() {{(pid=74743) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 17:25:37 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 17:25:37 user nova-compute[74743]: DEBUG nova.compute.manager [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Start building block device mappings for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 17:25:37 user nova-compute[74743]: DEBUG nova.policy [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '35aedc702bc4444eb3802772a523ba79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5502edf6a6b94cb59d58d52494efc90d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74743) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 17:25:37 user nova-compute[74743]: DEBUG nova.compute.manager [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Start spawning the instance on the hypervisor. {{(pid=74743) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 17:25:37 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Creating instance directory {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 17:25:37 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Creating image(s)
Nov 18 17:25:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquiring lock "/opt/stack/data/nova/instances/b111f169-d737-4bbe-bad3-394a2bc57218/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:25:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "/opt/stack/data/nova/instances/b111f169-d737-4bbe-bad3-394a2bc57218/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:25:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "/opt/stack/data/nova/instances/b111f169-d737-4bbe-bad3-394a2bc57218/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:25:37 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:25:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.212s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:25:38 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquiring lock "c188b3a997bfafa42fa341f9dcc326545681eed9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:25:38 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:25:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:25:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.169s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:25:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/b111f169-d737-4bbe-bad3-394a2bc57218/disk 1073741824 {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:25:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/b111f169-d737-4bbe-bad3-394a2bc57218/disk 1073741824" returned: 0 in 0.062s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:25:38 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:25:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:25:38 user nova-compute[74743]: DEBUG nova.network.neutron [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Successfully created port: f5631450-b11b-498b-978f-71101e2a80b5 {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:25:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.179s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:25:38 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b111f169-d737-4bbe-bad3-394a2bc57218/disk. size=1073741824 {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 17:25:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b111f169-d737-4bbe-bad3-394a2bc57218/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:25:38 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:25:38 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:25:38 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Starting heal instance info cache {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 17:25:38 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "refresh_cache-c58db905-7030-44d1-80ca-91e0cd746218" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:25:38 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquired lock "refresh_cache-c58db905-7030-44d1-80ca-91e0cd746218" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:25:38 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Forcefully refreshing network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 17:25:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b111f169-d737-4bbe-bad3-394a2bc57218/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:25:38 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Cannot resize image /opt/stack/data/nova/instances/b111f169-d737-4bbe-bad3-394a2bc57218/disk to a smaller size. {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 17:25:38 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Created local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 17:25:38 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Ensure instance console log exists: /opt/stack/data/nova/instances/b111f169-d737-4bbe-bad3-394a2bc57218/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:25:38 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:25:38 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:25:38 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Updating instance_info_cache with network_info: [{"id": "2dc327a1-177d-4d19-9fb1-ce60b5367a7e", "address": "fa:16:3e:05:b8:d4", "network": {"id": "e1c28f74-c9c1-4eb3-931e-003332ff6243", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-453481916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a17803c613c4ef299c797bba85c1a4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc327a1-17", "ovs_interfaceid": "2dc327a1-177d-4d19-9fb1-ce60b5367a7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Releasing lock "refresh_cache-c58db905-7030-44d1-80ca-91e0cd746218" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Updated the network info_cache for instance {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG nova.network.neutron [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Successfully updated port: f5631450-b11b-498b-978f-71101e2a80b5 {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquiring lock "refresh_cache-b111f169-d737-4bbe-bad3-394a2bc57218" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquired lock "refresh_cache-b111f169-d737-4bbe-bad3-394a2bc57218" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG nova.network.neutron [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG nova.compute.manager [req-79c76975-9796-47ce-aeec-433ab745ec2d req-5b48aded-8153-4d74-835d-2dfb855d5157 service nova] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Received event network-changed-f5631450-b11b-498b-978f-71101e2a80b5 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG nova.compute.manager [req-79c76975-9796-47ce-aeec-433ab745ec2d req-5b48aded-8153-4d74-835d-2dfb855d5157 service nova] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Refreshing instance network info cache due to event network-changed-f5631450-b11b-498b-978f-71101e2a80b5. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-79c76975-9796-47ce-aeec-433ab745ec2d req-5b48aded-8153-4d74-835d-2dfb855d5157 service nova] Acquiring lock "refresh_cache-b111f169-d737-4bbe-bad3-394a2bc57218" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG nova.network.neutron [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Auditing locally available compute resources for user (node: user) {{(pid=74743) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG nova.network.neutron [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Updating instance_info_cache with network_info: [{"id": "f5631450-b11b-498b-978f-71101e2a80b5", "address": "fa:16:3e:a4:4c:d4", "network": {"id": "b03d3355-7704-43de-8af7-7a5dc1ee490d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1492507432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5502edf6a6b94cb59d58d52494efc90d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5631450-b1", "ovs_interfaceid": "f5631450-b11b-498b-978f-71101e2a80b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Releasing lock "refresh_cache-b111f169-d737-4bbe-bad3-394a2bc57218" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG nova.compute.manager [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Instance network_info: |[{"id": "f5631450-b11b-498b-978f-71101e2a80b5", "address": "fa:16:3e:a4:4c:d4", "network": {"id": "b03d3355-7704-43de-8af7-7a5dc1ee490d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1492507432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5502edf6a6b94cb59d58d52494efc90d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5631450-b1", "ovs_interfaceid": "f5631450-b11b-498b-978f-71101e2a80b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-79c76975-9796-47ce-aeec-433ab745ec2d req-5b48aded-8153-4d74-835d-2dfb855d5157 service nova] Acquired lock "refresh_cache-b111f169-d737-4bbe-bad3-394a2bc57218" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG nova.network.neutron [req-79c76975-9796-47ce-aeec-433ab745ec2d req-5b48aded-8153-4d74-835d-2dfb855d5157 service nova] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Refreshing network info cache for port f5631450-b11b-498b-978f-71101e2a80b5 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Start _get_guest_xml network_info=[{"id": "f5631450-b11b-498b-978f-71101e2a80b5", "address": "fa:16:3e:a4:4c:d4", "network": {"id": "b03d3355-7704-43de-8af7-7a5dc1ee490d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1492507432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5502edf6a6b94cb59d58d52494efc90d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5631450-b1", "ovs_interfaceid": "f5631450-b11b-498b-978f-71101e2a80b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '9536f6cf-95c4-40e2-864a-09a91525678a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:25:39 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:25:39 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:25:39 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:25:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-667533672',display_name='tempest-AttachVolumeNegativeTest-server-667533672',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-667533672',id=43,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLt6vj5zWDS2I4XiANoaOtqEZXHSZ1FYv9eNB+7fyZdch1VrKYcm9A6JJ7snGkro6Hy7QO5XtwLTC8v5eHrKYCeA4HdLt5TVaBCsvf9ZKTwoOu+pM92xen1mXMNhqzCmQw==',key_name='tempest-keypair-798546158',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5502edf6a6b94cb59d58d52494efc90d',ramdisk_id='',reservation_id='r-3i2noxij',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1149732113',owner_user_name='tempest-AttachVolumeNegativeTest-1149732113-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:25:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35aedc702bc4444eb3802772a523ba79',uuid=b111f169-d737-4bbe-bad3-394a2bc57218,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5631450-b11b-498b-978f-71101e2a80b5", "address": "fa:16:3e:a4:4c:d4", "network": {"id": "b03d3355-7704-43de-8af7-7a5dc1ee490d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1492507432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5502edf6a6b94cb59d58d52494efc90d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5631450-b1", "ovs_interfaceid": "f5631450-b11b-498b-978f-71101e2a80b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Converting VIF {"id": "f5631450-b11b-498b-978f-71101e2a80b5", "address": "fa:16:3e:a4:4c:d4", "network": {"id": "b03d3355-7704-43de-8af7-7a5dc1ee490d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1492507432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5502edf6a6b94cb59d58d52494efc90d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5631450-b1", "ovs_interfaceid": "f5631450-b11b-498b-978f-71101e2a80b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:4c:d4,bridge_name='br-int',has_traffic_filtering=True,id=f5631450-b11b-498b-978f-71101e2a80b5,network=Network(b03d3355-7704-43de-8af7-7a5dc1ee490d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5631450-b1') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG nova.objects.instance [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lazy-loading 'pci_devices' on Instance uuid b111f169-d737-4bbe-bad3-394a2bc57218 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:25:39 user nova-compute[74743]:   <uuid>b111f169-d737-4bbe-bad3-394a2bc57218</uuid>
Nov 18 17:25:39 user nova-compute[74743]:   <name>instance-0000002b</name>
Nov 18 17:25:39 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:25:39 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:25:39 user nova-compute[74743]:   <metadata>
Nov 18 17:25:39 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:25:39 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:25:39 user nova-compute[74743]:       <nova:name>tempest-AttachVolumeNegativeTest-server-667533672</nova:name>
Nov 18 17:25:39 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:25:39</nova:creationTime>
Nov 18 17:25:39 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:25:39 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:25:39 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:25:39 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:25:39 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:25:39 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:25:39 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:25:39 user nova-compute[74743]:       <nova:owner>
Nov 18 17:25:39 user nova-compute[74743]:         <nova:user uuid="35aedc702bc4444eb3802772a523ba79">tempest-AttachVolumeNegativeTest-1149732113-project-member</nova:user>
Nov 18 17:25:39 user nova-compute[74743]:         <nova:project uuid="5502edf6a6b94cb59d58d52494efc90d">tempest-AttachVolumeNegativeTest-1149732113</nova:project>
Nov 18 17:25:39 user nova-compute[74743]:       </nova:owner>
Nov 18 17:25:39 user nova-compute[74743]:       <nova:root type="image" uuid="9536f6cf-95c4-40e2-864a-09a91525678a"/>
Nov 18 17:25:39 user nova-compute[74743]:       <nova:ports>
Nov 18 17:25:39 user nova-compute[74743]:         <nova:port uuid="f5631450-b11b-498b-978f-71101e2a80b5">
Nov 18 17:25:39 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 18 17:25:39 user nova-compute[74743]:         </nova:port>
Nov 18 17:25:39 user nova-compute[74743]:       </nova:ports>
Nov 18 17:25:39 user nova-compute[74743]:     </nova:instance>
Nov 18 17:25:39 user nova-compute[74743]:   </metadata>
Nov 18 17:25:39 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:25:39 user nova-compute[74743]:     <system>
Nov 18 17:25:39 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:25:39 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:25:39 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:25:39 user nova-compute[74743]:       <entry name="serial">b111f169-d737-4bbe-bad3-394a2bc57218</entry>
Nov 18 17:25:39 user nova-compute[74743]:       <entry name="uuid">b111f169-d737-4bbe-bad3-394a2bc57218</entry>
Nov 18 17:25:39 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:25:39 user nova-compute[74743]:     </system>
Nov 18 17:25:39 user nova-compute[74743]:   </sysinfo>
Nov 18 17:25:39 user nova-compute[74743]:   <os>
Nov 18 17:25:39 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:25:39 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:25:39 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:25:39 user nova-compute[74743]:   </os>
Nov 18 17:25:39 user nova-compute[74743]:   <features>
Nov 18 17:25:39 user nova-compute[74743]:     <acpi/>
Nov 18 17:25:39 user nova-compute[74743]:     <apic/>
Nov 18 17:25:39 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:25:39 user nova-compute[74743]:   </features>
Nov 18 17:25:39 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:25:39 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:25:39 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:25:39 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:25:39 user nova-compute[74743]:   </clock>
Nov 18 17:25:39 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:25:39 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:25:39 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:25:39 user nova-compute[74743]:   </cpu>
Nov 18 17:25:39 user nova-compute[74743]:   <devices>
Nov 18 17:25:39 user nova-compute[74743]:     <disk type="file" device="disk">
Nov 18 17:25:39 user nova-compute[74743]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 17:25:39 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/b111f169-d737-4bbe-bad3-394a2bc57218/disk"/>
Nov 18 17:25:39 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:25:39 user nova-compute[74743]:     </disk>
Nov 18 17:25:39 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:25:39 user nova-compute[74743]:       <mac address="fa:16:3e:a4:4c:d4"/>
Nov 18 17:25:39 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:25:39 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:25:39 user nova-compute[74743]:       <target dev="tapf5631450-b1"/>
Nov 18 17:25:39 user nova-compute[74743]:     </interface>
Nov 18 17:25:39 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:25:39 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/b111f169-d737-4bbe-bad3-394a2bc57218/console.log" append="off"/>
Nov 18 17:25:39 user nova-compute[74743]:     </serial>
Nov 18 17:25:39 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:25:39 user nova-compute[74743]:     <video>
Nov 18 17:25:39 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:25:39 user nova-compute[74743]:     </video>
Nov 18 17:25:39 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:25:39 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:25:39 user nova-compute[74743]:     </rng>
Nov 18 17:25:39 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:25:39 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:25:39 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:25:39 user nova-compute[74743]:     </memballoon>
Nov 18 17:25:39 user nova-compute[74743]:   </devices>
Nov 18 17:25:39 user nova-compute[74743]: </domain>
Nov 18 17:25:39 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:25:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-667533672',display_name='tempest-AttachVolumeNegativeTest-server-667533672',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-667533672',id=43,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLt6vj5zWDS2I4XiANoaOtqEZXHSZ1FYv9eNB+7fyZdch1VrKYcm9A6JJ7snGkro6Hy7QO5XtwLTC8v5eHrKYCeA4HdLt5TVaBCsvf9ZKTwoOu+pM92xen1mXMNhqzCmQw==',key_name='tempest-keypair-798546158',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5502edf6a6b94cb59d58d52494efc90d',ramdisk_id='',reservation_id='r-3i2noxij',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1149732113',owner_user_name='tempest-AttachVolumeNegativeTest-1149732113-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:25:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35aedc702bc4444eb3802772a523ba79',uuid=b111f169-d737-4bbe-bad3-394a2bc57218,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5631450-b11b-498b-978f-71101e2a80b5", "address": "fa:16:3e:a4:4c:d4", "network": {"id": "b03d3355-7704-43de-8af7-7a5dc1ee490d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1492507432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5502edf6a6b94cb59d58d52494efc90d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5631450-b1", "ovs_interfaceid": "f5631450-b11b-498b-978f-71101e2a80b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Converting VIF {"id": "f5631450-b11b-498b-978f-71101e2a80b5", "address": "fa:16:3e:a4:4c:d4", "network": {"id": "b03d3355-7704-43de-8af7-7a5dc1ee490d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1492507432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5502edf6a6b94cb59d58d52494efc90d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5631450-b1", "ovs_interfaceid": "f5631450-b11b-498b-978f-71101e2a80b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:4c:d4,bridge_name='br-int',has_traffic_filtering=True,id=f5631450-b11b-498b-978f-71101e2a80b5,network=Network(b03d3355-7704-43de-8af7-7a5dc1ee490d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5631450-b1') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG os_vif [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:4c:d4,bridge_name='br-int',has_traffic_filtering=True,id=f5631450-b11b-498b-978f-71101e2a80b5,network=Network(b03d3355-7704-43de-8af7-7a5dc1ee490d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5631450-b1') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '54c45792-652e-5b50-9013-5c52fabea68c', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5631450-b1, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf5631450-b1, col_values=(('qos', UUID('f53d03cc-72f4-42fd-ab48-cc9707d3e355')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf5631450-b1, col_values=(('external_ids', {'iface-id': 'f5631450-b11b-498b-978f-71101e2a80b5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:4c:d4', 'vm-uuid': 'b111f169-d737-4bbe-bad3-394a2bc57218'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/789583c2-1c04-4510-a37e-0e9b7d3a0971/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:39 user nova-compute[74743]: INFO os_vif [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:4c:d4,bridge_name='br-int',has_traffic_filtering=True,id=f5631450-b11b-498b-978f-71101e2a80b5,network=Network(b03d3355-7704-43de-8af7-7a5dc1ee490d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5631450-b1')
Nov 18 17:25:39 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] No VIF found with MAC fa:16:3e:a4:4c:d4, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/789583c2-1c04-4510-a37e-0e9b7d3a0971/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:25:39 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/789583c2-1c04-4510-a37e-0e9b7d3a0971/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:25:40 user nova-compute[74743]: DEBUG nova.network.neutron [req-79c76975-9796-47ce-aeec-433ab745ec2d req-5b48aded-8153-4d74-835d-2dfb855d5157 service nova] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Updated VIF entry in instance network info cache for port f5631450-b11b-498b-978f-71101e2a80b5. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:25:40 user nova-compute[74743]: DEBUG nova.network.neutron [req-79c76975-9796-47ce-aeec-433ab745ec2d req-5b48aded-8153-4d74-835d-2dfb855d5157 service nova] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Updating instance_info_cache with network_info: [{"id": "f5631450-b11b-498b-978f-71101e2a80b5", "address": "fa:16:3e:a4:4c:d4", "network": {"id": "b03d3355-7704-43de-8af7-7a5dc1ee490d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1492507432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5502edf6a6b94cb59d58d52494efc90d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5631450-b1", "ovs_interfaceid": "f5631450-b11b-498b-978f-71101e2a80b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:25:40 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-79c76975-9796-47ce-aeec-433ab745ec2d req-5b48aded-8153-4d74-835d-2dfb855d5157 service nova] Releasing lock "refresh_cache-b111f169-d737-4bbe-bad3-394a2bc57218" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:25:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/789583c2-1c04-4510-a37e-0e9b7d3a0971/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:25:40 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:25:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93772071-cb21-4f4e-8b07-c55be8cf7bea/disk.rescue --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:25:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93772071-cb21-4f4e-8b07-c55be8cf7bea/disk.rescue --force-share --output=json" returned: 0 in 0.164s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:25:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93772071-cb21-4f4e-8b07-c55be8cf7bea/disk.rescue --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:25:40 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93772071-cb21-4f4e-8b07-c55be8cf7bea/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:25:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:25:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:25:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:25:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:25:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fd86416-72c2-45e5-814d-9195b4cfcc61/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:25:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fd86416-72c2-45e5-814d-9195b4cfcc61/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:25:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fd86416-72c2-45e5-814d-9195b4cfcc61/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:25:41 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:41 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:41 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fd86416-72c2-45e5-814d-9195b4cfcc61/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:25:41 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:25:41 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:25:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0b7c0c-a4ad-4ccd-b60a-721070a57f98/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:25:41 user nova-compute[74743]: DEBUG nova.compute.manager [req-0cd3355c-1aad-494c-a401-3b885b33ed32 req-42ee0e09-9db6-4373-a714-2b3fd150100b service nova] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Received event network-vif-plugged-f5631450-b11b-498b-978f-71101e2a80b5 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:25:41 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-0cd3355c-1aad-494c-a401-3b885b33ed32 req-42ee0e09-9db6-4373-a714-2b3fd150100b service nova] Acquiring lock "b111f169-d737-4bbe-bad3-394a2bc57218-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:25:41 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-0cd3355c-1aad-494c-a401-3b885b33ed32 req-42ee0e09-9db6-4373-a714-2b3fd150100b service nova] Lock "b111f169-d737-4bbe-bad3-394a2bc57218-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:25:41 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-0cd3355c-1aad-494c-a401-3b885b33ed32 req-42ee0e09-9db6-4373-a714-2b3fd150100b service nova] Lock "b111f169-d737-4bbe-bad3-394a2bc57218-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:25:41 user nova-compute[74743]: DEBUG nova.compute.manager [req-0cd3355c-1aad-494c-a401-3b885b33ed32 req-42ee0e09-9db6-4373-a714-2b3fd150100b service nova] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] No waiting events found dispatching network-vif-plugged-f5631450-b11b-498b-978f-71101e2a80b5 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:25:41 user nova-compute[74743]: WARNING nova.compute.manager [req-0cd3355c-1aad-494c-a401-3b885b33ed32 req-42ee0e09-9db6-4373-a714-2b3fd150100b service nova] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Received unexpected event network-vif-plugged-f5631450-b11b-498b-978f-71101e2a80b5 for instance with vm_state building and task_state spawning.
Nov 18 17:25:41 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0b7c0c-a4ad-4ccd-b60a-721070a57f98/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:25:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0b7c0c-a4ad-4ccd-b60a-721070a57f98/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:25:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0b7c0c-a4ad-4ccd-b60a-721070a57f98/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:25:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c58db905-7030-44d1-80ca-91e0cd746218/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:25:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c58db905-7030-44d1-80ca-91e0cd746218/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:25:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c58db905-7030-44d1-80ca-91e0cd746218/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:25:42 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c58db905-7030-44d1-80ca-91e0cd746218/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:25:42 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:25:42 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:25:42 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Hypervisor/Node resource view: name=user free_ram=8109MB free_disk=25.035320281982422GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74743) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 17:25:42 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:25:42 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:25:42 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance aefe3db1-b9bb-4cce-aa31-d0b6684ad791 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:25:42 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance f649143e-f7db-475a-bbe5-d5e7316caac3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:25:42 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 789583c2-1c04-4510-a37e-0e9b7d3a0971 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:25:42 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 93772071-cb21-4f4e-8b07-c55be8cf7bea actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:25:42 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 1fd86416-72c2-45e5-814d-9195b4cfcc61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:25:42 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance c58db905-7030-44d1-80ca-91e0cd746218 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:25:42 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:25:42 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance b111f169-d737-4bbe-bad3-394a2bc57218 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:25:42 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 17:25:42 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 17:25:42 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:25:42 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:25:42 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Compute_service record updated for user:user {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 17:25:42 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.439s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:25:43 user nova-compute[74743]: DEBUG nova.compute.manager [req-58d15126-4efd-4d87-af5f-dbc025772c29 req-5cf1f151-0713-4c76-abc8-2d519f927649 service nova] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Received event network-vif-plugged-f5631450-b11b-498b-978f-71101e2a80b5 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:25:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-58d15126-4efd-4d87-af5f-dbc025772c29 req-5cf1f151-0713-4c76-abc8-2d519f927649 service nova] Acquiring lock "b111f169-d737-4bbe-bad3-394a2bc57218-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:25:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-58d15126-4efd-4d87-af5f-dbc025772c29 req-5cf1f151-0713-4c76-abc8-2d519f927649 service nova] Lock "b111f169-d737-4bbe-bad3-394a2bc57218-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:25:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-58d15126-4efd-4d87-af5f-dbc025772c29 req-5cf1f151-0713-4c76-abc8-2d519f927649 service nova] Lock "b111f169-d737-4bbe-bad3-394a2bc57218-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:25:43 user nova-compute[74743]: DEBUG nova.compute.manager [req-58d15126-4efd-4d87-af5f-dbc025772c29 req-5cf1f151-0713-4c76-abc8-2d519f927649 service nova] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] No waiting events found dispatching network-vif-plugged-f5631450-b11b-498b-978f-71101e2a80b5 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:25:43 user nova-compute[74743]: WARNING nova.compute.manager [req-58d15126-4efd-4d87-af5f-dbc025772c29 req-5cf1f151-0713-4c76-abc8-2d519f927649 service nova] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Received unexpected event network-vif-plugged-f5631450-b11b-498b-978f-71101e2a80b5 for instance with vm_state building and task_state spawning.
Nov 18 17:25:43 user nova-compute[74743]: DEBUG nova.compute.manager [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:25:43 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Guest created on hypervisor {{(pid=74743) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 17:25:43 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Instance spawned successfully.
Nov 18 17:25:43 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 17:25:43 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Found default for hw_cdrom_bus of ide {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:25:43 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Found default for hw_disk_bus of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:25:43 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Found default for hw_input_bus of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:25:43 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Found default for hw_pointer_model of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:25:43 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Found default for hw_video_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:25:43 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Found default for hw_vif_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:25:43 user nova-compute[74743]: INFO nova.compute.manager [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Took 5.95 seconds to spawn the instance on the hypervisor.
Nov 18 17:25:43 user nova-compute[74743]: DEBUG nova.compute.manager [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:25:43 user nova-compute[74743]: INFO nova.compute.manager [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Took 6.70 seconds to build instance.
Nov 18 17:25:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-5a3136db-f098-4c6a-95ac-90a55592e4fd tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "b111f169-d737-4bbe-bad3-394a2bc57218" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.804s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:25:44 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:25:44 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:25:44 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:45 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:46 user nova-compute[74743]: INFO nova.compute.manager [None req-cda105a8-efa4-4a73-8507-bdb278b7b6b7 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Unrescuing
Nov 18 17:25:46 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cda105a8-efa4-4a73-8507-bdb278b7b6b7 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquiring lock "refresh_cache-93772071-cb21-4f4e-8b07-c55be8cf7bea" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:25:46 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cda105a8-efa4-4a73-8507-bdb278b7b6b7 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquired lock "refresh_cache-93772071-cb21-4f4e-8b07-c55be8cf7bea" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:25:46 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cda105a8-efa4-4a73-8507-bdb278b7b6b7 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:25:47 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cda105a8-efa4-4a73-8507-bdb278b7b6b7 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Updating instance_info_cache with network_info: [{"id": "8aa1f220-b71a-4dce-b48a-cbef38e01517", "address": "fa:16:3e:c9:74:4b", "network": {"id": "1bbf6aff-4048-4212-a716-d0628575bfd0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc0fda74575d488a94e2dcfdc016598c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8aa1f220-b7", "ovs_interfaceid": "8aa1f220-b71a-4dce-b48a-cbef38e01517", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:25:47 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cda105a8-efa4-4a73-8507-bdb278b7b6b7 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Releasing lock "refresh_cache-93772071-cb21-4f4e-8b07-c55be8cf7bea" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:25:47 user nova-compute[74743]: DEBUG nova.objects.instance [None req-cda105a8-efa4-4a73-8507-bdb278b7b6b7 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lazy-loading 'flavor' on Instance uuid 93772071-cb21-4f4e-8b07-c55be8cf7bea {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:25:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:47 user nova-compute[74743]: DEBUG nova.compute.manager [req-fd49f51b-5531-4e63-a8b0-223daf763c01 req-63e05532-3a4c-444c-bca4-33a12ab0f7d1 service nova] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Received event network-vif-unplugged-8aa1f220-b71a-4dce-b48a-cbef38e01517 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:25:47 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-fd49f51b-5531-4e63-a8b0-223daf763c01 req-63e05532-3a4c-444c-bca4-33a12ab0f7d1 service nova] Acquiring lock "93772071-cb21-4f4e-8b07-c55be8cf7bea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:25:47 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-fd49f51b-5531-4e63-a8b0-223daf763c01 req-63e05532-3a4c-444c-bca4-33a12ab0f7d1 service nova] Lock "93772071-cb21-4f4e-8b07-c55be8cf7bea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:25:47 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-fd49f51b-5531-4e63-a8b0-223daf763c01 req-63e05532-3a4c-444c-bca4-33a12ab0f7d1 service nova] Lock "93772071-cb21-4f4e-8b07-c55be8cf7bea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:25:47 user nova-compute[74743]: DEBUG nova.compute.manager [req-fd49f51b-5531-4e63-a8b0-223daf763c01 req-63e05532-3a4c-444c-bca4-33a12ab0f7d1 service nova] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] No waiting events found dispatching network-vif-unplugged-8aa1f220-b71a-4dce-b48a-cbef38e01517 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:25:47 user nova-compute[74743]: WARNING nova.compute.manager [req-fd49f51b-5531-4e63-a8b0-223daf763c01 req-63e05532-3a4c-444c-bca4-33a12ab0f7d1 service nova] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Received unexpected event network-vif-unplugged-8aa1f220-b71a-4dce-b48a-cbef38e01517 for instance with vm_state rescued and task_state unrescuing.
Nov 18 17:25:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:47 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Instance destroyed successfully.
Nov 18 17:25:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:49 user nova-compute[74743]: DEBUG nova.compute.manager [req-841b4859-7ec7-45b8-ad50-9a39096209d4 req-fae74633-7301-4bfd-9e57-cb8eadfe45e7 service nova] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Received event network-vif-plugged-8aa1f220-b71a-4dce-b48a-cbef38e01517 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:25:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-841b4859-7ec7-45b8-ad50-9a39096209d4 req-fae74633-7301-4bfd-9e57-cb8eadfe45e7 service nova] Acquiring lock "93772071-cb21-4f4e-8b07-c55be8cf7bea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:25:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-841b4859-7ec7-45b8-ad50-9a39096209d4 req-fae74633-7301-4bfd-9e57-cb8eadfe45e7 service nova] Lock "93772071-cb21-4f4e-8b07-c55be8cf7bea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:25:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-841b4859-7ec7-45b8-ad50-9a39096209d4 req-fae74633-7301-4bfd-9e57-cb8eadfe45e7 service nova] Lock "93772071-cb21-4f4e-8b07-c55be8cf7bea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:25:49 user nova-compute[74743]: DEBUG nova.compute.manager [req-841b4859-7ec7-45b8-ad50-9a39096209d4 req-fae74633-7301-4bfd-9e57-cb8eadfe45e7 service nova] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] No waiting events found dispatching network-vif-plugged-8aa1f220-b71a-4dce-b48a-cbef38e01517 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:25:49 user nova-compute[74743]: WARNING nova.compute.manager [req-841b4859-7ec7-45b8-ad50-9a39096209d4 req-fae74633-7301-4bfd-9e57-cb8eadfe45e7 service nova] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Received unexpected event network-vif-plugged-8aa1f220-b71a-4dce-b48a-cbef38e01517 for instance with vm_state rescued and task_state unrescuing.
Nov 18 17:25:49 user nova-compute[74743]: DEBUG nova.compute.manager [req-841b4859-7ec7-45b8-ad50-9a39096209d4 req-fae74633-7301-4bfd-9e57-cb8eadfe45e7 service nova] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Received event network-vif-plugged-8aa1f220-b71a-4dce-b48a-cbef38e01517 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:25:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-841b4859-7ec7-45b8-ad50-9a39096209d4 req-fae74633-7301-4bfd-9e57-cb8eadfe45e7 service nova] Acquiring lock "93772071-cb21-4f4e-8b07-c55be8cf7bea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:25:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-841b4859-7ec7-45b8-ad50-9a39096209d4 req-fae74633-7301-4bfd-9e57-cb8eadfe45e7 service nova] Lock "93772071-cb21-4f4e-8b07-c55be8cf7bea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:25:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-841b4859-7ec7-45b8-ad50-9a39096209d4 req-fae74633-7301-4bfd-9e57-cb8eadfe45e7 service nova] Lock "93772071-cb21-4f4e-8b07-c55be8cf7bea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:25:49 user nova-compute[74743]: DEBUG nova.compute.manager [req-841b4859-7ec7-45b8-ad50-9a39096209d4 req-fae74633-7301-4bfd-9e57-cb8eadfe45e7 service nova] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] No waiting events found dispatching network-vif-plugged-8aa1f220-b71a-4dce-b48a-cbef38e01517 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:25:49 user nova-compute[74743]: WARNING nova.compute.manager [req-841b4859-7ec7-45b8-ad50-9a39096209d4 req-fae74633-7301-4bfd-9e57-cb8eadfe45e7 service nova] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Received unexpected event network-vif-plugged-8aa1f220-b71a-4dce-b48a-cbef38e01517 for instance with vm_state rescued and task_state unrescuing.
Nov 18 17:25:49 user nova-compute[74743]: DEBUG nova.compute.manager [req-841b4859-7ec7-45b8-ad50-9a39096209d4 req-fae74633-7301-4bfd-9e57-cb8eadfe45e7 service nova] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Received event network-vif-plugged-8aa1f220-b71a-4dce-b48a-cbef38e01517 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:25:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-841b4859-7ec7-45b8-ad50-9a39096209d4 req-fae74633-7301-4bfd-9e57-cb8eadfe45e7 service nova] Acquiring lock "93772071-cb21-4f4e-8b07-c55be8cf7bea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:25:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-841b4859-7ec7-45b8-ad50-9a39096209d4 req-fae74633-7301-4bfd-9e57-cb8eadfe45e7 service nova] Lock "93772071-cb21-4f4e-8b07-c55be8cf7bea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:25:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-841b4859-7ec7-45b8-ad50-9a39096209d4 req-fae74633-7301-4bfd-9e57-cb8eadfe45e7 service nova] Lock "93772071-cb21-4f4e-8b07-c55be8cf7bea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:25:49 user nova-compute[74743]: DEBUG nova.compute.manager [req-841b4859-7ec7-45b8-ad50-9a39096209d4 req-fae74633-7301-4bfd-9e57-cb8eadfe45e7 service nova] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] No waiting events found dispatching network-vif-plugged-8aa1f220-b71a-4dce-b48a-cbef38e01517 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:25:49 user nova-compute[74743]: WARNING nova.compute.manager [req-841b4859-7ec7-45b8-ad50-9a39096209d4 req-fae74633-7301-4bfd-9e57-cb8eadfe45e7 service nova] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Received unexpected event network-vif-plugged-8aa1f220-b71a-4dce-b48a-cbef38e01517 for instance with vm_state rescued and task_state unrescuing.
Nov 18 17:25:49 user nova-compute[74743]: DEBUG nova.compute.manager [req-841b4859-7ec7-45b8-ad50-9a39096209d4 req-fae74633-7301-4bfd-9e57-cb8eadfe45e7 service nova] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Received event network-vif-unplugged-8aa1f220-b71a-4dce-b48a-cbef38e01517 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:25:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-841b4859-7ec7-45b8-ad50-9a39096209d4 req-fae74633-7301-4bfd-9e57-cb8eadfe45e7 service nova] Acquiring lock "93772071-cb21-4f4e-8b07-c55be8cf7bea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:25:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-841b4859-7ec7-45b8-ad50-9a39096209d4 req-fae74633-7301-4bfd-9e57-cb8eadfe45e7 service nova] Lock "93772071-cb21-4f4e-8b07-c55be8cf7bea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:25:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-841b4859-7ec7-45b8-ad50-9a39096209d4 req-fae74633-7301-4bfd-9e57-cb8eadfe45e7 service nova] Lock "93772071-cb21-4f4e-8b07-c55be8cf7bea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:25:49 user nova-compute[74743]: DEBUG nova.compute.manager [req-841b4859-7ec7-45b8-ad50-9a39096209d4 req-fae74633-7301-4bfd-9e57-cb8eadfe45e7 service nova] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] No waiting events found dispatching network-vif-unplugged-8aa1f220-b71a-4dce-b48a-cbef38e01517 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:25:49 user nova-compute[74743]: WARNING nova.compute.manager [req-841b4859-7ec7-45b8-ad50-9a39096209d4 req-fae74633-7301-4bfd-9e57-cb8eadfe45e7 service nova] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Received unexpected event network-vif-unplugged-8aa1f220-b71a-4dce-b48a-cbef38e01517 for instance with vm_state rescued and task_state unrescuing.
Nov 18 17:25:49 user nova-compute[74743]: DEBUG nova.compute.manager [req-841b4859-7ec7-45b8-ad50-9a39096209d4 req-fae74633-7301-4bfd-9e57-cb8eadfe45e7 service nova] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Received event network-vif-plugged-8aa1f220-b71a-4dce-b48a-cbef38e01517 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:25:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-841b4859-7ec7-45b8-ad50-9a39096209d4 req-fae74633-7301-4bfd-9e57-cb8eadfe45e7 service nova] Acquiring lock "93772071-cb21-4f4e-8b07-c55be8cf7bea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:25:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-841b4859-7ec7-45b8-ad50-9a39096209d4 req-fae74633-7301-4bfd-9e57-cb8eadfe45e7 service nova] Lock "93772071-cb21-4f4e-8b07-c55be8cf7bea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:25:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-841b4859-7ec7-45b8-ad50-9a39096209d4 req-fae74633-7301-4bfd-9e57-cb8eadfe45e7 service nova] Lock "93772071-cb21-4f4e-8b07-c55be8cf7bea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:25:49 user nova-compute[74743]: DEBUG nova.compute.manager [req-841b4859-7ec7-45b8-ad50-9a39096209d4 req-fae74633-7301-4bfd-9e57-cb8eadfe45e7 service nova] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] No waiting events found dispatching network-vif-plugged-8aa1f220-b71a-4dce-b48a-cbef38e01517 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:25:49 user nova-compute[74743]: WARNING nova.compute.manager [req-841b4859-7ec7-45b8-ad50-9a39096209d4 req-fae74633-7301-4bfd-9e57-cb8eadfe45e7 service nova] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Received unexpected event network-vif-plugged-8aa1f220-b71a-4dce-b48a-cbef38e01517 for instance with vm_state rescued and task_state unrescuing.
Nov 18 17:25:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:50 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:51 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cda105a8-efa4-4a73-8507-bdb278b7b6b7 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:25:51 user nova-compute[74743]: DEBUG nova.compute.manager [req-52317afb-e612-43cd-9763-d7621b1f498f req-5dfa84f0-2b7f-43fc-8cad-87ebc454b0d2 service nova] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Received event network-vif-plugged-8aa1f220-b71a-4dce-b48a-cbef38e01517 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:25:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-52317afb-e612-43cd-9763-d7621b1f498f req-5dfa84f0-2b7f-43fc-8cad-87ebc454b0d2 service nova] Acquiring lock "93772071-cb21-4f4e-8b07-c55be8cf7bea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:25:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-52317afb-e612-43cd-9763-d7621b1f498f req-5dfa84f0-2b7f-43fc-8cad-87ebc454b0d2 service nova] Lock "93772071-cb21-4f4e-8b07-c55be8cf7bea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:25:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-52317afb-e612-43cd-9763-d7621b1f498f req-5dfa84f0-2b7f-43fc-8cad-87ebc454b0d2 service nova] Lock "93772071-cb21-4f4e-8b07-c55be8cf7bea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:25:51 user nova-compute[74743]: DEBUG nova.compute.manager [req-52317afb-e612-43cd-9763-d7621b1f498f req-5dfa84f0-2b7f-43fc-8cad-87ebc454b0d2 service nova] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] No waiting events found dispatching network-vif-plugged-8aa1f220-b71a-4dce-b48a-cbef38e01517 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:25:51 user nova-compute[74743]: WARNING nova.compute.manager [req-52317afb-e612-43cd-9763-d7621b1f498f req-5dfa84f0-2b7f-43fc-8cad-87ebc454b0d2 service nova] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Received unexpected event network-vif-plugged-8aa1f220-b71a-4dce-b48a-cbef38e01517 for instance with vm_state rescued and task_state unrescuing.
Nov 18 17:25:51 user nova-compute[74743]: DEBUG nova.compute.manager [req-52317afb-e612-43cd-9763-d7621b1f498f req-5dfa84f0-2b7f-43fc-8cad-87ebc454b0d2 service nova] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Received event network-vif-plugged-8aa1f220-b71a-4dce-b48a-cbef38e01517 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:25:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-52317afb-e612-43cd-9763-d7621b1f498f req-5dfa84f0-2b7f-43fc-8cad-87ebc454b0d2 service nova] Acquiring lock "93772071-cb21-4f4e-8b07-c55be8cf7bea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:25:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-52317afb-e612-43cd-9763-d7621b1f498f req-5dfa84f0-2b7f-43fc-8cad-87ebc454b0d2 service nova] Lock "93772071-cb21-4f4e-8b07-c55be8cf7bea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:25:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-52317afb-e612-43cd-9763-d7621b1f498f req-5dfa84f0-2b7f-43fc-8cad-87ebc454b0d2 service nova] Lock "93772071-cb21-4f4e-8b07-c55be8cf7bea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:25:51 user nova-compute[74743]: DEBUG nova.compute.manager [req-52317afb-e612-43cd-9763-d7621b1f498f req-5dfa84f0-2b7f-43fc-8cad-87ebc454b0d2 service nova] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] No waiting events found dispatching network-vif-plugged-8aa1f220-b71a-4dce-b48a-cbef38e01517 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:25:51 user nova-compute[74743]: WARNING nova.compute.manager [req-52317afb-e612-43cd-9763-d7621b1f498f req-5dfa84f0-2b7f-43fc-8cad-87ebc454b0d2 service nova] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Received unexpected event network-vif-plugged-8aa1f220-b71a-4dce-b48a-cbef38e01517 for instance with vm_state rescued and task_state unrescuing.
Nov 18 17:25:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-df0905be-b57f-45aa-8992-386949d0f1d5 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Acquiring lock "c58db905-7030-44d1-80ca-91e0cd746218" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:25:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-df0905be-b57f-45aa-8992-386949d0f1d5 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "c58db905-7030-44d1-80ca-91e0cd746218" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:25:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-df0905be-b57f-45aa-8992-386949d0f1d5 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Acquiring lock "c58db905-7030-44d1-80ca-91e0cd746218-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:25:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-df0905be-b57f-45aa-8992-386949d0f1d5 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "c58db905-7030-44d1-80ca-91e0cd746218-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:25:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-df0905be-b57f-45aa-8992-386949d0f1d5 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "c58db905-7030-44d1-80ca-91e0cd746218-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:25:55 user nova-compute[74743]: INFO nova.compute.manager [None req-df0905be-b57f-45aa-8992-386949d0f1d5 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Terminating instance
Nov 18 17:25:55 user nova-compute[74743]: DEBUG nova.compute.manager [None req-df0905be-b57f-45aa-8992-386949d0f1d5 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Start destroying the instance on the hypervisor. {{(pid=74743) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 17:25:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:55 user nova-compute[74743]: DEBUG nova.compute.manager [req-96f4ce30-2f43-4bf0-8086-0bcce32f0de5 req-84b80862-06f0-490c-be89-6b1e295edab0 service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Received event network-vif-unplugged-2dc327a1-177d-4d19-9fb1-ce60b5367a7e {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:25:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-96f4ce30-2f43-4bf0-8086-0bcce32f0de5 req-84b80862-06f0-490c-be89-6b1e295edab0 service nova] Acquiring lock "c58db905-7030-44d1-80ca-91e0cd746218-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:25:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-96f4ce30-2f43-4bf0-8086-0bcce32f0de5 req-84b80862-06f0-490c-be89-6b1e295edab0 service nova] Lock "c58db905-7030-44d1-80ca-91e0cd746218-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:25:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-96f4ce30-2f43-4bf0-8086-0bcce32f0de5 req-84b80862-06f0-490c-be89-6b1e295edab0 service nova] Lock "c58db905-7030-44d1-80ca-91e0cd746218-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:25:55 user nova-compute[74743]: DEBUG nova.compute.manager [req-96f4ce30-2f43-4bf0-8086-0bcce32f0de5 req-84b80862-06f0-490c-be89-6b1e295edab0 service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] No waiting events found dispatching network-vif-unplugged-2dc327a1-177d-4d19-9fb1-ce60b5367a7e {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:25:55 user nova-compute[74743]: DEBUG nova.compute.manager [req-96f4ce30-2f43-4bf0-8086-0bcce32f0de5 req-84b80862-06f0-490c-be89-6b1e295edab0 service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Received event network-vif-unplugged-2dc327a1-177d-4d19-9fb1-ce60b5367a7e for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:25:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:56 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Instance destroyed successfully.
Nov 18 17:25:56 user nova-compute[74743]: DEBUG nova.objects.instance [None req-df0905be-b57f-45aa-8992-386949d0f1d5 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lazy-loading 'resources' on Instance uuid c58db905-7030-44d1-80ca-91e0cd746218 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:25:56 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-df0905be-b57f-45aa-8992-386949d0f1d5 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-18T17:20:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1999190186',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1999190186',id=36,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAVdZsN+DFKrCPNzanPHBqWs091OcQHgphg4iBlSfWRqz7epu6i3jKz8RNDrRHwUSaEHm/Cp6vRBJpFWpKEkvK3bZeVx7cY08vXJaHPMBdOZ7gBw6/rmmlh7AEdXEtEhkA==',key_name='tempest-keypair-405514316',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:24:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0a17803c613c4ef299c797bba85c1a4b',ramdisk_id='',reservation_id='r-p5x4eoy0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-13499029',owner_user_name='tempest-AttachVolumeShelveTestJSON-13499029-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:24:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18483ad6106b4d95afbbed450d625b53',uuid=c58db905-7030-44d1-80ca-91e0cd746218,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2dc327a1-177d-4d19-9fb1-ce60b5367a7e", "address": "fa:16:3e:05:b8:d4", "network": {"id": "e1c28f74-c9c1-4eb3-931e-003332ff6243", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-453481916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a17803c613c4ef299c797bba85c1a4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc327a1-17", "ovs_interfaceid": "2dc327a1-177d-4d19-9fb1-ce60b5367a7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:25:56 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-df0905be-b57f-45aa-8992-386949d0f1d5 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Converting VIF {"id": "2dc327a1-177d-4d19-9fb1-ce60b5367a7e", "address": "fa:16:3e:05:b8:d4", "network": {"id": "e1c28f74-c9c1-4eb3-931e-003332ff6243", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-453481916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a17803c613c4ef299c797bba85c1a4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc327a1-17", "ovs_interfaceid": "2dc327a1-177d-4d19-9fb1-ce60b5367a7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:25:56 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-df0905be-b57f-45aa-8992-386949d0f1d5 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:b8:d4,bridge_name='br-int',has_traffic_filtering=True,id=2dc327a1-177d-4d19-9fb1-ce60b5367a7e,network=Network(e1c28f74-c9c1-4eb3-931e-003332ff6243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dc327a1-17') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:25:56 user nova-compute[74743]: DEBUG os_vif [None req-df0905be-b57f-45aa-8992-386949d0f1d5 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:b8:d4,bridge_name='br-int',has_traffic_filtering=True,id=2dc327a1-177d-4d19-9fb1-ce60b5367a7e,network=Network(e1c28f74-c9c1-4eb3-931e-003332ff6243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dc327a1-17') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:25:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2dc327a1-17, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:25:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:25:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3f20bdb0-0e96-40fc-97c1-80bad833b88f) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:25:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:56 user nova-compute[74743]: INFO os_vif [None req-df0905be-b57f-45aa-8992-386949d0f1d5 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:b8:d4,bridge_name='br-int',has_traffic_filtering=True,id=2dc327a1-177d-4d19-9fb1-ce60b5367a7e,network=Network(e1c28f74-c9c1-4eb3-931e-003332ff6243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dc327a1-17')
Nov 18 17:25:56 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-df0905be-b57f-45aa-8992-386949d0f1d5 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Deleting instance files /opt/stack/data/nova/instances/c58db905-7030-44d1-80ca-91e0cd746218_del
Nov 18 17:25:56 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-df0905be-b57f-45aa-8992-386949d0f1d5 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Deletion of /opt/stack/data/nova/instances/c58db905-7030-44d1-80ca-91e0cd746218_del complete
Nov 18 17:25:56 user nova-compute[74743]: INFO nova.compute.manager [None req-df0905be-b57f-45aa-8992-386949d0f1d5 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 18 17:25:56 user nova-compute[74743]: DEBUG oslo.service.loopingcall [None req-df0905be-b57f-45aa-8992-386949d0f1d5 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74743) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 17:25:56 user nova-compute[74743]: DEBUG nova.compute.manager [-] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Deallocating network for instance {{(pid=74743) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 17:25:56 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: c58db905-7030-44d1-80ca-91e0cd746218] deallocate_for_instance() {{(pid=74743) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 17:25:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:25:57 user nova-compute[74743]: DEBUG nova.compute.manager [req-57bd401a-de52-40f3-914c-0418ca18d389 req-8fb2cde8-5dd1-4f8c-8ad1-43ff04b42c9e service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Received event network-vif-deleted-2dc327a1-177d-4d19-9fb1-ce60b5367a7e {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:25:57 user nova-compute[74743]: INFO nova.compute.manager [req-57bd401a-de52-40f3-914c-0418ca18d389 req-8fb2cde8-5dd1-4f8c-8ad1-43ff04b42c9e service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Neutron deleted interface 2dc327a1-177d-4d19-9fb1-ce60b5367a7e; detaching it from the instance and deleting it from the info cache
Nov 18 17:25:57 user nova-compute[74743]: DEBUG nova.network.neutron [req-57bd401a-de52-40f3-914c-0418ca18d389 req-8fb2cde8-5dd1-4f8c-8ad1-43ff04b42c9e service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:25:57 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:25:57 user nova-compute[74743]: INFO nova.compute.manager [-] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Took 0.85 seconds to deallocate network for instance.
Nov 18 17:25:57 user nova-compute[74743]: DEBUG nova.compute.manager [req-57bd401a-de52-40f3-914c-0418ca18d389 req-8fb2cde8-5dd1-4f8c-8ad1-43ff04b42c9e service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Detach interface failed, port_id=2dc327a1-177d-4d19-9fb1-ce60b5367a7e, reason: Instance c58db905-7030-44d1-80ca-91e0cd746218 could not be found. {{(pid=74743) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 17:25:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-df0905be-b57f-45aa-8992-386949d0f1d5 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:25:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-df0905be-b57f-45aa-8992-386949d0f1d5 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:25:57 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-df0905be-b57f-45aa-8992-386949d0f1d5 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:25:57 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-df0905be-b57f-45aa-8992-386949d0f1d5 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:25:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-df0905be-b57f-45aa-8992-386949d0f1d5 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.283s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:25:57 user nova-compute[74743]: INFO nova.scheduler.client.report [None req-df0905be-b57f-45aa-8992-386949d0f1d5 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Deleted allocations for instance c58db905-7030-44d1-80ca-91e0cd746218
Nov 18 17:25:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-df0905be-b57f-45aa-8992-386949d0f1d5 tempest-AttachVolumeShelveTestJSON-13499029 tempest-AttachVolumeShelveTestJSON-13499029-project-member] Lock "c58db905-7030-44d1-80ca-91e0cd746218" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.384s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:25:57 user nova-compute[74743]: DEBUG nova.compute.manager [req-e621b35b-e868-4d0f-ad53-c872a311233d req-1a336337-31ae-4b7f-8d2f-c8992fc827cd service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Received event network-vif-plugged-2dc327a1-177d-4d19-9fb1-ce60b5367a7e {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:25:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e621b35b-e868-4d0f-ad53-c872a311233d req-1a336337-31ae-4b7f-8d2f-c8992fc827cd service nova] Acquiring lock "c58db905-7030-44d1-80ca-91e0cd746218-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:25:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e621b35b-e868-4d0f-ad53-c872a311233d req-1a336337-31ae-4b7f-8d2f-c8992fc827cd service nova] Lock "c58db905-7030-44d1-80ca-91e0cd746218-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:25:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e621b35b-e868-4d0f-ad53-c872a311233d req-1a336337-31ae-4b7f-8d2f-c8992fc827cd service nova] Lock "c58db905-7030-44d1-80ca-91e0cd746218-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:25:57 user nova-compute[74743]: DEBUG nova.compute.manager [req-e621b35b-e868-4d0f-ad53-c872a311233d req-1a336337-31ae-4b7f-8d2f-c8992fc827cd service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] No waiting events found dispatching network-vif-plugged-2dc327a1-177d-4d19-9fb1-ce60b5367a7e {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:25:57 user nova-compute[74743]: WARNING nova.compute.manager [req-e621b35b-e868-4d0f-ad53-c872a311233d req-1a336337-31ae-4b7f-8d2f-c8992fc827cd service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Received unexpected event network-vif-plugged-2dc327a1-177d-4d19-9fb1-ce60b5367a7e for instance with vm_state deleted and task_state None.
Nov 18 17:25:57 user nova-compute[74743]: DEBUG nova.compute.manager [req-e621b35b-e868-4d0f-ad53-c872a311233d req-1a336337-31ae-4b7f-8d2f-c8992fc827cd service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Received event network-vif-plugged-2dc327a1-177d-4d19-9fb1-ce60b5367a7e {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:25:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e621b35b-e868-4d0f-ad53-c872a311233d req-1a336337-31ae-4b7f-8d2f-c8992fc827cd service nova] Acquiring lock "c58db905-7030-44d1-80ca-91e0cd746218-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:25:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e621b35b-e868-4d0f-ad53-c872a311233d req-1a336337-31ae-4b7f-8d2f-c8992fc827cd service nova] Lock "c58db905-7030-44d1-80ca-91e0cd746218-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:25:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e621b35b-e868-4d0f-ad53-c872a311233d req-1a336337-31ae-4b7f-8d2f-c8992fc827cd service nova] Lock "c58db905-7030-44d1-80ca-91e0cd746218-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:25:57 user nova-compute[74743]: DEBUG nova.compute.manager [req-e621b35b-e868-4d0f-ad53-c872a311233d req-1a336337-31ae-4b7f-8d2f-c8992fc827cd service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] No waiting events found dispatching network-vif-plugged-2dc327a1-177d-4d19-9fb1-ce60b5367a7e {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:25:57 user nova-compute[74743]: WARNING nova.compute.manager [req-e621b35b-e868-4d0f-ad53-c872a311233d req-1a336337-31ae-4b7f-8d2f-c8992fc827cd service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Received unexpected event network-vif-plugged-2dc327a1-177d-4d19-9fb1-ce60b5367a7e for instance with vm_state deleted and task_state None.
Nov 18 17:25:57 user nova-compute[74743]: DEBUG nova.compute.manager [req-e621b35b-e868-4d0f-ad53-c872a311233d req-1a336337-31ae-4b7f-8d2f-c8992fc827cd service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Received event network-vif-plugged-2dc327a1-177d-4d19-9fb1-ce60b5367a7e {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:25:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e621b35b-e868-4d0f-ad53-c872a311233d req-1a336337-31ae-4b7f-8d2f-c8992fc827cd service nova] Acquiring lock "c58db905-7030-44d1-80ca-91e0cd746218-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:25:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e621b35b-e868-4d0f-ad53-c872a311233d req-1a336337-31ae-4b7f-8d2f-c8992fc827cd service nova] Lock "c58db905-7030-44d1-80ca-91e0cd746218-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:25:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e621b35b-e868-4d0f-ad53-c872a311233d req-1a336337-31ae-4b7f-8d2f-c8992fc827cd service nova] Lock "c58db905-7030-44d1-80ca-91e0cd746218-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:25:57 user nova-compute[74743]: DEBUG nova.compute.manager [req-e621b35b-e868-4d0f-ad53-c872a311233d req-1a336337-31ae-4b7f-8d2f-c8992fc827cd service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] No waiting events found dispatching network-vif-plugged-2dc327a1-177d-4d19-9fb1-ce60b5367a7e {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:25:57 user nova-compute[74743]: WARNING nova.compute.manager [req-e621b35b-e868-4d0f-ad53-c872a311233d req-1a336337-31ae-4b7f-8d2f-c8992fc827cd service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Received unexpected event network-vif-plugged-2dc327a1-177d-4d19-9fb1-ce60b5367a7e for instance with vm_state deleted and task_state None.
Nov 18 17:25:57 user nova-compute[74743]: DEBUG nova.compute.manager [req-e621b35b-e868-4d0f-ad53-c872a311233d req-1a336337-31ae-4b7f-8d2f-c8992fc827cd service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Received event network-vif-unplugged-2dc327a1-177d-4d19-9fb1-ce60b5367a7e {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:25:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e621b35b-e868-4d0f-ad53-c872a311233d req-1a336337-31ae-4b7f-8d2f-c8992fc827cd service nova] Acquiring lock "c58db905-7030-44d1-80ca-91e0cd746218-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:25:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e621b35b-e868-4d0f-ad53-c872a311233d req-1a336337-31ae-4b7f-8d2f-c8992fc827cd service nova] Lock "c58db905-7030-44d1-80ca-91e0cd746218-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:25:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e621b35b-e868-4d0f-ad53-c872a311233d req-1a336337-31ae-4b7f-8d2f-c8992fc827cd service nova] Lock "c58db905-7030-44d1-80ca-91e0cd746218-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:25:57 user nova-compute[74743]: DEBUG nova.compute.manager [req-e621b35b-e868-4d0f-ad53-c872a311233d req-1a336337-31ae-4b7f-8d2f-c8992fc827cd service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] No waiting events found dispatching network-vif-unplugged-2dc327a1-177d-4d19-9fb1-ce60b5367a7e {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:25:57 user nova-compute[74743]: WARNING nova.compute.manager [req-e621b35b-e868-4d0f-ad53-c872a311233d req-1a336337-31ae-4b7f-8d2f-c8992fc827cd service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Received unexpected event network-vif-unplugged-2dc327a1-177d-4d19-9fb1-ce60b5367a7e for instance with vm_state deleted and task_state None.
Nov 18 17:25:57 user nova-compute[74743]: DEBUG nova.compute.manager [req-e621b35b-e868-4d0f-ad53-c872a311233d req-1a336337-31ae-4b7f-8d2f-c8992fc827cd service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Received event network-vif-plugged-2dc327a1-177d-4d19-9fb1-ce60b5367a7e {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:25:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e621b35b-e868-4d0f-ad53-c872a311233d req-1a336337-31ae-4b7f-8d2f-c8992fc827cd service nova] Acquiring lock "c58db905-7030-44d1-80ca-91e0cd746218-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:25:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e621b35b-e868-4d0f-ad53-c872a311233d req-1a336337-31ae-4b7f-8d2f-c8992fc827cd service nova] Lock "c58db905-7030-44d1-80ca-91e0cd746218-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:25:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e621b35b-e868-4d0f-ad53-c872a311233d req-1a336337-31ae-4b7f-8d2f-c8992fc827cd service nova] Lock "c58db905-7030-44d1-80ca-91e0cd746218-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:25:57 user nova-compute[74743]: DEBUG nova.compute.manager [req-e621b35b-e868-4d0f-ad53-c872a311233d req-1a336337-31ae-4b7f-8d2f-c8992fc827cd service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] No waiting events found dispatching network-vif-plugged-2dc327a1-177d-4d19-9fb1-ce60b5367a7e {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:25:57 user nova-compute[74743]: WARNING nova.compute.manager [req-e621b35b-e868-4d0f-ad53-c872a311233d req-1a336337-31ae-4b7f-8d2f-c8992fc827cd service nova] [instance: c58db905-7030-44d1-80ca-91e0cd746218] Received unexpected event network-vif-plugged-2dc327a1-177d-4d19-9fb1-ce60b5367a7e for instance with vm_state deleted and task_state None.
Nov 18 17:26:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:26:01 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:26:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:26:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:26:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:26:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:26:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:26:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:26:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:26:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:26:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:26:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:26:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:26:29 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:26:31 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:26:33 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:26:33 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:26:33 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74743) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 17:26:34 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:26:35 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:26:36 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:26:39 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:26:40 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:26:40 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Starting heal instance info cache {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 17:26:40 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Didn't find any instances for network info cache update. {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 18 17:26:40 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:26:40 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:26:40 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:26:40 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:26:40 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Auditing locally available compute resources for user (node: user) {{(pid=74743) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 17:26:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/789583c2-1c04-4510-a37e-0e9b7d3a0971/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:26:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/789583c2-1c04-4510-a37e-0e9b7d3a0971/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:26:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/789583c2-1c04-4510-a37e-0e9b7d3a0971/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:26:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/789583c2-1c04-4510-a37e-0e9b7d3a0971/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:26:41 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:26:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:26:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:26:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:26:41 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:26:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:26:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b111f169-d737-4bbe-bad3-394a2bc57218/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:26:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b111f169-d737-4bbe-bad3-394a2bc57218/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:26:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b111f169-d737-4bbe-bad3-394a2bc57218/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:26:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b111f169-d737-4bbe-bad3-394a2bc57218/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:26:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fd86416-72c2-45e5-814d-9195b4cfcc61/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:26:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fd86416-72c2-45e5-814d-9195b4cfcc61/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:26:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fd86416-72c2-45e5-814d-9195b4cfcc61/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:26:42 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fd86416-72c2-45e5-814d-9195b4cfcc61/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:26:42 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:26:42 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:26:42 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0b7c0c-a4ad-4ccd-b60a-721070a57f98/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:26:42 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0b7c0c-a4ad-4ccd-b60a-721070a57f98/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:26:42 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0b7c0c-a4ad-4ccd-b60a-721070a57f98/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:26:42 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0b7c0c-a4ad-4ccd-b60a-721070a57f98/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:26:43 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:26:43 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:26:43 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Hypervisor/Node resource view: name=user free_ram=8201MB free_disk=25.0330810546875GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74743) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 17:26:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:26:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:26:43 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance aefe3db1-b9bb-4cce-aa31-d0b6684ad791 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:26:43 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance f649143e-f7db-475a-bbe5-d5e7316caac3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:26:43 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 789583c2-1c04-4510-a37e-0e9b7d3a0971 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:26:43 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 93772071-cb21-4f4e-8b07-c55be8cf7bea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:26:43 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 1fd86416-72c2-45e5-814d-9195b4cfcc61 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:26:43 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:26:43 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance b111f169-d737-4bbe-bad3-394a2bc57218 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:26:43 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 17:26:43 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 17:26:43 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:26:43 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:26:43 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Compute_service record updated for user:user {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 17:26:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.470s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:26:45 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:26:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:26:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:26:48 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cd6fd1dd-6a78-4503-9eec-492b291b4fd5 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Acquiring lock "7e0b7c0c-a4ad-4ccd-b60a-721070a57f98" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:26:48 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cd6fd1dd-6a78-4503-9eec-492b291b4fd5 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "7e0b7c0c-a4ad-4ccd-b60a-721070a57f98" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:26:48 user nova-compute[74743]: DEBUG nova.objects.instance [None req-cd6fd1dd-6a78-4503-9eec-492b291b4fd5 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lazy-loading 'flavor' on Instance uuid 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:26:48 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cd6fd1dd-6a78-4503-9eec-492b291b4fd5 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "7e0b7c0c-a4ad-4ccd-b60a-721070a57f98" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:26:48 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cd6fd1dd-6a78-4503-9eec-492b291b4fd5 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Acquiring lock "7e0b7c0c-a4ad-4ccd-b60a-721070a57f98" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:26:48 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cd6fd1dd-6a78-4503-9eec-492b291b4fd5 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "7e0b7c0c-a4ad-4ccd-b60a-721070a57f98" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:26:48 user nova-compute[74743]: INFO nova.compute.manager [None req-cd6fd1dd-6a78-4503-9eec-492b291b4fd5 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Attaching volume 66125cd9-577b-4c86-856e-7f157125c46a to /dev/vdb
Nov 18 17:26:48 user nova-compute[74743]: DEBUG os_brick.utils [None req-cd6fd1dd-6a78-4503-9eec-492b291b4fd5 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:26:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:26:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:26:48 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7cf95e-e20d-4dda-8243-569a4bc0a357]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1116acd8874d\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:26:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:26:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:26:48 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc776a63-9175-415c-be8f-c65d4d6a476c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:26:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:26:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:26:48 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f7ecec-7655-4e74-a9c0-b9b49d204ff2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:26:48 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbd63bc-30a6-4cab-b2a9-eb23f43bd14e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:26:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cd6fd1dd-6a78-4503-9eec-492b291b4fd5 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Running cmd (subprocess): nvme version {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:26:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cd6fd1dd-6a78-4503-9eec-492b291b4fd5 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] 'nvme version' failed. Not Retrying. {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:26:48 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cd6fd1dd-6a78-4503-9eec-492b291b4fd5 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] nvme not present on system {{(pid=74743) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 17:26:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:26:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:26:48 user nova-compute[74743]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 17:26:48 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a942d12d-0ea9-4df0-a172-8123fd0905a7]: (4, '') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:26:48 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-cd6fd1dd-6a78-4503-9eec-492b291b4fd5 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74743) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 17:26:48 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-cd6fd1dd-6a78-4503-9eec-492b291b4fd5 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 17:26:48 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-cd6fd1dd-6a78-4503-9eec-492b291b4fd5 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] LIGHTOS: no hostnqn found. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 17:26:48 user nova-compute[74743]: DEBUG os_brick.utils [None req-cd6fd1dd-6a78-4503-9eec-492b291b4fd5 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1116acd8874d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:26:48 user nova-compute[74743]: DEBUG nova.virt.block_device [None req-cd6fd1dd-6a78-4503-9eec-492b291b4fd5 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Updating existing volume attachment record: d13b4a62-4802-4291-bdc7-fd246e11b412 {{(pid=74743) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 17:26:51 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:26:54 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd6fd1dd-6a78-4503-9eec-492b291b4fd5 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Calling os-brick to attach iSCSI Volume {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 17:26:54 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6fd1dd-6a78-4503-9eec-492b291b4fd5 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pqzfORIa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:26:54 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-cd6fd1dd-6a78-4503-9eec-492b291b4fd5 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:26:54 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-cd6fd1dd-6a78-4503-9eec-492b291b4fd5 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:26:54 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-cd6fd1dd-6a78-4503-9eec-492b291b4fd5 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:26:54 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-cd6fd1dd-6a78-4503-9eec-492b291b4fd5 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:26:54 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-cd6fd1dd-6a78-4503-9eec-492b291b4fd5 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:26:54 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-cd6fd1dd-6a78-4503-9eec-492b291b4fd5 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:26:54 user nova-compute[74743]: INFO os_brick.initiator.connectors.iscsi [None req-cd6fd1dd-6a78-4503-9eec-492b291b4fd5 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 17:26:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a -p 172.16.0.220:3260 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:26:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:26:54 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54c32fb-7fbf-488f-a6e1-88e088db9077]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:26:54 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6fd1dd-6a78-4503-9eec-492b291b4fd5 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 17:26:54 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:26:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a -p 172.16.0.220:3260 --interface default --op new {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:26:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:26:54 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[52631e19-c23a-4893-ac40-b662fea2d64f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a] added\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:26:54 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6fd1dd-6a78-4503-9eec-492b291b4fd5 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a] added
Nov 18 17:26:54 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:26:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:26:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:26:54 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba22213-661b-4e5a-89a6-8a884b77f569]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:26:54 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6fd1dd-6a78-4503-9eec-492b291b4fd5 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:26:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:26:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:26:54 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b31b0dd-5cde-4627-884c-fc64e85fc181]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:26:54 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6fd1dd-6a78-4503-9eec-492b291b4fd5 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:26:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pqzfORIa {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:26:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pqzfORIa" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:26:54 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b05a03b-a2ae-419d-9f89-874bffa92001]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:26:54 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6fd1dd-6a78-4503-9eec-492b291b4fd5 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pqzfORIa'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:26:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:26:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:26:54 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfce4fbd-d5d3-4a0a-a922-1584a352e7d9]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:26:54 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6fd1dd-6a78-4503-9eec-492b291b4fd5 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:26:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:26:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:26:54 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6b066a-5c41-47ba-a750-3678c3d2d9ab]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:26:54 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6fd1dd-6a78-4503-9eec-492b291b4fd5 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:26:54 user nova-compute[74743]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb (non-flash)
Nov 18 17:26:54 user nova-compute[74743]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb (non-flash)
Nov 18 17:26:54 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:26:54 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6fd1dd-6a78-4503-9eec-492b291b4fd5 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:26:54 user nova-compute[74743]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb (non-flash)
Nov 18 17:26:54 user nova-compute[74743]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb (non-flash)
Nov 18 17:26:54 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:26:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a -p 172.16.0.220:3260 --login {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:26:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:26:54 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeae5a5e-534a-42a5-a5c9-64b3e9fedf02]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:26:54 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6fd1dd-6a78-4503-9eec-492b291b4fd5 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a, portal: 172.16.0.220,3260]
Nov 18 17:26:54 user nova-compute[74743]: Login to [iface: default, target: iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a, portal: 172.16.0.220,3260] successful.
Nov 18 17:26:54 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:26:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:26:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:26:54 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f6b3d1-5ed6-4782-9794-3c32e646fa80]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:26:54 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6fd1dd-6a78-4503-9eec-492b291b4fd5 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:26:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:26:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:26:54 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa99574d-54b2-487b-a67c-009753ead4dc]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:26:54 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6fd1dd-6a78-4503-9eec-492b291b4fd5 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:26:54 user nova-compute[74743]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb (non-flash)
Nov 18 17:26:54 user nova-compute[74743]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb (non-flash)
Nov 18 17:26:54 user nova-compute[74743]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a (non-flash)
Nov 18 17:26:54 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:26:54 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6fd1dd-6a78-4503-9eec-492b291b4fd5 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:26:54 user nova-compute[74743]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb (non-flash)
Nov 18 17:26:54 user nova-compute[74743]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb (non-flash)
Nov 18 17:26:54 user nova-compute[74743]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a (non-flash)
Nov 18 17:26:54 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:26:54 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-cd6fd1dd-6a78-4503-9eec-492b291b4fd5 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:26:54 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6fd1dd-6a78-4503-9eec-492b291b4fd5 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Connected to 172.16.0.220:3260 {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 17:26:54 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-cd6fd1dd-6a78-4503-9eec-492b291b4fd5 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] HCTL ('35', '-', '-', 0) found on session 49 with lun 0 {{(pid=74743) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 17:26:54 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-cd6fd1dd-6a78-4503-9eec-492b291b4fd5 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74743) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 17:26:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:26:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:26:54 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e63305e-f899-42ae-814e-5181a129d77a]: (4, ('- - 0', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:26:54 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-cd6fd1dd-6a78-4503-9eec-492b291b4fd5 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: None {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:26:55 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-cd6fd1dd-6a78-4503-9eec-492b291b4fd5 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:26:55 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6fd1dd-6a78-4503-9eec-492b291b4fd5 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pqzfORIa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 17:26:55 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-cd6fd1dd-6a78-4503-9eec-492b291b4fd5 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:26:55 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6fd1dd-6a78-4503-9eec-492b291b4fd5 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23634323535376234', 'path': '/dev/sdd'} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:26:55 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd6fd1dd-6a78-4503-9eec-492b291b4fd5 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634323535376234', 'path': '/dev/sdd'} {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 17:26:55 user nova-compute[74743]: DEBUG nova.objects.instance [None req-cd6fd1dd-6a78-4503-9eec-492b291b4fd5 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lazy-loading 'flavor' on Instance uuid 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:26:55 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-cd6fd1dd-6a78-4503-9eec-492b291b4fd5 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 17:26:55 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:26:55 user nova-compute[74743]:   <source dev="/dev/sdd"/>
Nov 18 17:26:55 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:26:55 user nova-compute[74743]:   <serial>66125cd9-577b-4c86-856e-7f157125c46a</serial>
Nov 18 17:26:55 user nova-compute[74743]: </disk>
Nov 18 17:26:55 user nova-compute[74743]:  {{(pid=74743) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 17:26:56 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cd6fd1dd-6a78-4503-9eec-492b291b4fd5 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:26:56 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cd6fd1dd-6a78-4503-9eec-492b291b4fd5 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:26:56 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cd6fd1dd-6a78-4503-9eec-492b291b4fd5 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] No VIF found with MAC fa:16:3e:a3:43:e6, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:26:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cd6fd1dd-6a78-4503-9eec-492b291b4fd5 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "7e0b7c0c-a4ad-4ccd-b60a-721070a57f98" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.780s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:26:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:26:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:26:59 user nova-compute[74743]: DEBUG nova.compute.manager [req-4e978752-fd8f-4977-8934-2ef1fb9781c8 req-e6f9f9c8-b8a3-41a5-81ca-051cdc30a236 service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Received event network-changed-3387dc52-f4d5-438c-a2c4-cee4fd142694 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:26:59 user nova-compute[74743]: DEBUG nova.compute.manager [req-4e978752-fd8f-4977-8934-2ef1fb9781c8 req-e6f9f9c8-b8a3-41a5-81ca-051cdc30a236 service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Refreshing instance network info cache due to event network-changed-3387dc52-f4d5-438c-a2c4-cee4fd142694. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:26:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4e978752-fd8f-4977-8934-2ef1fb9781c8 req-e6f9f9c8-b8a3-41a5-81ca-051cdc30a236 service nova] Acquiring lock "refresh_cache-7e0b7c0c-a4ad-4ccd-b60a-721070a57f98" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:26:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4e978752-fd8f-4977-8934-2ef1fb9781c8 req-e6f9f9c8-b8a3-41a5-81ca-051cdc30a236 service nova] Acquired lock "refresh_cache-7e0b7c0c-a4ad-4ccd-b60a-721070a57f98" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:26:59 user nova-compute[74743]: DEBUG nova.network.neutron [req-4e978752-fd8f-4977-8934-2ef1fb9781c8 req-e6f9f9c8-b8a3-41a5-81ca-051cdc30a236 service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Refreshing network info cache for port 3387dc52-f4d5-438c-a2c4-cee4fd142694 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:26:59 user nova-compute[74743]: DEBUG nova.network.neutron [req-4e978752-fd8f-4977-8934-2ef1fb9781c8 req-e6f9f9c8-b8a3-41a5-81ca-051cdc30a236 service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Updated VIF entry in instance network info cache for port 3387dc52-f4d5-438c-a2c4-cee4fd142694. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:26:59 user nova-compute[74743]: DEBUG nova.network.neutron [req-4e978752-fd8f-4977-8934-2ef1fb9781c8 req-e6f9f9c8-b8a3-41a5-81ca-051cdc30a236 service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Updating instance_info_cache with network_info: [{"id": "3387dc52-f4d5-438c-a2c4-cee4fd142694", "address": "fa:16:3e:a3:43:e6", "network": {"id": "cd6d2dbc-0950-412a-ab9d-cf7615c06eb8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1261309930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38303e1b311044deb8c833ed3299ce88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3387dc52-f4", "ovs_interfaceid": "3387dc52-f4d5-438c-a2c4-cee4fd142694", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:26:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4e978752-fd8f-4977-8934-2ef1fb9781c8 req-e6f9f9c8-b8a3-41a5-81ca-051cdc30a236 service nova] Releasing lock "refresh_cache-7e0b7c0c-a4ad-4ccd-b60a-721070a57f98" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:27:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:27:01 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:27:01 user nova-compute[74743]: DEBUG nova.compute.manager [req-277ab320-9912-4ae9-bdbb-051d6cf394b9 req-00f9f3de-cadf-46ad-9162-52ff66e21418 service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Received event network-changed-3387dc52-f4d5-438c-a2c4-cee4fd142694 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:27:01 user nova-compute[74743]: DEBUG nova.compute.manager [req-277ab320-9912-4ae9-bdbb-051d6cf394b9 req-00f9f3de-cadf-46ad-9162-52ff66e21418 service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Refreshing instance network info cache due to event network-changed-3387dc52-f4d5-438c-a2c4-cee4fd142694. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:27:01 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-277ab320-9912-4ae9-bdbb-051d6cf394b9 req-00f9f3de-cadf-46ad-9162-52ff66e21418 service nova] Acquiring lock "refresh_cache-7e0b7c0c-a4ad-4ccd-b60a-721070a57f98" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:27:01 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-277ab320-9912-4ae9-bdbb-051d6cf394b9 req-00f9f3de-cadf-46ad-9162-52ff66e21418 service nova] Acquired lock "refresh_cache-7e0b7c0c-a4ad-4ccd-b60a-721070a57f98" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:27:01 user nova-compute[74743]: DEBUG nova.network.neutron [req-277ab320-9912-4ae9-bdbb-051d6cf394b9 req-00f9f3de-cadf-46ad-9162-52ff66e21418 service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Refreshing network info cache for port 3387dc52-f4d5-438c-a2c4-cee4fd142694 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:27:01 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-9603084f-61be-4401-a5b0-ce936959f64c tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Acquiring lock "7e0b7c0c-a4ad-4ccd-b60a-721070a57f98" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:27:01 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-9603084f-61be-4401-a5b0-ce936959f64c tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "7e0b7c0c-a4ad-4ccd-b60a-721070a57f98" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:27:01 user nova-compute[74743]: INFO nova.compute.manager [None req-9603084f-61be-4401-a5b0-ce936959f64c tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Rebooting instance
Nov 18 17:27:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-9603084f-61be-4401-a5b0-ce936959f64c tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Acquiring lock "refresh_cache-7e0b7c0c-a4ad-4ccd-b60a-721070a57f98" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:27:02 user nova-compute[74743]: DEBUG nova.network.neutron [req-277ab320-9912-4ae9-bdbb-051d6cf394b9 req-00f9f3de-cadf-46ad-9162-52ff66e21418 service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Updated VIF entry in instance network info cache for port 3387dc52-f4d5-438c-a2c4-cee4fd142694. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:27:02 user nova-compute[74743]: DEBUG nova.network.neutron [req-277ab320-9912-4ae9-bdbb-051d6cf394b9 req-00f9f3de-cadf-46ad-9162-52ff66e21418 service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Updating instance_info_cache with network_info: [{"id": "3387dc52-f4d5-438c-a2c4-cee4fd142694", "address": "fa:16:3e:a3:43:e6", "network": {"id": "cd6d2dbc-0950-412a-ab9d-cf7615c06eb8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1261309930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38303e1b311044deb8c833ed3299ce88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3387dc52-f4", "ovs_interfaceid": "3387dc52-f4d5-438c-a2c4-cee4fd142694", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:27:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-277ab320-9912-4ae9-bdbb-051d6cf394b9 req-00f9f3de-cadf-46ad-9162-52ff66e21418 service nova] Releasing lock "refresh_cache-7e0b7c0c-a4ad-4ccd-b60a-721070a57f98" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:27:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-9603084f-61be-4401-a5b0-ce936959f64c tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Acquired lock "refresh_cache-7e0b7c0c-a4ad-4ccd-b60a-721070a57f98" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:27:02 user nova-compute[74743]: DEBUG nova.network.neutron [None req-9603084f-61be-4401-a5b0-ce936959f64c tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:27:02 user nova-compute[74743]: DEBUG nova.network.neutron [None req-9603084f-61be-4401-a5b0-ce936959f64c tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Updating instance_info_cache with network_info: [{"id": "3387dc52-f4d5-438c-a2c4-cee4fd142694", "address": "fa:16:3e:a3:43:e6", "network": {"id": "cd6d2dbc-0950-412a-ab9d-cf7615c06eb8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1261309930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38303e1b311044deb8c833ed3299ce88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3387dc52-f4", "ovs_interfaceid": "3387dc52-f4d5-438c-a2c4-cee4fd142694", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:27:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-9603084f-61be-4401-a5b0-ce936959f64c tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Releasing lock "refresh_cache-7e0b7c0c-a4ad-4ccd-b60a-721070a57f98" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:27:02 user nova-compute[74743]: DEBUG nova.compute.manager [None req-9603084f-61be-4401-a5b0-ce936959f64c tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:27:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:27:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:27:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:27:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:27:05 user nova-compute[74743]: DEBUG nova.compute.manager [req-e689f344-6585-4c15-b8aa-ceeaef0efbfb req-2a68ae97-3c00-4ea8-a9fe-b473a1896f6f service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Received event network-vif-unplugged-3387dc52-f4d5-438c-a2c4-cee4fd142694 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:27:05 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e689f344-6585-4c15-b8aa-ceeaef0efbfb req-2a68ae97-3c00-4ea8-a9fe-b473a1896f6f service nova] Acquiring lock "7e0b7c0c-a4ad-4ccd-b60a-721070a57f98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:27:05 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e689f344-6585-4c15-b8aa-ceeaef0efbfb req-2a68ae97-3c00-4ea8-a9fe-b473a1896f6f service nova] Lock "7e0b7c0c-a4ad-4ccd-b60a-721070a57f98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:27:05 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e689f344-6585-4c15-b8aa-ceeaef0efbfb req-2a68ae97-3c00-4ea8-a9fe-b473a1896f6f service nova] Lock "7e0b7c0c-a4ad-4ccd-b60a-721070a57f98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:27:05 user nova-compute[74743]: DEBUG nova.compute.manager [req-e689f344-6585-4c15-b8aa-ceeaef0efbfb req-2a68ae97-3c00-4ea8-a9fe-b473a1896f6f service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] No waiting events found dispatching network-vif-unplugged-3387dc52-f4d5-438c-a2c4-cee4fd142694 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:27:05 user nova-compute[74743]: WARNING nova.compute.manager [req-e689f344-6585-4c15-b8aa-ceeaef0efbfb req-2a68ae97-3c00-4ea8-a9fe-b473a1896f6f service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Received unexpected event network-vif-unplugged-3387dc52-f4d5-438c-a2c4-cee4fd142694 for instance with vm_state active and task_state reboot_started.
Nov 18 17:27:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:27:05 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-9603084f-61be-4401-a5b0-ce936959f64c tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Instance shutdown successfully.
Nov 18 17:27:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:27:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:27:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:27:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:27:07 user nova-compute[74743]: DEBUG nova.compute.manager [req-214afc42-1abc-4b3f-919e-cebe9632858b req-2a514b83-f827-4013-911e-c75e744714ca service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Received event network-vif-plugged-3387dc52-f4d5-438c-a2c4-cee4fd142694 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:27:07 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-214afc42-1abc-4b3f-919e-cebe9632858b req-2a514b83-f827-4013-911e-c75e744714ca service nova] Acquiring lock "7e0b7c0c-a4ad-4ccd-b60a-721070a57f98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:27:07 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-214afc42-1abc-4b3f-919e-cebe9632858b req-2a514b83-f827-4013-911e-c75e744714ca service nova] Lock "7e0b7c0c-a4ad-4ccd-b60a-721070a57f98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:27:07 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-214afc42-1abc-4b3f-919e-cebe9632858b req-2a514b83-f827-4013-911e-c75e744714ca service nova] Lock "7e0b7c0c-a4ad-4ccd-b60a-721070a57f98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:27:07 user nova-compute[74743]: DEBUG nova.compute.manager [req-214afc42-1abc-4b3f-919e-cebe9632858b req-2a514b83-f827-4013-911e-c75e744714ca service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] No waiting events found dispatching network-vif-plugged-3387dc52-f4d5-438c-a2c4-cee4fd142694 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:27:07 user nova-compute[74743]: WARNING nova.compute.manager [req-214afc42-1abc-4b3f-919e-cebe9632858b req-2a514b83-f827-4013-911e-c75e744714ca service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Received unexpected event network-vif-plugged-3387dc52-f4d5-438c-a2c4-cee4fd142694 for instance with vm_state active and task_state reboot_started.
Nov 18 17:27:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:27:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:27:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:27:09 user nova-compute[74743]: DEBUG nova.compute.manager [req-b65942ae-9d3d-4276-896c-7c11dd4648cd req-6836e973-c1e0-4efa-a47e-4bcf87b0747f service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Received event network-vif-plugged-3387dc52-f4d5-438c-a2c4-cee4fd142694 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:27:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b65942ae-9d3d-4276-896c-7c11dd4648cd req-6836e973-c1e0-4efa-a47e-4bcf87b0747f service nova] Acquiring lock "7e0b7c0c-a4ad-4ccd-b60a-721070a57f98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:27:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b65942ae-9d3d-4276-896c-7c11dd4648cd req-6836e973-c1e0-4efa-a47e-4bcf87b0747f service nova] Lock "7e0b7c0c-a4ad-4ccd-b60a-721070a57f98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:27:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b65942ae-9d3d-4276-896c-7c11dd4648cd req-6836e973-c1e0-4efa-a47e-4bcf87b0747f service nova] Lock "7e0b7c0c-a4ad-4ccd-b60a-721070a57f98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:27:09 user nova-compute[74743]: DEBUG nova.compute.manager [req-b65942ae-9d3d-4276-896c-7c11dd4648cd req-6836e973-c1e0-4efa-a47e-4bcf87b0747f service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] No waiting events found dispatching network-vif-plugged-3387dc52-f4d5-438c-a2c4-cee4fd142694 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:27:09 user nova-compute[74743]: WARNING nova.compute.manager [req-b65942ae-9d3d-4276-896c-7c11dd4648cd req-6836e973-c1e0-4efa-a47e-4bcf87b0747f service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Received unexpected event network-vif-plugged-3387dc52-f4d5-438c-a2c4-cee4fd142694 for instance with vm_state active and task_state reboot_started.
Nov 18 17:27:09 user nova-compute[74743]: DEBUG nova.compute.manager [req-b65942ae-9d3d-4276-896c-7c11dd4648cd req-6836e973-c1e0-4efa-a47e-4bcf87b0747f service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Received event network-vif-plugged-3387dc52-f4d5-438c-a2c4-cee4fd142694 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:27:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b65942ae-9d3d-4276-896c-7c11dd4648cd req-6836e973-c1e0-4efa-a47e-4bcf87b0747f service nova] Acquiring lock "7e0b7c0c-a4ad-4ccd-b60a-721070a57f98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:27:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b65942ae-9d3d-4276-896c-7c11dd4648cd req-6836e973-c1e0-4efa-a47e-4bcf87b0747f service nova] Lock "7e0b7c0c-a4ad-4ccd-b60a-721070a57f98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:27:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b65942ae-9d3d-4276-896c-7c11dd4648cd req-6836e973-c1e0-4efa-a47e-4bcf87b0747f service nova] Lock "7e0b7c0c-a4ad-4ccd-b60a-721070a57f98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:27:09 user nova-compute[74743]: DEBUG nova.compute.manager [req-b65942ae-9d3d-4276-896c-7c11dd4648cd req-6836e973-c1e0-4efa-a47e-4bcf87b0747f service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] No waiting events found dispatching network-vif-plugged-3387dc52-f4d5-438c-a2c4-cee4fd142694 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:27:09 user nova-compute[74743]: WARNING nova.compute.manager [req-b65942ae-9d3d-4276-896c-7c11dd4648cd req-6836e973-c1e0-4efa-a47e-4bcf87b0747f service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Received unexpected event network-vif-plugged-3387dc52-f4d5-438c-a2c4-cee4fd142694 for instance with vm_state active and task_state reboot_started.
Nov 18 17:27:09 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Instance running successfully.
Nov 18 17:27:09 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-9603084f-61be-4401-a5b0-ce936959f64c tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Instance soft rebooted successfully.
Nov 18 17:27:09 user nova-compute[74743]: DEBUG nova.compute.manager [None req-9603084f-61be-4401-a5b0-ce936959f64c tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:27:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-9603084f-61be-4401-a5b0-ce936959f64c tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "7e0b7c0c-a4ad-4ccd-b60a-721070a57f98" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.408s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:27:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:27:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:27:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:27:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:27:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:27:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:27:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:27:27 user nova-compute[74743]: DEBUG nova.compute.manager [req-e142a6e4-b903-4e02-ad93-9cfb630f1413 req-8f648988-1792-409f-bf52-447d4b05be75 service nova] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Received event network-changed-f5631450-b11b-498b-978f-71101e2a80b5 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:27:27 user nova-compute[74743]: DEBUG nova.compute.manager [req-e142a6e4-b903-4e02-ad93-9cfb630f1413 req-8f648988-1792-409f-bf52-447d4b05be75 service nova] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Refreshing instance network info cache due to event network-changed-f5631450-b11b-498b-978f-71101e2a80b5. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:27:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e142a6e4-b903-4e02-ad93-9cfb630f1413 req-8f648988-1792-409f-bf52-447d4b05be75 service nova] Acquiring lock "refresh_cache-b111f169-d737-4bbe-bad3-394a2bc57218" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:27:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e142a6e4-b903-4e02-ad93-9cfb630f1413 req-8f648988-1792-409f-bf52-447d4b05be75 service nova] Acquired lock "refresh_cache-b111f169-d737-4bbe-bad3-394a2bc57218" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:27:27 user nova-compute[74743]: DEBUG nova.network.neutron [req-e142a6e4-b903-4e02-ad93-9cfb630f1413 req-8f648988-1792-409f-bf52-447d4b05be75 service nova] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Refreshing network info cache for port f5631450-b11b-498b-978f-71101e2a80b5 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:27:28 user nova-compute[74743]: DEBUG nova.network.neutron [req-e142a6e4-b903-4e02-ad93-9cfb630f1413 req-8f648988-1792-409f-bf52-447d4b05be75 service nova] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Updated VIF entry in instance network info cache for port f5631450-b11b-498b-978f-71101e2a80b5. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:27:28 user nova-compute[74743]: DEBUG nova.network.neutron [req-e142a6e4-b903-4e02-ad93-9cfb630f1413 req-8f648988-1792-409f-bf52-447d4b05be75 service nova] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Updating instance_info_cache with network_info: [{"id": "f5631450-b11b-498b-978f-71101e2a80b5", "address": "fa:16:3e:a4:4c:d4", "network": {"id": "b03d3355-7704-43de-8af7-7a5dc1ee490d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1492507432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5502edf6a6b94cb59d58d52494efc90d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5631450-b1", "ovs_interfaceid": "f5631450-b11b-498b-978f-71101e2a80b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:27:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-97452a4b-d54f-40bb-9882-5f3563482a04 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquiring lock "b111f169-d737-4bbe-bad3-394a2bc57218" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:27:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-97452a4b-d54f-40bb-9882-5f3563482a04 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "b111f169-d737-4bbe-bad3-394a2bc57218" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:27:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-97452a4b-d54f-40bb-9882-5f3563482a04 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquiring lock "b111f169-d737-4bbe-bad3-394a2bc57218-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:27:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-97452a4b-d54f-40bb-9882-5f3563482a04 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "b111f169-d737-4bbe-bad3-394a2bc57218-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:27:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-97452a4b-d54f-40bb-9882-5f3563482a04 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "b111f169-d737-4bbe-bad3-394a2bc57218-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:27:28 user nova-compute[74743]: INFO nova.compute.manager [None req-97452a4b-d54f-40bb-9882-5f3563482a04 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Terminating instance
Nov 18 17:27:28 user nova-compute[74743]: DEBUG nova.compute.manager [None req-97452a4b-d54f-40bb-9882-5f3563482a04 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Start destroying the instance on the hypervisor. {{(pid=74743) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 17:27:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e142a6e4-b903-4e02-ad93-9cfb630f1413 req-8f648988-1792-409f-bf52-447d4b05be75 service nova] Releasing lock "refresh_cache-b111f169-d737-4bbe-bad3-394a2bc57218" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:27:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:27:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:27:28 user nova-compute[74743]: DEBUG nova.compute.manager [req-af2cbaa2-7d35-4025-91aa-251e73acc982 req-5a698339-4dfc-419c-a168-cd108756fb76 service nova] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Received event network-vif-unplugged-f5631450-b11b-498b-978f-71101e2a80b5 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:27:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-af2cbaa2-7d35-4025-91aa-251e73acc982 req-5a698339-4dfc-419c-a168-cd108756fb76 service nova] Acquiring lock "b111f169-d737-4bbe-bad3-394a2bc57218-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:27:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-af2cbaa2-7d35-4025-91aa-251e73acc982 req-5a698339-4dfc-419c-a168-cd108756fb76 service nova] Lock "b111f169-d737-4bbe-bad3-394a2bc57218-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:27:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-af2cbaa2-7d35-4025-91aa-251e73acc982 req-5a698339-4dfc-419c-a168-cd108756fb76 service nova] Lock "b111f169-d737-4bbe-bad3-394a2bc57218-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:27:28 user nova-compute[74743]: DEBUG nova.compute.manager [req-af2cbaa2-7d35-4025-91aa-251e73acc982 req-5a698339-4dfc-419c-a168-cd108756fb76 service nova] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] No waiting events found dispatching network-vif-unplugged-f5631450-b11b-498b-978f-71101e2a80b5 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:27:28 user nova-compute[74743]: DEBUG nova.compute.manager [req-af2cbaa2-7d35-4025-91aa-251e73acc982 req-5a698339-4dfc-419c-a168-cd108756fb76 service nova] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Received event network-vif-unplugged-f5631450-b11b-498b-978f-71101e2a80b5 for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:27:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:27:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:27:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:27:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:27:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:27:28 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Instance destroyed successfully.
Nov 18 17:27:28 user nova-compute[74743]: DEBUG nova.objects.instance [None req-97452a4b-d54f-40bb-9882-5f3563482a04 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lazy-loading 'resources' on Instance uuid b111f169-d737-4bbe-bad3-394a2bc57218 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:27:28 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-97452a4b-d54f-40bb-9882-5f3563482a04 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:25:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-667533672',display_name='tempest-AttachVolumeNegativeTest-server-667533672',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-667533672',id=43,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLt6vj5zWDS2I4XiANoaOtqEZXHSZ1FYv9eNB+7fyZdch1VrKYcm9A6JJ7snGkro6Hy7QO5XtwLTC8v5eHrKYCeA4HdLt5TVaBCsvf9ZKTwoOu+pM92xen1mXMNhqzCmQw==',key_name='tempest-keypair-798546158',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:25:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5502edf6a6b94cb59d58d52494efc90d',ramdisk_id='',reservation_id='r-3i2noxij',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1149732113',owner_user_name='tempest-AttachVolumeNegativeTest-1149732113-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:25:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35aedc702bc4444eb3802772a523ba79',uuid=b111f169-d737-4bbe-bad3-394a2bc57218,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5631450-b11b-498b-978f-71101e2a80b5", "address": "fa:16:3e:a4:4c:d4", "network": {"id": "b03d3355-7704-43de-8af7-7a5dc1ee490d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1492507432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5502edf6a6b94cb59d58d52494efc90d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5631450-b1", "ovs_interfaceid": "f5631450-b11b-498b-978f-71101e2a80b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:27:28 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-97452a4b-d54f-40bb-9882-5f3563482a04 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Converting VIF {"id": "f5631450-b11b-498b-978f-71101e2a80b5", "address": "fa:16:3e:a4:4c:d4", "network": {"id": "b03d3355-7704-43de-8af7-7a5dc1ee490d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1492507432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5502edf6a6b94cb59d58d52494efc90d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5631450-b1", "ovs_interfaceid": "f5631450-b11b-498b-978f-71101e2a80b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:27:28 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-97452a4b-d54f-40bb-9882-5f3563482a04 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:4c:d4,bridge_name='br-int',has_traffic_filtering=True,id=f5631450-b11b-498b-978f-71101e2a80b5,network=Network(b03d3355-7704-43de-8af7-7a5dc1ee490d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5631450-b1') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:27:28 user nova-compute[74743]: DEBUG os_vif [None req-97452a4b-d54f-40bb-9882-5f3563482a04 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:4c:d4,bridge_name='br-int',has_traffic_filtering=True,id=f5631450-b11b-498b-978f-71101e2a80b5,network=Network(b03d3355-7704-43de-8af7-7a5dc1ee490d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5631450-b1') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:27:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:27:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5631450-b1, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:27:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:27:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:27:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:27:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:27:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f53d03cc-72f4-42fd-ab48-cc9707d3e355) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:27:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:27:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:27:28 user nova-compute[74743]: INFO os_vif [None req-97452a4b-d54f-40bb-9882-5f3563482a04 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:4c:d4,bridge_name='br-int',has_traffic_filtering=True,id=f5631450-b11b-498b-978f-71101e2a80b5,network=Network(b03d3355-7704-43de-8af7-7a5dc1ee490d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5631450-b1')
Nov 18 17:27:28 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-97452a4b-d54f-40bb-9882-5f3563482a04 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Deleting instance files /opt/stack/data/nova/instances/b111f169-d737-4bbe-bad3-394a2bc57218_del
Nov 18 17:27:28 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-97452a4b-d54f-40bb-9882-5f3563482a04 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Deletion of /opt/stack/data/nova/instances/b111f169-d737-4bbe-bad3-394a2bc57218_del complete
Nov 18 17:27:28 user nova-compute[74743]: INFO nova.compute.manager [None req-97452a4b-d54f-40bb-9882-5f3563482a04 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Took 0.69 seconds to destroy the instance on the hypervisor.
Nov 18 17:27:28 user nova-compute[74743]: DEBUG oslo.service.loopingcall [None req-97452a4b-d54f-40bb-9882-5f3563482a04 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74743) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 17:27:28 user nova-compute[74743]: DEBUG nova.compute.manager [-] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Deallocating network for instance {{(pid=74743) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 17:27:28 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] deallocate_for_instance() {{(pid=74743) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 17:27:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:27:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:27:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:27:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:27:30 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:27:30 user nova-compute[74743]: INFO nova.compute.manager [-] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Took 1.28 seconds to deallocate network for instance.
Nov 18 17:27:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-97452a4b-d54f-40bb-9882-5f3563482a04 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:27:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-97452a4b-d54f-40bb-9882-5f3563482a04 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:27:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:27:30 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-97452a4b-d54f-40bb-9882-5f3563482a04 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:27:30 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-97452a4b-d54f-40bb-9882-5f3563482a04 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:27:30 user nova-compute[74743]: DEBUG nova.compute.manager [req-f4690948-ab6b-4736-b9f6-904a7fd0ddf6 req-c35195aa-48e3-4332-b010-73c8fd033c19 service nova] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Received event network-vif-plugged-f5631450-b11b-498b-978f-71101e2a80b5 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:27:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f4690948-ab6b-4736-b9f6-904a7fd0ddf6 req-c35195aa-48e3-4332-b010-73c8fd033c19 service nova] Acquiring lock "b111f169-d737-4bbe-bad3-394a2bc57218-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:27:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f4690948-ab6b-4736-b9f6-904a7fd0ddf6 req-c35195aa-48e3-4332-b010-73c8fd033c19 service nova] Lock "b111f169-d737-4bbe-bad3-394a2bc57218-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:27:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f4690948-ab6b-4736-b9f6-904a7fd0ddf6 req-c35195aa-48e3-4332-b010-73c8fd033c19 service nova] Lock "b111f169-d737-4bbe-bad3-394a2bc57218-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:27:30 user nova-compute[74743]: DEBUG nova.compute.manager [req-f4690948-ab6b-4736-b9f6-904a7fd0ddf6 req-c35195aa-48e3-4332-b010-73c8fd033c19 service nova] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] No waiting events found dispatching network-vif-plugged-f5631450-b11b-498b-978f-71101e2a80b5 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:27:30 user nova-compute[74743]: WARNING nova.compute.manager [req-f4690948-ab6b-4736-b9f6-904a7fd0ddf6 req-c35195aa-48e3-4332-b010-73c8fd033c19 service nova] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Received unexpected event network-vif-plugged-f5631450-b11b-498b-978f-71101e2a80b5 for instance with vm_state deleted and task_state None.
Nov 18 17:27:30 user nova-compute[74743]: DEBUG nova.compute.manager [req-f4690948-ab6b-4736-b9f6-904a7fd0ddf6 req-c35195aa-48e3-4332-b010-73c8fd033c19 service nova] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Received event network-vif-plugged-f5631450-b11b-498b-978f-71101e2a80b5 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:27:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f4690948-ab6b-4736-b9f6-904a7fd0ddf6 req-c35195aa-48e3-4332-b010-73c8fd033c19 service nova] Acquiring lock "b111f169-d737-4bbe-bad3-394a2bc57218-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:27:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f4690948-ab6b-4736-b9f6-904a7fd0ddf6 req-c35195aa-48e3-4332-b010-73c8fd033c19 service nova] Lock "b111f169-d737-4bbe-bad3-394a2bc57218-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:27:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f4690948-ab6b-4736-b9f6-904a7fd0ddf6 req-c35195aa-48e3-4332-b010-73c8fd033c19 service nova] Lock "b111f169-d737-4bbe-bad3-394a2bc57218-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:27:30 user nova-compute[74743]: DEBUG nova.compute.manager [req-f4690948-ab6b-4736-b9f6-904a7fd0ddf6 req-c35195aa-48e3-4332-b010-73c8fd033c19 service nova] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] No waiting events found dispatching network-vif-plugged-f5631450-b11b-498b-978f-71101e2a80b5 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:27:30 user nova-compute[74743]: WARNING nova.compute.manager [req-f4690948-ab6b-4736-b9f6-904a7fd0ddf6 req-c35195aa-48e3-4332-b010-73c8fd033c19 service nova] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Received unexpected event network-vif-plugged-f5631450-b11b-498b-978f-71101e2a80b5 for instance with vm_state deleted and task_state None.
Nov 18 17:27:30 user nova-compute[74743]: DEBUG nova.compute.manager [req-f4690948-ab6b-4736-b9f6-904a7fd0ddf6 req-c35195aa-48e3-4332-b010-73c8fd033c19 service nova] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Received event network-vif-plugged-f5631450-b11b-498b-978f-71101e2a80b5 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:27:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f4690948-ab6b-4736-b9f6-904a7fd0ddf6 req-c35195aa-48e3-4332-b010-73c8fd033c19 service nova] Acquiring lock "b111f169-d737-4bbe-bad3-394a2bc57218-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:27:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f4690948-ab6b-4736-b9f6-904a7fd0ddf6 req-c35195aa-48e3-4332-b010-73c8fd033c19 service nova] Lock "b111f169-d737-4bbe-bad3-394a2bc57218-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:27:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f4690948-ab6b-4736-b9f6-904a7fd0ddf6 req-c35195aa-48e3-4332-b010-73c8fd033c19 service nova] Lock "b111f169-d737-4bbe-bad3-394a2bc57218-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:27:30 user nova-compute[74743]: DEBUG nova.compute.manager [req-f4690948-ab6b-4736-b9f6-904a7fd0ddf6 req-c35195aa-48e3-4332-b010-73c8fd033c19 service nova] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] No waiting events found dispatching network-vif-plugged-f5631450-b11b-498b-978f-71101e2a80b5 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:27:30 user nova-compute[74743]: WARNING nova.compute.manager [req-f4690948-ab6b-4736-b9f6-904a7fd0ddf6 req-c35195aa-48e3-4332-b010-73c8fd033c19 service nova] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Received unexpected event network-vif-plugged-f5631450-b11b-498b-978f-71101e2a80b5 for instance with vm_state deleted and task_state None.
Nov 18 17:27:30 user nova-compute[74743]: DEBUG nova.compute.manager [req-f4690948-ab6b-4736-b9f6-904a7fd0ddf6 req-c35195aa-48e3-4332-b010-73c8fd033c19 service nova] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Received event network-vif-unplugged-f5631450-b11b-498b-978f-71101e2a80b5 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:27:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f4690948-ab6b-4736-b9f6-904a7fd0ddf6 req-c35195aa-48e3-4332-b010-73c8fd033c19 service nova] Acquiring lock "b111f169-d737-4bbe-bad3-394a2bc57218-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:27:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f4690948-ab6b-4736-b9f6-904a7fd0ddf6 req-c35195aa-48e3-4332-b010-73c8fd033c19 service nova] Lock "b111f169-d737-4bbe-bad3-394a2bc57218-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:27:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f4690948-ab6b-4736-b9f6-904a7fd0ddf6 req-c35195aa-48e3-4332-b010-73c8fd033c19 service nova] Lock "b111f169-d737-4bbe-bad3-394a2bc57218-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:27:30 user nova-compute[74743]: DEBUG nova.compute.manager [req-f4690948-ab6b-4736-b9f6-904a7fd0ddf6 req-c35195aa-48e3-4332-b010-73c8fd033c19 service nova] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] No waiting events found dispatching network-vif-unplugged-f5631450-b11b-498b-978f-71101e2a80b5 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:27:30 user nova-compute[74743]: WARNING nova.compute.manager [req-f4690948-ab6b-4736-b9f6-904a7fd0ddf6 req-c35195aa-48e3-4332-b010-73c8fd033c19 service nova] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Received unexpected event network-vif-unplugged-f5631450-b11b-498b-978f-71101e2a80b5 for instance with vm_state deleted and task_state None.
Nov 18 17:27:30 user nova-compute[74743]: DEBUG nova.compute.manager [req-f4690948-ab6b-4736-b9f6-904a7fd0ddf6 req-c35195aa-48e3-4332-b010-73c8fd033c19 service nova] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Received event network-vif-plugged-f5631450-b11b-498b-978f-71101e2a80b5 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:27:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f4690948-ab6b-4736-b9f6-904a7fd0ddf6 req-c35195aa-48e3-4332-b010-73c8fd033c19 service nova] Acquiring lock "b111f169-d737-4bbe-bad3-394a2bc57218-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:27:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f4690948-ab6b-4736-b9f6-904a7fd0ddf6 req-c35195aa-48e3-4332-b010-73c8fd033c19 service nova] Lock "b111f169-d737-4bbe-bad3-394a2bc57218-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:27:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f4690948-ab6b-4736-b9f6-904a7fd0ddf6 req-c35195aa-48e3-4332-b010-73c8fd033c19 service nova] Lock "b111f169-d737-4bbe-bad3-394a2bc57218-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:27:30 user nova-compute[74743]: DEBUG nova.compute.manager [req-f4690948-ab6b-4736-b9f6-904a7fd0ddf6 req-c35195aa-48e3-4332-b010-73c8fd033c19 service nova] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] No waiting events found dispatching network-vif-plugged-f5631450-b11b-498b-978f-71101e2a80b5 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:27:30 user nova-compute[74743]: WARNING nova.compute.manager [req-f4690948-ab6b-4736-b9f6-904a7fd0ddf6 req-c35195aa-48e3-4332-b010-73c8fd033c19 service nova] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Received unexpected event network-vif-plugged-f5631450-b11b-498b-978f-71101e2a80b5 for instance with vm_state deleted and task_state None.
Nov 18 17:27:30 user nova-compute[74743]: DEBUG nova.compute.manager [req-f4690948-ab6b-4736-b9f6-904a7fd0ddf6 req-c35195aa-48e3-4332-b010-73c8fd033c19 service nova] [instance: b111f169-d737-4bbe-bad3-394a2bc57218] Received event network-vif-deleted-f5631450-b11b-498b-978f-71101e2a80b5 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:27:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-97452a4b-d54f-40bb-9882-5f3563482a04 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.247s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:27:30 user nova-compute[74743]: INFO nova.scheduler.client.report [None req-97452a4b-d54f-40bb-9882-5f3563482a04 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Deleted allocations for instance b111f169-d737-4bbe-bad3-394a2bc57218
Nov 18 17:27:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-97452a4b-d54f-40bb-9882-5f3563482a04 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "b111f169-d737-4bbe-bad3-394a2bc57218" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.431s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:27:31 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:27:33 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:27:33 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74743) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 17:27:33 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:27:34 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:27:35 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:27:35 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:27:36 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:27:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e418a771-7149-4b16-a945-cfcaf0b21b73 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquiring lock "93772071-cb21-4f4e-8b07-c55be8cf7bea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:27:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e418a771-7149-4b16-a945-cfcaf0b21b73 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "93772071-cb21-4f4e-8b07-c55be8cf7bea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:27:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e418a771-7149-4b16-a945-cfcaf0b21b73 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquiring lock "93772071-cb21-4f4e-8b07-c55be8cf7bea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:27:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e418a771-7149-4b16-a945-cfcaf0b21b73 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "93772071-cb21-4f4e-8b07-c55be8cf7bea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:27:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e418a771-7149-4b16-a945-cfcaf0b21b73 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "93772071-cb21-4f4e-8b07-c55be8cf7bea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:27:37 user nova-compute[74743]: INFO nova.compute.manager [None req-e418a771-7149-4b16-a945-cfcaf0b21b73 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Terminating instance
Nov 18 17:27:37 user nova-compute[74743]: DEBUG nova.compute.manager [None req-e418a771-7149-4b16-a945-cfcaf0b21b73 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Start destroying the instance on the hypervisor. {{(pid=74743) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 17:27:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:27:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:27:37 user nova-compute[74743]: DEBUG nova.compute.manager [req-1b118258-20eb-424d-9420-3dbf3fd06aef req-c89816a3-a6a4-4f27-a846-389a7d2f8ede service nova] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Received event network-vif-unplugged-8aa1f220-b71a-4dce-b48a-cbef38e01517 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:27:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-1b118258-20eb-424d-9420-3dbf3fd06aef req-c89816a3-a6a4-4f27-a846-389a7d2f8ede service nova] Acquiring lock "93772071-cb21-4f4e-8b07-c55be8cf7bea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:27:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-1b118258-20eb-424d-9420-3dbf3fd06aef req-c89816a3-a6a4-4f27-a846-389a7d2f8ede service nova] Lock "93772071-cb21-4f4e-8b07-c55be8cf7bea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:27:37 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-1b118258-20eb-424d-9420-3dbf3fd06aef req-c89816a3-a6a4-4f27-a846-389a7d2f8ede service nova] Lock "93772071-cb21-4f4e-8b07-c55be8cf7bea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:27:37 user nova-compute[74743]: DEBUG nova.compute.manager [req-1b118258-20eb-424d-9420-3dbf3fd06aef req-c89816a3-a6a4-4f27-a846-389a7d2f8ede service nova] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] No waiting events found dispatching network-vif-unplugged-8aa1f220-b71a-4dce-b48a-cbef38e01517 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:27:37 user nova-compute[74743]: DEBUG nova.compute.manager [req-1b118258-20eb-424d-9420-3dbf3fd06aef req-c89816a3-a6a4-4f27-a846-389a7d2f8ede service nova] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Received event network-vif-unplugged-8aa1f220-b71a-4dce-b48a-cbef38e01517 for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:27:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:27:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:27:38 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Instance destroyed successfully.
Nov 18 17:27:38 user nova-compute[74743]: DEBUG nova.objects.instance [None req-e418a771-7149-4b16-a945-cfcaf0b21b73 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lazy-loading 'resources' on Instance uuid 93772071-cb21-4f4e-8b07-c55be8cf7bea {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-e418a771-7149-4b16-a945-cfcaf0b21b73 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:22:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-483967353',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-483967353',id=39,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:24:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc0fda74575d488a94e2dcfdc016598c',ramdisk_id='',reservation_id='r-qzba9c41',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-633893051',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:25:52Z,user_data=None,user_id='5639bd2666534fdca04d0958dcdc9f54',uuid=93772071-cb21-4f4e-8b07-c55be8cf7bea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8aa1f220-b71a-4dce-b48a-cbef38e01517", "address": "fa:16:3e:c9:74:4b", "network": {"id": "1bbf6aff-4048-4212-a716-d0628575bfd0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc0fda74575d488a94e2dcfdc016598c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8aa1f220-b7", "ovs_interfaceid": "8aa1f220-b71a-4dce-b48a-cbef38e01517", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-e418a771-7149-4b16-a945-cfcaf0b21b73 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Converting VIF {"id": "8aa1f220-b71a-4dce-b48a-cbef38e01517", "address": "fa:16:3e:c9:74:4b", "network": {"id": "1bbf6aff-4048-4212-a716-d0628575bfd0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc0fda74575d488a94e2dcfdc016598c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8aa1f220-b7", "ovs_interfaceid": "8aa1f220-b71a-4dce-b48a-cbef38e01517", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-e418a771-7149-4b16-a945-cfcaf0b21b73 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:74:4b,bridge_name='br-int',has_traffic_filtering=True,id=8aa1f220-b71a-4dce-b48a-cbef38e01517,network=Network(1bbf6aff-4048-4212-a716-d0628575bfd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8aa1f220-b7') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG os_vif [None req-e418a771-7149-4b16-a945-cfcaf0b21b73 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:74:4b,bridge_name='br-int',has_traffic_filtering=True,id=8aa1f220-b71a-4dce-b48a-cbef38e01517,network=Network(1bbf6aff-4048-4212-a716-d0628575bfd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8aa1f220-b7') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8aa1f220-b7, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0b6f5efd-9036-4f9c-8803-a879ca58f1a9) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:27:38 user nova-compute[74743]: INFO os_vif [None req-e418a771-7149-4b16-a945-cfcaf0b21b73 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:74:4b,bridge_name='br-int',has_traffic_filtering=True,id=8aa1f220-b71a-4dce-b48a-cbef38e01517,network=Network(1bbf6aff-4048-4212-a716-d0628575bfd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8aa1f220-b7')
Nov 18 17:27:38 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e418a771-7149-4b16-a945-cfcaf0b21b73 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] calling os-brick to detach iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e418a771-7149-4b16-a945-cfcaf0b21b73 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, {'target_iqn': 'iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EBGDNSIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:27:38 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-e418a771-7149-4b16-a945-cfcaf0b21b73 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:27:38 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-e418a771-7149-4b16-a945-cfcaf0b21b73 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-e418a771-7149-4b16-a945-cfcaf0b21b73 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7bdceb-036b-46ef-99f0-bf0d0d3425bb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e418a771-7149-4b16-a945-cfcaf0b21b73 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 17:27:38 user nova-compute[74743]: No targets found.
Nov 18 17:27:38 user nova-compute[74743]: iSNS:
Nov 18 17:27:38 user nova-compute[74743]: No targets found.
Nov 18 17:27:38 user nova-compute[74743]: STATIC:
Nov 18 17:27:38 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127
Nov 18 17:27:38 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:27:38 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:27:38 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a
Nov 18 17:27:38 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:27:38 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:27:38 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb
Nov 18 17:27:38 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:27:38 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:27:38 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb
Nov 18 17:27:38 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:27:38 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:27:38 user nova-compute[74743]: FIRMWARE:
Nov 18 17:27:38 user nova-compute[74743]: No targets found.
Nov 18 17:27:38 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e418a771-7149-4b16-a945-cfcaf0b21b73 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 17:27:38 user nova-compute[74743]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 17:27:38 user nova-compute[74743]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74743) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e418a771-7149-4b16-a945-cfcaf0b21b73 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb', 0)] {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e28fd27-70bf-4382-9de8-d10cd2679c01]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[5950f4eb-7780-4d45-8d3e-23f8a362e7b3]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e418a771-7149-4b16-a945-cfcaf0b21b73 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:27:38 user nova-compute[74743]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb (non-flash)
Nov 18 17:27:38 user nova-compute[74743]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb (non-flash)
Nov 18 17:27:38 user nova-compute[74743]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a (non-flash)
Nov 18 17:27:38 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e418a771-7149-4b16-a945-cfcaf0b21b73 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:27:38 user nova-compute[74743]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb (non-flash)
Nov 18 17:27:38 user nova-compute[74743]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb (non-flash)
Nov 18 17:27:38 user nova-compute[74743]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a (non-flash)
Nov 18 17:27:38 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e418a771-7149-4b16-a945-cfcaf0b21b73 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb08264670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb'): ({'sdc'}, set())}) {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-e418a771-7149-4b16-a945-cfcaf0b21b73 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Removing single pathed devices sdc {{(pid=74743) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf92d66-ba14-4b26-9642-b2e9a3ed2a55]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e2e82c-2315-45d8-8260-5c138e7018a5]: (4, ('ok\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-e418a771-7149-4b16-a945-cfcaf0b21b73 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Flushing IO for device /dev/sdc {{(pid=74743) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee675ce-ba0d-4267-bcd0-0353ec4229bb]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-e418a771-7149-4b16-a945-cfcaf0b21b73 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74743) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.115s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[5810fa5d-002c-4e22-baa6-145cbadbea14]: (4, ('1', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-e418a771-7149-4b16-a945-cfcaf0b21b73 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-e418a771-7149-4b16-a945-cfcaf0b21b73 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] SCSI volumes sdc have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e418a771-7149-4b16-a945-cfcaf0b21b73 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb')] {{(pid=74743) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[5159d8e5-e104-411f-bdb6-3f93f1f084e3]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e418a771-7149-4b16-a945-cfcaf0b21b73 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb -p 172.16.0.220:3260 --logout {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[262f53f6-1eaa-4e07-81e2-b303aaf877cc]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e418a771-7149-4b16-a945-cfcaf0b21b73 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb, portal: 172.16.0.220,3260]
Nov 18 17:27:38 user nova-compute[74743]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb, portal: 172.16.0.220,3260] successful.
Nov 18 17:27:38 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb -p 172.16.0.220:3260 --op delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:410ff800-e826-4b57-8396-11316cec6abb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc592dd-b8a1-436e-a12b-7c1af543a45d]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e418a771-7149-4b16-a945-cfcaf0b21b73 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-e418a771-7149-4b16-a945-cfcaf0b21b73 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.410s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e418a771-7149-4b16-a945-cfcaf0b21b73 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] <== disconnect_volume: return (411ms) None {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e418a771-7149-4b16-a945-cfcaf0b21b73 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Disconnected iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 17:27:38 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-e418a771-7149-4b16-a945-cfcaf0b21b73 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Deleting instance files /opt/stack/data/nova/instances/93772071-cb21-4f4e-8b07-c55be8cf7bea_del
Nov 18 17:27:38 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-e418a771-7149-4b16-a945-cfcaf0b21b73 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Deletion of /opt/stack/data/nova/instances/93772071-cb21-4f4e-8b07-c55be8cf7bea_del complete
Nov 18 17:27:38 user nova-compute[74743]: INFO nova.compute.manager [None req-e418a771-7149-4b16-a945-cfcaf0b21b73 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Took 1.30 seconds to destroy the instance on the hypervisor.
Nov 18 17:27:38 user nova-compute[74743]: DEBUG oslo.service.loopingcall [None req-e418a771-7149-4b16-a945-cfcaf0b21b73 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74743) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG nova.compute.manager [-] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Deallocating network for instance {{(pid=74743) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 17:27:38 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] deallocate_for_instance() {{(pid=74743) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 17:27:39 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:27:39 user nova-compute[74743]: INFO nova.compute.manager [-] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Took 0.43 seconds to deallocate network for instance.
Nov 18 17:27:39 user nova-compute[74743]: DEBUG nova.compute.manager [req-957c481c-b8c3-46e9-bc4d-9e53a02fe524 req-91e1a3e1-cb41-4f97-b07a-ee477a799bbe service nova] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Received event network-vif-deleted-8aa1f220-b71a-4dce-b48a-cbef38e01517 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:27:39 user nova-compute[74743]: DEBUG nova.compute.manager [req-899dbcd7-29a3-4be8-8163-3bb2bd88f5a4 req-c12af70b-07e3-4fa9-a8f4-035dfdadd04e service nova] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Received event network-vif-plugged-8aa1f220-b71a-4dce-b48a-cbef38e01517 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:27:39 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-899dbcd7-29a3-4be8-8163-3bb2bd88f5a4 req-c12af70b-07e3-4fa9-a8f4-035dfdadd04e service nova] Acquiring lock "93772071-cb21-4f4e-8b07-c55be8cf7bea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:27:39 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-899dbcd7-29a3-4be8-8163-3bb2bd88f5a4 req-c12af70b-07e3-4fa9-a8f4-035dfdadd04e service nova] Lock "93772071-cb21-4f4e-8b07-c55be8cf7bea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:27:39 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-899dbcd7-29a3-4be8-8163-3bb2bd88f5a4 req-c12af70b-07e3-4fa9-a8f4-035dfdadd04e service nova] Lock "93772071-cb21-4f4e-8b07-c55be8cf7bea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:27:39 user nova-compute[74743]: DEBUG nova.compute.manager [req-899dbcd7-29a3-4be8-8163-3bb2bd88f5a4 req-c12af70b-07e3-4fa9-a8f4-035dfdadd04e service nova] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] No waiting events found dispatching network-vif-plugged-8aa1f220-b71a-4dce-b48a-cbef38e01517 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:27:39 user nova-compute[74743]: WARNING nova.compute.manager [req-899dbcd7-29a3-4be8-8163-3bb2bd88f5a4 req-c12af70b-07e3-4fa9-a8f4-035dfdadd04e service nova] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Received unexpected event network-vif-plugged-8aa1f220-b71a-4dce-b48a-cbef38e01517 for instance with vm_state active and task_state deleting.
Nov 18 17:27:40 user nova-compute[74743]: INFO nova.compute.manager [None req-e418a771-7149-4b16-a945-cfcaf0b21b73 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 93772071-cb21-4f4e-8b07-c55be8cf7bea] Took 0.75 seconds to detach 1 volumes for instance.
Nov 18 17:27:40 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e418a771-7149-4b16-a945-cfcaf0b21b73 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:27:40 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e418a771-7149-4b16-a945-cfcaf0b21b73 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:27:40 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-e418a771-7149-4b16-a945-cfcaf0b21b73 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:27:40 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-e418a771-7149-4b16-a945-cfcaf0b21b73 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:27:40 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e418a771-7149-4b16-a945-cfcaf0b21b73 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.256s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:27:40 user nova-compute[74743]: INFO nova.scheduler.client.report [None req-e418a771-7149-4b16-a945-cfcaf0b21b73 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Deleted allocations for instance 93772071-cb21-4f4e-8b07-c55be8cf7bea
Nov 18 17:27:40 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:27:40 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e418a771-7149-4b16-a945-cfcaf0b21b73 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "93772071-cb21-4f4e-8b07-c55be8cf7bea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.921s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:27:41 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:27:41 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:27:41 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Starting heal instance info cache {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 17:27:41 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Rebuilding the list of instances to heal {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 17:27:41 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "refresh_cache-aefe3db1-b9bb-4cce-aa31-d0b6684ad791" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:27:41 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquired lock "refresh_cache-aefe3db1-b9bb-4cce-aa31-d0b6684ad791" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:27:41 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Forcefully refreshing network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 17:27:41 user nova-compute[74743]: DEBUG nova.objects.instance [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lazy-loading 'info_cache' on Instance uuid aefe3db1-b9bb-4cce-aa31-d0b6684ad791 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:27:41 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Updating instance_info_cache with network_info: [{"id": "7bc10485-32b0-44a5-8813-2fa64d1dfbba", "address": "fa:16:3e:47:96:7f", "network": {"id": "1bbf6aff-4048-4212-a716-d0628575bfd0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc0fda74575d488a94e2dcfdc016598c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc10485-32", "ovs_interfaceid": "7bc10485-32b0-44a5-8813-2fa64d1dfbba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:27:41 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Releasing lock "refresh_cache-aefe3db1-b9bb-4cce-aa31-d0b6684ad791" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:27:41 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Updated the network info_cache for instance {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 17:27:41 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:27:42 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:27:42 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:27:42 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:27:42 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Auditing locally available compute resources for user (node: user) {{(pid=74743) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 17:27:42 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/789583c2-1c04-4510-a37e-0e9b7d3a0971/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:27:42 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/789583c2-1c04-4510-a37e-0e9b7d3a0971/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:27:42 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/789583c2-1c04-4510-a37e-0e9b7d3a0971/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:27:42 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/789583c2-1c04-4510-a37e-0e9b7d3a0971/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:27:42 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:27:42 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:27:42 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:27:42 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:27:42 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fd86416-72c2-45e5-814d-9195b4cfcc61/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:27:43 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fd86416-72c2-45e5-814d-9195b4cfcc61/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:27:43 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fd86416-72c2-45e5-814d-9195b4cfcc61/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:27:43 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fd86416-72c2-45e5-814d-9195b4cfcc61/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:27:43 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:27:43 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:27:43 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0b7c0c-a4ad-4ccd-b60a-721070a57f98/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:27:43 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:27:43 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0b7c0c-a4ad-4ccd-b60a-721070a57f98/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:27:43 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0b7c0c-a4ad-4ccd-b60a-721070a57f98/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:27:43 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0b7c0c-a4ad-4ccd-b60a-721070a57f98/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:27:43 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:27:44 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:27:44 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:27:44 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Hypervisor/Node resource view: name=user free_ram=8441MB free_disk=25.040042877197266GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74743) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 17:27:44 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:27:44 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:27:44 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance aefe3db1-b9bb-4cce-aa31-d0b6684ad791 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:27:44 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance f649143e-f7db-475a-bbe5-d5e7316caac3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:27:44 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 789583c2-1c04-4510-a37e-0e9b7d3a0971 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:27:44 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 1fd86416-72c2-45e5-814d-9195b4cfcc61 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:27:44 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:27:44 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 17:27:44 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 17:27:44 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:27:44 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:27:44 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Compute_service record updated for user:user {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 17:27:44 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.380s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:27:45 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:27:46 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:27:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:27:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:27:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:27:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:27:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74743) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 17:27:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:27:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:27:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:28:03 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:28:08 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:28:13 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:28:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:28:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:28:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74743) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 17:28:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:28:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:28:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:28:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:28:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-00fdae5e-8ea8-436a-bb06-5439f7cabb62 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquiring lock "1fd86416-72c2-45e5-814d-9195b4cfcc61" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:28:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-00fdae5e-8ea8-436a-bb06-5439f7cabb62 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "1fd86416-72c2-45e5-814d-9195b4cfcc61" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:28:19 user nova-compute[74743]: INFO nova.compute.manager [None req-00fdae5e-8ea8-436a-bb06-5439f7cabb62 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Detaching volume 3935a32e-e6ba-494d-a04a-873f3f70a2eb
Nov 18 17:28:19 user nova-compute[74743]: INFO nova.virt.block_device [None req-00fdae5e-8ea8-436a-bb06-5439f7cabb62 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Attempting to driver detach volume 3935a32e-e6ba-494d-a04a-873f3f70a2eb from mountpoint /dev/vdb
Nov 18 17:28:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-00fdae5e-8ea8-436a-bb06-5439f7cabb62 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Attempting to detach device vdb from instance 1fd86416-72c2-45e5-814d-9195b4cfcc61 from the persistent domain config. {{(pid=74743) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 17:28:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-00fdae5e-8ea8-436a-bb06-5439f7cabb62 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 17:28:19 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:28:19 user nova-compute[74743]:   <source dev="/dev/sdb"/>
Nov 18 17:28:19 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:28:19 user nova-compute[74743]:   <serial>3935a32e-e6ba-494d-a04a-873f3f70a2eb</serial>
Nov 18 17:28:19 user nova-compute[74743]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 17:28:19 user nova-compute[74743]: </disk>
Nov 18 17:28:19 user nova-compute[74743]:  {{(pid=74743) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 17:28:19 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-00fdae5e-8ea8-436a-bb06-5439f7cabb62 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Successfully detached device vdb from instance 1fd86416-72c2-45e5-814d-9195b4cfcc61 from the persistent domain config.
Nov 18 17:28:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-00fdae5e-8ea8-436a-bb06-5439f7cabb62 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1fd86416-72c2-45e5-814d-9195b4cfcc61 from the live domain config. {{(pid=74743) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 17:28:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-00fdae5e-8ea8-436a-bb06-5439f7cabb62 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 17:28:19 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:28:19 user nova-compute[74743]:   <source dev="/dev/sdb"/>
Nov 18 17:28:19 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:28:19 user nova-compute[74743]:   <serial>3935a32e-e6ba-494d-a04a-873f3f70a2eb</serial>
Nov 18 17:28:19 user nova-compute[74743]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 17:28:19 user nova-compute[74743]: </disk>
Nov 18 17:28:19 user nova-compute[74743]:  {{(pid=74743) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 17:28:20 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-00fdae5e-8ea8-436a-bb06-5439f7cabb62 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1fd86416-72c2-45e5-814d-9195b4cfcc61 {{(pid=74743) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 17:28:23 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:28:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-eba5400c-8592-4004-80cf-a0af8c8843c4 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquiring lock "789583c2-1c04-4510-a37e-0e9b7d3a0971" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:28:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-eba5400c-8592-4004-80cf-a0af8c8843c4 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "789583c2-1c04-4510-a37e-0e9b7d3a0971" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:28:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-eba5400c-8592-4004-80cf-a0af8c8843c4 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquiring lock "789583c2-1c04-4510-a37e-0e9b7d3a0971-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:28:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-eba5400c-8592-4004-80cf-a0af8c8843c4 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "789583c2-1c04-4510-a37e-0e9b7d3a0971-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:28:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-eba5400c-8592-4004-80cf-a0af8c8843c4 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "789583c2-1c04-4510-a37e-0e9b7d3a0971-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:28:28 user nova-compute[74743]: INFO nova.compute.manager [None req-eba5400c-8592-4004-80cf-a0af8c8843c4 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Terminating instance
Nov 18 17:28:28 user nova-compute[74743]: DEBUG nova.compute.manager [None req-eba5400c-8592-4004-80cf-a0af8c8843c4 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Start destroying the instance on the hypervisor. {{(pid=74743) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 17:28:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:28:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:28:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:28:28 user nova-compute[74743]: DEBUG nova.compute.manager [req-71dd238d-1340-4bbd-bd0b-95fe1380d179 req-8da1c4ed-b3ca-4815-9e29-9c65b5d22c79 service nova] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Received event network-vif-unplugged-db8b331f-9b3f-472b-968a-2151da14f567 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:28:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-71dd238d-1340-4bbd-bd0b-95fe1380d179 req-8da1c4ed-b3ca-4815-9e29-9c65b5d22c79 service nova] Acquiring lock "789583c2-1c04-4510-a37e-0e9b7d3a0971-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:28:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-71dd238d-1340-4bbd-bd0b-95fe1380d179 req-8da1c4ed-b3ca-4815-9e29-9c65b5d22c79 service nova] Lock "789583c2-1c04-4510-a37e-0e9b7d3a0971-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:28:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-71dd238d-1340-4bbd-bd0b-95fe1380d179 req-8da1c4ed-b3ca-4815-9e29-9c65b5d22c79 service nova] Lock "789583c2-1c04-4510-a37e-0e9b7d3a0971-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:28:28 user nova-compute[74743]: DEBUG nova.compute.manager [req-71dd238d-1340-4bbd-bd0b-95fe1380d179 req-8da1c4ed-b3ca-4815-9e29-9c65b5d22c79 service nova] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] No waiting events found dispatching network-vif-unplugged-db8b331f-9b3f-472b-968a-2151da14f567 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:28:28 user nova-compute[74743]: DEBUG nova.compute.manager [req-71dd238d-1340-4bbd-bd0b-95fe1380d179 req-8da1c4ed-b3ca-4815-9e29-9c65b5d22c79 service nova] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Received event network-vif-unplugged-db8b331f-9b3f-472b-968a-2151da14f567 for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:28:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:28:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:28:28 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Instance destroyed successfully.
Nov 18 17:28:28 user nova-compute[74743]: DEBUG nova.objects.instance [None req-eba5400c-8592-4004-80cf-a0af8c8843c4 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lazy-loading 'resources' on Instance uuid 789583c2-1c04-4510-a37e-0e9b7d3a0971 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:28:28 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-eba5400c-8592-4004-80cf-a0af8c8843c4 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:19:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1258737260',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1258737260',id=35,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:19:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc0fda74575d488a94e2dcfdc016598c',ramdisk_id='',reservation_id='r-obw0cpai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-633893051',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:21:03Z,user_data=None,user_id='5639bd2666534fdca04d0958dcdc9f54',uuid=789583c2-1c04-4510-a37e-0e9b7d3a0971,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db8b331f-9b3f-472b-968a-2151da14f567", "address": "fa:16:3e:50:6a:16", "network": {"id": "1bbf6aff-4048-4212-a716-d0628575bfd0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc0fda74575d488a94e2dcfdc016598c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb8b331f-9b", "ovs_interfaceid": "db8b331f-9b3f-472b-968a-2151da14f567", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:28:28 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-eba5400c-8592-4004-80cf-a0af8c8843c4 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Converting VIF {"id": "db8b331f-9b3f-472b-968a-2151da14f567", "address": "fa:16:3e:50:6a:16", "network": {"id": "1bbf6aff-4048-4212-a716-d0628575bfd0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc0fda74575d488a94e2dcfdc016598c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb8b331f-9b", "ovs_interfaceid": "db8b331f-9b3f-472b-968a-2151da14f567", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:28:28 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-eba5400c-8592-4004-80cf-a0af8c8843c4 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:50:6a:16,bridge_name='br-int',has_traffic_filtering=True,id=db8b331f-9b3f-472b-968a-2151da14f567,network=Network(1bbf6aff-4048-4212-a716-d0628575bfd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb8b331f-9b') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:28:28 user nova-compute[74743]: DEBUG os_vif [None req-eba5400c-8592-4004-80cf-a0af8c8843c4 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:6a:16,bridge_name='br-int',has_traffic_filtering=True,id=db8b331f-9b3f-472b-968a-2151da14f567,network=Network(1bbf6aff-4048-4212-a716-d0628575bfd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb8b331f-9b') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:28:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:28:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb8b331f-9b, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:28:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:28:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:28:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:28:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b2b0962a-66b5-4d27-b544-811b3e959532) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:28:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:28:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:28:28 user nova-compute[74743]: INFO os_vif [None req-eba5400c-8592-4004-80cf-a0af8c8843c4 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:6a:16,bridge_name='br-int',has_traffic_filtering=True,id=db8b331f-9b3f-472b-968a-2151da14f567,network=Network(1bbf6aff-4048-4212-a716-d0628575bfd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb8b331f-9b')
Nov 18 17:28:28 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-eba5400c-8592-4004-80cf-a0af8c8843c4 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Deleting instance files /opt/stack/data/nova/instances/789583c2-1c04-4510-a37e-0e9b7d3a0971_del
Nov 18 17:28:28 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-eba5400c-8592-4004-80cf-a0af8c8843c4 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Deletion of /opt/stack/data/nova/instances/789583c2-1c04-4510-a37e-0e9b7d3a0971_del complete
Nov 18 17:28:28 user nova-compute[74743]: INFO nova.compute.manager [None req-eba5400c-8592-4004-80cf-a0af8c8843c4 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 18 17:28:28 user nova-compute[74743]: DEBUG oslo.service.loopingcall [None req-eba5400c-8592-4004-80cf-a0af8c8843c4 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74743) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 17:28:28 user nova-compute[74743]: DEBUG nova.compute.manager [-] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Deallocating network for instance {{(pid=74743) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 17:28:28 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] deallocate_for_instance() {{(pid=74743) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 17:28:29 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:28:29 user nova-compute[74743]: INFO nova.compute.manager [-] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Took 0.43 seconds to deallocate network for instance.
Nov 18 17:28:29 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-eba5400c-8592-4004-80cf-a0af8c8843c4 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:28:29 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-eba5400c-8592-4004-80cf-a0af8c8843c4 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:28:29 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-eba5400c-8592-4004-80cf-a0af8c8843c4 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:28:29 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-eba5400c-8592-4004-80cf-a0af8c8843c4 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:28:29 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-eba5400c-8592-4004-80cf-a0af8c8843c4 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.189s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:28:29 user nova-compute[74743]: INFO nova.scheduler.client.report [None req-eba5400c-8592-4004-80cf-a0af8c8843c4 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Deleted allocations for instance 789583c2-1c04-4510-a37e-0e9b7d3a0971
Nov 18 17:28:29 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-eba5400c-8592-4004-80cf-a0af8c8843c4 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "789583c2-1c04-4510-a37e-0e9b7d3a0971" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.456s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:28:30 user nova-compute[74743]: DEBUG nova.compute.manager [req-5f35fd3a-483c-45cc-bd2f-8a5a5cb5a2fd req-c4257404-6c84-43e7-8b14-38c3dc86b559 service nova] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Received event network-vif-plugged-db8b331f-9b3f-472b-968a-2151da14f567 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:28:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-5f35fd3a-483c-45cc-bd2f-8a5a5cb5a2fd req-c4257404-6c84-43e7-8b14-38c3dc86b559 service nova] Acquiring lock "789583c2-1c04-4510-a37e-0e9b7d3a0971-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:28:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-5f35fd3a-483c-45cc-bd2f-8a5a5cb5a2fd req-c4257404-6c84-43e7-8b14-38c3dc86b559 service nova] Lock "789583c2-1c04-4510-a37e-0e9b7d3a0971-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:28:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-5f35fd3a-483c-45cc-bd2f-8a5a5cb5a2fd req-c4257404-6c84-43e7-8b14-38c3dc86b559 service nova] Lock "789583c2-1c04-4510-a37e-0e9b7d3a0971-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:28:30 user nova-compute[74743]: DEBUG nova.compute.manager [req-5f35fd3a-483c-45cc-bd2f-8a5a5cb5a2fd req-c4257404-6c84-43e7-8b14-38c3dc86b559 service nova] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] No waiting events found dispatching network-vif-plugged-db8b331f-9b3f-472b-968a-2151da14f567 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:28:30 user nova-compute[74743]: WARNING nova.compute.manager [req-5f35fd3a-483c-45cc-bd2f-8a5a5cb5a2fd req-c4257404-6c84-43e7-8b14-38c3dc86b559 service nova] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Received unexpected event network-vif-plugged-db8b331f-9b3f-472b-968a-2151da14f567 for instance with vm_state deleted and task_state None.
Nov 18 17:28:30 user nova-compute[74743]: DEBUG nova.compute.manager [req-5f35fd3a-483c-45cc-bd2f-8a5a5cb5a2fd req-c4257404-6c84-43e7-8b14-38c3dc86b559 service nova] [instance: 789583c2-1c04-4510-a37e-0e9b7d3a0971] Received event network-vif-deleted-db8b331f-9b3f-472b-968a-2151da14f567 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:28:31 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:28:33 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:28:33 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74743) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 17:28:33 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:28:36 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:28:36 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:28:38 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:28:38 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:28:40 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-00fdae5e-8ea8-436a-bb06-5439f7cabb62 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1fd86416-72c2-45e5-814d-9195b4cfcc61 is timed out.
Nov 18 17:28:40 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-00fdae5e-8ea8-436a-bb06-5439f7cabb62 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Successfully detached device vdb from instance 1fd86416-72c2-45e5-814d-9195b4cfcc61 from the live domain config.
Nov 18 17:28:40 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00fdae5e-8ea8-436a-bb06-5439f7cabb62 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] calling os-brick to detach iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 17:28:40 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-00fdae5e-8ea8-436a-bb06-5439f7cabb62 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, {'target_iqn': 'iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DAmHizka', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:28:40 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-00fdae5e-8ea8-436a-bb06-5439f7cabb62 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:28:40 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-00fdae5e-8ea8-436a-bb06-5439f7cabb62 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:28:40 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-00fdae5e-8ea8-436a-bb06-5439f7cabb62 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:28:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:28:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:28:40 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6dabfa2-2ec6-41d1-948d-d89bfe5b84af]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:28:40 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-00fdae5e-8ea8-436a-bb06-5439f7cabb62 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 17:28:40 user nova-compute[74743]: No targets found.
Nov 18 17:28:40 user nova-compute[74743]: iSNS:
Nov 18 17:28:40 user nova-compute[74743]: No targets found.
Nov 18 17:28:40 user nova-compute[74743]: STATIC:
Nov 18 17:28:40 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127
Nov 18 17:28:40 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:28:40 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:28:40 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a
Nov 18 17:28:40 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:28:40 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:28:40 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb
Nov 18 17:28:40 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:28:40 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:28:40 user nova-compute[74743]: FIRMWARE:
Nov 18 17:28:40 user nova-compute[74743]: No targets found.
Nov 18 17:28:40 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:28:40 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-00fdae5e-8ea8-436a-bb06-5439f7cabb62 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 17:28:40 user nova-compute[74743]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 17:28:40 user nova-compute[74743]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74743) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 17:28:40 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-00fdae5e-8ea8-436a-bb06-5439f7cabb62 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb', 0)] {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 17:28:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:28:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:28:40 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ea225b-96b9-4592-8e91-9a8740015262]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:28:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:28:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:28:40 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1233bec-3f0a-46bc-99ec-ae8a69d60da7]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:28:40 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-00fdae5e-8ea8-436a-bb06-5439f7cabb62 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:28:40 user nova-compute[74743]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb (non-flash)
Nov 18 17:28:40 user nova-compute[74743]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a (non-flash)
Nov 18 17:28:40 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:28:40 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-00fdae5e-8ea8-436a-bb06-5439f7cabb62 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:28:40 user nova-compute[74743]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb (non-flash)
Nov 18 17:28:40 user nova-compute[74743]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a (non-flash)
Nov 18 17:28:40 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:28:40 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-00fdae5e-8ea8-436a-bb06-5439f7cabb62 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb0819fac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb'): ({'sdb'}, set())}) {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 17:28:40 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-00fdae5e-8ea8-436a-bb06-5439f7cabb62 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Removing single pathed devices sdb {{(pid=74743) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 17:28:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:28:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:28:40 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[195cecae-e7e0-41a2-804d-2a6dbe73613f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:28:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:28:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:28:40 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77a51d2-0b37-4e10-84d5-50e426429cb6]: (4, ('ok\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:28:40 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-00fdae5e-8ea8-436a-bb06-5439f7cabb62 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Flushing IO for device /dev/sdb {{(pid=74743) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 17:28:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:28:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:28:40 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3b664e-dce2-48b1-9d9c-45f464ab93a1]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:28:40 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-00fdae5e-8ea8-436a-bb06-5439f7cabb62 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74743) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 17:28:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:28:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.031s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:28:40 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8997ee-4569-4aa8-9579-d59c6dab8907]: (4, ('1', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:28:40 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-00fdae5e-8ea8-436a-bb06-5439f7cabb62 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 17:28:40 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-00fdae5e-8ea8-436a-bb06-5439f7cabb62 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] SCSI volumes sdb have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 17:28:40 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-00fdae5e-8ea8-436a-bb06-5439f7cabb62 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb')] {{(pid=74743) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 17:28:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:28:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:28:40 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9d8a6f-8cfe-4349-b9c6-e3114ef443a5]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:28:40 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-00fdae5e-8ea8-436a-bb06-5439f7cabb62 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:28:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb -p 172.16.0.220:3260 --logout {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:28:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:28:40 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75dcc24-b7fc-4569-b526-bb63411dd530]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:28:40 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-00fdae5e-8ea8-436a-bb06-5439f7cabb62 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb, portal: 172.16.0.220,3260]
Nov 18 17:28:40 user nova-compute[74743]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb, portal: 172.16.0.220,3260] successful.
Nov 18 17:28:40 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:28:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb -p 172.16.0.220:3260 --op delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:28:40 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3935a32e-e6ba-494d-a04a-873f3f70a2eb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:28:40 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e362202-4ded-47b4-b756-c64f43eba397]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:28:40 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-00fdae5e-8ea8-436a-bb06-5439f7cabb62 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:28:40 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-00fdae5e-8ea8-436a-bb06-5439f7cabb62 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:28:40 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-00fdae5e-8ea8-436a-bb06-5439f7cabb62 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] <== disconnect_volume: return (321ms) None {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:28:40 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00fdae5e-8ea8-436a-bb06-5439f7cabb62 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Disconnected iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 17:28:41 user nova-compute[74743]: DEBUG nova.objects.instance [None req-00fdae5e-8ea8-436a-bb06-5439f7cabb62 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lazy-loading 'flavor' on Instance uuid 1fd86416-72c2-45e5-814d-9195b4cfcc61 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:28:41 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-00fdae5e-8ea8-436a-bb06-5439f7cabb62 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "1fd86416-72c2-45e5-814d-9195b4cfcc61" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.881s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:28:43 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:28:43 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:28:43 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Starting heal instance info cache {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 17:28:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "refresh_cache-f649143e-f7db-475a-bbe5-d5e7316caac3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:28:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquired lock "refresh_cache-f649143e-f7db-475a-bbe5-d5e7316caac3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:28:43 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Forcefully refreshing network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 17:28:43 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:28:44 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Updating instance_info_cache with network_info: [{"id": "494b363a-ab2e-4efc-9331-d2b303860a08", "address": "fa:16:3e:e7:77:41", "network": {"id": "1bbf6aff-4048-4212-a716-d0628575bfd0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc0fda74575d488a94e2dcfdc016598c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494b363a-ab", "ovs_interfaceid": "494b363a-ab2e-4efc-9331-d2b303860a08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:28:44 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Releasing lock "refresh_cache-f649143e-f7db-475a-bbe5-d5e7316caac3" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:28:44 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Updated the network info_cache for instance {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 17:28:44 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:28:44 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:28:44 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:28:44 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:28:44 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:28:44 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Auditing locally available compute resources for user (node: user) {{(pid=74743) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 17:28:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:28:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:28:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:28:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:28:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fd86416-72c2-45e5-814d-9195b4cfcc61/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:28:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fd86416-72c2-45e5-814d-9195b4cfcc61/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:28:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fd86416-72c2-45e5-814d-9195b4cfcc61/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:28:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fd86416-72c2-45e5-814d-9195b4cfcc61/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:28:45 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:28:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0b7c0c-a4ad-4ccd-b60a-721070a57f98/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:28:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0b7c0c-a4ad-4ccd-b60a-721070a57f98/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:28:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0b7c0c-a4ad-4ccd-b60a-721070a57f98/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:28:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0b7c0c-a4ad-4ccd-b60a-721070a57f98/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:28:45 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:28:45 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:28:45 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:28:45 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Hypervisor/Node resource view: name=user free_ram=8673MB free_disk=25.164199829101562GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74743) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 17:28:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:28:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:28:45 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance aefe3db1-b9bb-4cce-aa31-d0b6684ad791 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:28:45 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance f649143e-f7db-475a-bbe5-d5e7316caac3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:28:45 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 1fd86416-72c2-45e5-814d-9195b4cfcc61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:28:45 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:28:45 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 17:28:45 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 17:28:46 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:28:46 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:28:46 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Compute_service record updated for user:user {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 17:28:46 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.275s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:28:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:28:53 user nova-compute[74743]: DEBUG nova.compute.manager [req-5a4bf749-7acf-43e0-a950-6c2dfbca8bc4 req-81f6e183-5130-4a9f-a2f4-06c1961a34a5 service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Received event network-changed-3387dc52-f4d5-438c-a2c4-cee4fd142694 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:28:53 user nova-compute[74743]: DEBUG nova.compute.manager [req-5a4bf749-7acf-43e0-a950-6c2dfbca8bc4 req-81f6e183-5130-4a9f-a2f4-06c1961a34a5 service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Refreshing instance network info cache due to event network-changed-3387dc52-f4d5-438c-a2c4-cee4fd142694. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:28:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-5a4bf749-7acf-43e0-a950-6c2dfbca8bc4 req-81f6e183-5130-4a9f-a2f4-06c1961a34a5 service nova] Acquiring lock "refresh_cache-7e0b7c0c-a4ad-4ccd-b60a-721070a57f98" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:28:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-5a4bf749-7acf-43e0-a950-6c2dfbca8bc4 req-81f6e183-5130-4a9f-a2f4-06c1961a34a5 service nova] Acquired lock "refresh_cache-7e0b7c0c-a4ad-4ccd-b60a-721070a57f98" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:28:53 user nova-compute[74743]: DEBUG nova.network.neutron [req-5a4bf749-7acf-43e0-a950-6c2dfbca8bc4 req-81f6e183-5130-4a9f-a2f4-06c1961a34a5 service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Refreshing network info cache for port 3387dc52-f4d5-438c-a2c4-cee4fd142694 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:28:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:28:54 user nova-compute[74743]: DEBUG nova.network.neutron [req-5a4bf749-7acf-43e0-a950-6c2dfbca8bc4 req-81f6e183-5130-4a9f-a2f4-06c1961a34a5 service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Updated VIF entry in instance network info cache for port 3387dc52-f4d5-438c-a2c4-cee4fd142694. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:28:54 user nova-compute[74743]: DEBUG nova.network.neutron [req-5a4bf749-7acf-43e0-a950-6c2dfbca8bc4 req-81f6e183-5130-4a9f-a2f4-06c1961a34a5 service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Updating instance_info_cache with network_info: [{"id": "3387dc52-f4d5-438c-a2c4-cee4fd142694", "address": "fa:16:3e:a3:43:e6", "network": {"id": "cd6d2dbc-0950-412a-ab9d-cf7615c06eb8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1261309930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38303e1b311044deb8c833ed3299ce88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3387dc52-f4", "ovs_interfaceid": "3387dc52-f4d5-438c-a2c4-cee4fd142694", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:28:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-5a4bf749-7acf-43e0-a950-6c2dfbca8bc4 req-81f6e183-5130-4a9f-a2f4-06c1961a34a5 service nova] Releasing lock "refresh_cache-7e0b7c0c-a4ad-4ccd-b60a-721070a57f98" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:28:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cb0ee6bf-1ac3-44f9-9272-e438dddb8439 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Acquiring lock "7e0b7c0c-a4ad-4ccd-b60a-721070a57f98" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:28:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cb0ee6bf-1ac3-44f9-9272-e438dddb8439 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "7e0b7c0c-a4ad-4ccd-b60a-721070a57f98" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:28:54 user nova-compute[74743]: INFO nova.compute.manager [None req-cb0ee6bf-1ac3-44f9-9272-e438dddb8439 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Detaching volume 66125cd9-577b-4c86-856e-7f157125c46a
Nov 18 17:28:54 user nova-compute[74743]: INFO nova.virt.block_device [None req-cb0ee6bf-1ac3-44f9-9272-e438dddb8439 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Attempting to driver detach volume 66125cd9-577b-4c86-856e-7f157125c46a from mountpoint /dev/vdb
Nov 18 17:28:54 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cb0ee6bf-1ac3-44f9-9272-e438dddb8439 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Attempting to detach device vdb from instance 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98 from the persistent domain config. {{(pid=74743) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 17:28:54 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-cb0ee6bf-1ac3-44f9-9272-e438dddb8439 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 17:28:54 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:28:54 user nova-compute[74743]:   <source dev="/dev/sdd"/>
Nov 18 17:28:54 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:28:54 user nova-compute[74743]:   <serial>66125cd9-577b-4c86-856e-7f157125c46a</serial>
Nov 18 17:28:54 user nova-compute[74743]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 17:28:54 user nova-compute[74743]: </disk>
Nov 18 17:28:54 user nova-compute[74743]:  {{(pid=74743) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 17:28:54 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-cb0ee6bf-1ac3-44f9-9272-e438dddb8439 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Successfully detached device vdb from instance 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98 from the persistent domain config.
Nov 18 17:28:54 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cb0ee6bf-1ac3-44f9-9272-e438dddb8439 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98 from the live domain config. {{(pid=74743) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 17:28:54 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-cb0ee6bf-1ac3-44f9-9272-e438dddb8439 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 17:28:54 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:28:54 user nova-compute[74743]:   <source dev="/dev/sdd"/>
Nov 18 17:28:54 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:28:54 user nova-compute[74743]:   <serial>66125cd9-577b-4c86-856e-7f157125c46a</serial>
Nov 18 17:28:54 user nova-compute[74743]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 17:28:54 user nova-compute[74743]: </disk>
Nov 18 17:28:54 user nova-compute[74743]:  {{(pid=74743) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 17:28:55 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cb0ee6bf-1ac3-44f9-9272-e438dddb8439 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98 {{(pid=74743) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 17:28:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:28:55 user nova-compute[74743]: DEBUG nova.compute.manager [req-ce5323b7-02fd-41f2-af07-4e0cec2f7e1f req-8ca12324-0bf9-4d0a-be84-a712dd2432ec service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Received event network-changed-3387dc52-f4d5-438c-a2c4-cee4fd142694 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:28:55 user nova-compute[74743]: DEBUG nova.compute.manager [req-ce5323b7-02fd-41f2-af07-4e0cec2f7e1f req-8ca12324-0bf9-4d0a-be84-a712dd2432ec service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Refreshing instance network info cache due to event network-changed-3387dc52-f4d5-438c-a2c4-cee4fd142694. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:28:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ce5323b7-02fd-41f2-af07-4e0cec2f7e1f req-8ca12324-0bf9-4d0a-be84-a712dd2432ec service nova] Acquiring lock "refresh_cache-7e0b7c0c-a4ad-4ccd-b60a-721070a57f98" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:28:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ce5323b7-02fd-41f2-af07-4e0cec2f7e1f req-8ca12324-0bf9-4d0a-be84-a712dd2432ec service nova] Acquired lock "refresh_cache-7e0b7c0c-a4ad-4ccd-b60a-721070a57f98" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:28:55 user nova-compute[74743]: DEBUG nova.network.neutron [req-ce5323b7-02fd-41f2-af07-4e0cec2f7e1f req-8ca12324-0bf9-4d0a-be84-a712dd2432ec service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Refreshing network info cache for port 3387dc52-f4d5-438c-a2c4-cee4fd142694 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:28:55 user nova-compute[74743]: DEBUG nova.network.neutron [req-ce5323b7-02fd-41f2-af07-4e0cec2f7e1f req-8ca12324-0bf9-4d0a-be84-a712dd2432ec service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Updated VIF entry in instance network info cache for port 3387dc52-f4d5-438c-a2c4-cee4fd142694. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:28:55 user nova-compute[74743]: DEBUG nova.network.neutron [req-ce5323b7-02fd-41f2-af07-4e0cec2f7e1f req-8ca12324-0bf9-4d0a-be84-a712dd2432ec service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Updating instance_info_cache with network_info: [{"id": "3387dc52-f4d5-438c-a2c4-cee4fd142694", "address": "fa:16:3e:a3:43:e6", "network": {"id": "cd6d2dbc-0950-412a-ab9d-cf7615c06eb8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1261309930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38303e1b311044deb8c833ed3299ce88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3387dc52-f4", "ovs_interfaceid": "3387dc52-f4d5-438c-a2c4-cee4fd142694", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:28:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ce5323b7-02fd-41f2-af07-4e0cec2f7e1f req-8ca12324-0bf9-4d0a-be84-a712dd2432ec service nova] Releasing lock "refresh_cache-7e0b7c0c-a4ad-4ccd-b60a-721070a57f98" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:28:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:29:03 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:29:08 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:29:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-89a1faef-cf11-45cb-baee-18c761218091 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquiring lock "1fd86416-72c2-45e5-814d-9195b4cfcc61" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:29:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-89a1faef-cf11-45cb-baee-18c761218091 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "1fd86416-72c2-45e5-814d-9195b4cfcc61" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:29:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-89a1faef-cf11-45cb-baee-18c761218091 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquiring lock "1fd86416-72c2-45e5-814d-9195b4cfcc61-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:29:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-89a1faef-cf11-45cb-baee-18c761218091 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "1fd86416-72c2-45e5-814d-9195b4cfcc61-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:29:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-89a1faef-cf11-45cb-baee-18c761218091 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "1fd86416-72c2-45e5-814d-9195b4cfcc61-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:29:10 user nova-compute[74743]: INFO nova.compute.manager [None req-89a1faef-cf11-45cb-baee-18c761218091 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Terminating instance
Nov 18 17:29:10 user nova-compute[74743]: DEBUG nova.compute.manager [None req-89a1faef-cf11-45cb-baee-18c761218091 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Start destroying the instance on the hypervisor. {{(pid=74743) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 17:29:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:29:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:29:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:29:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:29:10 user nova-compute[74743]: DEBUG nova.compute.manager [req-dc0af41e-facf-42ed-9682-de42bdcbdd15 req-d20ba89c-68ae-44bf-829f-041bc233c78b service nova] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Received event network-vif-unplugged-044dbd97-bde5-4feb-a5fb-801f22043ae4 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:29:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-dc0af41e-facf-42ed-9682-de42bdcbdd15 req-d20ba89c-68ae-44bf-829f-041bc233c78b service nova] Acquiring lock "1fd86416-72c2-45e5-814d-9195b4cfcc61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:29:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-dc0af41e-facf-42ed-9682-de42bdcbdd15 req-d20ba89c-68ae-44bf-829f-041bc233c78b service nova] Lock "1fd86416-72c2-45e5-814d-9195b4cfcc61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:29:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-dc0af41e-facf-42ed-9682-de42bdcbdd15 req-d20ba89c-68ae-44bf-829f-041bc233c78b service nova] Lock "1fd86416-72c2-45e5-814d-9195b4cfcc61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:29:10 user nova-compute[74743]: DEBUG nova.compute.manager [req-dc0af41e-facf-42ed-9682-de42bdcbdd15 req-d20ba89c-68ae-44bf-829f-041bc233c78b service nova] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] No waiting events found dispatching network-vif-unplugged-044dbd97-bde5-4feb-a5fb-801f22043ae4 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:29:10 user nova-compute[74743]: DEBUG nova.compute.manager [req-dc0af41e-facf-42ed-9682-de42bdcbdd15 req-d20ba89c-68ae-44bf-829f-041bc233c78b service nova] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Received event network-vif-unplugged-044dbd97-bde5-4feb-a5fb-801f22043ae4 for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:29:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:29:10 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Instance destroyed successfully.
Nov 18 17:29:10 user nova-compute[74743]: DEBUG nova.objects.instance [None req-89a1faef-cf11-45cb-baee-18c761218091 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lazy-loading 'resources' on Instance uuid 1fd86416-72c2-45e5-814d-9195b4cfcc61 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:29:10 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-89a1faef-cf11-45cb-baee-18c761218091 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:23:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1795284009',display_name='tempest-AttachVolumeNegativeTest-server-1795284009',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1795284009',id=41,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHLZZBRZDOsPrMzZxlejBLPVGSwic0dkjfAZPtWgp6tO9pGlomYd/HfxiUTCYOzmij5XPCWHsiDkJdoWkRwen2oYYy1v2REZx95HgWDOcWfszeCEXxuqpLbaYOr1UlVf6g==',key_name='tempest-keypair-981794856',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:23:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5502edf6a6b94cb59d58d52494efc90d',ramdisk_id='',reservation_id='r-ao6ywubh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1149732113',owner_user_name='tempest-AttachVolumeNegativeTest-1149732113-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:23:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35aedc702bc4444eb3802772a523ba79',uuid=1fd86416-72c2-45e5-814d-9195b4cfcc61,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "044dbd97-bde5-4feb-a5fb-801f22043ae4", "address": "fa:16:3e:3f:13:af", "network": {"id": "b03d3355-7704-43de-8af7-7a5dc1ee490d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1492507432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5502edf6a6b94cb59d58d52494efc90d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap044dbd97-bd", "ovs_interfaceid": "044dbd97-bde5-4feb-a5fb-801f22043ae4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:29:10 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-89a1faef-cf11-45cb-baee-18c761218091 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Converting VIF {"id": "044dbd97-bde5-4feb-a5fb-801f22043ae4", "address": "fa:16:3e:3f:13:af", "network": {"id": "b03d3355-7704-43de-8af7-7a5dc1ee490d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1492507432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5502edf6a6b94cb59d58d52494efc90d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap044dbd97-bd", "ovs_interfaceid": "044dbd97-bde5-4feb-a5fb-801f22043ae4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:29:10 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-89a1faef-cf11-45cb-baee-18c761218091 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:13:af,bridge_name='br-int',has_traffic_filtering=True,id=044dbd97-bde5-4feb-a5fb-801f22043ae4,network=Network(b03d3355-7704-43de-8af7-7a5dc1ee490d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap044dbd97-bd') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:29:10 user nova-compute[74743]: DEBUG os_vif [None req-89a1faef-cf11-45cb-baee-18c761218091 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:13:af,bridge_name='br-int',has_traffic_filtering=True,id=044dbd97-bde5-4feb-a5fb-801f22043ae4,network=Network(b03d3355-7704-43de-8af7-7a5dc1ee490d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap044dbd97-bd') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:29:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:29:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap044dbd97-bd, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:29:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:29:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:29:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:29:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2f0edae0-812b-4f6d-8caa-13e32fd7b633) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:29:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:29:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:29:10 user nova-compute[74743]: INFO os_vif [None req-89a1faef-cf11-45cb-baee-18c761218091 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:13:af,bridge_name='br-int',has_traffic_filtering=True,id=044dbd97-bde5-4feb-a5fb-801f22043ae4,network=Network(b03d3355-7704-43de-8af7-7a5dc1ee490d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap044dbd97-bd')
Nov 18 17:29:10 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-89a1faef-cf11-45cb-baee-18c761218091 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Deleting instance files /opt/stack/data/nova/instances/1fd86416-72c2-45e5-814d-9195b4cfcc61_del
Nov 18 17:29:10 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-89a1faef-cf11-45cb-baee-18c761218091 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Deletion of /opt/stack/data/nova/instances/1fd86416-72c2-45e5-814d-9195b4cfcc61_del complete
Nov 18 17:29:10 user nova-compute[74743]: INFO nova.compute.manager [None req-89a1faef-cf11-45cb-baee-18c761218091 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Took 0.83 seconds to destroy the instance on the hypervisor.
Nov 18 17:29:10 user nova-compute[74743]: DEBUG oslo.service.loopingcall [None req-89a1faef-cf11-45cb-baee-18c761218091 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74743) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 17:29:10 user nova-compute[74743]: DEBUG nova.compute.manager [-] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Deallocating network for instance {{(pid=74743) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 17:29:10 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] deallocate_for_instance() {{(pid=74743) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 17:29:11 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:29:11 user nova-compute[74743]: INFO nova.compute.manager [-] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Took 0.67 seconds to deallocate network for instance.
Nov 18 17:29:11 user nova-compute[74743]: DEBUG nova.compute.manager [req-da686f07-85ad-41d5-bb65-641e8f8a2827 req-7ebd4858-b6b9-4388-bab9-33810f1e2480 service nova] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Received event network-vif-deleted-044dbd97-bde5-4feb-a5fb-801f22043ae4 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:29:11 user nova-compute[74743]: INFO nova.compute.manager [req-da686f07-85ad-41d5-bb65-641e8f8a2827 req-7ebd4858-b6b9-4388-bab9-33810f1e2480 service nova] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Neutron deleted interface 044dbd97-bde5-4feb-a5fb-801f22043ae4; detaching it from the instance and deleting it from the info cache
Nov 18 17:29:11 user nova-compute[74743]: DEBUG nova.network.neutron [req-da686f07-85ad-41d5-bb65-641e8f8a2827 req-7ebd4858-b6b9-4388-bab9-33810f1e2480 service nova] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:29:11 user nova-compute[74743]: DEBUG nova.compute.manager [req-da686f07-85ad-41d5-bb65-641e8f8a2827 req-7ebd4858-b6b9-4388-bab9-33810f1e2480 service nova] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Detach interface failed, port_id=044dbd97-bde5-4feb-a5fb-801f22043ae4, reason: Instance 1fd86416-72c2-45e5-814d-9195b4cfcc61 could not be found. {{(pid=74743) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 17:29:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-89a1faef-cf11-45cb-baee-18c761218091 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:29:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-89a1faef-cf11-45cb-baee-18c761218091 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:29:11 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-89a1faef-cf11-45cb-baee-18c761218091 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:29:11 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-89a1faef-cf11-45cb-baee-18c761218091 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:29:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-89a1faef-cf11-45cb-baee-18c761218091 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.182s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:29:11 user nova-compute[74743]: INFO nova.scheduler.client.report [None req-89a1faef-cf11-45cb-baee-18c761218091 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Deleted allocations for instance 1fd86416-72c2-45e5-814d-9195b4cfcc61
Nov 18 17:29:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-89a1faef-cf11-45cb-baee-18c761218091 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "1fd86416-72c2-45e5-814d-9195b4cfcc61" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.852s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:29:12 user nova-compute[74743]: DEBUG nova.compute.manager [req-df840810-3b0e-4dc2-870c-804945d46979 req-d8d062db-f8b2-415e-94c8-78340b8810f2 service nova] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Received event network-vif-plugged-044dbd97-bde5-4feb-a5fb-801f22043ae4 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:29:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-df840810-3b0e-4dc2-870c-804945d46979 req-d8d062db-f8b2-415e-94c8-78340b8810f2 service nova] Acquiring lock "1fd86416-72c2-45e5-814d-9195b4cfcc61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:29:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-df840810-3b0e-4dc2-870c-804945d46979 req-d8d062db-f8b2-415e-94c8-78340b8810f2 service nova] Lock "1fd86416-72c2-45e5-814d-9195b4cfcc61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:29:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-df840810-3b0e-4dc2-870c-804945d46979 req-d8d062db-f8b2-415e-94c8-78340b8810f2 service nova] Lock "1fd86416-72c2-45e5-814d-9195b4cfcc61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:29:12 user nova-compute[74743]: DEBUG nova.compute.manager [req-df840810-3b0e-4dc2-870c-804945d46979 req-d8d062db-f8b2-415e-94c8-78340b8810f2 service nova] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] No waiting events found dispatching network-vif-plugged-044dbd97-bde5-4feb-a5fb-801f22043ae4 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:29:12 user nova-compute[74743]: WARNING nova.compute.manager [req-df840810-3b0e-4dc2-870c-804945d46979 req-d8d062db-f8b2-415e-94c8-78340b8810f2 service nova] [instance: 1fd86416-72c2-45e5-814d-9195b4cfcc61] Received unexpected event network-vif-plugged-044dbd97-bde5-4feb-a5fb-801f22043ae4 for instance with vm_state deleted and task_state None.
Nov 18 17:29:15 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cb0ee6bf-1ac3-44f9-9272-e438dddb8439 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98 is timed out.
Nov 18 17:29:15 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-cb0ee6bf-1ac3-44f9-9272-e438dddb8439 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Successfully detached device vdb from instance 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98 from the live domain config.
Nov 18 17:29:15 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb0ee6bf-1ac3-44f9-9272-e438dddb8439 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] calling os-brick to detach iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 17:29:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb0ee6bf-1ac3-44f9-9272-e438dddb8439 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, {'target_iqn': 'iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pqzfORIa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:29:15 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-cb0ee6bf-1ac3-44f9-9272-e438dddb8439 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:29:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-cb0ee6bf-1ac3-44f9-9272-e438dddb8439 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:29:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-cb0ee6bf-1ac3-44f9-9272-e438dddb8439 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:29:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:29:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:29:15 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[8621a774-deb9-4966-9bc7-2d128d898e37]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:29:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb0ee6bf-1ac3-44f9-9272-e438dddb8439 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 17:29:15 user nova-compute[74743]: No targets found.
Nov 18 17:29:15 user nova-compute[74743]: iSNS:
Nov 18 17:29:15 user nova-compute[74743]: No targets found.
Nov 18 17:29:15 user nova-compute[74743]: STATIC:
Nov 18 17:29:15 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127
Nov 18 17:29:15 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:29:15 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:29:15 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a
Nov 18 17:29:15 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:29:15 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:29:15 user nova-compute[74743]: FIRMWARE:
Nov 18 17:29:15 user nova-compute[74743]: No targets found.
Nov 18 17:29:15 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:29:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb0ee6bf-1ac3-44f9-9272-e438dddb8439 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 17:29:15 user nova-compute[74743]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 17:29:15 user nova-compute[74743]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74743) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 17:29:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb0ee6bf-1ac3-44f9-9272-e438dddb8439 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a', 0)] {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 17:29:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:29:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:29:15 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12858e2-935f-47fa-b0da-9b159299afdb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:29:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:29:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:29:15 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30f21ed-7376-4f84-877f-af4f7fffdd44]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:29:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb0ee6bf-1ac3-44f9-9272-e438dddb8439 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:29:15 user nova-compute[74743]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a (non-flash)
Nov 18 17:29:15 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:29:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb0ee6bf-1ac3-44f9-9272-e438dddb8439 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:29:15 user nova-compute[74743]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a (non-flash)
Nov 18 17:29:15 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:29:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb0ee6bf-1ac3-44f9-9272-e438dddb8439 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb287643a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a'): ({'sdd'}, set())}) {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 17:29:15 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-cb0ee6bf-1ac3-44f9-9272-e438dddb8439 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Removing single pathed devices sdd {{(pid=74743) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 17:29:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:29:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:29:15 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bda0ae1-2d4f-4bd5-83dc-21b828d838e2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:29:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:29:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:29:15 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf06937-ec33-488d-8451-764bb8c7c376]: (4, ('ok\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:29:15 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-cb0ee6bf-1ac3-44f9-9272-e438dddb8439 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Flushing IO for device /dev/sdd {{(pid=74743) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 17:29:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:29:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:29:15 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[5841e424-d796-4262-af28-7dbf3d9a7026]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:29:15 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-cb0ee6bf-1ac3-44f9-9272-e438dddb8439 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74743) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 17:29:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:29:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:29:15 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[774bf59a-8c09-44a8-be21-af73813f178a]: (4, ('1', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:29:15 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-cb0ee6bf-1ac3-44f9-9272-e438dddb8439 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 17:29:15 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-cb0ee6bf-1ac3-44f9-9272-e438dddb8439 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] SCSI volumes sdd have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 17:29:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb0ee6bf-1ac3-44f9-9272-e438dddb8439 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a')] {{(pid=74743) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 17:29:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:29:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:29:15 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[60cfc852-ccd5-4a64-91f8-ee80f4060006]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:29:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb0ee6bf-1ac3-44f9-9272-e438dddb8439 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:29:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a -p 172.16.0.220:3260 --logout {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:29:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:29:15 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[296c73ba-d660-49d8-8b07-779129728c56]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:29:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb0ee6bf-1ac3-44f9-9272-e438dddb8439 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a, portal: 172.16.0.220,3260]
Nov 18 17:29:15 user nova-compute[74743]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a, portal: 172.16.0.220,3260] successful.
Nov 18 17:29:15 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:29:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a -p 172.16.0.220:3260 --op delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:29:15 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66125cd9-577b-4c86-856e-7f157125c46a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:29:15 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9ab471-ba61-48e2-b4c9-9a9ba3dbaf32]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:29:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb0ee6bf-1ac3-44f9-9272-e438dddb8439 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:29:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-cb0ee6bf-1ac3-44f9-9272-e438dddb8439 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:29:15 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb0ee6bf-1ac3-44f9-9272-e438dddb8439 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] <== disconnect_volume: return (333ms) None {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:29:15 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb0ee6bf-1ac3-44f9-9272-e438dddb8439 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Disconnected iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 17:29:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:29:16 user nova-compute[74743]: DEBUG nova.objects.instance [None req-cb0ee6bf-1ac3-44f9-9272-e438dddb8439 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lazy-loading 'flavor' on Instance uuid 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:29:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cb0ee6bf-1ac3-44f9-9272-e438dddb8439 tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "7e0b7c0c-a4ad-4ccd-b60a-721070a57f98" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.871s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:29:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8c497798-1e39-4c85-832e-8faffca8e5a6 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquiring lock "f649143e-f7db-475a-bbe5-d5e7316caac3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:29:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8c497798-1e39-4c85-832e-8faffca8e5a6 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "f649143e-f7db-475a-bbe5-d5e7316caac3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:29:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8c497798-1e39-4c85-832e-8faffca8e5a6 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquiring lock "f649143e-f7db-475a-bbe5-d5e7316caac3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:29:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8c497798-1e39-4c85-832e-8faffca8e5a6 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "f649143e-f7db-475a-bbe5-d5e7316caac3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:29:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8c497798-1e39-4c85-832e-8faffca8e5a6 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "f649143e-f7db-475a-bbe5-d5e7316caac3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:29:18 user nova-compute[74743]: INFO nova.compute.manager [None req-8c497798-1e39-4c85-832e-8faffca8e5a6 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Terminating instance
Nov 18 17:29:18 user nova-compute[74743]: DEBUG nova.compute.manager [None req-8c497798-1e39-4c85-832e-8faffca8e5a6 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Start destroying the instance on the hypervisor. {{(pid=74743) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 17:29:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:29:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:29:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-a000f31a-3572-4124-b023-fbfb5df29c83 req-41324b88-1268-4417-b820-8b4e503bbc38 service nova] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Received event network-vif-unplugged-494b363a-ab2e-4efc-9331-d2b303860a08 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:29:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a000f31a-3572-4124-b023-fbfb5df29c83 req-41324b88-1268-4417-b820-8b4e503bbc38 service nova] Acquiring lock "f649143e-f7db-475a-bbe5-d5e7316caac3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:29:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a000f31a-3572-4124-b023-fbfb5df29c83 req-41324b88-1268-4417-b820-8b4e503bbc38 service nova] Lock "f649143e-f7db-475a-bbe5-d5e7316caac3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:29:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a000f31a-3572-4124-b023-fbfb5df29c83 req-41324b88-1268-4417-b820-8b4e503bbc38 service nova] Lock "f649143e-f7db-475a-bbe5-d5e7316caac3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:29:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-a000f31a-3572-4124-b023-fbfb5df29c83 req-41324b88-1268-4417-b820-8b4e503bbc38 service nova] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] No waiting events found dispatching network-vif-unplugged-494b363a-ab2e-4efc-9331-d2b303860a08 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:29:18 user nova-compute[74743]: DEBUG nova.compute.manager [req-a000f31a-3572-4124-b023-fbfb5df29c83 req-41324b88-1268-4417-b820-8b4e503bbc38 service nova] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Received event network-vif-unplugged-494b363a-ab2e-4efc-9331-d2b303860a08 for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:29:19 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Instance destroyed successfully.
Nov 18 17:29:19 user nova-compute[74743]: DEBUG nova.objects.instance [None req-8c497798-1e39-4c85-832e-8faffca8e5a6 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lazy-loading 'resources' on Instance uuid f649143e-f7db-475a-bbe5-d5e7316caac3 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-8c497798-1e39-4c85-832e-8faffca8e5a6 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:13:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-813639784',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-813639784',id=29,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:15:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc0fda74575d488a94e2dcfdc016598c',ramdisk_id='',reservation_id='r-i2jtfef2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-633893051',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:17:19Z,user_data=None,user_id='5639bd2666534fdca04d0958dcdc9f54',uuid=f649143e-f7db-475a-bbe5-d5e7316caac3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "494b363a-ab2e-4efc-9331-d2b303860a08", "address": "fa:16:3e:e7:77:41", "network": {"id": "1bbf6aff-4048-4212-a716-d0628575bfd0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc0fda74575d488a94e2dcfdc016598c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494b363a-ab", "ovs_interfaceid": "494b363a-ab2e-4efc-9331-d2b303860a08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-8c497798-1e39-4c85-832e-8faffca8e5a6 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Converting VIF {"id": "494b363a-ab2e-4efc-9331-d2b303860a08", "address": "fa:16:3e:e7:77:41", "network": {"id": "1bbf6aff-4048-4212-a716-d0628575bfd0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc0fda74575d488a94e2dcfdc016598c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494b363a-ab", "ovs_interfaceid": "494b363a-ab2e-4efc-9331-d2b303860a08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-8c497798-1e39-4c85-832e-8faffca8e5a6 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:77:41,bridge_name='br-int',has_traffic_filtering=True,id=494b363a-ab2e-4efc-9331-d2b303860a08,network=Network(1bbf6aff-4048-4212-a716-d0628575bfd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap494b363a-ab') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG os_vif [None req-8c497798-1e39-4c85-832e-8faffca8e5a6 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:77:41,bridge_name='br-int',has_traffic_filtering=True,id=494b363a-ab2e-4efc-9331-d2b303860a08,network=Network(1bbf6aff-4048-4212-a716-d0628575bfd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap494b363a-ab') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap494b363a-ab, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3117f89c-23d2-4d3c-b7c3-4683c329df59) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:29:19 user nova-compute[74743]: INFO os_vif [None req-8c497798-1e39-4c85-832e-8faffca8e5a6 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:77:41,bridge_name='br-int',has_traffic_filtering=True,id=494b363a-ab2e-4efc-9331-d2b303860a08,network=Network(1bbf6aff-4048-4212-a716-d0628575bfd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap494b363a-ab')
Nov 18 17:29:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c497798-1e39-4c85-832e-8faffca8e5a6 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] calling os-brick to detach iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c497798-1e39-4c85-832e-8faffca8e5a6 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, {'target_iqn': 'iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nPaDyYBm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:29:19 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-8c497798-1e39-4c85-832e-8faffca8e5a6 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:29:19 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-8c497798-1e39-4c85-832e-8faffca8e5a6 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-8c497798-1e39-4c85-832e-8faffca8e5a6 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e1ad09-22b1-489d-b79e-37ca6d0481bf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c497798-1e39-4c85-832e-8faffca8e5a6 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 17:29:19 user nova-compute[74743]: No targets found.
Nov 18 17:29:19 user nova-compute[74743]: iSNS:
Nov 18 17:29:19 user nova-compute[74743]: No targets found.
Nov 18 17:29:19 user nova-compute[74743]: STATIC:
Nov 18 17:29:19 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127
Nov 18 17:29:19 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:29:19 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:29:19 user nova-compute[74743]: FIRMWARE:
Nov 18 17:29:19 user nova-compute[74743]: No targets found.
Nov 18 17:29:19 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c497798-1e39-4c85-832e-8faffca8e5a6 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 17:29:19 user nova-compute[74743]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 17:29:19 user nova-compute[74743]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74743) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c497798-1e39-4c85-832e-8faffca8e5a6 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127', 0)] {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[618612e9-c2ad-4ee5-92a5-272f21cfc594]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3f6c28-e553-4c39-abb9-4efe20e2393b]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c497798-1e39-4c85-832e-8faffca8e5a6 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:29:19 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c497798-1e39-4c85-832e-8faffca8e5a6 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 (non-flash)
Nov 18 17:29:19 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c497798-1e39-4c85-832e-8faffca8e5a6 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb084e2830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127'): ({'sdf'}, set())}) {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-8c497798-1e39-4c85-832e-8faffca8e5a6 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Removing single pathed devices sdf {{(pid=74743) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca53effc-d6dc-4b55-bf81-6e9c4238b9fb]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4917a7-2081-4338-960f-4c9d6d910ec5]: (4, ('ok\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-8c497798-1e39-4c85-832e-8faffca8e5a6 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Flushing IO for device /dev/sdf {{(pid=74743) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[63567534-106d-47ee-a0c6-6458ea662f67]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-8c497798-1e39-4c85-832e-8faffca8e5a6 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74743) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.033s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[99cbe424-b20f-4d28-ae23-e06c2f4846d9]: (4, ('1', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-8c497798-1e39-4c85-832e-8faffca8e5a6 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-8c497798-1e39-4c85-832e-8faffca8e5a6 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] SCSI volumes sdf have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c497798-1e39-4c85-832e-8faffca8e5a6 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127')] {{(pid=74743) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb72bd72-3038-444e-a902-3a7576f9db1b]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c497798-1e39-4c85-832e-8faffca8e5a6 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 -p 172.16.0.220:3260 --logout {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e40257d-974b-441b-b363-32b88a0e38c0]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c497798-1e39-4c85-832e-8faffca8e5a6 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127, portal: 172.16.0.220,3260]
Nov 18 17:29:19 user nova-compute[74743]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127, portal: 172.16.0.220,3260] successful.
Nov 18 17:29:19 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 -p 172.16.0.220:3260 --op delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc44e0d3-d7fa-4591-8c0d-47dc457d0127 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0472f0c1-134c-48d7-b1f1-9922a382c6ce]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c497798-1e39-4c85-832e-8faffca8e5a6 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-8c497798-1e39-4c85-832e-8faffca8e5a6 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c497798-1e39-4c85-832e-8faffca8e5a6 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] <== disconnect_volume: return (287ms) None {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c497798-1e39-4c85-832e-8faffca8e5a6 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Disconnected iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 17:29:19 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-8c497798-1e39-4c85-832e-8faffca8e5a6 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Deleting instance files /opt/stack/data/nova/instances/f649143e-f7db-475a-bbe5-d5e7316caac3_del
Nov 18 17:29:19 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-8c497798-1e39-4c85-832e-8faffca8e5a6 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Deletion of /opt/stack/data/nova/instances/f649143e-f7db-475a-bbe5-d5e7316caac3_del complete
Nov 18 17:29:19 user nova-compute[74743]: INFO nova.compute.manager [None req-8c497798-1e39-4c85-832e-8faffca8e5a6 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Took 1.11 seconds to destroy the instance on the hypervisor.
Nov 18 17:29:19 user nova-compute[74743]: DEBUG oslo.service.loopingcall [None req-8c497798-1e39-4c85-832e-8faffca8e5a6 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74743) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG nova.compute.manager [-] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Deallocating network for instance {{(pid=74743) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 17:29:19 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] deallocate_for_instance() {{(pid=74743) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 17:29:20 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:29:20 user nova-compute[74743]: INFO nova.compute.manager [-] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Took 0.42 seconds to deallocate network for instance.
Nov 18 17:29:21 user nova-compute[74743]: INFO nova.compute.manager [None req-8c497798-1e39-4c85-832e-8faffca8e5a6 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Took 0.76 seconds to detach 1 volumes for instance.
Nov 18 17:29:21 user nova-compute[74743]: DEBUG nova.compute.manager [req-aef7b241-3991-4dcf-b48b-1d66704d7e15 req-9558b068-3f4a-44d5-a922-771469f7fc2e service nova] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Received event network-vif-plugged-494b363a-ab2e-4efc-9331-d2b303860a08 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:29:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-aef7b241-3991-4dcf-b48b-1d66704d7e15 req-9558b068-3f4a-44d5-a922-771469f7fc2e service nova] Acquiring lock "f649143e-f7db-475a-bbe5-d5e7316caac3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:29:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-aef7b241-3991-4dcf-b48b-1d66704d7e15 req-9558b068-3f4a-44d5-a922-771469f7fc2e service nova] Lock "f649143e-f7db-475a-bbe5-d5e7316caac3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:29:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-aef7b241-3991-4dcf-b48b-1d66704d7e15 req-9558b068-3f4a-44d5-a922-771469f7fc2e service nova] Lock "f649143e-f7db-475a-bbe5-d5e7316caac3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:29:21 user nova-compute[74743]: DEBUG nova.compute.manager [req-aef7b241-3991-4dcf-b48b-1d66704d7e15 req-9558b068-3f4a-44d5-a922-771469f7fc2e service nova] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] No waiting events found dispatching network-vif-plugged-494b363a-ab2e-4efc-9331-d2b303860a08 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:29:21 user nova-compute[74743]: WARNING nova.compute.manager [req-aef7b241-3991-4dcf-b48b-1d66704d7e15 req-9558b068-3f4a-44d5-a922-771469f7fc2e service nova] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Received unexpected event network-vif-plugged-494b363a-ab2e-4efc-9331-d2b303860a08 for instance with vm_state active and task_state deleting.
Nov 18 17:29:21 user nova-compute[74743]: DEBUG nova.compute.manager [req-aef7b241-3991-4dcf-b48b-1d66704d7e15 req-9558b068-3f4a-44d5-a922-771469f7fc2e service nova] [instance: f649143e-f7db-475a-bbe5-d5e7316caac3] Received event network-vif-deleted-494b363a-ab2e-4efc-9331-d2b303860a08 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:29:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8c497798-1e39-4c85-832e-8faffca8e5a6 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:29:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8c497798-1e39-4c85-832e-8faffca8e5a6 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:29:21 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-8c497798-1e39-4c85-832e-8faffca8e5a6 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:29:21 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-8c497798-1e39-4c85-832e-8faffca8e5a6 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:29:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8c497798-1e39-4c85-832e-8faffca8e5a6 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.165s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:29:21 user nova-compute[74743]: INFO nova.scheduler.client.report [None req-8c497798-1e39-4c85-832e-8faffca8e5a6 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Deleted allocations for instance f649143e-f7db-475a-bbe5-d5e7316caac3
Nov 18 17:29:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8c497798-1e39-4c85-832e-8faffca8e5a6 tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "f649143e-f7db-475a-bbe5-d5e7316caac3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.649s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:29:24 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:29:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:29:33 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:29:34 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:29:34 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74743) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 17:29:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:29:36 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:29:36 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:29:39 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:29:39 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Cleaning up deleted instances {{(pid=74743) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 18 17:29:39 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] There are 0 instances to clean {{(pid=74743) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 18 17:29:39 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:29:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:29:40 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:29:41 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:29:41 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Cleaning up deleted instances with incomplete migration  {{(pid=74743) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 18 17:29:43 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:29:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:29:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:29:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:29:43 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Auditing locally available compute resources for user (node: user) {{(pid=74743) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 17:29:43 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:29:43 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:29:43 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:29:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:29:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0b7c0c-a4ad-4ccd-b60a-721070a57f98/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:29:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0b7c0c-a4ad-4ccd-b60a-721070a57f98/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:29:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0b7c0c-a4ad-4ccd-b60a-721070a57f98/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:29:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0b7c0c-a4ad-4ccd-b60a-721070a57f98/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:29:44 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:29:44 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:29:44 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:29:44 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Hypervisor/Node resource view: name=user free_ram=8783MB free_disk=25.183181762695312GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74743) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 17:29:44 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:29:44 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:29:45 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance aefe3db1-b9bb-4cce-aa31-d0b6684ad791 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:29:45 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:29:45 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 17:29:45 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 17:29:45 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Refreshing inventories for resource provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 18 17:29:45 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Updating ProviderTree inventory for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 18 17:29:45 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Updating inventory in ProviderTree for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 18 17:29:45 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Refreshing aggregate associations for resource provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8, aggregates: None {{(pid=74743) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 18 17:29:45 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Refreshing trait associations for resource provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=74743) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 18 17:29:45 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:29:45 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:29:45 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Compute_service record updated for user:user {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 17:29:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.493s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:29:47 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:29:47 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:29:47 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Starting heal instance info cache {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 17:29:47 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "refresh_cache-7e0b7c0c-a4ad-4ccd-b60a-721070a57f98" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:29:47 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquired lock "refresh_cache-7e0b7c0c-a4ad-4ccd-b60a-721070a57f98" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:29:47 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Forcefully refreshing network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 17:29:47 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Updating instance_info_cache with network_info: [{"id": "3387dc52-f4d5-438c-a2c4-cee4fd142694", "address": "fa:16:3e:a3:43:e6", "network": {"id": "cd6d2dbc-0950-412a-ab9d-cf7615c06eb8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1261309930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38303e1b311044deb8c833ed3299ce88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3387dc52-f4", "ovs_interfaceid": "3387dc52-f4d5-438c-a2c4-cee4fd142694", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:29:47 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Releasing lock "refresh_cache-7e0b7c0c-a4ad-4ccd-b60a-721070a57f98" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:29:47 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Updated the network info_cache for instance {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 17:29:47 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:29:48 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-015275ba-f98b-4732-b143-d8fce0d7d55d tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Acquiring lock "7e0b7c0c-a4ad-4ccd-b60a-721070a57f98" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:29:48 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-015275ba-f98b-4732-b143-d8fce0d7d55d tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "7e0b7c0c-a4ad-4ccd-b60a-721070a57f98" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:29:48 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-015275ba-f98b-4732-b143-d8fce0d7d55d tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Acquiring lock "7e0b7c0c-a4ad-4ccd-b60a-721070a57f98-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:29:48 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-015275ba-f98b-4732-b143-d8fce0d7d55d tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "7e0b7c0c-a4ad-4ccd-b60a-721070a57f98-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:29:48 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-015275ba-f98b-4732-b143-d8fce0d7d55d tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "7e0b7c0c-a4ad-4ccd-b60a-721070a57f98-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:29:48 user nova-compute[74743]: INFO nova.compute.manager [None req-015275ba-f98b-4732-b143-d8fce0d7d55d tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Terminating instance
Nov 18 17:29:48 user nova-compute[74743]: DEBUG nova.compute.manager [None req-015275ba-f98b-4732-b143-d8fce0d7d55d tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Start destroying the instance on the hypervisor. {{(pid=74743) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 17:29:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:29:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:29:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:29:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:29:48 user nova-compute[74743]: DEBUG nova.compute.manager [req-421c5b8e-d304-4a36-9087-b0a90c2eaec9 req-f5e89e25-347b-4322-9915-be71ed91e33f service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Received event network-vif-unplugged-3387dc52-f4d5-438c-a2c4-cee4fd142694 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:29:48 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-421c5b8e-d304-4a36-9087-b0a90c2eaec9 req-f5e89e25-347b-4322-9915-be71ed91e33f service nova] Acquiring lock "7e0b7c0c-a4ad-4ccd-b60a-721070a57f98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:29:48 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-421c5b8e-d304-4a36-9087-b0a90c2eaec9 req-f5e89e25-347b-4322-9915-be71ed91e33f service nova] Lock "7e0b7c0c-a4ad-4ccd-b60a-721070a57f98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:29:48 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-421c5b8e-d304-4a36-9087-b0a90c2eaec9 req-f5e89e25-347b-4322-9915-be71ed91e33f service nova] Lock "7e0b7c0c-a4ad-4ccd-b60a-721070a57f98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:29:48 user nova-compute[74743]: DEBUG nova.compute.manager [req-421c5b8e-d304-4a36-9087-b0a90c2eaec9 req-f5e89e25-347b-4322-9915-be71ed91e33f service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] No waiting events found dispatching network-vif-unplugged-3387dc52-f4d5-438c-a2c4-cee4fd142694 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:29:48 user nova-compute[74743]: DEBUG nova.compute.manager [req-421c5b8e-d304-4a36-9087-b0a90c2eaec9 req-f5e89e25-347b-4322-9915-be71ed91e33f service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Received event network-vif-unplugged-3387dc52-f4d5-438c-a2c4-cee4fd142694 for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:29:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:29:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:29:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:29:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:29:48 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Instance destroyed successfully.
Nov 18 17:29:48 user nova-compute[74743]: DEBUG nova.objects.instance [None req-015275ba-f98b-4732-b143-d8fce0d7d55d tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lazy-loading 'resources' on Instance uuid 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:29:48 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-015275ba-f98b-4732-b143-d8fce0d7d55d tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:24:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1296422400',display_name='tempest-TestMinimumBasicScenario-server-1296422400',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1296422400',id=42,image_ref='2cbdd988-3c92-4be4-9d1b-ab72b4bf2a9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwUUdO9jGks9c0A+n2tPlxIhLsdYTWY5b8WeqvnSxjCnoV8hbKg77DG0ZRGZuFyZd3nlzF2C3svuUT1rFJGBTMgqPVD+oaxBIkZx8NfRTTe7QcqPyvElsE8fOGrni7t5w==',key_name='tempest-TestMinimumBasicScenario-1510836974',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:24:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='38303e1b311044deb8c833ed3299ce88',ramdisk_id='',reservation_id='r-fjs2drsc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2cbdd988-3c92-4be4-9d1b-ab72b4bf2a9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1229544582',owner_user_name='tempest-TestMinimumBasicScenario-1229544582-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:27:09Z,user_data=None,user_id='52673e9f58e44abc8f9bd60d066c4197',uuid=7e0b7c0c-a4ad-4ccd-b60a-721070a57f98,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3387dc52-f4d5-438c-a2c4-cee4fd142694", "address": "fa:16:3e:a3:43:e6", "network": {"id": "cd6d2dbc-0950-412a-ab9d-cf7615c06eb8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1261309930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38303e1b311044deb8c833ed3299ce88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3387dc52-f4", "ovs_interfaceid": "3387dc52-f4d5-438c-a2c4-cee4fd142694", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:29:48 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-015275ba-f98b-4732-b143-d8fce0d7d55d tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Converting VIF {"id": "3387dc52-f4d5-438c-a2c4-cee4fd142694", "address": "fa:16:3e:a3:43:e6", "network": {"id": "cd6d2dbc-0950-412a-ab9d-cf7615c06eb8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1261309930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38303e1b311044deb8c833ed3299ce88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3387dc52-f4", "ovs_interfaceid": "3387dc52-f4d5-438c-a2c4-cee4fd142694", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:29:48 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-015275ba-f98b-4732-b143-d8fce0d7d55d tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a3:43:e6,bridge_name='br-int',has_traffic_filtering=True,id=3387dc52-f4d5-438c-a2c4-cee4fd142694,network=Network(cd6d2dbc-0950-412a-ab9d-cf7615c06eb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3387dc52-f4') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:29:48 user nova-compute[74743]: DEBUG os_vif [None req-015275ba-f98b-4732-b143-d8fce0d7d55d tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:43:e6,bridge_name='br-int',has_traffic_filtering=True,id=3387dc52-f4d5-438c-a2c4-cee4fd142694,network=Network(cd6d2dbc-0950-412a-ab9d-cf7615c06eb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3387dc52-f4') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:29:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:29:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3387dc52-f4, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:29:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:29:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:29:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:29:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:29:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=58c89c21-1763-4438-bc63-41db457ede6c) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:29:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:29:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:29:48 user nova-compute[74743]: INFO os_vif [None req-015275ba-f98b-4732-b143-d8fce0d7d55d tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:43:e6,bridge_name='br-int',has_traffic_filtering=True,id=3387dc52-f4d5-438c-a2c4-cee4fd142694,network=Network(cd6d2dbc-0950-412a-ab9d-cf7615c06eb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3387dc52-f4')
Nov 18 17:29:48 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-015275ba-f98b-4732-b143-d8fce0d7d55d tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Deleting instance files /opt/stack/data/nova/instances/7e0b7c0c-a4ad-4ccd-b60a-721070a57f98_del
Nov 18 17:29:48 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-015275ba-f98b-4732-b143-d8fce0d7d55d tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Deletion of /opt/stack/data/nova/instances/7e0b7c0c-a4ad-4ccd-b60a-721070a57f98_del complete
Nov 18 17:29:49 user nova-compute[74743]: INFO nova.compute.manager [None req-015275ba-f98b-4732-b143-d8fce0d7d55d tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 18 17:29:49 user nova-compute[74743]: DEBUG oslo.service.loopingcall [None req-015275ba-f98b-4732-b143-d8fce0d7d55d tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74743) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 17:29:49 user nova-compute[74743]: DEBUG nova.compute.manager [-] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Deallocating network for instance {{(pid=74743) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 17:29:49 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] deallocate_for_instance() {{(pid=74743) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 17:29:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:29:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:29:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:29:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:29:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:29:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:29:49 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:29:49 user nova-compute[74743]: INFO nova.compute.manager [-] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Took 0.73 seconds to deallocate network for instance.
Nov 18 17:29:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-015275ba-f98b-4732-b143-d8fce0d7d55d tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:29:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-015275ba-f98b-4732-b143-d8fce0d7d55d tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:29:49 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-015275ba-f98b-4732-b143-d8fce0d7d55d tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:29:49 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-015275ba-f98b-4732-b143-d8fce0d7d55d tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:29:49 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:29:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-015275ba-f98b-4732-b143-d8fce0d7d55d tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.128s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:29:50 user nova-compute[74743]: INFO nova.scheduler.client.report [None req-015275ba-f98b-4732-b143-d8fce0d7d55d tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Deleted allocations for instance 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98
Nov 18 17:29:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-015275ba-f98b-4732-b143-d8fce0d7d55d tempest-TestMinimumBasicScenario-1229544582 tempest-TestMinimumBasicScenario-1229544582-project-member] Lock "7e0b7c0c-a4ad-4ccd-b60a-721070a57f98" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.971s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:29:50 user nova-compute[74743]: DEBUG nova.compute.manager [req-3d05c1e9-e0c1-4702-a03e-e7be537d7915 req-a6105869-cab7-4a03-8668-038f95cf6458 service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Received event network-vif-plugged-3387dc52-f4d5-438c-a2c4-cee4fd142694 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:29:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3d05c1e9-e0c1-4702-a03e-e7be537d7915 req-a6105869-cab7-4a03-8668-038f95cf6458 service nova] Acquiring lock "7e0b7c0c-a4ad-4ccd-b60a-721070a57f98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:29:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3d05c1e9-e0c1-4702-a03e-e7be537d7915 req-a6105869-cab7-4a03-8668-038f95cf6458 service nova] Lock "7e0b7c0c-a4ad-4ccd-b60a-721070a57f98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:29:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3d05c1e9-e0c1-4702-a03e-e7be537d7915 req-a6105869-cab7-4a03-8668-038f95cf6458 service nova] Lock "7e0b7c0c-a4ad-4ccd-b60a-721070a57f98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:29:50 user nova-compute[74743]: DEBUG nova.compute.manager [req-3d05c1e9-e0c1-4702-a03e-e7be537d7915 req-a6105869-cab7-4a03-8668-038f95cf6458 service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] No waiting events found dispatching network-vif-plugged-3387dc52-f4d5-438c-a2c4-cee4fd142694 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:29:50 user nova-compute[74743]: WARNING nova.compute.manager [req-3d05c1e9-e0c1-4702-a03e-e7be537d7915 req-a6105869-cab7-4a03-8668-038f95cf6458 service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Received unexpected event network-vif-plugged-3387dc52-f4d5-438c-a2c4-cee4fd142694 for instance with vm_state deleted and task_state None.
Nov 18 17:29:50 user nova-compute[74743]: DEBUG nova.compute.manager [req-3d05c1e9-e0c1-4702-a03e-e7be537d7915 req-a6105869-cab7-4a03-8668-038f95cf6458 service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Received event network-vif-plugged-3387dc52-f4d5-438c-a2c4-cee4fd142694 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:29:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3d05c1e9-e0c1-4702-a03e-e7be537d7915 req-a6105869-cab7-4a03-8668-038f95cf6458 service nova] Acquiring lock "7e0b7c0c-a4ad-4ccd-b60a-721070a57f98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:29:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3d05c1e9-e0c1-4702-a03e-e7be537d7915 req-a6105869-cab7-4a03-8668-038f95cf6458 service nova] Lock "7e0b7c0c-a4ad-4ccd-b60a-721070a57f98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:29:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3d05c1e9-e0c1-4702-a03e-e7be537d7915 req-a6105869-cab7-4a03-8668-038f95cf6458 service nova] Lock "7e0b7c0c-a4ad-4ccd-b60a-721070a57f98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:29:50 user nova-compute[74743]: DEBUG nova.compute.manager [req-3d05c1e9-e0c1-4702-a03e-e7be537d7915 req-a6105869-cab7-4a03-8668-038f95cf6458 service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] No waiting events found dispatching network-vif-plugged-3387dc52-f4d5-438c-a2c4-cee4fd142694 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:29:50 user nova-compute[74743]: WARNING nova.compute.manager [req-3d05c1e9-e0c1-4702-a03e-e7be537d7915 req-a6105869-cab7-4a03-8668-038f95cf6458 service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Received unexpected event network-vif-plugged-3387dc52-f4d5-438c-a2c4-cee4fd142694 for instance with vm_state deleted and task_state None.
Nov 18 17:29:50 user nova-compute[74743]: DEBUG nova.compute.manager [req-3d05c1e9-e0c1-4702-a03e-e7be537d7915 req-a6105869-cab7-4a03-8668-038f95cf6458 service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Received event network-vif-plugged-3387dc52-f4d5-438c-a2c4-cee4fd142694 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:29:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3d05c1e9-e0c1-4702-a03e-e7be537d7915 req-a6105869-cab7-4a03-8668-038f95cf6458 service nova] Acquiring lock "7e0b7c0c-a4ad-4ccd-b60a-721070a57f98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:29:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3d05c1e9-e0c1-4702-a03e-e7be537d7915 req-a6105869-cab7-4a03-8668-038f95cf6458 service nova] Lock "7e0b7c0c-a4ad-4ccd-b60a-721070a57f98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:29:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3d05c1e9-e0c1-4702-a03e-e7be537d7915 req-a6105869-cab7-4a03-8668-038f95cf6458 service nova] Lock "7e0b7c0c-a4ad-4ccd-b60a-721070a57f98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:29:50 user nova-compute[74743]: DEBUG nova.compute.manager [req-3d05c1e9-e0c1-4702-a03e-e7be537d7915 req-a6105869-cab7-4a03-8668-038f95cf6458 service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] No waiting events found dispatching network-vif-plugged-3387dc52-f4d5-438c-a2c4-cee4fd142694 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:29:50 user nova-compute[74743]: WARNING nova.compute.manager [req-3d05c1e9-e0c1-4702-a03e-e7be537d7915 req-a6105869-cab7-4a03-8668-038f95cf6458 service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Received unexpected event network-vif-plugged-3387dc52-f4d5-438c-a2c4-cee4fd142694 for instance with vm_state deleted and task_state None.
Nov 18 17:29:50 user nova-compute[74743]: DEBUG nova.compute.manager [req-3d05c1e9-e0c1-4702-a03e-e7be537d7915 req-a6105869-cab7-4a03-8668-038f95cf6458 service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Received event network-vif-unplugged-3387dc52-f4d5-438c-a2c4-cee4fd142694 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:29:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3d05c1e9-e0c1-4702-a03e-e7be537d7915 req-a6105869-cab7-4a03-8668-038f95cf6458 service nova] Acquiring lock "7e0b7c0c-a4ad-4ccd-b60a-721070a57f98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:29:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3d05c1e9-e0c1-4702-a03e-e7be537d7915 req-a6105869-cab7-4a03-8668-038f95cf6458 service nova] Lock "7e0b7c0c-a4ad-4ccd-b60a-721070a57f98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:29:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3d05c1e9-e0c1-4702-a03e-e7be537d7915 req-a6105869-cab7-4a03-8668-038f95cf6458 service nova] Lock "7e0b7c0c-a4ad-4ccd-b60a-721070a57f98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:29:50 user nova-compute[74743]: DEBUG nova.compute.manager [req-3d05c1e9-e0c1-4702-a03e-e7be537d7915 req-a6105869-cab7-4a03-8668-038f95cf6458 service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] No waiting events found dispatching network-vif-unplugged-3387dc52-f4d5-438c-a2c4-cee4fd142694 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:29:50 user nova-compute[74743]: WARNING nova.compute.manager [req-3d05c1e9-e0c1-4702-a03e-e7be537d7915 req-a6105869-cab7-4a03-8668-038f95cf6458 service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Received unexpected event network-vif-unplugged-3387dc52-f4d5-438c-a2c4-cee4fd142694 for instance with vm_state deleted and task_state None.
Nov 18 17:29:50 user nova-compute[74743]: DEBUG nova.compute.manager [req-3d05c1e9-e0c1-4702-a03e-e7be537d7915 req-a6105869-cab7-4a03-8668-038f95cf6458 service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Received event network-vif-plugged-3387dc52-f4d5-438c-a2c4-cee4fd142694 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:29:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3d05c1e9-e0c1-4702-a03e-e7be537d7915 req-a6105869-cab7-4a03-8668-038f95cf6458 service nova] Acquiring lock "7e0b7c0c-a4ad-4ccd-b60a-721070a57f98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:29:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3d05c1e9-e0c1-4702-a03e-e7be537d7915 req-a6105869-cab7-4a03-8668-038f95cf6458 service nova] Lock "7e0b7c0c-a4ad-4ccd-b60a-721070a57f98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:29:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3d05c1e9-e0c1-4702-a03e-e7be537d7915 req-a6105869-cab7-4a03-8668-038f95cf6458 service nova] Lock "7e0b7c0c-a4ad-4ccd-b60a-721070a57f98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:29:50 user nova-compute[74743]: DEBUG nova.compute.manager [req-3d05c1e9-e0c1-4702-a03e-e7be537d7915 req-a6105869-cab7-4a03-8668-038f95cf6458 service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] No waiting events found dispatching network-vif-plugged-3387dc52-f4d5-438c-a2c4-cee4fd142694 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:29:50 user nova-compute[74743]: WARNING nova.compute.manager [req-3d05c1e9-e0c1-4702-a03e-e7be537d7915 req-a6105869-cab7-4a03-8668-038f95cf6458 service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Received unexpected event network-vif-plugged-3387dc52-f4d5-438c-a2c4-cee4fd142694 for instance with vm_state deleted and task_state None.
Nov 18 17:29:50 user nova-compute[74743]: DEBUG nova.compute.manager [req-3d05c1e9-e0c1-4702-a03e-e7be537d7915 req-a6105869-cab7-4a03-8668-038f95cf6458 service nova] [instance: 7e0b7c0c-a4ad-4ccd-b60a-721070a57f98] Received event network-vif-deleted-3387dc52-f4d5-438c-a2c4-cee4fd142694 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:29:52 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:29:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:29:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:30:01 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:30:03 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquiring lock "21d1afa4-bf4b-476c-88a0-ddf76002cac6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:30:03 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "21d1afa4-bf4b-476c-88a0-ddf76002cac6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:30:03 user nova-compute[74743]: DEBUG nova.compute.manager [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Starting instance... {{(pid=74743) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 17:30:03 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:30:03 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:30:03 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74743) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 17:30:03 user nova-compute[74743]: INFO nova.compute.claims [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Claim successful on node user
Nov 18 17:30:03 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:30:04 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:30:04 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:30:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.199s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:30:04 user nova-compute[74743]: DEBUG nova.compute.manager [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Start building networks asynchronously for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 17:30:04 user nova-compute[74743]: DEBUG nova.compute.manager [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Allocating IP information in the background. {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 17:30:04 user nova-compute[74743]: DEBUG nova.network.neutron [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] allocate_for_instance() {{(pid=74743) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 17:30:04 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 17:30:04 user nova-compute[74743]: DEBUG nova.compute.manager [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Start building block device mappings for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 17:30:04 user nova-compute[74743]: DEBUG nova.policy [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '35aedc702bc4444eb3802772a523ba79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5502edf6a6b94cb59d58d52494efc90d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74743) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 17:30:04 user nova-compute[74743]: DEBUG nova.compute.manager [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Start spawning the instance on the hypervisor. {{(pid=74743) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 17:30:04 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Creating instance directory {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 17:30:04 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Creating image(s)
Nov 18 17:30:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquiring lock "/opt/stack/data/nova/instances/21d1afa4-bf4b-476c-88a0-ddf76002cac6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:30:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "/opt/stack/data/nova/instances/21d1afa4-bf4b-476c-88a0-ddf76002cac6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:30:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "/opt/stack/data/nova/instances/21d1afa4-bf4b-476c-88a0-ddf76002cac6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:30:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:30:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.176s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:30:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquiring lock "c188b3a997bfafa42fa341f9dcc326545681eed9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:30:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:30:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:30:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.176s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:30:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/21d1afa4-bf4b-476c-88a0-ddf76002cac6/disk 1073741824 {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:30:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/21d1afa4-bf4b-476c-88a0-ddf76002cac6/disk 1073741824" returned: 0 in 0.059s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:30:05 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:30:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:30:05 user nova-compute[74743]: DEBUG nova.network.neutron [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Successfully created port: 133bae79-0949-485f-b364-9886ed4b69a9 {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:30:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.179s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:30:05 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Checking if we can resize image /opt/stack/data/nova/instances/21d1afa4-bf4b-476c-88a0-ddf76002cac6/disk. size=1073741824 {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 17:30:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d1afa4-bf4b-476c-88a0-ddf76002cac6/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:30:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d1afa4-bf4b-476c-88a0-ddf76002cac6/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:30:05 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Cannot resize image /opt/stack/data/nova/instances/21d1afa4-bf4b-476c-88a0-ddf76002cac6/disk to a smaller size. {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 17:30:05 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Created local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 17:30:05 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Ensure instance console log exists: /opt/stack/data/nova/instances/21d1afa4-bf4b-476c-88a0-ddf76002cac6/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:30:05 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:30:05 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:30:05 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:30:05 user nova-compute[74743]: DEBUG nova.network.neutron [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Successfully updated port: 133bae79-0949-485f-b364-9886ed4b69a9 {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:30:05 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquiring lock "refresh_cache-21d1afa4-bf4b-476c-88a0-ddf76002cac6" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:30:05 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquired lock "refresh_cache-21d1afa4-bf4b-476c-88a0-ddf76002cac6" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:30:05 user nova-compute[74743]: DEBUG nova.network.neutron [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:30:05 user nova-compute[74743]: DEBUG nova.compute.manager [req-5debf238-cf5c-4cb8-acdc-11ac49c0cb94 req-2506b2b4-4898-4faf-9c4d-2c10de3f7705 service nova] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Received event network-changed-133bae79-0949-485f-b364-9886ed4b69a9 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:30:05 user nova-compute[74743]: DEBUG nova.compute.manager [req-5debf238-cf5c-4cb8-acdc-11ac49c0cb94 req-2506b2b4-4898-4faf-9c4d-2c10de3f7705 service nova] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Refreshing instance network info cache due to event network-changed-133bae79-0949-485f-b364-9886ed4b69a9. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:30:05 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-5debf238-cf5c-4cb8-acdc-11ac49c0cb94 req-2506b2b4-4898-4faf-9c4d-2c10de3f7705 service nova] Acquiring lock "refresh_cache-21d1afa4-bf4b-476c-88a0-ddf76002cac6" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:30:05 user nova-compute[74743]: DEBUG nova.network.neutron [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:30:05 user nova-compute[74743]: DEBUG nova.network.neutron [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Updating instance_info_cache with network_info: [{"id": "133bae79-0949-485f-b364-9886ed4b69a9", "address": "fa:16:3e:30:62:06", "network": {"id": "b03d3355-7704-43de-8af7-7a5dc1ee490d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1492507432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5502edf6a6b94cb59d58d52494efc90d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap133bae79-09", "ovs_interfaceid": "133bae79-0949-485f-b364-9886ed4b69a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:30:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Releasing lock "refresh_cache-21d1afa4-bf4b-476c-88a0-ddf76002cac6" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:30:06 user nova-compute[74743]: DEBUG nova.compute.manager [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Instance network_info: |[{"id": "133bae79-0949-485f-b364-9886ed4b69a9", "address": "fa:16:3e:30:62:06", "network": {"id": "b03d3355-7704-43de-8af7-7a5dc1ee490d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1492507432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5502edf6a6b94cb59d58d52494efc90d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap133bae79-09", "ovs_interfaceid": "133bae79-0949-485f-b364-9886ed4b69a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 17:30:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-5debf238-cf5c-4cb8-acdc-11ac49c0cb94 req-2506b2b4-4898-4faf-9c4d-2c10de3f7705 service nova] Acquired lock "refresh_cache-21d1afa4-bf4b-476c-88a0-ddf76002cac6" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:30:06 user nova-compute[74743]: DEBUG nova.network.neutron [req-5debf238-cf5c-4cb8-acdc-11ac49c0cb94 req-2506b2b4-4898-4faf-9c4d-2c10de3f7705 service nova] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Refreshing network info cache for port 133bae79-0949-485f-b364-9886ed4b69a9 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:30:06 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Start _get_guest_xml network_info=[{"id": "133bae79-0949-485f-b364-9886ed4b69a9", "address": "fa:16:3e:30:62:06", "network": {"id": "b03d3355-7704-43de-8af7-7a5dc1ee490d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1492507432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5502edf6a6b94cb59d58d52494efc90d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap133bae79-09", "ovs_interfaceid": "133bae79-0949-485f-b364-9886ed4b69a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '9536f6cf-95c4-40e2-864a-09a91525678a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:30:06 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:30:06 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:30:06 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:30:06 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:30:06 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:30:06 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:30:06 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:30:06 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:30:06 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:30:06 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:30:06 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:30:06 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:30:06 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:30:06 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:30:06 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:30:06 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:30:06 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:30:06 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:30:06 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:30:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-295911454',display_name='tempest-AttachVolumeNegativeTest-server-295911454',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-295911454',id=44,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHLE2yVfxueswEPlR5OLnAgYgiLhRnotojp8xMZpXH4CsG3cR6pDVP2uo/K49mRt2vmyfz0WvI7zmxw4hKTvX+l9qYg9zIk+w4VT9IN62U6YUWCjnUDoaejcENWlg6B8Q==',key_name='tempest-keypair-25753312',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5502edf6a6b94cb59d58d52494efc90d',ramdisk_id='',reservation_id='r-hyth7vxm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1149732113',owner_user_name='tempest-AttachVolumeNegativeTest-1149732113-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:30:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35aedc702bc4444eb3802772a523ba79',uuid=21d1afa4-bf4b-476c-88a0-ddf76002cac6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "133bae79-0949-485f-b364-9886ed4b69a9", "address": "fa:16:3e:30:62:06", "network": {"id": "b03d3355-7704-43de-8af7-7a5dc1ee490d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1492507432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5502edf6a6b94cb59d58d52494efc90d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap133bae79-09", "ovs_interfaceid": "133bae79-0949-485f-b364-9886ed4b69a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:30:06 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Converting VIF {"id": "133bae79-0949-485f-b364-9886ed4b69a9", "address": "fa:16:3e:30:62:06", "network": {"id": "b03d3355-7704-43de-8af7-7a5dc1ee490d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1492507432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5502edf6a6b94cb59d58d52494efc90d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap133bae79-09", "ovs_interfaceid": "133bae79-0949-485f-b364-9886ed4b69a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:30:06 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:62:06,bridge_name='br-int',has_traffic_filtering=True,id=133bae79-0949-485f-b364-9886ed4b69a9,network=Network(b03d3355-7704-43de-8af7-7a5dc1ee490d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap133bae79-09') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:30:06 user nova-compute[74743]: DEBUG nova.objects.instance [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lazy-loading 'pci_devices' on Instance uuid 21d1afa4-bf4b-476c-88a0-ddf76002cac6 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:30:06 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:30:06 user nova-compute[74743]:   <uuid>21d1afa4-bf4b-476c-88a0-ddf76002cac6</uuid>
Nov 18 17:30:06 user nova-compute[74743]:   <name>instance-0000002c</name>
Nov 18 17:30:06 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:30:06 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:30:06 user nova-compute[74743]:   <metadata>
Nov 18 17:30:06 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:30:06 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:30:06 user nova-compute[74743]:       <nova:name>tempest-AttachVolumeNegativeTest-server-295911454</nova:name>
Nov 18 17:30:06 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:30:06</nova:creationTime>
Nov 18 17:30:06 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:30:06 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:30:06 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:30:06 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:30:06 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:30:06 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:30:06 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:30:06 user nova-compute[74743]:       <nova:owner>
Nov 18 17:30:06 user nova-compute[74743]:         <nova:user uuid="35aedc702bc4444eb3802772a523ba79">tempest-AttachVolumeNegativeTest-1149732113-project-member</nova:user>
Nov 18 17:30:06 user nova-compute[74743]:         <nova:project uuid="5502edf6a6b94cb59d58d52494efc90d">tempest-AttachVolumeNegativeTest-1149732113</nova:project>
Nov 18 17:30:06 user nova-compute[74743]:       </nova:owner>
Nov 18 17:30:06 user nova-compute[74743]:       <nova:root type="image" uuid="9536f6cf-95c4-40e2-864a-09a91525678a"/>
Nov 18 17:30:06 user nova-compute[74743]:       <nova:ports>
Nov 18 17:30:06 user nova-compute[74743]:         <nova:port uuid="133bae79-0949-485f-b364-9886ed4b69a9">
Nov 18 17:30:06 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 18 17:30:06 user nova-compute[74743]:         </nova:port>
Nov 18 17:30:06 user nova-compute[74743]:       </nova:ports>
Nov 18 17:30:06 user nova-compute[74743]:     </nova:instance>
Nov 18 17:30:06 user nova-compute[74743]:   </metadata>
Nov 18 17:30:06 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:30:06 user nova-compute[74743]:     <system>
Nov 18 17:30:06 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:30:06 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:30:06 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:30:06 user nova-compute[74743]:       <entry name="serial">21d1afa4-bf4b-476c-88a0-ddf76002cac6</entry>
Nov 18 17:30:06 user nova-compute[74743]:       <entry name="uuid">21d1afa4-bf4b-476c-88a0-ddf76002cac6</entry>
Nov 18 17:30:06 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:30:06 user nova-compute[74743]:     </system>
Nov 18 17:30:06 user nova-compute[74743]:   </sysinfo>
Nov 18 17:30:06 user nova-compute[74743]:   <os>
Nov 18 17:30:06 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:30:06 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:30:06 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:30:06 user nova-compute[74743]:   </os>
Nov 18 17:30:06 user nova-compute[74743]:   <features>
Nov 18 17:30:06 user nova-compute[74743]:     <acpi/>
Nov 18 17:30:06 user nova-compute[74743]:     <apic/>
Nov 18 17:30:06 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:30:06 user nova-compute[74743]:   </features>
Nov 18 17:30:06 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:30:06 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:30:06 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:30:06 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:30:06 user nova-compute[74743]:   </clock>
Nov 18 17:30:06 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:30:06 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:30:06 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:30:06 user nova-compute[74743]:   </cpu>
Nov 18 17:30:06 user nova-compute[74743]:   <devices>
Nov 18 17:30:06 user nova-compute[74743]:     <disk type="file" device="disk">
Nov 18 17:30:06 user nova-compute[74743]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 17:30:06 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/21d1afa4-bf4b-476c-88a0-ddf76002cac6/disk"/>
Nov 18 17:30:06 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:30:06 user nova-compute[74743]:     </disk>
Nov 18 17:30:06 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:30:06 user nova-compute[74743]:       <mac address="fa:16:3e:30:62:06"/>
Nov 18 17:30:06 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:30:06 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:30:06 user nova-compute[74743]:       <target dev="tap133bae79-09"/>
Nov 18 17:30:06 user nova-compute[74743]:     </interface>
Nov 18 17:30:06 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:30:06 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/21d1afa4-bf4b-476c-88a0-ddf76002cac6/console.log" append="off"/>
Nov 18 17:30:06 user nova-compute[74743]:     </serial>
Nov 18 17:30:06 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:30:06 user nova-compute[74743]:     <video>
Nov 18 17:30:06 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:30:06 user nova-compute[74743]:     </video>
Nov 18 17:30:06 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:30:06 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:30:06 user nova-compute[74743]:     </rng>
Nov 18 17:30:06 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:30:06 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:30:06 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:30:06 user nova-compute[74743]:     </memballoon>
Nov 18 17:30:06 user nova-compute[74743]:   </devices>
Nov 18 17:30:06 user nova-compute[74743]: </domain>
Nov 18 17:30:06 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:30:06 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:30:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-295911454',display_name='tempest-AttachVolumeNegativeTest-server-295911454',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-295911454',id=44,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHLE2yVfxueswEPlR5OLnAgYgiLhRnotojp8xMZpXH4CsG3cR6pDVP2uo/K49mRt2vmyfz0WvI7zmxw4hKTvX+l9qYg9zIk+w4VT9IN62U6YUWCjnUDoaejcENWlg6B8Q==',key_name='tempest-keypair-25753312',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5502edf6a6b94cb59d58d52494efc90d',ramdisk_id='',reservation_id='r-hyth7vxm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1149732113',owner_user_name='tempest-AttachVolumeNegativeTest-1149732113-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:30:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35aedc702bc4444eb3802772a523ba79',uuid=21d1afa4-bf4b-476c-88a0-ddf76002cac6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "133bae79-0949-485f-b364-9886ed4b69a9", "address": "fa:16:3e:30:62:06", "network": {"id": "b03d3355-7704-43de-8af7-7a5dc1ee490d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1492507432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5502edf6a6b94cb59d58d52494efc90d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap133bae79-09", "ovs_interfaceid": "133bae79-0949-485f-b364-9886ed4b69a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:30:06 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Converting VIF {"id": "133bae79-0949-485f-b364-9886ed4b69a9", "address": "fa:16:3e:30:62:06", "network": {"id": "b03d3355-7704-43de-8af7-7a5dc1ee490d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1492507432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5502edf6a6b94cb59d58d52494efc90d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap133bae79-09", "ovs_interfaceid": "133bae79-0949-485f-b364-9886ed4b69a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:30:06 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:62:06,bridge_name='br-int',has_traffic_filtering=True,id=133bae79-0949-485f-b364-9886ed4b69a9,network=Network(b03d3355-7704-43de-8af7-7a5dc1ee490d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap133bae79-09') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:30:06 user nova-compute[74743]: DEBUG os_vif [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:62:06,bridge_name='br-int',has_traffic_filtering=True,id=133bae79-0949-485f-b364-9886ed4b69a9,network=Network(b03d3355-7704-43de-8af7-7a5dc1ee490d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap133bae79-09') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:30:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:30:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:30:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:30:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:30:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '742931e0-c1ff-5e99-8f46-ee995d675bba', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:30:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:30:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:30:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:30:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap133bae79-09, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:30:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap133bae79-09, col_values=(('qos', UUID('3f363c7c-38bd-49d8-9258-4a3ebdfc2f44')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:30:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap133bae79-09, col_values=(('external_ids', {'iface-id': '133bae79-0949-485f-b364-9886ed4b69a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:62:06', 'vm-uuid': '21d1afa4-bf4b-476c-88a0-ddf76002cac6'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:30:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:30:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:30:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:30:06 user nova-compute[74743]: INFO os_vif [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:62:06,bridge_name='br-int',has_traffic_filtering=True,id=133bae79-0949-485f-b364-9886ed4b69a9,network=Network(b03d3355-7704-43de-8af7-7a5dc1ee490d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap133bae79-09')
Nov 18 17:30:06 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:30:06 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] No VIF found with MAC fa:16:3e:30:62:06, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:30:06 user nova-compute[74743]: DEBUG nova.network.neutron [req-5debf238-cf5c-4cb8-acdc-11ac49c0cb94 req-2506b2b4-4898-4faf-9c4d-2c10de3f7705 service nova] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Updated VIF entry in instance network info cache for port 133bae79-0949-485f-b364-9886ed4b69a9. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:30:06 user nova-compute[74743]: DEBUG nova.network.neutron [req-5debf238-cf5c-4cb8-acdc-11ac49c0cb94 req-2506b2b4-4898-4faf-9c4d-2c10de3f7705 service nova] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Updating instance_info_cache with network_info: [{"id": "133bae79-0949-485f-b364-9886ed4b69a9", "address": "fa:16:3e:30:62:06", "network": {"id": "b03d3355-7704-43de-8af7-7a5dc1ee490d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1492507432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5502edf6a6b94cb59d58d52494efc90d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap133bae79-09", "ovs_interfaceid": "133bae79-0949-485f-b364-9886ed4b69a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:30:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-5debf238-cf5c-4cb8-acdc-11ac49c0cb94 req-2506b2b4-4898-4faf-9c4d-2c10de3f7705 service nova] Releasing lock "refresh_cache-21d1afa4-bf4b-476c-88a0-ddf76002cac6" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:30:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:30:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:30:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:30:07 user nova-compute[74743]: DEBUG nova.compute.manager [req-a2a0fd06-c4aa-4d99-afe1-55ed00d731f1 req-3ff1e011-e136-40f5-bb5e-ac45d2b7f9d3 service nova] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Received event network-vif-plugged-133bae79-0949-485f-b364-9886ed4b69a9 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:30:07 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a2a0fd06-c4aa-4d99-afe1-55ed00d731f1 req-3ff1e011-e136-40f5-bb5e-ac45d2b7f9d3 service nova] Acquiring lock "21d1afa4-bf4b-476c-88a0-ddf76002cac6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:30:07 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a2a0fd06-c4aa-4d99-afe1-55ed00d731f1 req-3ff1e011-e136-40f5-bb5e-ac45d2b7f9d3 service nova] Lock "21d1afa4-bf4b-476c-88a0-ddf76002cac6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:30:07 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a2a0fd06-c4aa-4d99-afe1-55ed00d731f1 req-3ff1e011-e136-40f5-bb5e-ac45d2b7f9d3 service nova] Lock "21d1afa4-bf4b-476c-88a0-ddf76002cac6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:30:07 user nova-compute[74743]: DEBUG nova.compute.manager [req-a2a0fd06-c4aa-4d99-afe1-55ed00d731f1 req-3ff1e011-e136-40f5-bb5e-ac45d2b7f9d3 service nova] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] No waiting events found dispatching network-vif-plugged-133bae79-0949-485f-b364-9886ed4b69a9 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:30:07 user nova-compute[74743]: WARNING nova.compute.manager [req-a2a0fd06-c4aa-4d99-afe1-55ed00d731f1 req-3ff1e011-e136-40f5-bb5e-ac45d2b7f9d3 service nova] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Received unexpected event network-vif-plugged-133bae79-0949-485f-b364-9886ed4b69a9 for instance with vm_state building and task_state spawning.
Nov 18 17:30:08 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:30:08 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:30:09 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._sync_power_states {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:30:09 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Triggering sync for uuid aefe3db1-b9bb-4cce-aa31-d0b6684ad791 {{(pid=74743) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 17:30:09 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Triggering sync for uuid 21d1afa4-bf4b-476c-88a0-ddf76002cac6 {{(pid=74743) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 17:30:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "aefe3db1-b9bb-4cce-aa31-d0b6684ad791" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:30:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "aefe3db1-b9bb-4cce-aa31-d0b6684ad791" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:30:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "21d1afa4-bf4b-476c-88a0-ddf76002cac6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:30:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "aefe3db1-b9bb-4cce-aa31-d0b6684ad791" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:30:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4cdf9519-d622-404e-9118-1e030e0d2c2c tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquiring lock "aefe3db1-b9bb-4cce-aa31-d0b6684ad791" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:30:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4cdf9519-d622-404e-9118-1e030e0d2c2c tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "aefe3db1-b9bb-4cce-aa31-d0b6684ad791" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:30:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4cdf9519-d622-404e-9118-1e030e0d2c2c tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquiring lock "aefe3db1-b9bb-4cce-aa31-d0b6684ad791-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:30:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4cdf9519-d622-404e-9118-1e030e0d2c2c tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "aefe3db1-b9bb-4cce-aa31-d0b6684ad791-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:30:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4cdf9519-d622-404e-9118-1e030e0d2c2c tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "aefe3db1-b9bb-4cce-aa31-d0b6684ad791-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:30:09 user nova-compute[74743]: INFO nova.compute.manager [None req-4cdf9519-d622-404e-9118-1e030e0d2c2c tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Terminating instance
Nov 18 17:30:09 user nova-compute[74743]: DEBUG nova.compute.manager [None req-4cdf9519-d622-404e-9118-1e030e0d2c2c tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Start destroying the instance on the hypervisor. {{(pid=74743) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 17:30:09 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:30:09 user nova-compute[74743]: DEBUG nova.compute.manager [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:30:09 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Guest created on hypervisor {{(pid=74743) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 17:30:09 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Instance spawned successfully.
Nov 18 17:30:09 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:30:09 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 17:30:09 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:30:09 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Found default for hw_cdrom_bus of ide {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:30:09 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Found default for hw_disk_bus of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:30:09 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Found default for hw_input_bus of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:30:09 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Found default for hw_pointer_model of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:30:09 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Found default for hw_video_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:30:09 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Found default for hw_vif_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:30:09 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:30:09 user nova-compute[74743]: INFO nova.compute.manager [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Took 5.08 seconds to spawn the instance on the hypervisor.
Nov 18 17:30:09 user nova-compute[74743]: DEBUG nova.compute.manager [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:30:09 user nova-compute[74743]: INFO nova.compute.manager [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Took 5.84 seconds to build instance.
Nov 18 17:30:09 user nova-compute[74743]: DEBUG nova.compute.manager [req-826a4f8b-ebd6-4ce0-afb4-ba44b1e9d54d req-93e548c2-5c57-4b00-9b53-71e7a311e3c4 service nova] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Received event network-vif-unplugged-7bc10485-32b0-44a5-8813-2fa64d1dfbba {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:30:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-826a4f8b-ebd6-4ce0-afb4-ba44b1e9d54d req-93e548c2-5c57-4b00-9b53-71e7a311e3c4 service nova] Acquiring lock "aefe3db1-b9bb-4cce-aa31-d0b6684ad791-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:30:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-826a4f8b-ebd6-4ce0-afb4-ba44b1e9d54d req-93e548c2-5c57-4b00-9b53-71e7a311e3c4 service nova] Lock "aefe3db1-b9bb-4cce-aa31-d0b6684ad791-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:30:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-826a4f8b-ebd6-4ce0-afb4-ba44b1e9d54d req-93e548c2-5c57-4b00-9b53-71e7a311e3c4 service nova] Lock "aefe3db1-b9bb-4cce-aa31-d0b6684ad791-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:30:09 user nova-compute[74743]: DEBUG nova.compute.manager [req-826a4f8b-ebd6-4ce0-afb4-ba44b1e9d54d req-93e548c2-5c57-4b00-9b53-71e7a311e3c4 service nova] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] No waiting events found dispatching network-vif-unplugged-7bc10485-32b0-44a5-8813-2fa64d1dfbba {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:30:09 user nova-compute[74743]: DEBUG nova.compute.manager [req-826a4f8b-ebd6-4ce0-afb4-ba44b1e9d54d req-93e548c2-5c57-4b00-9b53-71e7a311e3c4 service nova] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Received event network-vif-unplugged-7bc10485-32b0-44a5-8813-2fa64d1dfbba for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:30:09 user nova-compute[74743]: DEBUG nova.compute.manager [req-cc5e4bb6-1752-4649-9595-f1eaeb9d359f req-12d9e54e-4280-486c-8705-f5a061c9327a service nova] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Received event network-vif-plugged-133bae79-0949-485f-b364-9886ed4b69a9 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:30:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-cc5e4bb6-1752-4649-9595-f1eaeb9d359f req-12d9e54e-4280-486c-8705-f5a061c9327a service nova] Acquiring lock "21d1afa4-bf4b-476c-88a0-ddf76002cac6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:30:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-cc5e4bb6-1752-4649-9595-f1eaeb9d359f req-12d9e54e-4280-486c-8705-f5a061c9327a service nova] Lock "21d1afa4-bf4b-476c-88a0-ddf76002cac6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:30:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-cc5e4bb6-1752-4649-9595-f1eaeb9d359f req-12d9e54e-4280-486c-8705-f5a061c9327a service nova] Lock "21d1afa4-bf4b-476c-88a0-ddf76002cac6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:30:09 user nova-compute[74743]: DEBUG nova.compute.manager [req-cc5e4bb6-1752-4649-9595-f1eaeb9d359f req-12d9e54e-4280-486c-8705-f5a061c9327a service nova] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] No waiting events found dispatching network-vif-plugged-133bae79-0949-485f-b364-9886ed4b69a9 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:30:09 user nova-compute[74743]: WARNING nova.compute.manager [req-cc5e4bb6-1752-4649-9595-f1eaeb9d359f req-12d9e54e-4280-486c-8705-f5a061c9327a service nova] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Received unexpected event network-vif-plugged-133bae79-0949-485f-b364-9886ed4b69a9 for instance with vm_state active and task_state None.
Nov 18 17:30:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-f6276be3-e3fc-4af5-b1ad-beb91970aa0f tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "21d1afa4-bf4b-476c-88a0-ddf76002cac6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.935s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:30:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "21d1afa4-bf4b-476c-88a0-ddf76002cac6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.688s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:30:09 user nova-compute[74743]: INFO nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] During sync_power_state the instance has a pending task (spawning). Skip.
Nov 18 17:30:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "21d1afa4-bf4b-476c-88a0-ddf76002cac6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:30:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:30:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:30:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:30:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:30:10 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Instance destroyed successfully.
Nov 18 17:30:10 user nova-compute[74743]: DEBUG nova.objects.instance [None req-4cdf9519-d622-404e-9118-1e030e0d2c2c tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lazy-loading 'resources' on Instance uuid aefe3db1-b9bb-4cce-aa31-d0b6684ad791 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:30:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:30:10 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-4cdf9519-d622-404e-9118-1e030e0d2c2c tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:10:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1636603748',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1636603748',id=24,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:10:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc0fda74575d488a94e2dcfdc016598c',ramdisk_id='',reservation_id='r-r63awruk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-633893051',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:12:30Z,user_data=None,user_id='5639bd2666534fdca04d0958dcdc9f54',uuid=aefe3db1-b9bb-4cce-aa31-d0b6684ad791,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7bc10485-32b0-44a5-8813-2fa64d1dfbba", "address": "fa:16:3e:47:96:7f", "network": {"id": "1bbf6aff-4048-4212-a716-d0628575bfd0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc0fda74575d488a94e2dcfdc016598c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc10485-32", "ovs_interfaceid": "7bc10485-32b0-44a5-8813-2fa64d1dfbba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:30:10 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-4cdf9519-d622-404e-9118-1e030e0d2c2c tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Converting VIF {"id": "7bc10485-32b0-44a5-8813-2fa64d1dfbba", "address": "fa:16:3e:47:96:7f", "network": {"id": "1bbf6aff-4048-4212-a716-d0628575bfd0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1827361364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc0fda74575d488a94e2dcfdc016598c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc10485-32", "ovs_interfaceid": "7bc10485-32b0-44a5-8813-2fa64d1dfbba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:30:10 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-4cdf9519-d622-404e-9118-1e030e0d2c2c tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:96:7f,bridge_name='br-int',has_traffic_filtering=True,id=7bc10485-32b0-44a5-8813-2fa64d1dfbba,network=Network(1bbf6aff-4048-4212-a716-d0628575bfd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bc10485-32') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:30:10 user nova-compute[74743]: DEBUG os_vif [None req-4cdf9519-d622-404e-9118-1e030e0d2c2c tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:96:7f,bridge_name='br-int',has_traffic_filtering=True,id=7bc10485-32b0-44a5-8813-2fa64d1dfbba,network=Network(1bbf6aff-4048-4212-a716-d0628575bfd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bc10485-32') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:30:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:30:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7bc10485-32, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:30:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:30:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:30:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:30:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=af6e35ce-4544-4d48-b804-68a2af9ad5da) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:30:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:30:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:30:10 user nova-compute[74743]: INFO os_vif [None req-4cdf9519-d622-404e-9118-1e030e0d2c2c tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:96:7f,bridge_name='br-int',has_traffic_filtering=True,id=7bc10485-32b0-44a5-8813-2fa64d1dfbba,network=Network(1bbf6aff-4048-4212-a716-d0628575bfd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bc10485-32')
Nov 18 17:30:10 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-4cdf9519-d622-404e-9118-1e030e0d2c2c tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Deleting instance files /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791_del
Nov 18 17:30:10 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-4cdf9519-d622-404e-9118-1e030e0d2c2c tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Deletion of /opt/stack/data/nova/instances/aefe3db1-b9bb-4cce-aa31-d0b6684ad791_del complete
Nov 18 17:30:10 user nova-compute[74743]: INFO nova.compute.manager [None req-4cdf9519-d622-404e-9118-1e030e0d2c2c tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 18 17:30:10 user nova-compute[74743]: DEBUG oslo.service.loopingcall [None req-4cdf9519-d622-404e-9118-1e030e0d2c2c tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74743) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 17:30:10 user nova-compute[74743]: DEBUG nova.compute.manager [-] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Deallocating network for instance {{(pid=74743) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 17:30:10 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] deallocate_for_instance() {{(pid=74743) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 17:30:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:30:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:30:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:30:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:30:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:30:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:30:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:30:11 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:30:11 user nova-compute[74743]: DEBUG nova.compute.manager [req-2525fbda-d108-45a5-be52-ae3ebd156933 req-0b7a2699-afd0-42af-93fb-3530d6f927cf service nova] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Received event network-vif-deleted-7bc10485-32b0-44a5-8813-2fa64d1dfbba {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:30:11 user nova-compute[74743]: INFO nova.compute.manager [req-2525fbda-d108-45a5-be52-ae3ebd156933 req-0b7a2699-afd0-42af-93fb-3530d6f927cf service nova] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Neutron deleted interface 7bc10485-32b0-44a5-8813-2fa64d1dfbba; detaching it from the instance and deleting it from the info cache
Nov 18 17:30:11 user nova-compute[74743]: DEBUG nova.network.neutron [req-2525fbda-d108-45a5-be52-ae3ebd156933 req-0b7a2699-afd0-42af-93fb-3530d6f927cf service nova] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:30:11 user nova-compute[74743]: INFO nova.compute.manager [-] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Took 0.86 seconds to deallocate network for instance.
Nov 18 17:30:11 user nova-compute[74743]: DEBUG nova.compute.manager [req-2525fbda-d108-45a5-be52-ae3ebd156933 req-0b7a2699-afd0-42af-93fb-3530d6f927cf service nova] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Detach interface failed, port_id=7bc10485-32b0-44a5-8813-2fa64d1dfbba, reason: Instance aefe3db1-b9bb-4cce-aa31-d0b6684ad791 could not be found. {{(pid=74743) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 17:30:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4cdf9519-d622-404e-9118-1e030e0d2c2c tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:30:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4cdf9519-d622-404e-9118-1e030e0d2c2c tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:30:11 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-4cdf9519-d622-404e-9118-1e030e0d2c2c tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:30:11 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-4cdf9519-d622-404e-9118-1e030e0d2c2c tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:30:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4cdf9519-d622-404e-9118-1e030e0d2c2c tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.151s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:30:11 user nova-compute[74743]: INFO nova.scheduler.client.report [None req-4cdf9519-d622-404e-9118-1e030e0d2c2c tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Deleted allocations for instance aefe3db1-b9bb-4cce-aa31-d0b6684ad791
Nov 18 17:30:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4cdf9519-d622-404e-9118-1e030e0d2c2c tempest-ServerBootFromVolumeStableRescueTest-633893051 tempest-ServerBootFromVolumeStableRescueTest-633893051-project-member] Lock "aefe3db1-b9bb-4cce-aa31-d0b6684ad791" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.138s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:30:11 user nova-compute[74743]: DEBUG nova.compute.manager [req-b8f99137-3984-45c8-a3e2-9bef455fd197 req-b27eebc9-20bf-40d3-8b48-ed6b20746930 service nova] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Received event network-vif-plugged-7bc10485-32b0-44a5-8813-2fa64d1dfbba {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:30:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b8f99137-3984-45c8-a3e2-9bef455fd197 req-b27eebc9-20bf-40d3-8b48-ed6b20746930 service nova] Acquiring lock "aefe3db1-b9bb-4cce-aa31-d0b6684ad791-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:30:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b8f99137-3984-45c8-a3e2-9bef455fd197 req-b27eebc9-20bf-40d3-8b48-ed6b20746930 service nova] Lock "aefe3db1-b9bb-4cce-aa31-d0b6684ad791-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:30:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b8f99137-3984-45c8-a3e2-9bef455fd197 req-b27eebc9-20bf-40d3-8b48-ed6b20746930 service nova] Lock "aefe3db1-b9bb-4cce-aa31-d0b6684ad791-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:30:11 user nova-compute[74743]: DEBUG nova.compute.manager [req-b8f99137-3984-45c8-a3e2-9bef455fd197 req-b27eebc9-20bf-40d3-8b48-ed6b20746930 service nova] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] No waiting events found dispatching network-vif-plugged-7bc10485-32b0-44a5-8813-2fa64d1dfbba {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:30:11 user nova-compute[74743]: WARNING nova.compute.manager [req-b8f99137-3984-45c8-a3e2-9bef455fd197 req-b27eebc9-20bf-40d3-8b48-ed6b20746930 service nova] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Received unexpected event network-vif-plugged-7bc10485-32b0-44a5-8813-2fa64d1dfbba for instance with vm_state deleted and task_state None.
Nov 18 17:30:11 user nova-compute[74743]: DEBUG nova.compute.manager [req-b8f99137-3984-45c8-a3e2-9bef455fd197 req-b27eebc9-20bf-40d3-8b48-ed6b20746930 service nova] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Received event network-vif-plugged-7bc10485-32b0-44a5-8813-2fa64d1dfbba {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:30:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b8f99137-3984-45c8-a3e2-9bef455fd197 req-b27eebc9-20bf-40d3-8b48-ed6b20746930 service nova] Acquiring lock "aefe3db1-b9bb-4cce-aa31-d0b6684ad791-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:30:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b8f99137-3984-45c8-a3e2-9bef455fd197 req-b27eebc9-20bf-40d3-8b48-ed6b20746930 service nova] Lock "aefe3db1-b9bb-4cce-aa31-d0b6684ad791-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:30:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b8f99137-3984-45c8-a3e2-9bef455fd197 req-b27eebc9-20bf-40d3-8b48-ed6b20746930 service nova] Lock "aefe3db1-b9bb-4cce-aa31-d0b6684ad791-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:30:11 user nova-compute[74743]: DEBUG nova.compute.manager [req-b8f99137-3984-45c8-a3e2-9bef455fd197 req-b27eebc9-20bf-40d3-8b48-ed6b20746930 service nova] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] No waiting events found dispatching network-vif-plugged-7bc10485-32b0-44a5-8813-2fa64d1dfbba {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:30:11 user nova-compute[74743]: WARNING nova.compute.manager [req-b8f99137-3984-45c8-a3e2-9bef455fd197 req-b27eebc9-20bf-40d3-8b48-ed6b20746930 service nova] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Received unexpected event network-vif-plugged-7bc10485-32b0-44a5-8813-2fa64d1dfbba for instance with vm_state deleted and task_state None.
Nov 18 17:30:11 user nova-compute[74743]: DEBUG nova.compute.manager [req-b8f99137-3984-45c8-a3e2-9bef455fd197 req-b27eebc9-20bf-40d3-8b48-ed6b20746930 service nova] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Received event network-vif-plugged-7bc10485-32b0-44a5-8813-2fa64d1dfbba {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:30:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b8f99137-3984-45c8-a3e2-9bef455fd197 req-b27eebc9-20bf-40d3-8b48-ed6b20746930 service nova] Acquiring lock "aefe3db1-b9bb-4cce-aa31-d0b6684ad791-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:30:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b8f99137-3984-45c8-a3e2-9bef455fd197 req-b27eebc9-20bf-40d3-8b48-ed6b20746930 service nova] Lock "aefe3db1-b9bb-4cce-aa31-d0b6684ad791-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:30:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b8f99137-3984-45c8-a3e2-9bef455fd197 req-b27eebc9-20bf-40d3-8b48-ed6b20746930 service nova] Lock "aefe3db1-b9bb-4cce-aa31-d0b6684ad791-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:30:11 user nova-compute[74743]: DEBUG nova.compute.manager [req-b8f99137-3984-45c8-a3e2-9bef455fd197 req-b27eebc9-20bf-40d3-8b48-ed6b20746930 service nova] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] No waiting events found dispatching network-vif-plugged-7bc10485-32b0-44a5-8813-2fa64d1dfbba {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:30:11 user nova-compute[74743]: WARNING nova.compute.manager [req-b8f99137-3984-45c8-a3e2-9bef455fd197 req-b27eebc9-20bf-40d3-8b48-ed6b20746930 service nova] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Received unexpected event network-vif-plugged-7bc10485-32b0-44a5-8813-2fa64d1dfbba for instance with vm_state deleted and task_state None.
Nov 18 17:30:11 user nova-compute[74743]: DEBUG nova.compute.manager [req-b8f99137-3984-45c8-a3e2-9bef455fd197 req-b27eebc9-20bf-40d3-8b48-ed6b20746930 service nova] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Received event network-vif-unplugged-7bc10485-32b0-44a5-8813-2fa64d1dfbba {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:30:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b8f99137-3984-45c8-a3e2-9bef455fd197 req-b27eebc9-20bf-40d3-8b48-ed6b20746930 service nova] Acquiring lock "aefe3db1-b9bb-4cce-aa31-d0b6684ad791-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:30:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b8f99137-3984-45c8-a3e2-9bef455fd197 req-b27eebc9-20bf-40d3-8b48-ed6b20746930 service nova] Lock "aefe3db1-b9bb-4cce-aa31-d0b6684ad791-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:30:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b8f99137-3984-45c8-a3e2-9bef455fd197 req-b27eebc9-20bf-40d3-8b48-ed6b20746930 service nova] Lock "aefe3db1-b9bb-4cce-aa31-d0b6684ad791-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:30:11 user nova-compute[74743]: DEBUG nova.compute.manager [req-b8f99137-3984-45c8-a3e2-9bef455fd197 req-b27eebc9-20bf-40d3-8b48-ed6b20746930 service nova] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] No waiting events found dispatching network-vif-unplugged-7bc10485-32b0-44a5-8813-2fa64d1dfbba {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:30:11 user nova-compute[74743]: WARNING nova.compute.manager [req-b8f99137-3984-45c8-a3e2-9bef455fd197 req-b27eebc9-20bf-40d3-8b48-ed6b20746930 service nova] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Received unexpected event network-vif-unplugged-7bc10485-32b0-44a5-8813-2fa64d1dfbba for instance with vm_state deleted and task_state None.
Nov 18 17:30:11 user nova-compute[74743]: DEBUG nova.compute.manager [req-b8f99137-3984-45c8-a3e2-9bef455fd197 req-b27eebc9-20bf-40d3-8b48-ed6b20746930 service nova] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Received event network-vif-plugged-7bc10485-32b0-44a5-8813-2fa64d1dfbba {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:30:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b8f99137-3984-45c8-a3e2-9bef455fd197 req-b27eebc9-20bf-40d3-8b48-ed6b20746930 service nova] Acquiring lock "aefe3db1-b9bb-4cce-aa31-d0b6684ad791-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:30:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b8f99137-3984-45c8-a3e2-9bef455fd197 req-b27eebc9-20bf-40d3-8b48-ed6b20746930 service nova] Lock "aefe3db1-b9bb-4cce-aa31-d0b6684ad791-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:30:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b8f99137-3984-45c8-a3e2-9bef455fd197 req-b27eebc9-20bf-40d3-8b48-ed6b20746930 service nova] Lock "aefe3db1-b9bb-4cce-aa31-d0b6684ad791-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:30:11 user nova-compute[74743]: DEBUG nova.compute.manager [req-b8f99137-3984-45c8-a3e2-9bef455fd197 req-b27eebc9-20bf-40d3-8b48-ed6b20746930 service nova] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] No waiting events found dispatching network-vif-plugged-7bc10485-32b0-44a5-8813-2fa64d1dfbba {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:30:11 user nova-compute[74743]: WARNING nova.compute.manager [req-b8f99137-3984-45c8-a3e2-9bef455fd197 req-b27eebc9-20bf-40d3-8b48-ed6b20746930 service nova] [instance: aefe3db1-b9bb-4cce-aa31-d0b6684ad791] Received unexpected event network-vif-plugged-7bc10485-32b0-44a5-8813-2fa64d1dfbba for instance with vm_state deleted and task_state None.
Nov 18 17:30:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:30:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:30:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:30:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74743) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 17:30:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:30:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:30:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:30:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:30:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:30:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:30:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:30:31 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:30:34 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:30:34 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74743) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 17:30:35 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:30:35 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:30:37 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:30:38 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:30:40 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:30:40 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:30:41 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:30:41 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:30:43 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:30:44 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:30:44 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:30:44 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:30:44 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:30:44 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Auditing locally available compute resources for user (node: user) {{(pid=74743) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 17:30:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d1afa4-bf4b-476c-88a0-ddf76002cac6/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:30:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d1afa4-bf4b-476c-88a0-ddf76002cac6/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:30:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d1afa4-bf4b-476c-88a0-ddf76002cac6/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:30:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d1afa4-bf4b-476c-88a0-ddf76002cac6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:30:45 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:30:45 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:30:45 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:30:45 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Hypervisor/Node resource view: name=user free_ram=8861MB free_disk=25.345733642578125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74743) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 17:30:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:30:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:30:45 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 21d1afa4-bf4b-476c-88a0-ddf76002cac6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:30:45 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 17:30:45 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 17:30:45 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:30:45 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:30:45 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Compute_service record updated for user:user {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 17:30:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.204s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:30:46 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:30:46 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:30:47 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:30:47 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Starting heal instance info cache {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 17:30:47 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Rebuilding the list of instances to heal {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 17:30:47 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "refresh_cache-21d1afa4-bf4b-476c-88a0-ddf76002cac6" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:30:47 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquired lock "refresh_cache-21d1afa4-bf4b-476c-88a0-ddf76002cac6" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:30:47 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Forcefully refreshing network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 17:30:47 user nova-compute[74743]: DEBUG nova.objects.instance [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lazy-loading 'info_cache' on Instance uuid 21d1afa4-bf4b-476c-88a0-ddf76002cac6 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:30:47 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Updating instance_info_cache with network_info: [{"id": "133bae79-0949-485f-b364-9886ed4b69a9", "address": "fa:16:3e:30:62:06", "network": {"id": "b03d3355-7704-43de-8af7-7a5dc1ee490d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1492507432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5502edf6a6b94cb59d58d52494efc90d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap133bae79-09", "ovs_interfaceid": "133bae79-0949-485f-b364-9886ed4b69a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:30:47 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Releasing lock "refresh_cache-21d1afa4-bf4b-476c-88a0-ddf76002cac6" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:30:47 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Updated the network info_cache for instance {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 17:30:50 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:30:50 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:30:50 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74743) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 17:30:50 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:30:50 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:30:50 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:30:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:30:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:30:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74743) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 17:30:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:30:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:30:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:31:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:31:01 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:31:02 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:31:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:31:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:31:09 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:31:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:31:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:31:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Acquiring lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:31:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:31:12 user nova-compute[74743]: DEBUG nova.compute.manager [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Starting instance... {{(pid=74743) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 17:31:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:31:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:31:12 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74743) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 17:31:12 user nova-compute[74743]: INFO nova.compute.claims [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Claim successful on node user
Nov 18 17:31:12 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:31:12 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:31:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.243s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:31:12 user nova-compute[74743]: DEBUG nova.compute.manager [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Start building networks asynchronously for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 17:31:12 user nova-compute[74743]: DEBUG nova.compute.manager [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Allocating IP information in the background. {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 17:31:12 user nova-compute[74743]: DEBUG nova.network.neutron [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] allocate_for_instance() {{(pid=74743) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 17:31:12 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 17:31:12 user nova-compute[74743]: DEBUG nova.compute.manager [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Start building block device mappings for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 17:31:12 user nova-compute[74743]: DEBUG nova.policy [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ad24aa794fd148fab6df6d7b98443a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2bcb9ffb2749128da81f4c2df7f6c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74743) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 17:31:12 user nova-compute[74743]: DEBUG nova.compute.manager [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Start spawning the instance on the hypervisor. {{(pid=74743) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 17:31:12 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Creating instance directory {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 17:31:12 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Creating image(s)
Nov 18 17:31:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Acquiring lock "/opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:31:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Lock "/opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:31:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Lock "/opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:31:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:31:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.173s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:31:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Acquiring lock "c188b3a997bfafa42fa341f9dcc326545681eed9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:31:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:31:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:31:13 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.169s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:31:13 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/disk 1073741824 {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:31:13 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/disk 1073741824" returned: 0 in 0.051s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:31:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:31:13 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:31:13 user nova-compute[74743]: DEBUG nova.network.neutron [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Successfully created port: d22822e2-3327-4efc-8aa0-55a47b73c5bf {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:31:13 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.167s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:31:13 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Checking if we can resize image /opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/disk. size=1073741824 {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 17:31:13 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:31:13 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:31:13 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Cannot resize image /opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/disk to a smaller size. {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 17:31:13 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Created local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 17:31:13 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Ensure instance console log exists: /opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:31:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:31:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:31:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:31:13 user nova-compute[74743]: DEBUG nova.network.neutron [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Successfully updated port: d22822e2-3327-4efc-8aa0-55a47b73c5bf {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:31:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Acquiring lock "refresh_cache-69d7f224-23d7-4d0e-8bb5-8db35a8ee4de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:31:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Acquired lock "refresh_cache-69d7f224-23d7-4d0e-8bb5-8db35a8ee4de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:31:13 user nova-compute[74743]: DEBUG nova.network.neutron [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:31:13 user nova-compute[74743]: DEBUG nova.compute.manager [req-03b25140-dd78-4973-ab14-53f0d1d5615e req-05a94ea1-500b-4a07-9c15-0b20df616779 service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Received event network-changed-d22822e2-3327-4efc-8aa0-55a47b73c5bf {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:31:13 user nova-compute[74743]: DEBUG nova.compute.manager [req-03b25140-dd78-4973-ab14-53f0d1d5615e req-05a94ea1-500b-4a07-9c15-0b20df616779 service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Refreshing instance network info cache due to event network-changed-d22822e2-3327-4efc-8aa0-55a47b73c5bf. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:31:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-03b25140-dd78-4973-ab14-53f0d1d5615e req-05a94ea1-500b-4a07-9c15-0b20df616779 service nova] Acquiring lock "refresh_cache-69d7f224-23d7-4d0e-8bb5-8db35a8ee4de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:31:14 user nova-compute[74743]: DEBUG nova.network.neutron [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:31:14 user nova-compute[74743]: DEBUG nova.network.neutron [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Updating instance_info_cache with network_info: [{"id": "d22822e2-3327-4efc-8aa0-55a47b73c5bf", "address": "fa:16:3e:25:10:56", "network": {"id": "97b8f910-abe2-43b1-98c4-c7b52200906f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1194489190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce2bcb9ffb2749128da81f4c2df7f6c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd22822e2-33", "ovs_interfaceid": "d22822e2-3327-4efc-8aa0-55a47b73c5bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:31:14 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Releasing lock "refresh_cache-69d7f224-23d7-4d0e-8bb5-8db35a8ee4de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:31:14 user nova-compute[74743]: DEBUG nova.compute.manager [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Instance network_info: |[{"id": "d22822e2-3327-4efc-8aa0-55a47b73c5bf", "address": "fa:16:3e:25:10:56", "network": {"id": "97b8f910-abe2-43b1-98c4-c7b52200906f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1194489190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce2bcb9ffb2749128da81f4c2df7f6c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd22822e2-33", "ovs_interfaceid": "d22822e2-3327-4efc-8aa0-55a47b73c5bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 17:31:14 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-03b25140-dd78-4973-ab14-53f0d1d5615e req-05a94ea1-500b-4a07-9c15-0b20df616779 service nova] Acquired lock "refresh_cache-69d7f224-23d7-4d0e-8bb5-8db35a8ee4de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:31:14 user nova-compute[74743]: DEBUG nova.network.neutron [req-03b25140-dd78-4973-ab14-53f0d1d5615e req-05a94ea1-500b-4a07-9c15-0b20df616779 service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Refreshing network info cache for port d22822e2-3327-4efc-8aa0-55a47b73c5bf {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:31:14 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Start _get_guest_xml network_info=[{"id": "d22822e2-3327-4efc-8aa0-55a47b73c5bf", "address": "fa:16:3e:25:10:56", "network": {"id": "97b8f910-abe2-43b1-98c4-c7b52200906f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1194489190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce2bcb9ffb2749128da81f4c2df7f6c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd22822e2-33", "ovs_interfaceid": "d22822e2-3327-4efc-8aa0-55a47b73c5bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '9536f6cf-95c4-40e2-864a-09a91525678a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:31:14 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:31:14 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:31:14 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:31:14 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:31:14 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:31:14 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:31:14 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:31:14 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:31:14 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:31:14 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:31:14 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:31:14 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:31:14 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:31:14 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:31:14 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:31:14 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:31:14 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:31:14 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:31:14 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:31:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1530848000',display_name='tempest-ServerStableDeviceRescueTest-server-1530848000',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1530848000',id=45,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBChhBo9VaY4BOIEFz523V2/9n5F5kQpNA2Q/p8rjF0+VRwZUYTxFpwuCPuS3su+tPJHnXXaAkikoqSKB9iEmlKXcPvgT6Y454gPB2vB2hybhUh/7RHCr59TSrRv/zlM5Rg==',key_name='tempest-keypair-969517686',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce2bcb9ffb2749128da81f4c2df7f6c1',ramdisk_id='',reservation_id='r-wquedsqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1073155627',owner_user_name='tempest-ServerStableDeviceRescueTest-1073155627-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:31:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad24aa794fd148fab6df6d7b98443a90',uuid=69d7f224-23d7-4d0e-8bb5-8db35a8ee4de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d22822e2-3327-4efc-8aa0-55a47b73c5bf", "address": "fa:16:3e:25:10:56", "network": {"id": "97b8f910-abe2-43b1-98c4-c7b52200906f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1194489190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce2bcb9ffb2749128da81f4c2df7f6c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd22822e2-33", "ovs_interfaceid": "d22822e2-3327-4efc-8aa0-55a47b73c5bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:31:14 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Converting VIF {"id": "d22822e2-3327-4efc-8aa0-55a47b73c5bf", "address": "fa:16:3e:25:10:56", "network": {"id": "97b8f910-abe2-43b1-98c4-c7b52200906f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1194489190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce2bcb9ffb2749128da81f4c2df7f6c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd22822e2-33", "ovs_interfaceid": "d22822e2-3327-4efc-8aa0-55a47b73c5bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:31:14 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:10:56,bridge_name='br-int',has_traffic_filtering=True,id=d22822e2-3327-4efc-8aa0-55a47b73c5bf,network=Network(97b8f910-abe2-43b1-98c4-c7b52200906f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd22822e2-33') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:31:14 user nova-compute[74743]: DEBUG nova.objects.instance [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Lazy-loading 'pci_devices' on Instance uuid 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:31:14 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:31:14 user nova-compute[74743]:   <uuid>69d7f224-23d7-4d0e-8bb5-8db35a8ee4de</uuid>
Nov 18 17:31:14 user nova-compute[74743]:   <name>instance-0000002d</name>
Nov 18 17:31:14 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:31:14 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:31:14 user nova-compute[74743]:   <metadata>
Nov 18 17:31:14 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:31:14 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:31:14 user nova-compute[74743]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1530848000</nova:name>
Nov 18 17:31:14 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:31:14</nova:creationTime>
Nov 18 17:31:14 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:31:14 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:31:14 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:31:14 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:31:14 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:31:14 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:31:14 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:31:14 user nova-compute[74743]:       <nova:owner>
Nov 18 17:31:14 user nova-compute[74743]:         <nova:user uuid="ad24aa794fd148fab6df6d7b98443a90">tempest-ServerStableDeviceRescueTest-1073155627-project-member</nova:user>
Nov 18 17:31:14 user nova-compute[74743]:         <nova:project uuid="ce2bcb9ffb2749128da81f4c2df7f6c1">tempest-ServerStableDeviceRescueTest-1073155627</nova:project>
Nov 18 17:31:14 user nova-compute[74743]:       </nova:owner>
Nov 18 17:31:14 user nova-compute[74743]:       <nova:root type="image" uuid="9536f6cf-95c4-40e2-864a-09a91525678a"/>
Nov 18 17:31:14 user nova-compute[74743]:       <nova:ports>
Nov 18 17:31:14 user nova-compute[74743]:         <nova:port uuid="d22822e2-3327-4efc-8aa0-55a47b73c5bf">
Nov 18 17:31:14 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 18 17:31:14 user nova-compute[74743]:         </nova:port>
Nov 18 17:31:14 user nova-compute[74743]:       </nova:ports>
Nov 18 17:31:14 user nova-compute[74743]:     </nova:instance>
Nov 18 17:31:14 user nova-compute[74743]:   </metadata>
Nov 18 17:31:14 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:31:14 user nova-compute[74743]:     <system>
Nov 18 17:31:14 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:31:14 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:31:14 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:31:14 user nova-compute[74743]:       <entry name="serial">69d7f224-23d7-4d0e-8bb5-8db35a8ee4de</entry>
Nov 18 17:31:14 user nova-compute[74743]:       <entry name="uuid">69d7f224-23d7-4d0e-8bb5-8db35a8ee4de</entry>
Nov 18 17:31:14 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:31:14 user nova-compute[74743]:     </system>
Nov 18 17:31:14 user nova-compute[74743]:   </sysinfo>
Nov 18 17:31:14 user nova-compute[74743]:   <os>
Nov 18 17:31:14 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:31:14 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:31:14 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:31:14 user nova-compute[74743]:   </os>
Nov 18 17:31:14 user nova-compute[74743]:   <features>
Nov 18 17:31:14 user nova-compute[74743]:     <acpi/>
Nov 18 17:31:14 user nova-compute[74743]:     <apic/>
Nov 18 17:31:14 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:31:14 user nova-compute[74743]:   </features>
Nov 18 17:31:14 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:31:14 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:31:14 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:31:14 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:31:14 user nova-compute[74743]:   </clock>
Nov 18 17:31:14 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:31:14 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:31:14 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:31:14 user nova-compute[74743]:   </cpu>
Nov 18 17:31:14 user nova-compute[74743]:   <devices>
Nov 18 17:31:14 user nova-compute[74743]:     <disk type="file" device="disk">
Nov 18 17:31:14 user nova-compute[74743]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 17:31:14 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/disk"/>
Nov 18 17:31:14 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:31:14 user nova-compute[74743]:     </disk>
Nov 18 17:31:14 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:31:14 user nova-compute[74743]:       <mac address="fa:16:3e:25:10:56"/>
Nov 18 17:31:14 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:31:14 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:31:14 user nova-compute[74743]:       <target dev="tapd22822e2-33"/>
Nov 18 17:31:14 user nova-compute[74743]:     </interface>
Nov 18 17:31:14 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:31:14 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/console.log" append="off"/>
Nov 18 17:31:14 user nova-compute[74743]:     </serial>
Nov 18 17:31:14 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:31:14 user nova-compute[74743]:     <video>
Nov 18 17:31:14 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:31:14 user nova-compute[74743]:     </video>
Nov 18 17:31:14 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:31:14 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:31:14 user nova-compute[74743]:     </rng>
Nov 18 17:31:14 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:31:14 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:31:14 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:31:14 user nova-compute[74743]:     </memballoon>
Nov 18 17:31:14 user nova-compute[74743]:   </devices>
Nov 18 17:31:14 user nova-compute[74743]: </domain>
Nov 18 17:31:14 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:31:14 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:31:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1530848000',display_name='tempest-ServerStableDeviceRescueTest-server-1530848000',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1530848000',id=45,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBChhBo9VaY4BOIEFz523V2/9n5F5kQpNA2Q/p8rjF0+VRwZUYTxFpwuCPuS3su+tPJHnXXaAkikoqSKB9iEmlKXcPvgT6Y454gPB2vB2hybhUh/7RHCr59TSrRv/zlM5Rg==',key_name='tempest-keypair-969517686',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce2bcb9ffb2749128da81f4c2df7f6c1',ramdisk_id='',reservation_id='r-wquedsqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1073155627',owner_user_name='tempest-ServerStableDeviceRescueTest-1073155627-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:31:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad24aa794fd148fab6df6d7b98443a90',uuid=69d7f224-23d7-4d0e-8bb5-8db35a8ee4de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d22822e2-3327-4efc-8aa0-55a47b73c5bf", "address": "fa:16:3e:25:10:56", "network": {"id": "97b8f910-abe2-43b1-98c4-c7b52200906f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1194489190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce2bcb9ffb2749128da81f4c2df7f6c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd22822e2-33", "ovs_interfaceid": "d22822e2-3327-4efc-8aa0-55a47b73c5bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:31:14 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Converting VIF {"id": "d22822e2-3327-4efc-8aa0-55a47b73c5bf", "address": "fa:16:3e:25:10:56", "network": {"id": "97b8f910-abe2-43b1-98c4-c7b52200906f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1194489190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce2bcb9ffb2749128da81f4c2df7f6c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd22822e2-33", "ovs_interfaceid": "d22822e2-3327-4efc-8aa0-55a47b73c5bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:31:14 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:10:56,bridge_name='br-int',has_traffic_filtering=True,id=d22822e2-3327-4efc-8aa0-55a47b73c5bf,network=Network(97b8f910-abe2-43b1-98c4-c7b52200906f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd22822e2-33') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:31:14 user nova-compute[74743]: DEBUG os_vif [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:10:56,bridge_name='br-int',has_traffic_filtering=True,id=d22822e2-3327-4efc-8aa0-55a47b73c5bf,network=Network(97b8f910-abe2-43b1-98c4-c7b52200906f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd22822e2-33') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:31:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:31:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:31:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:31:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:31:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4923207e-f258-5214-a781-18051b972b21', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:31:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:31:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:31:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:31:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd22822e2-33, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:31:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd22822e2-33, col_values=(('qos', UUID('8679494f-f768-40a2-8454-119e7e51f74d')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:31:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd22822e2-33, col_values=(('external_ids', {'iface-id': 'd22822e2-3327-4efc-8aa0-55a47b73c5bf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:10:56', 'vm-uuid': '69d7f224-23d7-4d0e-8bb5-8db35a8ee4de'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:31:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:31:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:31:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:31:14 user nova-compute[74743]: INFO os_vif [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:10:56,bridge_name='br-int',has_traffic_filtering=True,id=d22822e2-3327-4efc-8aa0-55a47b73c5bf,network=Network(97b8f910-abe2-43b1-98c4-c7b52200906f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd22822e2-33')
Nov 18 17:31:14 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:31:14 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] No VIF found with MAC fa:16:3e:25:10:56, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:31:14 user nova-compute[74743]: DEBUG nova.network.neutron [req-03b25140-dd78-4973-ab14-53f0d1d5615e req-05a94ea1-500b-4a07-9c15-0b20df616779 service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Updated VIF entry in instance network info cache for port d22822e2-3327-4efc-8aa0-55a47b73c5bf. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:31:14 user nova-compute[74743]: DEBUG nova.network.neutron [req-03b25140-dd78-4973-ab14-53f0d1d5615e req-05a94ea1-500b-4a07-9c15-0b20df616779 service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Updating instance_info_cache with network_info: [{"id": "d22822e2-3327-4efc-8aa0-55a47b73c5bf", "address": "fa:16:3e:25:10:56", "network": {"id": "97b8f910-abe2-43b1-98c4-c7b52200906f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1194489190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce2bcb9ffb2749128da81f4c2df7f6c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd22822e2-33", "ovs_interfaceid": "d22822e2-3327-4efc-8aa0-55a47b73c5bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:31:14 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-03b25140-dd78-4973-ab14-53f0d1d5615e req-05a94ea1-500b-4a07-9c15-0b20df616779 service nova] Releasing lock "refresh_cache-69d7f224-23d7-4d0e-8bb5-8db35a8ee4de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:31:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:31:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:31:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:31:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:31:16 user nova-compute[74743]: DEBUG nova.compute.manager [req-1e423bd0-5320-4c89-8d12-9657e05248c7 req-ef7e0665-1ea2-4ebb-897c-39fc68cfae4e service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Received event network-vif-plugged-d22822e2-3327-4efc-8aa0-55a47b73c5bf {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:31:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-1e423bd0-5320-4c89-8d12-9657e05248c7 req-ef7e0665-1ea2-4ebb-897c-39fc68cfae4e service nova] Acquiring lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:31:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-1e423bd0-5320-4c89-8d12-9657e05248c7 req-ef7e0665-1ea2-4ebb-897c-39fc68cfae4e service nova] Lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:31:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-1e423bd0-5320-4c89-8d12-9657e05248c7 req-ef7e0665-1ea2-4ebb-897c-39fc68cfae4e service nova] Lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:31:16 user nova-compute[74743]: DEBUG nova.compute.manager [req-1e423bd0-5320-4c89-8d12-9657e05248c7 req-ef7e0665-1ea2-4ebb-897c-39fc68cfae4e service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] No waiting events found dispatching network-vif-plugged-d22822e2-3327-4efc-8aa0-55a47b73c5bf {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:31:16 user nova-compute[74743]: WARNING nova.compute.manager [req-1e423bd0-5320-4c89-8d12-9657e05248c7 req-ef7e0665-1ea2-4ebb-897c-39fc68cfae4e service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Received unexpected event network-vif-plugged-d22822e2-3327-4efc-8aa0-55a47b73c5bf for instance with vm_state building and task_state spawning.
Nov 18 17:31:16 user nova-compute[74743]: DEBUG nova.compute.manager [req-1e423bd0-5320-4c89-8d12-9657e05248c7 req-ef7e0665-1ea2-4ebb-897c-39fc68cfae4e service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Received event network-vif-plugged-d22822e2-3327-4efc-8aa0-55a47b73c5bf {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:31:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-1e423bd0-5320-4c89-8d12-9657e05248c7 req-ef7e0665-1ea2-4ebb-897c-39fc68cfae4e service nova] Acquiring lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:31:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-1e423bd0-5320-4c89-8d12-9657e05248c7 req-ef7e0665-1ea2-4ebb-897c-39fc68cfae4e service nova] Lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:31:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-1e423bd0-5320-4c89-8d12-9657e05248c7 req-ef7e0665-1ea2-4ebb-897c-39fc68cfae4e service nova] Lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:31:16 user nova-compute[74743]: DEBUG nova.compute.manager [req-1e423bd0-5320-4c89-8d12-9657e05248c7 req-ef7e0665-1ea2-4ebb-897c-39fc68cfae4e service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] No waiting events found dispatching network-vif-plugged-d22822e2-3327-4efc-8aa0-55a47b73c5bf {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:31:16 user nova-compute[74743]: WARNING nova.compute.manager [req-1e423bd0-5320-4c89-8d12-9657e05248c7 req-ef7e0665-1ea2-4ebb-897c-39fc68cfae4e service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Received unexpected event network-vif-plugged-d22822e2-3327-4efc-8aa0-55a47b73c5bf for instance with vm_state building and task_state spawning.
Nov 18 17:31:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:31:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:31:17 user nova-compute[74743]: DEBUG nova.compute.manager [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:31:17 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Guest created on hypervisor {{(pid=74743) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 17:31:17 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Instance spawned successfully.
Nov 18 17:31:17 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 17:31:17 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Found default for hw_cdrom_bus of ide {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:31:17 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Found default for hw_disk_bus of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:31:17 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Found default for hw_input_bus of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:31:17 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Found default for hw_pointer_model of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:31:17 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Found default for hw_video_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:31:17 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Found default for hw_vif_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:31:17 user nova-compute[74743]: INFO nova.compute.manager [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Took 5.22 seconds to spawn the instance on the hypervisor.
Nov 18 17:31:17 user nova-compute[74743]: DEBUG nova.compute.manager [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:31:17 user nova-compute[74743]: INFO nova.compute.manager [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Took 5.76 seconds to build instance.
Nov 18 17:31:17 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-126378e0-439f-4b25-8604-04b9aab611b4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.855s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:31:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:31:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:31:24 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:31:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:31:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:31:33 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:31:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:31:34 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:31:34 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74743) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 17:31:35 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:31:37 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:31:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:31:40 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:31:40 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:31:42 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:31:44 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:31:44 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:31:44 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:31:44 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:31:44 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:31:44 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Auditing locally available compute resources for user (node: user) {{(pid=74743) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 17:31:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d1afa4-bf4b-476c-88a0-ddf76002cac6/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:31:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d1afa4-bf4b-476c-88a0-ddf76002cac6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:31:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d1afa4-bf4b-476c-88a0-ddf76002cac6/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:31:44 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d1afa4-bf4b-476c-88a0-ddf76002cac6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:31:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:31:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:31:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:31:45 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:31:45 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:31:45 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:31:45 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:31:45 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Hypervisor/Node resource view: name=user free_ram=8833MB free_disk=25.315109252929688GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74743) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 17:31:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:31:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:31:45 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 21d1afa4-bf4b-476c-88a0-ddf76002cac6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:31:45 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:31:45 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 17:31:45 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 17:31:45 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:31:45 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:31:45 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Compute_service record updated for user:user {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 17:31:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.228s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:31:47 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:31:47 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:31:48 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:31:48 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Starting heal instance info cache {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 17:31:48 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Rebuilding the list of instances to heal {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 17:31:48 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "refresh_cache-21d1afa4-bf4b-476c-88a0-ddf76002cac6" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:31:48 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquired lock "refresh_cache-21d1afa4-bf4b-476c-88a0-ddf76002cac6" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:31:48 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Forcefully refreshing network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 17:31:48 user nova-compute[74743]: DEBUG nova.objects.instance [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lazy-loading 'info_cache' on Instance uuid 21d1afa4-bf4b-476c-88a0-ddf76002cac6 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:31:48 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Updating instance_info_cache with network_info: [{"id": "133bae79-0949-485f-b364-9886ed4b69a9", "address": "fa:16:3e:30:62:06", "network": {"id": "b03d3355-7704-43de-8af7-7a5dc1ee490d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1492507432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5502edf6a6b94cb59d58d52494efc90d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap133bae79-09", "ovs_interfaceid": "133bae79-0949-485f-b364-9886ed4b69a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:31:48 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Releasing lock "refresh_cache-21d1afa4-bf4b-476c-88a0-ddf76002cac6" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:31:48 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Updated the network info_cache for instance {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 17:31:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:31:52 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:31:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:31:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:31:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74743) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 17:31:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:31:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:31:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:31:54 user nova-compute[74743]: DEBUG nova.compute.manager [req-221c9e42-3ec2-4e76-8402-d363c515e59e req-edb0e830-bc88-4d94-bbb8-c98e52be270a service nova] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Received event network-changed-133bae79-0949-485f-b364-9886ed4b69a9 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:31:54 user nova-compute[74743]: DEBUG nova.compute.manager [req-221c9e42-3ec2-4e76-8402-d363c515e59e req-edb0e830-bc88-4d94-bbb8-c98e52be270a service nova] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Refreshing instance network info cache due to event network-changed-133bae79-0949-485f-b364-9886ed4b69a9. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:31:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-221c9e42-3ec2-4e76-8402-d363c515e59e req-edb0e830-bc88-4d94-bbb8-c98e52be270a service nova] Acquiring lock "refresh_cache-21d1afa4-bf4b-476c-88a0-ddf76002cac6" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:31:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-221c9e42-3ec2-4e76-8402-d363c515e59e req-edb0e830-bc88-4d94-bbb8-c98e52be270a service nova] Acquired lock "refresh_cache-21d1afa4-bf4b-476c-88a0-ddf76002cac6" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:31:54 user nova-compute[74743]: DEBUG nova.network.neutron [req-221c9e42-3ec2-4e76-8402-d363c515e59e req-edb0e830-bc88-4d94-bbb8-c98e52be270a service nova] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Refreshing network info cache for port 133bae79-0949-485f-b364-9886ed4b69a9 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:31:55 user nova-compute[74743]: DEBUG nova.network.neutron [req-221c9e42-3ec2-4e76-8402-d363c515e59e req-edb0e830-bc88-4d94-bbb8-c98e52be270a service nova] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Updated VIF entry in instance network info cache for port 133bae79-0949-485f-b364-9886ed4b69a9. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:31:55 user nova-compute[74743]: DEBUG nova.network.neutron [req-221c9e42-3ec2-4e76-8402-d363c515e59e req-edb0e830-bc88-4d94-bbb8-c98e52be270a service nova] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Updating instance_info_cache with network_info: [{"id": "133bae79-0949-485f-b364-9886ed4b69a9", "address": "fa:16:3e:30:62:06", "network": {"id": "b03d3355-7704-43de-8af7-7a5dc1ee490d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1492507432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5502edf6a6b94cb59d58d52494efc90d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap133bae79-09", "ovs_interfaceid": "133bae79-0949-485f-b364-9886ed4b69a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:31:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-221c9e42-3ec2-4e76-8402-d363c515e59e req-edb0e830-bc88-4d94-bbb8-c98e52be270a service nova] Releasing lock "refresh_cache-21d1afa4-bf4b-476c-88a0-ddf76002cac6" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:31:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:31:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-08bf83f1-f5c9-48de-adf2-17ac7c775580 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquiring lock "21d1afa4-bf4b-476c-88a0-ddf76002cac6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:31:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-08bf83f1-f5c9-48de-adf2-17ac7c775580 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "21d1afa4-bf4b-476c-88a0-ddf76002cac6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:31:57 user nova-compute[74743]: DEBUG nova.objects.instance [None req-08bf83f1-f5c9-48de-adf2-17ac7c775580 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lazy-loading 'flavor' on Instance uuid 21d1afa4-bf4b-476c-88a0-ddf76002cac6 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:31:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-08bf83f1-f5c9-48de-adf2-17ac7c775580 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "21d1afa4-bf4b-476c-88a0-ddf76002cac6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:31:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-08bf83f1-f5c9-48de-adf2-17ac7c775580 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquiring lock "21d1afa4-bf4b-476c-88a0-ddf76002cac6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:31:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-08bf83f1-f5c9-48de-adf2-17ac7c775580 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "21d1afa4-bf4b-476c-88a0-ddf76002cac6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:31:57 user nova-compute[74743]: INFO nova.compute.manager [None req-08bf83f1-f5c9-48de-adf2-17ac7c775580 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Attaching volume beaea375-1643-48e5-8e18-674607ea3873 to /dev/vdb
Nov 18 17:31:57 user nova-compute[74743]: DEBUG os_brick.utils [None req-08bf83f1-f5c9-48de-adf2-17ac7c775580 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:31:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:31:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:31:57 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8a2706-10ed-4fcc-b67f-dd6ee1e636bf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1116acd8874d\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:31:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:31:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:31:57 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72701e3-301c-4665-b57f-b6fac3069a45]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:31:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:31:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:31:57 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a01858-39fe-4e63-87d2-95dd9da37821]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:31:57 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a87013-91b2-44d7-9543-2643f5c965ae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:31:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-08bf83f1-f5c9-48de-adf2-17ac7c775580 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Running cmd (subprocess): nvme version {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:31:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-08bf83f1-f5c9-48de-adf2-17ac7c775580 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] 'nvme version' failed. Not Retrying. {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:31:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.nvmeof [None req-08bf83f1-f5c9-48de-adf2-17ac7c775580 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] nvme not present on system {{(pid=74743) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 17:31:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:31:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:31:57 user nova-compute[74743]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 17:31:57 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8cf515e-34ce-432b-a2e7-3c59ecf9f79a]: (4, '') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:31:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-08bf83f1-f5c9-48de-adf2-17ac7c775580 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74743) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 17:31:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-08bf83f1-f5c9-48de-adf2-17ac7c775580 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 17:31:57 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-08bf83f1-f5c9-48de-adf2-17ac7c775580 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] LIGHTOS: no hostnqn found. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 17:31:57 user nova-compute[74743]: DEBUG os_brick.utils [None req-08bf83f1-f5c9-48de-adf2-17ac7c775580 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1116acd8874d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:31:57 user nova-compute[74743]: DEBUG nova.virt.block_device [None req-08bf83f1-f5c9-48de-adf2-17ac7c775580 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Updating existing volume attachment record: 420b4a6e-0570-4017-bb4c-d68090340668 {{(pid=74743) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 17:31:59 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:32:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:32:02 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08bf83f1-f5c9-48de-adf2-17ac7c775580 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Calling os-brick to attach iSCSI Volume {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 17:32:02 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bf83f1-f5c9-48de-adf2-17ac7c775580 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:beaea375-1643-48e5-8e18-674607ea3873', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZMThDxPz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:32:02 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-08bf83f1-f5c9-48de-adf2-17ac7c775580 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:32:02 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-08bf83f1-f5c9-48de-adf2-17ac7c775580 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:32:02 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-08bf83f1-f5c9-48de-adf2-17ac7c775580 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:32:02 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-08bf83f1-f5c9-48de-adf2-17ac7c775580 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:32:02 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-08bf83f1-f5c9-48de-adf2-17ac7c775580 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:beaea375-1643-48e5-8e18-674607ea3873" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:32:02 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-08bf83f1-f5c9-48de-adf2-17ac7c775580 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:beaea375-1643-48e5-8e18-674607ea3873" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:32:02 user nova-compute[74743]: INFO os_brick.initiator.connectors.iscsi [None req-08bf83f1-f5c9-48de-adf2-17ac7c775580 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 17:32:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beaea375-1643-48e5-8e18-674607ea3873 -p 172.16.0.220:3260 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:32:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beaea375-1643-48e5-8e18-674607ea3873 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:32:02 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[40464791-e979-424c-9e39-be1fd93ef309]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:32:02 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bf83f1-f5c9-48de-adf2-17ac7c775580 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 17:32:02 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:32:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beaea375-1643-48e5-8e18-674607ea3873 -p 172.16.0.220:3260 --interface default --op new {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:32:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beaea375-1643-48e5-8e18-674607ea3873 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:32:02 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b582761a-18c1-4b58-9d60-9392ef3a0000]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:beaea375-1643-48e5-8e18-674607ea3873] added\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:32:02 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bf83f1-f5c9-48de-adf2-17ac7c775580 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:beaea375-1643-48e5-8e18-674607ea3873] added
Nov 18 17:32:02 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:32:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beaea375-1643-48e5-8e18-674607ea3873 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:32:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beaea375-1643-48e5-8e18-674607ea3873 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:32:02 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d299b67f-b891-4478-89a7-9d383c825ed5]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:32:02 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bf83f1-f5c9-48de-adf2-17ac7c775580 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:32:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beaea375-1643-48e5-8e18-674607ea3873 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:32:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beaea375-1643-48e5-8e18-674607ea3873 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:32:02 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4fcb67-0df6-41a9-accc-8e2582358fb3]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:32:02 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bf83f1-f5c9-48de-adf2-17ac7c775580 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:32:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beaea375-1643-48e5-8e18-674607ea3873 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZMThDxPz {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:32:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beaea375-1643-48e5-8e18-674607ea3873 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZMThDxPz" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:32:02 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8b37e8-4b34-40b7-bda9-21fb28afca2a]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:32:02 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bf83f1-f5c9-48de-adf2-17ac7c775580 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZMThDxPz'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:32:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beaea375-1643-48e5-8e18-674607ea3873 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:32:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beaea375-1643-48e5-8e18-674607ea3873 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:32:02 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[548e2589-a25b-4ece-a576-141e0aeb2548]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:32:02 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bf83f1-f5c9-48de-adf2-17ac7c775580 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:32:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:32:03 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:32:03 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f78190-edfc-4ffa-8fa0-fe44d62099ea]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:32:03 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bf83f1-f5c9-48de-adf2-17ac7c775580 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 18 17:32:03 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:32:03 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bf83f1-f5c9-48de-adf2-17ac7c775580 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 18 17:32:03 user nova-compute[74743]:  {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:32:03 user nova-compute[74743]: WARNING os_brick.initiator.connectors.iscsi [None req-08bf83f1-f5c9-48de-adf2-17ac7c775580 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 18 17:32:03 user nova-compute[74743]: 
Nov 18 17:32:03 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beaea375-1643-48e5-8e18-674607ea3873 -p 172.16.0.220:3260 --login {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:32:03 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beaea375-1643-48e5-8e18-674607ea3873 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:32:03 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d91201-05bf-4dd7-a6c4-717bfb94f95f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:beaea375-1643-48e5-8e18-674607ea3873, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:beaea375-1643-48e5-8e18-674607ea3873, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:32:03 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bf83f1-f5c9-48de-adf2-17ac7c775580 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:beaea375-1643-48e5-8e18-674607ea3873, portal: 172.16.0.220,3260]
Nov 18 17:32:03 user nova-compute[74743]: Login to [iface: default, target: iqn.2010-10.org.openstack:beaea375-1643-48e5-8e18-674607ea3873, portal: 172.16.0.220,3260] successful.
Nov 18 17:32:03 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:32:03 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beaea375-1643-48e5-8e18-674607ea3873 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:32:03 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beaea375-1643-48e5-8e18-674607ea3873 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:32:03 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d250448d-608f-4ab6-a717-e61ea7fa1171]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:32:03 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bf83f1-f5c9-48de-adf2-17ac7c775580 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:32:03 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:32:03 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:32:03 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[91192f4c-4039-45a7-8357-ca133f696c9a]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beaea375-1643-48e5-8e18-674607ea3873 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:32:03 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bf83f1-f5c9-48de-adf2-17ac7c775580 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beaea375-1643-48e5-8e18-674607ea3873 (non-flash)
Nov 18 17:32:03 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:32:03 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bf83f1-f5c9-48de-adf2-17ac7c775580 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beaea375-1643-48e5-8e18-674607ea3873 (non-flash)
Nov 18 17:32:03 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:32:03 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-08bf83f1-f5c9-48de-adf2-17ac7c775580 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:beaea375-1643-48e5-8e18-674607ea3873" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.240s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:32:03 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bf83f1-f5c9-48de-adf2-17ac7c775580 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Connected to 172.16.0.220:3260 {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 17:32:03 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-08bf83f1-f5c9-48de-adf2-17ac7c775580 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=74743) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 17:32:03 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-08bf83f1-f5c9-48de-adf2-17ac7c775580 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74743) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 17:32:03 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:32:03 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:32:03 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[976333fb-ee29-477a-88a5-d7282560a4e7]: (4, ('- - 0', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:32:03 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-08bf83f1-f5c9-48de-adf2-17ac7c775580 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: None {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:32:04 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-08bf83f1-f5c9-48de-adf2-17ac7c775580 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:32:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bf83f1-f5c9-48de-adf2-17ac7c775580 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:beaea375-1643-48e5-8e18-674607ea3873', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZMThDxPz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 17:32:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-08bf83f1-f5c9-48de-adf2-17ac7c775580 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.273s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:32:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bf83f1-f5c9-48de-adf2-17ac7c775580 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] <== connect_volume: return (1275ms) {'type': 'block', 'scsi_wwn': '23366623737353533', 'path': '/dev/sdb'} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:32:04 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08bf83f1-f5c9-48de-adf2-17ac7c775580 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366623737353533', 'path': '/dev/sdb'} {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 17:32:04 user nova-compute[74743]: DEBUG nova.objects.instance [None req-08bf83f1-f5c9-48de-adf2-17ac7c775580 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lazy-loading 'flavor' on Instance uuid 21d1afa4-bf4b-476c-88a0-ddf76002cac6 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:32:04 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-08bf83f1-f5c9-48de-adf2-17ac7c775580 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 17:32:04 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:32:04 user nova-compute[74743]:   <source dev="/dev/sdb"/>
Nov 18 17:32:04 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:32:04 user nova-compute[74743]:   <serial>beaea375-1643-48e5-8e18-674607ea3873</serial>
Nov 18 17:32:04 user nova-compute[74743]: </disk>
Nov 18 17:32:04 user nova-compute[74743]:  {{(pid=74743) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 17:32:04 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:32:04 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-08bf83f1-f5c9-48de-adf2-17ac7c775580 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:32:04 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-08bf83f1-f5c9-48de-adf2-17ac7c775580 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:32:04 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-08bf83f1-f5c9-48de-adf2-17ac7c775580 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] No VIF found with MAC fa:16:3e:30:62:06, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:32:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-08bf83f1-f5c9-48de-adf2-17ac7c775580 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "21d1afa4-bf4b-476c-88a0-ddf76002cac6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.248s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:32:05 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-38c21073-4885-455e-b355-68f9330a870c tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquiring lock "21d1afa4-bf4b-476c-88a0-ddf76002cac6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:32:05 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-38c21073-4885-455e-b355-68f9330a870c tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "21d1afa4-bf4b-476c-88a0-ddf76002cac6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:32:05 user nova-compute[74743]: INFO nova.compute.manager [None req-38c21073-4885-455e-b355-68f9330a870c tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Detaching volume beaea375-1643-48e5-8e18-674607ea3873
Nov 18 17:32:05 user nova-compute[74743]: INFO nova.virt.block_device [None req-38c21073-4885-455e-b355-68f9330a870c tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Attempting to driver detach volume beaea375-1643-48e5-8e18-674607ea3873 from mountpoint /dev/vdb
Nov 18 17:32:05 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-38c21073-4885-455e-b355-68f9330a870c tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Attempting to detach device vdb from instance 21d1afa4-bf4b-476c-88a0-ddf76002cac6 from the persistent domain config. {{(pid=74743) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 17:32:05 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-38c21073-4885-455e-b355-68f9330a870c tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 17:32:05 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:32:05 user nova-compute[74743]:   <source dev="/dev/sdb"/>
Nov 18 17:32:05 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:32:05 user nova-compute[74743]:   <serial>beaea375-1643-48e5-8e18-674607ea3873</serial>
Nov 18 17:32:05 user nova-compute[74743]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 17:32:05 user nova-compute[74743]: </disk>
Nov 18 17:32:05 user nova-compute[74743]:  {{(pid=74743) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 17:32:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:32:05 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-38c21073-4885-455e-b355-68f9330a870c tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Successfully detached device vdb from instance 21d1afa4-bf4b-476c-88a0-ddf76002cac6 from the persistent domain config.
Nov 18 17:32:05 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-38c21073-4885-455e-b355-68f9330a870c tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 21d1afa4-bf4b-476c-88a0-ddf76002cac6 from the live domain config. {{(pid=74743) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 17:32:05 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-38c21073-4885-455e-b355-68f9330a870c tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 17:32:05 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:32:05 user nova-compute[74743]:   <source dev="/dev/sdb"/>
Nov 18 17:32:05 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:32:05 user nova-compute[74743]:   <serial>beaea375-1643-48e5-8e18-674607ea3873</serial>
Nov 18 17:32:05 user nova-compute[74743]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 17:32:05 user nova-compute[74743]: </disk>
Nov 18 17:32:05 user nova-compute[74743]:  {{(pid=74743) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 17:32:05 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-38c21073-4885-455e-b355-68f9330a870c tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 21d1afa4-bf4b-476c-88a0-ddf76002cac6 {{(pid=74743) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 17:32:09 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:32:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:32:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:32:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:32:24 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:32:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:32:25 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-38c21073-4885-455e-b355-68f9330a870c tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 21d1afa4-bf4b-476c-88a0-ddf76002cac6 is timed out.
Nov 18 17:32:25 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-38c21073-4885-455e-b355-68f9330a870c tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Successfully detached device vdb from instance 21d1afa4-bf4b-476c-88a0-ddf76002cac6 from the live domain config.
Nov 18 17:32:25 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38c21073-4885-455e-b355-68f9330a870c tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] calling os-brick to detach iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 17:32:25 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-38c21073-4885-455e-b355-68f9330a870c tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, {'target_iqn': 'iqn.2010-10.org.openstack:beaea375-1643-48e5-8e18-674607ea3873', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZMThDxPz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:32:25 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-38c21073-4885-455e-b355-68f9330a870c tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:32:25 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-38c21073-4885-455e-b355-68f9330a870c tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:32:25 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-38c21073-4885-455e-b355-68f9330a870c tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:32:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:32:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:32:26 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdba99f8-d05f-47ba-bcb7-a15402d4800f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:beaea375-1643-48e5-8e18-674607ea3873\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:32:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-38c21073-4885-455e-b355-68f9330a870c tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 17:32:26 user nova-compute[74743]: No targets found.
Nov 18 17:32:26 user nova-compute[74743]: iSNS:
Nov 18 17:32:26 user nova-compute[74743]: No targets found.
Nov 18 17:32:26 user nova-compute[74743]: STATIC:
Nov 18 17:32:26 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:beaea375-1643-48e5-8e18-674607ea3873
Nov 18 17:32:26 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:32:26 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:32:26 user nova-compute[74743]: FIRMWARE:
Nov 18 17:32:26 user nova-compute[74743]: No targets found.
Nov 18 17:32:26 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:32:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-38c21073-4885-455e-b355-68f9330a870c tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 17:32:26 user nova-compute[74743]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 17:32:26 user nova-compute[74743]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74743) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 17:32:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-38c21073-4885-455e-b355-68f9330a870c tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:beaea375-1643-48e5-8e18-674607ea3873', 0)] {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 17:32:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:32:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:32:26 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fea867a-a01a-495a-b33a-5a2dcebc2345]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:beaea375-1643-48e5-8e18-674607ea3873\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:32:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:32:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:32:26 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9e9502-80f3-4837-acf9-e069bb60a6a9]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beaea375-1643-48e5-8e18-674607ea3873 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:32:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-38c21073-4885-455e-b355-68f9330a870c tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beaea375-1643-48e5-8e18-674607ea3873 (non-flash)
Nov 18 17:32:26 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:32:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-38c21073-4885-455e-b355-68f9330a870c tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beaea375-1643-48e5-8e18-674607ea3873 (non-flash)
Nov 18 17:32:26 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:32:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-38c21073-4885-455e-b355-68f9330a870c tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb085915a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:beaea375-1643-48e5-8e18-674607ea3873'): ({'sdb'}, set())}) {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 17:32:26 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-38c21073-4885-455e-b355-68f9330a870c tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Removing single pathed devices sdb {{(pid=74743) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 17:32:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:32:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:32:26 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[037c48dd-dcc9-48e8-bd82-bc4958d65ad7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:32:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:32:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:32:26 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec99210-996a-45b8-b53c-1c950036e13b]: (4, ('ok\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:32:26 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-38c21073-4885-455e-b355-68f9330a870c tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Flushing IO for device /dev/sdb {{(pid=74743) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 17:32:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:32:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:32:26 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[516bb2ca-20cd-467e-ba24-a244e2628328]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:32:26 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-38c21073-4885-455e-b355-68f9330a870c tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74743) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 17:32:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:32:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:32:26 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[192d0c65-f983-419c-9910-d4d511194572]: (4, ('1', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:32:26 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-38c21073-4885-455e-b355-68f9330a870c tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 17:32:26 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-38c21073-4885-455e-b355-68f9330a870c tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] SCSI volumes sdb have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 17:32:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-38c21073-4885-455e-b355-68f9330a870c tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:beaea375-1643-48e5-8e18-674607ea3873')] {{(pid=74743) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 17:32:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beaea375-1643-48e5-8e18-674607ea3873 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:32:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beaea375-1643-48e5-8e18-674607ea3873 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:32:26 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93c47e3-182a-4f79-9387-2f209d8f0cdd]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:32:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-38c21073-4885-455e-b355-68f9330a870c tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:32:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beaea375-1643-48e5-8e18-674607ea3873 -p 172.16.0.220:3260 --logout {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:32:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beaea375-1643-48e5-8e18-674607ea3873 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:32:26 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a82a487-0266-4fda-b854-80b1ce74db4e]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:beaea375-1643-48e5-8e18-674607ea3873, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:beaea375-1643-48e5-8e18-674607ea3873, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:32:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-38c21073-4885-455e-b355-68f9330a870c tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:beaea375-1643-48e5-8e18-674607ea3873, portal: 172.16.0.220,3260]
Nov 18 17:32:26 user nova-compute[74743]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:beaea375-1643-48e5-8e18-674607ea3873, portal: 172.16.0.220,3260] successful.
Nov 18 17:32:26 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:32:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beaea375-1643-48e5-8e18-674607ea3873 -p 172.16.0.220:3260 --op delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:32:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beaea375-1643-48e5-8e18-674607ea3873 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:32:26 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a68b91f-cfe5-425e-aa61-4a2a636dce54]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:32:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-38c21073-4885-455e-b355-68f9330a870c tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:32:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-38c21073-4885-455e-b355-68f9330a870c tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:32:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-38c21073-4885-455e-b355-68f9330a870c tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] <== disconnect_volume: return (274ms) None {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:32:26 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38c21073-4885-455e-b355-68f9330a870c tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Disconnected iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 17:32:26 user nova-compute[74743]: DEBUG nova.objects.instance [None req-38c21073-4885-455e-b355-68f9330a870c tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lazy-loading 'flavor' on Instance uuid 21d1afa4-bf4b-476c-88a0-ddf76002cac6 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:32:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-38c21073-4885-455e-b355-68f9330a870c tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "21d1afa4-bf4b-476c-88a0-ddf76002cac6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.591s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:32:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:32:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:32:35 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:32:35 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:32:35 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74743) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 17:32:37 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:32:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:32:41 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:32:42 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:32:44 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:32:46 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:32:46 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:32:46 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:32:46 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:32:46 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Auditing locally available compute resources for user (node: user) {{(pid=74743) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 17:32:46 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d1afa4-bf4b-476c-88a0-ddf76002cac6/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:32:46 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d1afa4-bf4b-476c-88a0-ddf76002cac6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:32:46 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d1afa4-bf4b-476c-88a0-ddf76002cac6/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:32:46 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d1afa4-bf4b-476c-88a0-ddf76002cac6/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:32:46 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:32:47 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:32:47 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:32:47 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:32:47 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:32:47 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:32:47 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Hypervisor/Node resource view: name=user free_ram=8857MB free_disk=25.3060302734375GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74743) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 17:32:47 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:32:47 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:32:47 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 21d1afa4-bf4b-476c-88a0-ddf76002cac6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:32:47 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:32:47 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 17:32:47 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 17:32:47 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:32:47 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:32:47 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Compute_service record updated for user:user {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 17:32:47 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.223s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:32:48 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:32:48 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:32:48 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Starting heal instance info cache {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 17:32:48 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "refresh_cache-69d7f224-23d7-4d0e-8bb5-8db35a8ee4de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:32:48 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquired lock "refresh_cache-69d7f224-23d7-4d0e-8bb5-8db35a8ee4de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:32:48 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Forcefully refreshing network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 17:32:49 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Updating instance_info_cache with network_info: [{"id": "d22822e2-3327-4efc-8aa0-55a47b73c5bf", "address": "fa:16:3e:25:10:56", "network": {"id": "97b8f910-abe2-43b1-98c4-c7b52200906f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1194489190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce2bcb9ffb2749128da81f4c2df7f6c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd22822e2-33", "ovs_interfaceid": "d22822e2-3327-4efc-8aa0-55a47b73c5bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:32:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Releasing lock "refresh_cache-69d7f224-23d7-4d0e-8bb5-8db35a8ee4de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:32:49 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Updated the network info_cache for instance {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 17:32:49 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:32:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:32:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:32:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-adf76b12-c38b-4092-bc17-9452a4c0a279 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquiring lock "21d1afa4-bf4b-476c-88a0-ddf76002cac6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:32:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-adf76b12-c38b-4092-bc17-9452a4c0a279 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "21d1afa4-bf4b-476c-88a0-ddf76002cac6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:32:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-adf76b12-c38b-4092-bc17-9452a4c0a279 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquiring lock "21d1afa4-bf4b-476c-88a0-ddf76002cac6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:32:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-adf76b12-c38b-4092-bc17-9452a4c0a279 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "21d1afa4-bf4b-476c-88a0-ddf76002cac6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:32:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-adf76b12-c38b-4092-bc17-9452a4c0a279 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "21d1afa4-bf4b-476c-88a0-ddf76002cac6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:32:55 user nova-compute[74743]: INFO nova.compute.manager [None req-adf76b12-c38b-4092-bc17-9452a4c0a279 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Terminating instance
Nov 18 17:32:55 user nova-compute[74743]: DEBUG nova.compute.manager [None req-adf76b12-c38b-4092-bc17-9452a4c0a279 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Start destroying the instance on the hypervisor. {{(pid=74743) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 17:32:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:32:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:32:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:32:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:32:56 user nova-compute[74743]: DEBUG nova.compute.manager [req-4f6d2ae7-1060-4704-b1f7-f48a4d6212af req-44957bf1-6196-458a-9086-515a7e9ab248 service nova] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Received event network-vif-unplugged-133bae79-0949-485f-b364-9886ed4b69a9 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:32:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4f6d2ae7-1060-4704-b1f7-f48a4d6212af req-44957bf1-6196-458a-9086-515a7e9ab248 service nova] Acquiring lock "21d1afa4-bf4b-476c-88a0-ddf76002cac6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:32:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4f6d2ae7-1060-4704-b1f7-f48a4d6212af req-44957bf1-6196-458a-9086-515a7e9ab248 service nova] Lock "21d1afa4-bf4b-476c-88a0-ddf76002cac6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:32:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4f6d2ae7-1060-4704-b1f7-f48a4d6212af req-44957bf1-6196-458a-9086-515a7e9ab248 service nova] Lock "21d1afa4-bf4b-476c-88a0-ddf76002cac6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:32:56 user nova-compute[74743]: DEBUG nova.compute.manager [req-4f6d2ae7-1060-4704-b1f7-f48a4d6212af req-44957bf1-6196-458a-9086-515a7e9ab248 service nova] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] No waiting events found dispatching network-vif-unplugged-133bae79-0949-485f-b364-9886ed4b69a9 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:32:56 user nova-compute[74743]: DEBUG nova.compute.manager [req-4f6d2ae7-1060-4704-b1f7-f48a4d6212af req-44957bf1-6196-458a-9086-515a7e9ab248 service nova] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Received event network-vif-unplugged-133bae79-0949-485f-b364-9886ed4b69a9 for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:32:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:32:56 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Instance destroyed successfully.
Nov 18 17:32:56 user nova-compute[74743]: DEBUG nova.objects.instance [None req-adf76b12-c38b-4092-bc17-9452a4c0a279 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lazy-loading 'resources' on Instance uuid 21d1afa4-bf4b-476c-88a0-ddf76002cac6 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:32:56 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-adf76b12-c38b-4092-bc17-9452a4c0a279 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:30:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-295911454',display_name='tempest-AttachVolumeNegativeTest-server-295911454',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-295911454',id=44,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHLE2yVfxueswEPlR5OLnAgYgiLhRnotojp8xMZpXH4CsG3cR6pDVP2uo/K49mRt2vmyfz0WvI7zmxw4hKTvX+l9qYg9zIk+w4VT9IN62U6YUWCjnUDoaejcENWlg6B8Q==',key_name='tempest-keypair-25753312',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:30:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5502edf6a6b94cb59d58d52494efc90d',ramdisk_id='',reservation_id='r-hyth7vxm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1149732113',owner_user_name='tempest-AttachVolumeNegativeTest-1149732113-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:30:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35aedc702bc4444eb3802772a523ba79',uuid=21d1afa4-bf4b-476c-88a0-ddf76002cac6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "133bae79-0949-485f-b364-9886ed4b69a9", "address": "fa:16:3e:30:62:06", "network": {"id": "b03d3355-7704-43de-8af7-7a5dc1ee490d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1492507432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5502edf6a6b94cb59d58d52494efc90d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap133bae79-09", "ovs_interfaceid": "133bae79-0949-485f-b364-9886ed4b69a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:32:56 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-adf76b12-c38b-4092-bc17-9452a4c0a279 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Converting VIF {"id": "133bae79-0949-485f-b364-9886ed4b69a9", "address": "fa:16:3e:30:62:06", "network": {"id": "b03d3355-7704-43de-8af7-7a5dc1ee490d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1492507432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5502edf6a6b94cb59d58d52494efc90d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap133bae79-09", "ovs_interfaceid": "133bae79-0949-485f-b364-9886ed4b69a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:32:56 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-adf76b12-c38b-4092-bc17-9452a4c0a279 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:62:06,bridge_name='br-int',has_traffic_filtering=True,id=133bae79-0949-485f-b364-9886ed4b69a9,network=Network(b03d3355-7704-43de-8af7-7a5dc1ee490d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap133bae79-09') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:32:56 user nova-compute[74743]: DEBUG os_vif [None req-adf76b12-c38b-4092-bc17-9452a4c0a279 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:62:06,bridge_name='br-int',has_traffic_filtering=True,id=133bae79-0949-485f-b364-9886ed4b69a9,network=Network(b03d3355-7704-43de-8af7-7a5dc1ee490d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap133bae79-09') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:32:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:32:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap133bae79-09, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:32:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:32:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:32:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3f363c7c-38bd-49d8-9258-4a3ebdfc2f44) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:32:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:32:56 user nova-compute[74743]: INFO os_vif [None req-adf76b12-c38b-4092-bc17-9452a4c0a279 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:62:06,bridge_name='br-int',has_traffic_filtering=True,id=133bae79-0949-485f-b364-9886ed4b69a9,network=Network(b03d3355-7704-43de-8af7-7a5dc1ee490d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap133bae79-09')
Nov 18 17:32:56 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-adf76b12-c38b-4092-bc17-9452a4c0a279 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Deleting instance files /opt/stack/data/nova/instances/21d1afa4-bf4b-476c-88a0-ddf76002cac6_del
Nov 18 17:32:56 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-adf76b12-c38b-4092-bc17-9452a4c0a279 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Deletion of /opt/stack/data/nova/instances/21d1afa4-bf4b-476c-88a0-ddf76002cac6_del complete
Nov 18 17:32:56 user nova-compute[74743]: INFO nova.compute.manager [None req-adf76b12-c38b-4092-bc17-9452a4c0a279 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 18 17:32:56 user nova-compute[74743]: DEBUG oslo.service.loopingcall [None req-adf76b12-c38b-4092-bc17-9452a4c0a279 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74743) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 17:32:56 user nova-compute[74743]: DEBUG nova.compute.manager [-] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Deallocating network for instance {{(pid=74743) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 17:32:56 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] deallocate_for_instance() {{(pid=74743) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 17:32:57 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:32:57 user nova-compute[74743]: INFO nova.compute.manager [-] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Took 0.67 seconds to deallocate network for instance.
Nov 18 17:32:57 user nova-compute[74743]: DEBUG nova.compute.manager [req-911b944c-32c4-4bd9-9055-0bee9e662de3 req-30456638-4e05-40f7-9b67-d811f26b4062 service nova] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Received event network-vif-deleted-133bae79-0949-485f-b364-9886ed4b69a9 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:32:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-adf76b12-c38b-4092-bc17-9452a4c0a279 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:32:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-adf76b12-c38b-4092-bc17-9452a4c0a279 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:32:57 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-adf76b12-c38b-4092-bc17-9452a4c0a279 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:32:57 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-adf76b12-c38b-4092-bc17-9452a4c0a279 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:32:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-adf76b12-c38b-4092-bc17-9452a4c0a279 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.133s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:32:57 user nova-compute[74743]: INFO nova.scheduler.client.report [None req-adf76b12-c38b-4092-bc17-9452a4c0a279 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Deleted allocations for instance 21d1afa4-bf4b-476c-88a0-ddf76002cac6
Nov 18 17:32:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-adf76b12-c38b-4092-bc17-9452a4c0a279 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "21d1afa4-bf4b-476c-88a0-ddf76002cac6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.834s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:32:58 user nova-compute[74743]: DEBUG nova.compute.manager [req-a6895f71-44a1-49cf-8106-789e2f9e7e43 req-1e401bf4-c5bf-4521-a64b-7032d47de5a6 service nova] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Received event network-vif-plugged-133bae79-0949-485f-b364-9886ed4b69a9 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:32:58 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a6895f71-44a1-49cf-8106-789e2f9e7e43 req-1e401bf4-c5bf-4521-a64b-7032d47de5a6 service nova] Acquiring lock "21d1afa4-bf4b-476c-88a0-ddf76002cac6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:32:58 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a6895f71-44a1-49cf-8106-789e2f9e7e43 req-1e401bf4-c5bf-4521-a64b-7032d47de5a6 service nova] Lock "21d1afa4-bf4b-476c-88a0-ddf76002cac6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:32:58 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a6895f71-44a1-49cf-8106-789e2f9e7e43 req-1e401bf4-c5bf-4521-a64b-7032d47de5a6 service nova] Lock "21d1afa4-bf4b-476c-88a0-ddf76002cac6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:32:58 user nova-compute[74743]: DEBUG nova.compute.manager [req-a6895f71-44a1-49cf-8106-789e2f9e7e43 req-1e401bf4-c5bf-4521-a64b-7032d47de5a6 service nova] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] No waiting events found dispatching network-vif-plugged-133bae79-0949-485f-b364-9886ed4b69a9 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:32:58 user nova-compute[74743]: WARNING nova.compute.manager [req-a6895f71-44a1-49cf-8106-789e2f9e7e43 req-1e401bf4-c5bf-4521-a64b-7032d47de5a6 service nova] [instance: 21d1afa4-bf4b-476c-88a0-ddf76002cac6] Received unexpected event network-vif-plugged-133bae79-0949-485f-b364-9886ed4b69a9 for instance with vm_state deleted and task_state None.
Nov 18 17:33:01 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:33:02 user nova-compute[74743]: DEBUG nova.compute.manager [req-f664b5e3-7db4-4ccc-9a30-ff2ac8f54685 req-e132bee9-74b6-4d97-b77c-86b61a5e3818 service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Received event network-changed-d22822e2-3327-4efc-8aa0-55a47b73c5bf {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:33:02 user nova-compute[74743]: DEBUG nova.compute.manager [req-f664b5e3-7db4-4ccc-9a30-ff2ac8f54685 req-e132bee9-74b6-4d97-b77c-86b61a5e3818 service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Refreshing instance network info cache due to event network-changed-d22822e2-3327-4efc-8aa0-55a47b73c5bf. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:33:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f664b5e3-7db4-4ccc-9a30-ff2ac8f54685 req-e132bee9-74b6-4d97-b77c-86b61a5e3818 service nova] Acquiring lock "refresh_cache-69d7f224-23d7-4d0e-8bb5-8db35a8ee4de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:33:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f664b5e3-7db4-4ccc-9a30-ff2ac8f54685 req-e132bee9-74b6-4d97-b77c-86b61a5e3818 service nova] Acquired lock "refresh_cache-69d7f224-23d7-4d0e-8bb5-8db35a8ee4de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:33:02 user nova-compute[74743]: DEBUG nova.network.neutron [req-f664b5e3-7db4-4ccc-9a30-ff2ac8f54685 req-e132bee9-74b6-4d97-b77c-86b61a5e3818 service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Refreshing network info cache for port d22822e2-3327-4efc-8aa0-55a47b73c5bf {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:33:03 user nova-compute[74743]: DEBUG nova.network.neutron [req-f664b5e3-7db4-4ccc-9a30-ff2ac8f54685 req-e132bee9-74b6-4d97-b77c-86b61a5e3818 service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Updated VIF entry in instance network info cache for port d22822e2-3327-4efc-8aa0-55a47b73c5bf. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:33:03 user nova-compute[74743]: DEBUG nova.network.neutron [req-f664b5e3-7db4-4ccc-9a30-ff2ac8f54685 req-e132bee9-74b6-4d97-b77c-86b61a5e3818 service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Updating instance_info_cache with network_info: [{"id": "d22822e2-3327-4efc-8aa0-55a47b73c5bf", "address": "fa:16:3e:25:10:56", "network": {"id": "97b8f910-abe2-43b1-98c4-c7b52200906f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1194489190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce2bcb9ffb2749128da81f4c2df7f6c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd22822e2-33", "ovs_interfaceid": "d22822e2-3327-4efc-8aa0-55a47b73c5bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:33:03 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f664b5e3-7db4-4ccc-9a30-ff2ac8f54685 req-e132bee9-74b6-4d97-b77c-86b61a5e3818 service nova] Releasing lock "refresh_cache-69d7f224-23d7-4d0e-8bb5-8db35a8ee4de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:33:04 user nova-compute[74743]: DEBUG nova.compute.manager [None req-380616d4-28f0-4ff7-b265-07b48e0349e4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:33:04 user nova-compute[74743]: INFO nova.compute.manager [None req-380616d4-28f0-4ff7-b265-07b48e0349e4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] instance snapshotting
Nov 18 17:33:04 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-380616d4-28f0-4ff7-b265-07b48e0349e4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Beginning live snapshot process
Nov 18 17:33:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-380616d4-28f0-4ff7-b265-07b48e0349e4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/disk --force-share --output=json -f qcow2 {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:33:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-380616d4-28f0-4ff7-b265-07b48e0349e4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:33:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-380616d4-28f0-4ff7-b265-07b48e0349e4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/disk --force-share --output=json -f qcow2 {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:33:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-380616d4-28f0-4ff7-b265-07b48e0349e4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/disk --force-share --output=json -f qcow2" returned: 0 in 0.201s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:33:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-380616d4-28f0-4ff7-b265-07b48e0349e4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:33:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-380616d4-28f0-4ff7-b265-07b48e0349e4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.170s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:33:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-380616d4-28f0-4ff7-b265-07b48e0349e4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpw_4ihbpa/117d8ac2bc0c4c52a51015d15c38bc11.delta 1073741824 {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:33:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-380616d4-28f0-4ff7-b265-07b48e0349e4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpw_4ihbpa/117d8ac2bc0c4c52a51015d15c38bc11.delta 1073741824" returned: 0 in 0.087s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:33:04 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-380616d4-28f0-4ff7-b265-07b48e0349e4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 18 17:33:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:33:05 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-380616d4-28f0-4ff7-b265-07b48e0349e4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74743) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 17:33:06 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-380616d4-28f0-4ff7-b265-07b48e0349e4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74743) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 17:33:06 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-380616d4-28f0-4ff7-b265-07b48e0349e4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 18 17:33:06 user nova-compute[74743]: DEBUG nova.privsep.utils [None req-380616d4-28f0-4ff7-b265-07b48e0349e4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74743) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 18 17:33:06 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-380616d4-28f0-4ff7-b265-07b48e0349e4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpw_4ihbpa/117d8ac2bc0c4c52a51015d15c38bc11.delta /opt/stack/data/nova/instances/snapshots/tmpw_4ihbpa/117d8ac2bc0c4c52a51015d15c38bc11 {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:33:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:33:06 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-380616d4-28f0-4ff7-b265-07b48e0349e4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpw_4ihbpa/117d8ac2bc0c4c52a51015d15c38bc11.delta /opt/stack/data/nova/instances/snapshots/tmpw_4ihbpa/117d8ac2bc0c4c52a51015d15c38bc11" returned: 0 in 0.640s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:33:06 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-380616d4-28f0-4ff7-b265-07b48e0349e4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Snapshot extracted, beginning image upload
Nov 18 17:33:09 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-380616d4-28f0-4ff7-b265-07b48e0349e4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Snapshot image upload complete
Nov 18 17:33:09 user nova-compute[74743]: INFO nova.compute.manager [None req-380616d4-28f0-4ff7-b265-07b48e0349e4 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Took 5.19 seconds to snapshot the instance on the hypervisor.
Nov 18 17:33:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:33:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:33:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:33:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:33:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:33:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:33:31 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:33:35 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:33:36 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:33:36 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:33:36 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74743) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 17:33:36 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:33:38 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:33:41 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:33:43 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:33:44 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:33:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:33:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:33:47 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:33:47 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:33:47 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:33:47 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:33:47 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:33:47 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Auditing locally available compute resources for user (node: user) {{(pid=74743) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 17:33:47 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:33:47 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:33:47 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:33:47 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:33:48 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:33:48 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:33:48 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Hypervisor/Node resource view: name=user free_ram=8939MB free_disk=25.284053802490234GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74743) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 17:33:48 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:33:48 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:33:48 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:33:48 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 17:33:48 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 17:33:48 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:33:48 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:33:48 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Compute_service record updated for user:user {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 17:33:48 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.209s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:33:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquiring lock "f9fefe0e-1346-4669-b363-9ce3e6a51502" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:33:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "f9fefe0e-1346-4669-b363-9ce3e6a51502" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:33:49 user nova-compute[74743]: DEBUG nova.compute.manager [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Starting instance... {{(pid=74743) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 17:33:49 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:33:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:33:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:33:49 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74743) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 17:33:49 user nova-compute[74743]: INFO nova.compute.claims [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Claim successful on node user
Nov 18 17:33:49 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:33:49 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:33:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.229s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:33:49 user nova-compute[74743]: DEBUG nova.compute.manager [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Start building networks asynchronously for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 17:33:49 user nova-compute[74743]: DEBUG nova.compute.manager [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Allocating IP information in the background. {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 17:33:49 user nova-compute[74743]: DEBUG nova.network.neutron [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] allocate_for_instance() {{(pid=74743) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 17:33:49 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 17:33:49 user nova-compute[74743]: DEBUG nova.compute.manager [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Start building block device mappings for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 17:33:49 user nova-compute[74743]: DEBUG nova.policy [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '35aedc702bc4444eb3802772a523ba79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5502edf6a6b94cb59d58d52494efc90d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74743) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 17:33:50 user nova-compute[74743]: DEBUG nova.compute.manager [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Start spawning the instance on the hypervisor. {{(pid=74743) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 17:33:50 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Creating instance directory {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 17:33:50 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Creating image(s)
Nov 18 17:33:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquiring lock "/opt/stack/data/nova/instances/f9fefe0e-1346-4669-b363-9ce3e6a51502/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:33:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "/opt/stack/data/nova/instances/f9fefe0e-1346-4669-b363-9ce3e6a51502/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:33:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "/opt/stack/data/nova/instances/f9fefe0e-1346-4669-b363-9ce3e6a51502/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:33:50 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:33:50 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.177s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:33:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquiring lock "c188b3a997bfafa42fa341f9dcc326545681eed9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:33:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:33:50 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:33:50 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.181s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:33:50 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/f9fefe0e-1346-4669-b363-9ce3e6a51502/disk 1073741824 {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:33:50 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/f9fefe0e-1346-4669-b363-9ce3e6a51502/disk 1073741824" returned: 0 in 0.046s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:33:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:33:50 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:33:50 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:33:50 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Starting heal instance info cache {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 17:33:50 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Rebuilding the list of instances to heal {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 17:33:50 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Skipping network cache update for instance because it is Building. {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 18 17:33:50 user nova-compute[74743]: DEBUG nova.network.neutron [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Successfully created port: fc7b67ca-67bb-4d59-afc9-28d33c907392 {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:33:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "refresh_cache-69d7f224-23d7-4d0e-8bb5-8db35a8ee4de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:33:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquired lock "refresh_cache-69d7f224-23d7-4d0e-8bb5-8db35a8ee4de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:33:50 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Forcefully refreshing network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 17:33:50 user nova-compute[74743]: DEBUG nova.objects.instance [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lazy-loading 'info_cache' on Instance uuid 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:33:50 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.186s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:33:50 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f9fefe0e-1346-4669-b363-9ce3e6a51502/disk. size=1073741824 {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 17:33:50 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9fefe0e-1346-4669-b363-9ce3e6a51502/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:33:50 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9fefe0e-1346-4669-b363-9ce3e6a51502/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:33:50 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Cannot resize image /opt/stack/data/nova/instances/f9fefe0e-1346-4669-b363-9ce3e6a51502/disk to a smaller size. {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 17:33:50 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Created local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 17:33:50 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Ensure instance console log exists: /opt/stack/data/nova/instances/f9fefe0e-1346-4669-b363-9ce3e6a51502/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:33:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:33:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:33:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:33:51 user nova-compute[74743]: DEBUG nova.network.neutron [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Successfully updated port: fc7b67ca-67bb-4d59-afc9-28d33c907392 {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:33:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquiring lock "refresh_cache-f9fefe0e-1346-4669-b363-9ce3e6a51502" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:33:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquired lock "refresh_cache-f9fefe0e-1346-4669-b363-9ce3e6a51502" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:33:51 user nova-compute[74743]: DEBUG nova.network.neutron [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:33:51 user nova-compute[74743]: DEBUG nova.compute.manager [req-a70d52da-ba58-43e3-a066-51daa9a1c45f req-01712ddf-5e13-48f6-86b2-c2f1d362d09c service nova] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Received event network-changed-fc7b67ca-67bb-4d59-afc9-28d33c907392 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:33:51 user nova-compute[74743]: DEBUG nova.compute.manager [req-a70d52da-ba58-43e3-a066-51daa9a1c45f req-01712ddf-5e13-48f6-86b2-c2f1d362d09c service nova] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Refreshing instance network info cache due to event network-changed-fc7b67ca-67bb-4d59-afc9-28d33c907392. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:33:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a70d52da-ba58-43e3-a066-51daa9a1c45f req-01712ddf-5e13-48f6-86b2-c2f1d362d09c service nova] Acquiring lock "refresh_cache-f9fefe0e-1346-4669-b363-9ce3e6a51502" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:33:51 user nova-compute[74743]: DEBUG nova.network.neutron [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:33:51 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Updating instance_info_cache with network_info: [{"id": "d22822e2-3327-4efc-8aa0-55a47b73c5bf", "address": "fa:16:3e:25:10:56", "network": {"id": "97b8f910-abe2-43b1-98c4-c7b52200906f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1194489190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce2bcb9ffb2749128da81f4c2df7f6c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd22822e2-33", "ovs_interfaceid": "d22822e2-3327-4efc-8aa0-55a47b73c5bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:33:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Releasing lock "refresh_cache-69d7f224-23d7-4d0e-8bb5-8db35a8ee4de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:33:51 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Updated the network info_cache for instance {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 17:33:51 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:33:51 user nova-compute[74743]: DEBUG nova.network.neutron [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Updating instance_info_cache with network_info: [{"id": "fc7b67ca-67bb-4d59-afc9-28d33c907392", "address": "fa:16:3e:a1:90:cd", "network": {"id": "b03d3355-7704-43de-8af7-7a5dc1ee490d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1492507432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5502edf6a6b94cb59d58d52494efc90d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc7b67ca-67", "ovs_interfaceid": "fc7b67ca-67bb-4d59-afc9-28d33c907392", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:33:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Releasing lock "refresh_cache-f9fefe0e-1346-4669-b363-9ce3e6a51502" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:33:51 user nova-compute[74743]: DEBUG nova.compute.manager [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Instance network_info: |[{"id": "fc7b67ca-67bb-4d59-afc9-28d33c907392", "address": "fa:16:3e:a1:90:cd", "network": {"id": "b03d3355-7704-43de-8af7-7a5dc1ee490d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1492507432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5502edf6a6b94cb59d58d52494efc90d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc7b67ca-67", "ovs_interfaceid": "fc7b67ca-67bb-4d59-afc9-28d33c907392", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 17:33:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a70d52da-ba58-43e3-a066-51daa9a1c45f req-01712ddf-5e13-48f6-86b2-c2f1d362d09c service nova] Acquired lock "refresh_cache-f9fefe0e-1346-4669-b363-9ce3e6a51502" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:33:51 user nova-compute[74743]: DEBUG nova.network.neutron [req-a70d52da-ba58-43e3-a066-51daa9a1c45f req-01712ddf-5e13-48f6-86b2-c2f1d362d09c service nova] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Refreshing network info cache for port fc7b67ca-67bb-4d59-afc9-28d33c907392 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:33:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Start _get_guest_xml network_info=[{"id": "fc7b67ca-67bb-4d59-afc9-28d33c907392", "address": "fa:16:3e:a1:90:cd", "network": {"id": "b03d3355-7704-43de-8af7-7a5dc1ee490d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1492507432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5502edf6a6b94cb59d58d52494efc90d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc7b67ca-67", "ovs_interfaceid": "fc7b67ca-67bb-4d59-afc9-28d33c907392", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '9536f6cf-95c4-40e2-864a-09a91525678a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:33:51 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:33:51 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:33:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:33:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:33:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:33:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:33:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:33:51 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:33:51 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:33:51 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:33:51 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:33:51 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:33:51 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:33:51 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:33:51 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:33:51 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:33:51 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:33:51 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:33:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:33:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1325740500',display_name='tempest-AttachVolumeNegativeTest-server-1325740500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1325740500',id=46,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPhng43WTYJ2Z9fjIMsersv/XsSgsJc2EDotNaOLHR9x68yVpSX/Rz2uYbTXqbclo29o4y7rMM5MM9yBhKeU72KctcEoraq9wQi73Boo4QT6vyg6NA8IFB5/xrVa0cd3Q==',key_name='tempest-keypair-1368191867',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5502edf6a6b94cb59d58d52494efc90d',ramdisk_id='',reservation_id='r-8gfzj4rl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1149732113',owner_user_name='tempest-AttachVolumeNegativeTest-1149732113-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:33:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35aedc702bc4444eb3802772a523ba79',uuid=f9fefe0e-1346-4669-b363-9ce3e6a51502,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc7b67ca-67bb-4d59-afc9-28d33c907392", "address": "fa:16:3e:a1:90:cd", "network": {"id": "b03d3355-7704-43de-8af7-7a5dc1ee490d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1492507432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5502edf6a6b94cb59d58d52494efc90d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc7b67ca-67", "ovs_interfaceid": "fc7b67ca-67bb-4d59-afc9-28d33c907392", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:33:51 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Converting VIF {"id": "fc7b67ca-67bb-4d59-afc9-28d33c907392", "address": "fa:16:3e:a1:90:cd", "network": {"id": "b03d3355-7704-43de-8af7-7a5dc1ee490d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1492507432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5502edf6a6b94cb59d58d52494efc90d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc7b67ca-67", "ovs_interfaceid": "fc7b67ca-67bb-4d59-afc9-28d33c907392", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:33:51 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:90:cd,bridge_name='br-int',has_traffic_filtering=True,id=fc7b67ca-67bb-4d59-afc9-28d33c907392,network=Network(b03d3355-7704-43de-8af7-7a5dc1ee490d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc7b67ca-67') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:33:51 user nova-compute[74743]: DEBUG nova.objects.instance [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lazy-loading 'pci_devices' on Instance uuid f9fefe0e-1346-4669-b363-9ce3e6a51502 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:33:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:33:51 user nova-compute[74743]:   <uuid>f9fefe0e-1346-4669-b363-9ce3e6a51502</uuid>
Nov 18 17:33:51 user nova-compute[74743]:   <name>instance-0000002e</name>
Nov 18 17:33:51 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:33:51 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:33:51 user nova-compute[74743]:   <metadata>
Nov 18 17:33:51 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:33:51 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:33:51 user nova-compute[74743]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1325740500</nova:name>
Nov 18 17:33:51 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:33:51</nova:creationTime>
Nov 18 17:33:51 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:33:51 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:33:51 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:33:51 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:33:51 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:33:51 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:33:51 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:33:51 user nova-compute[74743]:       <nova:owner>
Nov 18 17:33:51 user nova-compute[74743]:         <nova:user uuid="35aedc702bc4444eb3802772a523ba79">tempest-AttachVolumeNegativeTest-1149732113-project-member</nova:user>
Nov 18 17:33:51 user nova-compute[74743]:         <nova:project uuid="5502edf6a6b94cb59d58d52494efc90d">tempest-AttachVolumeNegativeTest-1149732113</nova:project>
Nov 18 17:33:51 user nova-compute[74743]:       </nova:owner>
Nov 18 17:33:51 user nova-compute[74743]:       <nova:root type="image" uuid="9536f6cf-95c4-40e2-864a-09a91525678a"/>
Nov 18 17:33:51 user nova-compute[74743]:       <nova:ports>
Nov 18 17:33:51 user nova-compute[74743]:         <nova:port uuid="fc7b67ca-67bb-4d59-afc9-28d33c907392">
Nov 18 17:33:51 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 18 17:33:51 user nova-compute[74743]:         </nova:port>
Nov 18 17:33:51 user nova-compute[74743]:       </nova:ports>
Nov 18 17:33:51 user nova-compute[74743]:     </nova:instance>
Nov 18 17:33:51 user nova-compute[74743]:   </metadata>
Nov 18 17:33:51 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:33:51 user nova-compute[74743]:     <system>
Nov 18 17:33:51 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:33:51 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:33:51 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:33:51 user nova-compute[74743]:       <entry name="serial">f9fefe0e-1346-4669-b363-9ce3e6a51502</entry>
Nov 18 17:33:51 user nova-compute[74743]:       <entry name="uuid">f9fefe0e-1346-4669-b363-9ce3e6a51502</entry>
Nov 18 17:33:51 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:33:51 user nova-compute[74743]:     </system>
Nov 18 17:33:51 user nova-compute[74743]:   </sysinfo>
Nov 18 17:33:51 user nova-compute[74743]:   <os>
Nov 18 17:33:51 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:33:51 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:33:51 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:33:51 user nova-compute[74743]:   </os>
Nov 18 17:33:51 user nova-compute[74743]:   <features>
Nov 18 17:33:51 user nova-compute[74743]:     <acpi/>
Nov 18 17:33:51 user nova-compute[74743]:     <apic/>
Nov 18 17:33:51 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:33:51 user nova-compute[74743]:   </features>
Nov 18 17:33:51 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:33:51 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:33:51 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:33:51 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:33:51 user nova-compute[74743]:   </clock>
Nov 18 17:33:51 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:33:51 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:33:51 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:33:51 user nova-compute[74743]:   </cpu>
Nov 18 17:33:51 user nova-compute[74743]:   <devices>
Nov 18 17:33:51 user nova-compute[74743]:     <disk type="file" device="disk">
Nov 18 17:33:51 user nova-compute[74743]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 17:33:51 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/f9fefe0e-1346-4669-b363-9ce3e6a51502/disk"/>
Nov 18 17:33:51 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:33:51 user nova-compute[74743]:     </disk>
Nov 18 17:33:51 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:33:51 user nova-compute[74743]:       <mac address="fa:16:3e:a1:90:cd"/>
Nov 18 17:33:51 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:33:51 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:33:51 user nova-compute[74743]:       <target dev="tapfc7b67ca-67"/>
Nov 18 17:33:51 user nova-compute[74743]:     </interface>
Nov 18 17:33:51 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:33:51 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/f9fefe0e-1346-4669-b363-9ce3e6a51502/console.log" append="off"/>
Nov 18 17:33:51 user nova-compute[74743]:     </serial>
Nov 18 17:33:51 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:33:51 user nova-compute[74743]:     <video>
Nov 18 17:33:51 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:33:51 user nova-compute[74743]:     </video>
Nov 18 17:33:51 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:33:51 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:33:51 user nova-compute[74743]:     </rng>
Nov 18 17:33:51 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:33:51 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:33:51 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:33:51 user nova-compute[74743]:     </memballoon>
Nov 18 17:33:51 user nova-compute[74743]:   </devices>
Nov 18 17:33:51 user nova-compute[74743]: </domain>
Nov 18 17:33:51 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:33:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:33:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1325740500',display_name='tempest-AttachVolumeNegativeTest-server-1325740500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1325740500',id=46,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPhng43WTYJ2Z9fjIMsersv/XsSgsJc2EDotNaOLHR9x68yVpSX/Rz2uYbTXqbclo29o4y7rMM5MM9yBhKeU72KctcEoraq9wQi73Boo4QT6vyg6NA8IFB5/xrVa0cd3Q==',key_name='tempest-keypair-1368191867',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5502edf6a6b94cb59d58d52494efc90d',ramdisk_id='',reservation_id='r-8gfzj4rl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1149732113',owner_user_name='tempest-AttachVolumeNegativeTest-1149732113-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:33:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35aedc702bc4444eb3802772a523ba79',uuid=f9fefe0e-1346-4669-b363-9ce3e6a51502,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc7b67ca-67bb-4d59-afc9-28d33c907392", "address": "fa:16:3e:a1:90:cd", "network": {"id": "b03d3355-7704-43de-8af7-7a5dc1ee490d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1492507432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5502edf6a6b94cb59d58d52494efc90d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc7b67ca-67", "ovs_interfaceid": "fc7b67ca-67bb-4d59-afc9-28d33c907392", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:33:51 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Converting VIF {"id": "fc7b67ca-67bb-4d59-afc9-28d33c907392", "address": "fa:16:3e:a1:90:cd", "network": {"id": "b03d3355-7704-43de-8af7-7a5dc1ee490d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1492507432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5502edf6a6b94cb59d58d52494efc90d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc7b67ca-67", "ovs_interfaceid": "fc7b67ca-67bb-4d59-afc9-28d33c907392", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:33:51 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:90:cd,bridge_name='br-int',has_traffic_filtering=True,id=fc7b67ca-67bb-4d59-afc9-28d33c907392,network=Network(b03d3355-7704-43de-8af7-7a5dc1ee490d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc7b67ca-67') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:33:51 user nova-compute[74743]: DEBUG os_vif [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:90:cd,bridge_name='br-int',has_traffic_filtering=True,id=fc7b67ca-67bb-4d59-afc9-28d33c907392,network=Network(b03d3355-7704-43de-8af7-7a5dc1ee490d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc7b67ca-67') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:33:51 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:33:51 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:33:51 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:33:51 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:33:51 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5ba888a9-23fc-54aa-bd00-fdcaac5be741', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:33:51 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:33:51 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:33:51 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:33:51 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc7b67ca-67, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:33:51 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfc7b67ca-67, col_values=(('qos', UUID('b22b5096-03ec-4930-b49f-ac51b7ea257b')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:33:51 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfc7b67ca-67, col_values=(('external_ids', {'iface-id': 'fc7b67ca-67bb-4d59-afc9-28d33c907392', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:90:cd', 'vm-uuid': 'f9fefe0e-1346-4669-b363-9ce3e6a51502'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:33:51 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:33:51 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:33:51 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:33:51 user nova-compute[74743]: INFO os_vif [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:90:cd,bridge_name='br-int',has_traffic_filtering=True,id=fc7b67ca-67bb-4d59-afc9-28d33c907392,network=Network(b03d3355-7704-43de-8af7-7a5dc1ee490d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc7b67ca-67')
Nov 18 17:33:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:33:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] No VIF found with MAC fa:16:3e:a1:90:cd, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:33:52 user nova-compute[74743]: DEBUG nova.network.neutron [req-a70d52da-ba58-43e3-a066-51daa9a1c45f req-01712ddf-5e13-48f6-86b2-c2f1d362d09c service nova] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Updated VIF entry in instance network info cache for port fc7b67ca-67bb-4d59-afc9-28d33c907392. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:33:52 user nova-compute[74743]: DEBUG nova.network.neutron [req-a70d52da-ba58-43e3-a066-51daa9a1c45f req-01712ddf-5e13-48f6-86b2-c2f1d362d09c service nova] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Updating instance_info_cache with network_info: [{"id": "fc7b67ca-67bb-4d59-afc9-28d33c907392", "address": "fa:16:3e:a1:90:cd", "network": {"id": "b03d3355-7704-43de-8af7-7a5dc1ee490d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1492507432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5502edf6a6b94cb59d58d52494efc90d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc7b67ca-67", "ovs_interfaceid": "fc7b67ca-67bb-4d59-afc9-28d33c907392", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:33:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a70d52da-ba58-43e3-a066-51daa9a1c45f req-01712ddf-5e13-48f6-86b2-c2f1d362d09c service nova] Releasing lock "refresh_cache-f9fefe0e-1346-4669-b363-9ce3e6a51502" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:33:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:33:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:33:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:33:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:33:53 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:33:53 user nova-compute[74743]: DEBUG nova.compute.manager [req-85feea66-a2d9-4028-8dd0-7003032901bc req-b83eeae7-9a2e-40ef-902d-d20ca4248f54 service nova] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Received event network-vif-plugged-fc7b67ca-67bb-4d59-afc9-28d33c907392 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:33:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-85feea66-a2d9-4028-8dd0-7003032901bc req-b83eeae7-9a2e-40ef-902d-d20ca4248f54 service nova] Acquiring lock "f9fefe0e-1346-4669-b363-9ce3e6a51502-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:33:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-85feea66-a2d9-4028-8dd0-7003032901bc req-b83eeae7-9a2e-40ef-902d-d20ca4248f54 service nova] Lock "f9fefe0e-1346-4669-b363-9ce3e6a51502-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:33:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-85feea66-a2d9-4028-8dd0-7003032901bc req-b83eeae7-9a2e-40ef-902d-d20ca4248f54 service nova] Lock "f9fefe0e-1346-4669-b363-9ce3e6a51502-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:33:53 user nova-compute[74743]: DEBUG nova.compute.manager [req-85feea66-a2d9-4028-8dd0-7003032901bc req-b83eeae7-9a2e-40ef-902d-d20ca4248f54 service nova] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] No waiting events found dispatching network-vif-plugged-fc7b67ca-67bb-4d59-afc9-28d33c907392 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:33:53 user nova-compute[74743]: WARNING nova.compute.manager [req-85feea66-a2d9-4028-8dd0-7003032901bc req-b83eeae7-9a2e-40ef-902d-d20ca4248f54 service nova] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Received unexpected event network-vif-plugged-fc7b67ca-67bb-4d59-afc9-28d33c907392 for instance with vm_state building and task_state spawning.
Nov 18 17:33:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:33:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:33:55 user nova-compute[74743]: DEBUG nova.compute.manager [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:33:55 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Guest created on hypervisor {{(pid=74743) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 17:33:55 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Instance spawned successfully.
Nov 18 17:33:55 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 17:33:55 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Found default for hw_cdrom_bus of ide {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:33:55 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Found default for hw_disk_bus of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:33:55 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Found default for hw_input_bus of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:33:55 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Found default for hw_pointer_model of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:33:55 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Found default for hw_video_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:33:55 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Found default for hw_vif_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:33:55 user nova-compute[74743]: INFO nova.compute.manager [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Took 5.40 seconds to spawn the instance on the hypervisor.
Nov 18 17:33:55 user nova-compute[74743]: DEBUG nova.compute.manager [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:33:55 user nova-compute[74743]: DEBUG nova.compute.manager [req-64dee27d-e72e-4dc3-8925-b03dbc7386e5 req-39337741-391b-4b3f-b89f-525df40bc5ae service nova] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Received event network-vif-plugged-fc7b67ca-67bb-4d59-afc9-28d33c907392 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:33:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-64dee27d-e72e-4dc3-8925-b03dbc7386e5 req-39337741-391b-4b3f-b89f-525df40bc5ae service nova] Acquiring lock "f9fefe0e-1346-4669-b363-9ce3e6a51502-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:33:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-64dee27d-e72e-4dc3-8925-b03dbc7386e5 req-39337741-391b-4b3f-b89f-525df40bc5ae service nova] Lock "f9fefe0e-1346-4669-b363-9ce3e6a51502-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:33:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-64dee27d-e72e-4dc3-8925-b03dbc7386e5 req-39337741-391b-4b3f-b89f-525df40bc5ae service nova] Lock "f9fefe0e-1346-4669-b363-9ce3e6a51502-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:33:55 user nova-compute[74743]: DEBUG nova.compute.manager [req-64dee27d-e72e-4dc3-8925-b03dbc7386e5 req-39337741-391b-4b3f-b89f-525df40bc5ae service nova] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] No waiting events found dispatching network-vif-plugged-fc7b67ca-67bb-4d59-afc9-28d33c907392 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:33:55 user nova-compute[74743]: WARNING nova.compute.manager [req-64dee27d-e72e-4dc3-8925-b03dbc7386e5 req-39337741-391b-4b3f-b89f-525df40bc5ae service nova] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Received unexpected event network-vif-plugged-fc7b67ca-67bb-4d59-afc9-28d33c907392 for instance with vm_state building and task_state spawning.
Nov 18 17:33:55 user nova-compute[74743]: INFO nova.compute.manager [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Took 6.01 seconds to build instance.
Nov 18 17:33:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7f3306e2-984e-4504-91a2-7a66b15e27a3 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "f9fefe0e-1346-4669-b363-9ce3e6a51502" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.101s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:33:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:33:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:34:01 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:34:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:34:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:34:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:34:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:34:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:34:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:34:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:34:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:34:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:34:31 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:34:36 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:34:38 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:34:38 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:34:38 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74743) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 17:34:40 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:34:41 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:34:44 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:34:45 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:34:45 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:34:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:34:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:34:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74743) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 17:34:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:34:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:34:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:34:47 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:34:47 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:34:47 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:34:47 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:34:47 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Auditing locally available compute resources for user (node: user) {{(pid=74743) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 17:34:47 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9fefe0e-1346-4669-b363-9ce3e6a51502/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:34:47 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9fefe0e-1346-4669-b363-9ce3e6a51502/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:34:47 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9fefe0e-1346-4669-b363-9ce3e6a51502/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:34:47 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9fefe0e-1346-4669-b363-9ce3e6a51502/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:34:47 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:34:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:34:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:34:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:34:48 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:34:48 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:34:48 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Hypervisor/Node resource view: name=user free_ram=8874MB free_disk=25.25448989868164GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74743) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 17:34:48 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:34:48 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:34:48 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:34:48 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance f9fefe0e-1346-4669-b363-9ce3e6a51502 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:34:48 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 17:34:48 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 17:34:48 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Refreshing inventories for resource provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 18 17:34:48 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Updating ProviderTree inventory for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 18 17:34:48 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Updating inventory in ProviderTree for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 18 17:34:49 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Refreshing aggregate associations for resource provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8, aggregates: None {{(pid=74743) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 18 17:34:49 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Refreshing trait associations for resource provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=74743) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 18 17:34:49 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:34:49 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:34:49 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Compute_service record updated for user:user {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 17:34:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.504s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:34:49 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:34:49 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Cleaning up deleted instances with incomplete migration  {{(pid=74743) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 18 17:34:51 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:34:51 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:34:51 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:34:51 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Starting heal instance info cache {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 17:34:51 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Rebuilding the list of instances to heal {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 17:34:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "refresh_cache-69d7f224-23d7-4d0e-8bb5-8db35a8ee4de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:34:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquired lock "refresh_cache-69d7f224-23d7-4d0e-8bb5-8db35a8ee4de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:34:51 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Forcefully refreshing network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 17:34:51 user nova-compute[74743]: DEBUG nova.objects.instance [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lazy-loading 'info_cache' on Instance uuid 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:34:51 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:34:51 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Updating instance_info_cache with network_info: [{"id": "d22822e2-3327-4efc-8aa0-55a47b73c5bf", "address": "fa:16:3e:25:10:56", "network": {"id": "97b8f910-abe2-43b1-98c4-c7b52200906f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1194489190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce2bcb9ffb2749128da81f4c2df7f6c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd22822e2-33", "ovs_interfaceid": "d22822e2-3327-4efc-8aa0-55a47b73c5bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:34:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Releasing lock "refresh_cache-69d7f224-23d7-4d0e-8bb5-8db35a8ee4de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:34:52 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Updated the network info_cache for instance {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 17:34:53 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:34:53 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Cleaning up deleted instances {{(pid=74743) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 18 17:34:53 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] There are 0 instances to clean {{(pid=74743) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 18 17:34:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8c818478-3d5f-4101-b797-9e8d37b25bfc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Acquiring lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:34:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8c818478-3d5f-4101-b797-9e8d37b25bfc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:34:55 user nova-compute[74743]: DEBUG nova.objects.instance [None req-8c818478-3d5f-4101-b797-9e8d37b25bfc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Lazy-loading 'flavor' on Instance uuid 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:34:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8c818478-3d5f-4101-b797-9e8d37b25bfc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:34:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8c818478-3d5f-4101-b797-9e8d37b25bfc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Acquiring lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:34:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8c818478-3d5f-4101-b797-9e8d37b25bfc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:34:55 user nova-compute[74743]: INFO nova.compute.manager [None req-8c818478-3d5f-4101-b797-9e8d37b25bfc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Attaching volume 2e6dfa5b-0b85-44db-9143-5418ac8a3722 to /dev/vdb
Nov 18 17:34:55 user nova-compute[74743]: DEBUG os_brick.utils [None req-8c818478-3d5f-4101-b797-9e8d37b25bfc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:34:55 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:34:55 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:34:55 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52d7e73-931d-481b-af26-52b3b39a7fcf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1116acd8874d\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:34:55 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:34:55 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:34:55 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[781c93de-da3f-4054-9e7a-818f0b33d1f0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:34:55 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:34:55 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:34:55 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8cd482f-f30f-4ce2-a0a2-3a05ac4beeb2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:34:55 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[8968e91d-2c58-4227-827d-8bdf1c211f61]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:34:55 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-8c818478-3d5f-4101-b797-9e8d37b25bfc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Running cmd (subprocess): nvme version {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:34:55 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-8c818478-3d5f-4101-b797-9e8d37b25bfc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] 'nvme version' failed. Not Retrying. {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:34:55 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8c818478-3d5f-4101-b797-9e8d37b25bfc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] nvme not present on system {{(pid=74743) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 17:34:55 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:34:55 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:34:55 user nova-compute[74743]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 17:34:55 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[7264f136-aac1-498f-8a5e-ba66f3332f51]: (4, '') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:34:55 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-8c818478-3d5f-4101-b797-9e8d37b25bfc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74743) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 17:34:55 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-8c818478-3d5f-4101-b797-9e8d37b25bfc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 17:34:55 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-8c818478-3d5f-4101-b797-9e8d37b25bfc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] LIGHTOS: no hostnqn found. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 17:34:55 user nova-compute[74743]: DEBUG os_brick.utils [None req-8c818478-3d5f-4101-b797-9e8d37b25bfc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1116acd8874d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:34:55 user nova-compute[74743]: DEBUG nova.virt.block_device [None req-8c818478-3d5f-4101-b797-9e8d37b25bfc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Updating existing volume attachment record: 669857dc-a025-47da-b391-10d464391494 {{(pid=74743) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 17:34:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:35:01 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:35:02 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c818478-3d5f-4101-b797-9e8d37b25bfc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Calling os-brick to attach iSCSI Volume {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 17:35:02 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c818478-3d5f-4101-b797-9e8d37b25bfc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YSFWduvj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:35:02 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-8c818478-3d5f-4101-b797-9e8d37b25bfc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:35:02 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-8c818478-3d5f-4101-b797-9e8d37b25bfc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:35:02 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-8c818478-3d5f-4101-b797-9e8d37b25bfc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:35:02 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-8c818478-3d5f-4101-b797-9e8d37b25bfc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:35:02 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-8c818478-3d5f-4101-b797-9e8d37b25bfc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:35:02 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-8c818478-3d5f-4101-b797-9e8d37b25bfc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:35:02 user nova-compute[74743]: INFO os_brick.initiator.connectors.iscsi [None req-8c818478-3d5f-4101-b797-9e8d37b25bfc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 17:35:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722 -p 172.16.0.220:3260 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:35:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:35:02 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[3000ee13-16c1-4631-9989-d1afe50ca595]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:35:02 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c818478-3d5f-4101-b797-9e8d37b25bfc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 17:35:02 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:35:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722 -p 172.16.0.220:3260 --interface default --op new {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:35:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:35:02 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9bdef80-f37d-469f-869e-6222881e2539]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722] added\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:35:02 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c818478-3d5f-4101-b797-9e8d37b25bfc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722] added
Nov 18 17:35:02 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:35:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:35:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:35:02 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06ccbfe-7051-4f5e-8a20-348cbd235837]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:35:02 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c818478-3d5f-4101-b797-9e8d37b25bfc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:35:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:35:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:35:02 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a835dbd5-31e1-42a3-9425-8a543da0c084]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:35:02 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c818478-3d5f-4101-b797-9e8d37b25bfc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:35:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YSFWduvj {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:35:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YSFWduvj" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:35:02 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c0f161-26b1-43e6-85c7-716729ea57fa]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:35:02 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c818478-3d5f-4101-b797-9e8d37b25bfc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YSFWduvj'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:35:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:35:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:35:02 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[77861123-c3c1-46f4-acfb-95cf8d45a038]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:35:02 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c818478-3d5f-4101-b797-9e8d37b25bfc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:35:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:35:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:35:02 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca037e6-7695-4f98-a3c1-2e58bb101f01]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:35:02 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c818478-3d5f-4101-b797-9e8d37b25bfc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 18 17:35:02 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:35:02 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c818478-3d5f-4101-b797-9e8d37b25bfc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 18 17:35:02 user nova-compute[74743]:  {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:35:02 user nova-compute[74743]: WARNING os_brick.initiator.connectors.iscsi [None req-8c818478-3d5f-4101-b797-9e8d37b25bfc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 18 17:35:02 user nova-compute[74743]: 
Nov 18 17:35:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722 -p 172.16.0.220:3260 --login {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:35:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:35:02 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c92105-04bf-4959-a796-8b32f22de17a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:35:02 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c818478-3d5f-4101-b797-9e8d37b25bfc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722, portal: 172.16.0.220,3260]
Nov 18 17:35:02 user nova-compute[74743]: Login to [iface: default, target: iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722, portal: 172.16.0.220,3260] successful.
Nov 18 17:35:02 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:35:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:35:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:35:02 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a3d58c-1e19-4867-9d26-62faa1a99af0]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:35:02 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c818478-3d5f-4101-b797-9e8d37b25bfc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:35:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:35:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:35:02 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[50caf1a5-d874-4034-8c4d-2971fafbf2ef]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:35:02 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c818478-3d5f-4101-b797-9e8d37b25bfc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722 (non-flash)
Nov 18 17:35:02 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:35:02 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c818478-3d5f-4101-b797-9e8d37b25bfc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722 (non-flash)
Nov 18 17:35:02 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:35:02 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-8c818478-3d5f-4101-b797-9e8d37b25bfc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.236s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:35:02 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c818478-3d5f-4101-b797-9e8d37b25bfc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Connected to 172.16.0.220:3260 {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 17:35:02 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-8c818478-3d5f-4101-b797-9e8d37b25bfc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=74743) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 17:35:02 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-8c818478-3d5f-4101-b797-9e8d37b25bfc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74743) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 17:35:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:35:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:35:02 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f584e21-ce7c-4573-a33c-c344e9df3896]: (4, ('- - 0', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:35:02 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-8c818478-3d5f-4101-b797-9e8d37b25bfc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:35:02 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c818478-3d5f-4101-b797-9e8d37b25bfc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YSFWduvj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 17:35:03 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-8c818478-3d5f-4101-b797-9e8d37b25bfc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.270s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:35:03 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c818478-3d5f-4101-b797-9e8d37b25bfc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] <== connect_volume: return (1272ms) {'type': 'block', 'scsi_wwn': '23236623961353161', 'path': '/dev/sdb'} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:35:03 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c818478-3d5f-4101-b797-9e8d37b25bfc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236623961353161', 'path': '/dev/sdb'} {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 17:35:03 user nova-compute[74743]: DEBUG nova.objects.instance [None req-8c818478-3d5f-4101-b797-9e8d37b25bfc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Lazy-loading 'flavor' on Instance uuid 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:35:03 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-8c818478-3d5f-4101-b797-9e8d37b25bfc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 17:35:03 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:35:03 user nova-compute[74743]:   <source dev="/dev/sdb"/>
Nov 18 17:35:03 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:35:03 user nova-compute[74743]:   <serial>2e6dfa5b-0b85-44db-9143-5418ac8a3722</serial>
Nov 18 17:35:03 user nova-compute[74743]: </disk>
Nov 18 17:35:03 user nova-compute[74743]:  {{(pid=74743) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 17:35:04 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-8c818478-3d5f-4101-b797-9e8d37b25bfc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:35:04 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-8c818478-3d5f-4101-b797-9e8d37b25bfc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:35:04 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-8c818478-3d5f-4101-b797-9e8d37b25bfc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] No VIF found with MAC fa:16:3e:25:10:56, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:35:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8c818478-3d5f-4101-b797-9e8d37b25bfc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.007s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:35:05 user nova-compute[74743]: INFO nova.compute.manager [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Rescuing
Nov 18 17:35:05 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Acquiring lock "refresh_cache-69d7f224-23d7-4d0e-8bb5-8db35a8ee4de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:35:05 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Acquired lock "refresh_cache-69d7f224-23d7-4d0e-8bb5-8db35a8ee4de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:35:05 user nova-compute[74743]: DEBUG nova.network.neutron [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:35:05 user nova-compute[74743]: DEBUG nova.network.neutron [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Updating instance_info_cache with network_info: [{"id": "d22822e2-3327-4efc-8aa0-55a47b73c5bf", "address": "fa:16:3e:25:10:56", "network": {"id": "97b8f910-abe2-43b1-98c4-c7b52200906f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1194489190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce2bcb9ffb2749128da81f4c2df7f6c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd22822e2-33", "ovs_interfaceid": "d22822e2-3327-4efc-8aa0-55a47b73c5bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:35:05 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Releasing lock "refresh_cache-69d7f224-23d7-4d0e-8bb5-8db35a8ee4de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:35:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:35:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:35:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:35:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:35:06 user nova-compute[74743]: DEBUG nova.compute.manager [req-e45dde61-d118-41dd-973d-0ee41eda5029 req-5756a324-5fb4-421f-a500-ddb2bb97b0c6 service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Received event network-vif-unplugged-d22822e2-3327-4efc-8aa0-55a47b73c5bf {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:35:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e45dde61-d118-41dd-973d-0ee41eda5029 req-5756a324-5fb4-421f-a500-ddb2bb97b0c6 service nova] Acquiring lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:35:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e45dde61-d118-41dd-973d-0ee41eda5029 req-5756a324-5fb4-421f-a500-ddb2bb97b0c6 service nova] Lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:35:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e45dde61-d118-41dd-973d-0ee41eda5029 req-5756a324-5fb4-421f-a500-ddb2bb97b0c6 service nova] Lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:35:06 user nova-compute[74743]: DEBUG nova.compute.manager [req-e45dde61-d118-41dd-973d-0ee41eda5029 req-5756a324-5fb4-421f-a500-ddb2bb97b0c6 service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] No waiting events found dispatching network-vif-unplugged-d22822e2-3327-4efc-8aa0-55a47b73c5bf {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:35:06 user nova-compute[74743]: WARNING nova.compute.manager [req-e45dde61-d118-41dd-973d-0ee41eda5029 req-5756a324-5fb4-421f-a500-ddb2bb97b0c6 service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Received unexpected event network-vif-unplugged-d22822e2-3327-4efc-8aa0-55a47b73c5bf for instance with vm_state active and task_state rescuing.
Nov 18 17:35:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:35:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:35:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:35:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:35:06 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Instance destroyed successfully.
Nov 18 17:35:06 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Attempting a stable device rescue
Nov 18 17:35:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:35:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:35:06 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74743) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 18 17:35:06 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Instance directory exists: not creating {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 18 17:35:06 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Creating image(s)
Nov 18 17:35:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Acquiring lock "/opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:35:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Lock "/opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:35:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Lock "/opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:35:06 user nova-compute[74743]: DEBUG nova.objects.instance [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Lazy-loading 'trusted_certs' on Instance uuid 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:35:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Acquiring lock "cda49b6b8a569253893882dbae5c5938462b1c01" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:35:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Lock "cda49b6b8a569253893882dbae5c5938462b1c01" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:35:07 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cda49b6b8a569253893882dbae5c5938462b1c01.part --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:35:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:35:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:35:07 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cda49b6b8a569253893882dbae5c5938462b1c01.part --force-share --output=json" returned: 0 in 0.168s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:35:07 user nova-compute[74743]: DEBUG nova.virt.images [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] a1b32fba-a165-46e8-8cde-8357d72bc973 was qcow2, converting to raw {{(pid=74743) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 18 17:35:07 user nova-compute[74743]: DEBUG nova.privsep.utils [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74743) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 18 17:35:07 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cda49b6b8a569253893882dbae5c5938462b1c01.part /opt/stack/data/nova/instances/_base/cda49b6b8a569253893882dbae5c5938462b1c01.converted {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cda49b6b8a569253893882dbae5c5938462b1c01.part /opt/stack/data/nova/instances/_base/cda49b6b8a569253893882dbae5c5938462b1c01.converted" returned: 0 in 0.296s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cda49b6b8a569253893882dbae5c5938462b1c01.converted --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG nova.compute.manager [req-c96ffe67-35a8-423e-af65-254688b9befd req-b56628b3-db74-45d2-a44c-b2dec687a315 service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Received event network-vif-plugged-d22822e2-3327-4efc-8aa0-55a47b73c5bf {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-c96ffe67-35a8-423e-af65-254688b9befd req-b56628b3-db74-45d2-a44c-b2dec687a315 service nova] Acquiring lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-c96ffe67-35a8-423e-af65-254688b9befd req-b56628b3-db74-45d2-a44c-b2dec687a315 service nova] Lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-c96ffe67-35a8-423e-af65-254688b9befd req-b56628b3-db74-45d2-a44c-b2dec687a315 service nova] Lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG nova.compute.manager [req-c96ffe67-35a8-423e-af65-254688b9befd req-b56628b3-db74-45d2-a44c-b2dec687a315 service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] No waiting events found dispatching network-vif-plugged-d22822e2-3327-4efc-8aa0-55a47b73c5bf {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:35:08 user nova-compute[74743]: WARNING nova.compute.manager [req-c96ffe67-35a8-423e-af65-254688b9befd req-b56628b3-db74-45d2-a44c-b2dec687a315 service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Received unexpected event network-vif-plugged-d22822e2-3327-4efc-8aa0-55a47b73c5bf for instance with vm_state active and task_state rescuing.
Nov 18 17:35:08 user nova-compute[74743]: DEBUG nova.compute.manager [req-c96ffe67-35a8-423e-af65-254688b9befd req-b56628b3-db74-45d2-a44c-b2dec687a315 service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Received event network-vif-plugged-d22822e2-3327-4efc-8aa0-55a47b73c5bf {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-c96ffe67-35a8-423e-af65-254688b9befd req-b56628b3-db74-45d2-a44c-b2dec687a315 service nova] Acquiring lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-c96ffe67-35a8-423e-af65-254688b9befd req-b56628b3-db74-45d2-a44c-b2dec687a315 service nova] Lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-c96ffe67-35a8-423e-af65-254688b9befd req-b56628b3-db74-45d2-a44c-b2dec687a315 service nova] Lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG nova.compute.manager [req-c96ffe67-35a8-423e-af65-254688b9befd req-b56628b3-db74-45d2-a44c-b2dec687a315 service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] No waiting events found dispatching network-vif-plugged-d22822e2-3327-4efc-8aa0-55a47b73c5bf {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:35:08 user nova-compute[74743]: WARNING nova.compute.manager [req-c96ffe67-35a8-423e-af65-254688b9befd req-b56628b3-db74-45d2-a44c-b2dec687a315 service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Received unexpected event network-vif-plugged-d22822e2-3327-4efc-8aa0-55a47b73c5bf for instance with vm_state active and task_state rescuing.
Nov 18 17:35:08 user nova-compute[74743]: DEBUG nova.compute.manager [req-c96ffe67-35a8-423e-af65-254688b9befd req-b56628b3-db74-45d2-a44c-b2dec687a315 service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Received event network-vif-plugged-d22822e2-3327-4efc-8aa0-55a47b73c5bf {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-c96ffe67-35a8-423e-af65-254688b9befd req-b56628b3-db74-45d2-a44c-b2dec687a315 service nova] Acquiring lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-c96ffe67-35a8-423e-af65-254688b9befd req-b56628b3-db74-45d2-a44c-b2dec687a315 service nova] Lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-c96ffe67-35a8-423e-af65-254688b9befd req-b56628b3-db74-45d2-a44c-b2dec687a315 service nova] Lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG nova.compute.manager [req-c96ffe67-35a8-423e-af65-254688b9befd req-b56628b3-db74-45d2-a44c-b2dec687a315 service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] No waiting events found dispatching network-vif-plugged-d22822e2-3327-4efc-8aa0-55a47b73c5bf {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:35:08 user nova-compute[74743]: WARNING nova.compute.manager [req-c96ffe67-35a8-423e-af65-254688b9befd req-b56628b3-db74-45d2-a44c-b2dec687a315 service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Received unexpected event network-vif-plugged-d22822e2-3327-4efc-8aa0-55a47b73c5bf for instance with vm_state active and task_state rescuing.
Nov 18 17:35:08 user nova-compute[74743]: DEBUG nova.compute.manager [req-c96ffe67-35a8-423e-af65-254688b9befd req-b56628b3-db74-45d2-a44c-b2dec687a315 service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Received event network-vif-unplugged-d22822e2-3327-4efc-8aa0-55a47b73c5bf {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-c96ffe67-35a8-423e-af65-254688b9befd req-b56628b3-db74-45d2-a44c-b2dec687a315 service nova] Acquiring lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-c96ffe67-35a8-423e-af65-254688b9befd req-b56628b3-db74-45d2-a44c-b2dec687a315 service nova] Lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-c96ffe67-35a8-423e-af65-254688b9befd req-b56628b3-db74-45d2-a44c-b2dec687a315 service nova] Lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG nova.compute.manager [req-c96ffe67-35a8-423e-af65-254688b9befd req-b56628b3-db74-45d2-a44c-b2dec687a315 service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] No waiting events found dispatching network-vif-unplugged-d22822e2-3327-4efc-8aa0-55a47b73c5bf {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:35:08 user nova-compute[74743]: WARNING nova.compute.manager [req-c96ffe67-35a8-423e-af65-254688b9befd req-b56628b3-db74-45d2-a44c-b2dec687a315 service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Received unexpected event network-vif-unplugged-d22822e2-3327-4efc-8aa0-55a47b73c5bf for instance with vm_state active and task_state rescuing.
Nov 18 17:35:08 user nova-compute[74743]: DEBUG nova.compute.manager [req-c96ffe67-35a8-423e-af65-254688b9befd req-b56628b3-db74-45d2-a44c-b2dec687a315 service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Received event network-vif-plugged-d22822e2-3327-4efc-8aa0-55a47b73c5bf {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-c96ffe67-35a8-423e-af65-254688b9befd req-b56628b3-db74-45d2-a44c-b2dec687a315 service nova] Acquiring lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-c96ffe67-35a8-423e-af65-254688b9befd req-b56628b3-db74-45d2-a44c-b2dec687a315 service nova] Lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-c96ffe67-35a8-423e-af65-254688b9befd req-b56628b3-db74-45d2-a44c-b2dec687a315 service nova] Lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG nova.compute.manager [req-c96ffe67-35a8-423e-af65-254688b9befd req-b56628b3-db74-45d2-a44c-b2dec687a315 service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] No waiting events found dispatching network-vif-plugged-d22822e2-3327-4efc-8aa0-55a47b73c5bf {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:35:08 user nova-compute[74743]: WARNING nova.compute.manager [req-c96ffe67-35a8-423e-af65-254688b9befd req-b56628b3-db74-45d2-a44c-b2dec687a315 service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Received unexpected event network-vif-plugged-d22822e2-3327-4efc-8aa0-55a47b73c5bf for instance with vm_state active and task_state rescuing.
Nov 18 17:35:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cda49b6b8a569253893882dbae5c5938462b1c01.converted --force-share --output=json" returned: 0 in 0.170s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Lock "cda49b6b8a569253893882dbae5c5938462b1c01" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.645s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Acquiring lock "cda49b6b8a569253893882dbae5c5938462b1c01" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Lock "cda49b6b8a569253893882dbae5c5938462b1c01" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cda49b6b8a569253893882dbae5c5938462b1c01 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cda49b6b8a569253893882dbae5c5938462b1c01 --force-share --output=json" returned: 0 in 0.170s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cda49b6b8a569253893882dbae5c5938462b1c01,backing_fmt=raw /opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/disk.rescue {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cda49b6b8a569253893882dbae5c5938462b1c01,backing_fmt=raw /opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/disk.rescue" returned: 0 in 0.047s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Lock "cda49b6b8a569253893882dbae5c5938462b1c01" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG nova.objects.instance [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Lazy-loading 'migration_context' on Instance uuid 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG nova.objects.base [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Object Instance<69d7f224-23d7-4d0e-8bb5-8db35a8ee4de> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Created local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Start _get_guest_xml network_info=[{"id": "d22822e2-3327-4efc-8aa0-55a47b73c5bf", "address": "fa:16:3e:25:10:56", "network": {"id": "97b8f910-abe2-43b1-98c4-c7b52200906f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1194489190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1194489190-network", "vif_mac": "fa:16:3e:25:10:56"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce2bcb9ffb2749128da81f4c2df7f6c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd22822e2-33", "ovs_interfaceid": "d22822e2-3327-4efc-8aa0-55a47b73c5bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a1b32fba-a165-46e8-8cde-8357d72bc973', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '9536f6cf-95c4-40e2-864a-09a91525678a'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'boot_index': None, 'mount_device': '/dev/vdb', 'attachment_id': '669857dc-a025-47da-b391-10d464391494', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YSFWduvj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '69d7f224-23d7-4d0e-8bb5-8db35a8ee4de', 'attached_at': '', 'detached_at': '', 'volume_id': '2e6dfa5b-0b85-44db-9143-5418ac8a3722', 'serial': '2e6dfa5b-0b85-44db-9143-5418ac8a3722'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG nova.objects.instance [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Lazy-loading 'resources' on Instance uuid 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG nova.objects.base [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Object Instance<69d7f224-23d7-4d0e-8bb5-8db35a8ee4de> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG nova.objects.instance [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Lazy-loading 'numa_topology' on Instance uuid 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG nova.objects.base [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Object Instance<69d7f224-23d7-4d0e-8bb5-8db35a8ee4de> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:35:08 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:35:08 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:35:08 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG nova.objects.instance [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Lazy-loading 'vcpu_model' on Instance uuid 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG nova.objects.base [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Object Instance<69d7f224-23d7-4d0e-8bb5-8db35a8ee4de> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Calling os-brick to attach iSCSI Volume {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YSFWduvj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:35:08 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:35:08 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:35:08 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:35:08 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:35:08 user nova-compute[74743]: INFO os_brick.initiator.connectors.iscsi [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 17:35:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722 -p 172.16.0.220:3260 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5f022b-9560-409f-93ea-676bdd11d35e]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = YSFWduvj\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 18 17:35:08 user nova-compute[74743]: node.name = iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722
Nov 18 17:35:08 user nova-compute[74743]: node.tpgt = -1
Nov 18 17:35:08 user nova-compute[74743]: node.startup = automatic
Nov 18 17:35:08 user nova-compute[74743]: node.leading_login = No
Nov 18 17:35:08 user nova-compute[74743]: iface.iscsi_ifacename = default
Nov 18 17:35:08 user nova-compute[74743]: iface.net_ifacename = <empty>
Nov 18 17:35:08 user nova-compute[74743]: iface.ipaddress = <empty>
Nov 18 17:35:08 user nova-compute[74743]: iface.prefix_len = 0
Nov 18 17:35:08 user nova-compute[74743]: iface.hwaddress = <empty>
Nov 18 17:35:08 user nova-compute[74743]: iface.transport_name = tcp
Nov 18 17:35:08 user nova-compute[74743]: iface.initiatorname = <empty>
Nov 18 17:35:08 user nova-compute[74743]: iface.state = <empty>
Nov 18 17:35:08 user nova-compute[74743]: iface.vlan_id = 0
Nov 18 17:35:08 user nova-compute[74743]: iface.vlan_priority = 0
Nov 18 17:35:08 user nova-compute[74743]: iface.vlan_state = <empty>
Nov 18 17:35:08 user nova-compute[74743]: iface.iface_num = 0
Nov 18 17:35:08 user nova-compute[74743]: iface.mtu = 0
Nov 18 17:35:08 user nova-compute[74743]: iface.port = 0
Nov 18 17:35:08 user nova-compute[74743]: iface.bootproto = <empty>
Nov 18 17:35:08 user nova-compute[74743]: iface.subnet_mask = <empty>
Nov 18 17:35:08 user nova-compute[74743]: iface.gateway = <empty>
Nov 18 17:35:08 user nova-compute[74743]: iface.dhcp_alt_client_id_state = <empty>
Nov 18 17:35:08 user nova-compute[74743]: iface.dhcp_alt_client_id = <empty>
Nov 18 17:35:08 user nova-compute[74743]: iface.dhcp_dns = <empty>
Nov 18 17:35:08 user nova-compute[74743]: iface.dhcp_learn_iqn = <empty>
Nov 18 17:35:08 user nova-compute[74743]: iface.dhcp_req_vendor_id_state = <empty>
Nov 18 17:35:08 user nova-compute[74743]: iface.dhcp_vendor_id_state = <empty>
Nov 18 17:35:08 user nova-compute[74743]: iface.dhcp_vendor_id = <empty>
Nov 18 17:35:08 user nova-compute[74743]: iface.dhcp_slp_da = <empty>
Nov 18 17:35:08 user nova-compute[74743]: iface.fragmentation = <empty>
Nov 18 17:35:08 user nova-compute[74743]: iface.gratuitous_arp = <empty>
Nov 18 17:35:08 user nova-compute[74743]: iface.incoming_forwarding = <empty>
Nov 18 17:35:08 user nova-compute[74743]: iface.tos_state = <empty>
Nov 18 17:35:08 user nova-compute[74743]: iface.tos = 0
Nov 18 17:35:08 user nova-compute[74743]: iface.ttl = 0
Nov 18 17:35:08 user nova-compute[74743]: iface.delayed_ack = <empty>
Nov 18 17:35:08 user nova-compute[74743]: iface.tcp_nagle = <empty>
Nov 18 17:35:08 user nova-compute[74743]: iface.tcp_wsf_state = <empty>
Nov 18 17:35:08 user nova-compute[74743]: iface.tcp_wsf = 0
Nov 18 17:35:08 user nova-compute[74743]: iface.tcp_timer_scale = 0
Nov 18 17:35:08 user nova-compute[74743]: iface.tcp_timestamp = <empty>
Nov 18 17:35:08 user nova-compute[74743]: iface.redirect = <empty>
Nov 18 17:35:08 user nova-compute[74743]: iface.def_task_mgmt_timeout = 0
Nov 18 17:35:08 user nova-compute[74743]: iface.header_digest = <empty>
Nov 18 17:35:08 user nova-compute[74743]: iface.data_digest = <empty>
Nov 18 17:35:08 user nova-compute[74743]: iface.immediate_data = <empty>
Nov 18 17:35:08 user nova-compute[74743]: iface.initial_r2t = <empty>
Nov 18 17:35:08 user nova-compute[74743]: iface.data_seq_inorder = <empty>
Nov 18 17:35:08 user nova-compute[74743]: iface.data_pdu_inorder = <empty>
Nov 18 17:35:08 user nova-compute[74743]: iface.erl = 0
Nov 18 17:35:08 user nova-compute[74743]: iface.max_receive_data_len = 0
Nov 18 17:35:08 user nova-compute[74743]: iface.first_burst_len = 0
Nov 18 17:35:08 user nova-compute[74743]: iface.max_outstanding_r2t = 0
Nov 18 17:35:08 user nova-compute[74743]: iface.max_burst_len = 0
Nov 18 17:35:08 user nova-compute[74743]: iface.chap_auth = <empty>
Nov 18 17:35:08 user nova-compute[74743]: iface.bidi_chap = <empty>
Nov 18 17:35:08 user nova-compute[74743]: iface.strict_login_compliance = <empty>
Nov 18 17:35:08 user nova-compute[74743]: iface.discovery_auth = <empty>
Nov 18 17:35:08 user nova-compute[74743]: iface.discovery_logout = <empty>
Nov 18 17:35:08 user nova-compute[74743]: node.discovery_address = <empty>
Nov 18 17:35:08 user nova-compute[74743]: node.discovery_port = 0
Nov 18 17:35:08 user nova-compute[74743]: node.discovery_type = static
Nov 18 17:35:08 user nova-compute[74743]: node.session.initial_cmdsn = 0
Nov 18 17:35:08 user nova-compute[74743]: node.session.initial_login_retry_max = 8
Nov 18 17:35:08 user nova-compute[74743]: node.session.xmit_thread_priority = -20
Nov 18 17:35:08 user nova-compute[74743]: node.session.cmds_max = 128
Nov 18 17:35:08 user nova-compute[74743]: node.session.queue_depth = 32
Nov 18 17:35:08 user nova-compute[74743]: node.session.nr_sessions = 1
Nov 18 17:35:08 user nova-compute[74743]: node.session.auth.authmethod = CHAP
Nov 18 17:35:08 user nova-compute[74743]: node.session.auth.username = YSFWduvj
Nov 18 17:35:08 user nova-compute[74743]: node.session.auth.password = ***
Nov 18 17:35:08 user nova-compute[74743]: node.session.auth.username_in = <empty>
Nov 18 17:35:08 user nova-compute[74743]: node.session.auth.password_in = <empty>
Nov 18 17:35:08 user nova-compute[74743]: node.session.auth.chap_algs = MD5
Nov 18 17:35:08 user nova-compute[74743]: node.session.timeo.replacement_timeout = 120
Nov 18 17:35:08 user nova-compute[74743]: node.session.err_timeo.abort_timeout = 15
Nov 18 17:35:08 user nova-compute[74743]: node.session.err_timeo.lu_reset_timeout = 30
Nov 18 17:35:08 user nova-compute[74743]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 18 17:35:08 user nova-compute[74743]: node.session.err_timeo.host_reset_timeout = 60
Nov 18 17:35:08 user nova-compute[74743]: node.session.iscsi.FastAbort = Yes
Nov 18 17:35:08 user nova-compute[74743]: node.session.iscsi.InitialR2T = No
Nov 18 17:35:08 user nova-compute[74743]: node.session.iscsi.ImmediateData = Yes
Nov 18 17:35:08 user nova-compute[74743]: node.session.iscsi.FirstBurstLength = 262144
Nov 18 17:35:08 user nova-compute[74743]: node.session.iscsi.MaxBurstLength = 16776192
Nov 18 17:35:08 user nova-compute[74743]: node.session.iscsi.DefaultTime2Retain = 0
Nov 18 17:35:08 user nova-compute[74743]: node.session.iscsi.DefaultTime2Wait = 2
Nov 18 17:35:08 user nova-compute[74743]: node.session.iscsi.MaxConnections = 1
Nov 18 17:35:08 user nova-compute[74743]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 18 17:35:08 user nova-compute[74743]: node.session.iscsi.ERL = 0
Nov 18 17:35:08 user nova-compute[74743]: node.session.scan = manual
Nov 18 17:35:08 user nova-compute[74743]: node.session.reopen_max = 0
Nov 18 17:35:08 user nova-compute[74743]: node.conn[0].address = 172.16.0.220
Nov 18 17:35:08 user nova-compute[74743]: node.conn[0].port = 3260
Nov 18 17:35:08 user nova-compute[74743]: node.conn[0].startup = manual
Nov 18 17:35:08 user nova-compute[74743]: node.conn[0].tcp.window_size = 524288
Nov 18 17:35:08 user nova-compute[74743]: node.conn[0].tcp.type_of_service = 0
Nov 18 17:35:08 user nova-compute[74743]: node.conn[0].timeo.logout_timeout = 15
Nov 18 17:35:08 user nova-compute[74743]: node.conn[0].timeo.login_timeout = 15
Nov 18 17:35:08 user nova-compute[74743]: node.conn[0].timeo.auth_timeout = 45
Nov 18 17:35:08 user nova-compute[74743]: node.conn[0].timeo.noop_out_interval = 5
Nov 18 17:35:08 user nova-compute[74743]: node.conn[0].timeo.noop_out_timeout = 5
Nov 18 17:35:08 user nova-compute[74743]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 18 17:35:08 user nova-compute[74743]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 18 17:35:08 user nova-compute[74743]: node.conn[0].iscsi.HeaderDigest = None
Nov 18 17:35:08 user nova-compute[74743]: node.conn[0].iscsi.DataDigest = None
Nov 18 17:35:08 user nova-compute[74743]: node.conn[0].iscsi.IFMarker = No
Nov 18 17:35:08 user nova-compute[74743]: node.conn[0].iscsi.OFMarker = No
Nov 18 17:35:08 user nova-compute[74743]: # END RECORD
Nov 18 17:35:08 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c428600-879c-4bfa-afc5-05f12e37ef18]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[33951d4e-c019-421a-b6cd-caaa3d70e1ef]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YSFWduvj {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YSFWduvj" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[383c0032-946f-4cbe-8081-85423f366e55]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YSFWduvj'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc71ad1d-ef3a-4481-a5b1-b0d9adf18f4d]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ee4876-6cb2-44fd-9697-b97961fbd987]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722 (non-flash)
Nov 18 17:35:08 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722 (non-flash)
Nov 18 17:35:08 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.137s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Connected to 172.16.0.220:3260 {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] HCTL ('33', '0', '0', 0) found on session 51 with lun 0 {{(pid=74743) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74743) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.014s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbdf66d-545e-45f2-ae66-1f16203bdbc0]: (4, ('0 0 0', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Searching for a device in session 51 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YSFWduvj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.161s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] <== connect_volume: return (163ms) {'type': 'block', 'scsi_wwn': '23236623961353161', 'path': '/dev/sdb'} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236623961353161', 'path': '/dev/sdb'} {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:31:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1530848000',display_name='tempest-ServerStableDeviceRescueTest-server-1530848000',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1530848000',id=45,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBChhBo9VaY4BOIEFz523V2/9n5F5kQpNA2Q/p8rjF0+VRwZUYTxFpwuCPuS3su+tPJHnXXaAkikoqSKB9iEmlKXcPvgT6Y454gPB2vB2hybhUh/7RHCr59TSrRv/zlM5Rg==',key_name='tempest-keypair-969517686',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:31:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ce2bcb9ffb2749128da81f4c2df7f6c1',ramdisk_id='',reservation_id='r-wquedsqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1073155627',owner_user_name='tempest-ServerStableDeviceRescueTest-1073155627-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:33:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad24aa794fd148fab6df6d7b98443a90',uuid=69d7f224-23d7-4d0e-8bb5-8db35a8ee4de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d22822e2-3327-4efc-8aa0-55a47b73c5bf", "address": "fa:16:3e:25:10:56", "network": {"id": "97b8f910-abe2-43b1-98c4-c7b52200906f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1194489190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1194489190-network", "vif_mac": "fa:16:3e:25:10:56"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce2bcb9ffb2749128da81f4c2df7f6c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd22822e2-33", "ovs_interfaceid": "d22822e2-3327-4efc-8aa0-55a47b73c5bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Converting VIF {"id": "d22822e2-3327-4efc-8aa0-55a47b73c5bf", "address": "fa:16:3e:25:10:56", "network": {"id": "97b8f910-abe2-43b1-98c4-c7b52200906f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1194489190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1194489190-network", "vif_mac": "fa:16:3e:25:10:56"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce2bcb9ffb2749128da81f4c2df7f6c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd22822e2-33", "ovs_interfaceid": "d22822e2-3327-4efc-8aa0-55a47b73c5bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:35:08 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:25:10:56,bridge_name='br-int',has_traffic_filtering=True,id=d22822e2-3327-4efc-8aa0-55a47b73c5bf,network=Network(97b8f910-abe2-43b1-98c4-c7b52200906f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd22822e2-33') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:35:09 user nova-compute[74743]: DEBUG nova.objects.instance [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Lazy-loading 'pci_devices' on Instance uuid 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:35:09 user nova-compute[74743]: DEBUG nova.objects.base [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Object Instance<69d7f224-23d7-4d0e-8bb5-8db35a8ee4de> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:35:09 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:35:09 user nova-compute[74743]:   <uuid>69d7f224-23d7-4d0e-8bb5-8db35a8ee4de</uuid>
Nov 18 17:35:09 user nova-compute[74743]:   <name>instance-0000002d</name>
Nov 18 17:35:09 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:35:09 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:35:09 user nova-compute[74743]:   <metadata>
Nov 18 17:35:09 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:35:09 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:35:09 user nova-compute[74743]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1530848000</nova:name>
Nov 18 17:35:09 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:35:08</nova:creationTime>
Nov 18 17:35:09 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:35:09 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:35:09 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:35:09 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:35:09 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:35:09 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:35:09 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:35:09 user nova-compute[74743]:       <nova:owner>
Nov 18 17:35:09 user nova-compute[74743]:         <nova:user uuid="ad24aa794fd148fab6df6d7b98443a90">tempest-ServerStableDeviceRescueTest-1073155627-project-member</nova:user>
Nov 18 17:35:09 user nova-compute[74743]:         <nova:project uuid="ce2bcb9ffb2749128da81f4c2df7f6c1">tempest-ServerStableDeviceRescueTest-1073155627</nova:project>
Nov 18 17:35:09 user nova-compute[74743]:       </nova:owner>
Nov 18 17:35:09 user nova-compute[74743]:       <nova:root type="image" uuid="9536f6cf-95c4-40e2-864a-09a91525678a"/>
Nov 18 17:35:09 user nova-compute[74743]:       <nova:ports>
Nov 18 17:35:09 user nova-compute[74743]:         <nova:port uuid="d22822e2-3327-4efc-8aa0-55a47b73c5bf">
Nov 18 17:35:09 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 18 17:35:09 user nova-compute[74743]:         </nova:port>
Nov 18 17:35:09 user nova-compute[74743]:       </nova:ports>
Nov 18 17:35:09 user nova-compute[74743]:     </nova:instance>
Nov 18 17:35:09 user nova-compute[74743]:   </metadata>
Nov 18 17:35:09 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:35:09 user nova-compute[74743]:     <system>
Nov 18 17:35:09 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:35:09 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:35:09 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:35:09 user nova-compute[74743]:       <entry name="serial">69d7f224-23d7-4d0e-8bb5-8db35a8ee4de</entry>
Nov 18 17:35:09 user nova-compute[74743]:       <entry name="uuid">69d7f224-23d7-4d0e-8bb5-8db35a8ee4de</entry>
Nov 18 17:35:09 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:35:09 user nova-compute[74743]:     </system>
Nov 18 17:35:09 user nova-compute[74743]:   </sysinfo>
Nov 18 17:35:09 user nova-compute[74743]:   <os>
Nov 18 17:35:09 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:35:09 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:35:09 user nova-compute[74743]:   </os>
Nov 18 17:35:09 user nova-compute[74743]:   <features>
Nov 18 17:35:09 user nova-compute[74743]:     <acpi/>
Nov 18 17:35:09 user nova-compute[74743]:     <apic/>
Nov 18 17:35:09 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:35:09 user nova-compute[74743]:   </features>
Nov 18 17:35:09 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:35:09 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:35:09 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:35:09 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:35:09 user nova-compute[74743]:   </clock>
Nov 18 17:35:09 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:35:09 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:35:09 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:35:09 user nova-compute[74743]:   </cpu>
Nov 18 17:35:09 user nova-compute[74743]:   <devices>
Nov 18 17:35:09 user nova-compute[74743]:     <disk type="file" device="disk">
Nov 18 17:35:09 user nova-compute[74743]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 17:35:09 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/disk"/>
Nov 18 17:35:09 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:35:09 user nova-compute[74743]:     </disk>
Nov 18 17:35:09 user nova-compute[74743]:     <disk type="block" device="disk">
Nov 18 17:35:09 user nova-compute[74743]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:35:09 user nova-compute[74743]:       <source dev="/dev/sdb"/>
Nov 18 17:35:09 user nova-compute[74743]:       <target dev="vdb" bus="virtio"/>
Nov 18 17:35:09 user nova-compute[74743]:       <serial>2e6dfa5b-0b85-44db-9143-5418ac8a3722</serial>
Nov 18 17:35:09 user nova-compute[74743]:     </disk>
Nov 18 17:35:09 user nova-compute[74743]:     <disk type="file" device="disk">
Nov 18 17:35:09 user nova-compute[74743]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 17:35:09 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/disk.rescue"/>
Nov 18 17:35:09 user nova-compute[74743]:       <target dev="vdc" bus="virtio"/>
Nov 18 17:35:09 user nova-compute[74743]:       <boot order="1"/>
Nov 18 17:35:09 user nova-compute[74743]:     </disk>
Nov 18 17:35:09 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:35:09 user nova-compute[74743]:       <mac address="fa:16:3e:25:10:56"/>
Nov 18 17:35:09 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:35:09 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:35:09 user nova-compute[74743]:       <target dev="tapd22822e2-33"/>
Nov 18 17:35:09 user nova-compute[74743]:     </interface>
Nov 18 17:35:09 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:35:09 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/console.log" append="off"/>
Nov 18 17:35:09 user nova-compute[74743]:     </serial>
Nov 18 17:35:09 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:35:09 user nova-compute[74743]:     <video>
Nov 18 17:35:09 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:35:09 user nova-compute[74743]:     </video>
Nov 18 17:35:09 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:35:09 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:35:09 user nova-compute[74743]:     </rng>
Nov 18 17:35:09 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:35:09 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:35:09 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:35:09 user nova-compute[74743]:     </memballoon>
Nov 18 17:35:09 user nova-compute[74743]:   </devices>
Nov 18 17:35:09 user nova-compute[74743]: </domain>
Nov 18 17:35:09 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:35:09 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Instance destroyed successfully.
Nov 18 17:35:09 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:35:09 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:35:09 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:35:09 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] No VIF found with MAC fa:16:3e:25:10:56, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:35:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:35:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:35:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:35:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:35:10 user nova-compute[74743]: DEBUG nova.compute.manager [req-06d1cff8-b5ae-442b-a9df-24433ee4a3bc req-2ad37a48-f7e7-4eab-8ba2-0336a40ec042 service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Received event network-vif-plugged-d22822e2-3327-4efc-8aa0-55a47b73c5bf {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:35:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-06d1cff8-b5ae-442b-a9df-24433ee4a3bc req-2ad37a48-f7e7-4eab-8ba2-0336a40ec042 service nova] Acquiring lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:35:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-06d1cff8-b5ae-442b-a9df-24433ee4a3bc req-2ad37a48-f7e7-4eab-8ba2-0336a40ec042 service nova] Lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:35:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-06d1cff8-b5ae-442b-a9df-24433ee4a3bc req-2ad37a48-f7e7-4eab-8ba2-0336a40ec042 service nova] Lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:35:10 user nova-compute[74743]: DEBUG nova.compute.manager [req-06d1cff8-b5ae-442b-a9df-24433ee4a3bc req-2ad37a48-f7e7-4eab-8ba2-0336a40ec042 service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] No waiting events found dispatching network-vif-plugged-d22822e2-3327-4efc-8aa0-55a47b73c5bf {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:35:10 user nova-compute[74743]: WARNING nova.compute.manager [req-06d1cff8-b5ae-442b-a9df-24433ee4a3bc req-2ad37a48-f7e7-4eab-8ba2-0336a40ec042 service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Received unexpected event network-vif-plugged-d22822e2-3327-4efc-8aa0-55a47b73c5bf for instance with vm_state active and task_state rescuing.
Nov 18 17:35:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:35:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:35:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:35:12 user nova-compute[74743]: DEBUG nova.compute.manager [None req-5672f009-70bf-4822-855e-bc97bf4e565e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:35:12 user nova-compute[74743]: DEBUG nova.compute.manager [req-a4cee69f-cbe4-46b9-a9db-35b8c9aabe91 req-80fa839e-e4b8-47f8-8735-9ced3d28eefb service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Received event network-vif-plugged-d22822e2-3327-4efc-8aa0-55a47b73c5bf {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:35:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a4cee69f-cbe4-46b9-a9db-35b8c9aabe91 req-80fa839e-e4b8-47f8-8735-9ced3d28eefb service nova] Acquiring lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:35:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a4cee69f-cbe4-46b9-a9db-35b8c9aabe91 req-80fa839e-e4b8-47f8-8735-9ced3d28eefb service nova] Lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:35:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a4cee69f-cbe4-46b9-a9db-35b8c9aabe91 req-80fa839e-e4b8-47f8-8735-9ced3d28eefb service nova] Lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:35:12 user nova-compute[74743]: DEBUG nova.compute.manager [req-a4cee69f-cbe4-46b9-a9db-35b8c9aabe91 req-80fa839e-e4b8-47f8-8735-9ced3d28eefb service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] No waiting events found dispatching network-vif-plugged-d22822e2-3327-4efc-8aa0-55a47b73c5bf {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:35:12 user nova-compute[74743]: WARNING nova.compute.manager [req-a4cee69f-cbe4-46b9-a9db-35b8c9aabe91 req-80fa839e-e4b8-47f8-8735-9ced3d28eefb service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Received unexpected event network-vif-plugged-d22822e2-3327-4efc-8aa0-55a47b73c5bf for instance with vm_state active and task_state rescuing.
Nov 18 17:35:12 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:35:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:35:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:35:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:35:27 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:35:27 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:35:27 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74743) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 17:35:27 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:35:27 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:35:27 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:35:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:35:32 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:35:35 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:35:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:35:38 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:35:38 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:35:38 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74743) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 17:35:40 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:35:40 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:35:40 user nova-compute[74743]: DEBUG nova.compute.manager [req-e9207033-522d-43c0-ba60-3a16133284c3 req-44cc3e6f-e023-45b3-b28d-557d6ef18c87 service nova] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Received event network-changed-fc7b67ca-67bb-4d59-afc9-28d33c907392 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:35:40 user nova-compute[74743]: DEBUG nova.compute.manager [req-e9207033-522d-43c0-ba60-3a16133284c3 req-44cc3e6f-e023-45b3-b28d-557d6ef18c87 service nova] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Refreshing instance network info cache due to event network-changed-fc7b67ca-67bb-4d59-afc9-28d33c907392. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:35:40 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e9207033-522d-43c0-ba60-3a16133284c3 req-44cc3e6f-e023-45b3-b28d-557d6ef18c87 service nova] Acquiring lock "refresh_cache-f9fefe0e-1346-4669-b363-9ce3e6a51502" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:35:40 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e9207033-522d-43c0-ba60-3a16133284c3 req-44cc3e6f-e023-45b3-b28d-557d6ef18c87 service nova] Acquired lock "refresh_cache-f9fefe0e-1346-4669-b363-9ce3e6a51502" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:35:40 user nova-compute[74743]: DEBUG nova.network.neutron [req-e9207033-522d-43c0-ba60-3a16133284c3 req-44cc3e6f-e023-45b3-b28d-557d6ef18c87 service nova] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Refreshing network info cache for port fc7b67ca-67bb-4d59-afc9-28d33c907392 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:35:41 user nova-compute[74743]: DEBUG nova.network.neutron [req-e9207033-522d-43c0-ba60-3a16133284c3 req-44cc3e6f-e023-45b3-b28d-557d6ef18c87 service nova] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Updated VIF entry in instance network info cache for port fc7b67ca-67bb-4d59-afc9-28d33c907392. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:35:41 user nova-compute[74743]: DEBUG nova.network.neutron [req-e9207033-522d-43c0-ba60-3a16133284c3 req-44cc3e6f-e023-45b3-b28d-557d6ef18c87 service nova] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Updating instance_info_cache with network_info: [{"id": "fc7b67ca-67bb-4d59-afc9-28d33c907392", "address": "fa:16:3e:a1:90:cd", "network": {"id": "b03d3355-7704-43de-8af7-7a5dc1ee490d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1492507432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5502edf6a6b94cb59d58d52494efc90d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc7b67ca-67", "ovs_interfaceid": "fc7b67ca-67bb-4d59-afc9-28d33c907392", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:35:41 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e9207033-522d-43c0-ba60-3a16133284c3 req-44cc3e6f-e023-45b3-b28d-557d6ef18c87 service nova] Releasing lock "refresh_cache-f9fefe0e-1346-4669-b363-9ce3e6a51502" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:35:42 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:35:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a87cae4b-9f34-4494-a6f6-e2eef5323a75 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquiring lock "f9fefe0e-1346-4669-b363-9ce3e6a51502" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:35:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a87cae4b-9f34-4494-a6f6-e2eef5323a75 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "f9fefe0e-1346-4669-b363-9ce3e6a51502" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:35:43 user nova-compute[74743]: DEBUG nova.objects.instance [None req-a87cae4b-9f34-4494-a6f6-e2eef5323a75 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lazy-loading 'flavor' on Instance uuid f9fefe0e-1346-4669-b363-9ce3e6a51502 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:35:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a87cae4b-9f34-4494-a6f6-e2eef5323a75 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "f9fefe0e-1346-4669-b363-9ce3e6a51502" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:35:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a87cae4b-9f34-4494-a6f6-e2eef5323a75 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquiring lock "f9fefe0e-1346-4669-b363-9ce3e6a51502" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:35:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a87cae4b-9f34-4494-a6f6-e2eef5323a75 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "f9fefe0e-1346-4669-b363-9ce3e6a51502" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:35:43 user nova-compute[74743]: INFO nova.compute.manager [None req-a87cae4b-9f34-4494-a6f6-e2eef5323a75 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Attaching volume 02f64d43-6658-4fcb-86ea-3a710f136128 to /dev/vdb
Nov 18 17:35:43 user nova-compute[74743]: DEBUG os_brick.utils [None req-a87cae4b-9f34-4494-a6f6-e2eef5323a75 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:35:43 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:35:43 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:35:43 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e7d9ec-cf86-4969-9671-ded79b8158b7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1116acd8874d\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:35:43 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:35:43 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:35:43 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33813eb-8a64-4cce-b0b9-82ecb298bd28]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:35:43 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:35:43 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:35:43 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ef3c57-889c-46f9-8110-25ca85eb2be5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:35:43 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d033040e-eeb1-4cd3-94ea-6b5fffc746c3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:35:43 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-a87cae4b-9f34-4494-a6f6-e2eef5323a75 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Running cmd (subprocess): nvme version {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:35:43 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-a87cae4b-9f34-4494-a6f6-e2eef5323a75 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] 'nvme version' failed. Not Retrying. {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:35:43 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a87cae4b-9f34-4494-a6f6-e2eef5323a75 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] nvme not present on system {{(pid=74743) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 17:35:43 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:35:43 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:35:43 user nova-compute[74743]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 17:35:43 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0ead8a-adf5-4cff-a3a7-9e3de3ed5c4d]: (4, '') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:35:43 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-a87cae4b-9f34-4494-a6f6-e2eef5323a75 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74743) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 17:35:43 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-a87cae4b-9f34-4494-a6f6-e2eef5323a75 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 17:35:43 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-a87cae4b-9f34-4494-a6f6-e2eef5323a75 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] LIGHTOS: no hostnqn found. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 17:35:43 user nova-compute[74743]: DEBUG os_brick.utils [None req-a87cae4b-9f34-4494-a6f6-e2eef5323a75 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1116acd8874d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:35:43 user nova-compute[74743]: DEBUG nova.virt.block_device [None req-a87cae4b-9f34-4494-a6f6-e2eef5323a75 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Updating existing volume attachment record: 50d4c2be-3ea3-47ba-b11c-33a95726beda {{(pid=74743) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 17:35:44 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:35:45 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:35:46 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:35:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:35:48 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:35:48 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:35:48 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:35:48 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:35:48 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Auditing locally available compute resources for user (node: user) {{(pid=74743) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 17:35:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9fefe0e-1346-4669-b363-9ce3e6a51502/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:35:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9fefe0e-1346-4669-b363-9ce3e6a51502/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:35:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9fefe0e-1346-4669-b363-9ce3e6a51502/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:35:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9fefe0e-1346-4669-b363-9ce3e6a51502/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:35:48 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a87cae4b-9f34-4494-a6f6-e2eef5323a75 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Calling os-brick to attach iSCSI Volume {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-a87cae4b-9f34-4494-a6f6-e2eef5323a75 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:02f64d43-6658-4fcb-86ea-3a710f136128', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VeCxoGgT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:35:49 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-a87cae4b-9f34-4494-a6f6-e2eef5323a75 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:35:49 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-a87cae4b-9f34-4494-a6f6-e2eef5323a75 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-a87cae4b-9f34-4494-a6f6-e2eef5323a75 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:35:49 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-a87cae4b-9f34-4494-a6f6-e2eef5323a75 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:35:49 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-a87cae4b-9f34-4494-a6f6-e2eef5323a75 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02f64d43-6658-4fcb-86ea-3a710f136128" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-a87cae4b-9f34-4494-a6f6-e2eef5323a75 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02f64d43-6658-4fcb-86ea-3a710f136128" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:35:49 user nova-compute[74743]: INFO os_brick.initiator.connectors.iscsi [None req-a87cae4b-9f34-4494-a6f6-e2eef5323a75 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 17:35:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02f64d43-6658-4fcb-86ea-3a710f136128 -p 172.16.0.220:3260 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02f64d43-6658-4fcb-86ea-3a710f136128 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c31ab71-f84b-4571-a9dd-19617e301efa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-a87cae4b-9f34-4494-a6f6-e2eef5323a75 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 17:35:49 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02f64d43-6658-4fcb-86ea-3a710f136128 -p 172.16.0.220:3260 --interface default --op new {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02f64d43-6658-4fcb-86ea-3a710f136128 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[af96556d-0be8-4245-a205-6760cf336a91]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02f64d43-6658-4fcb-86ea-3a710f136128] added\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-a87cae4b-9f34-4494-a6f6-e2eef5323a75 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02f64d43-6658-4fcb-86ea-3a710f136128] added
Nov 18 17:35:49 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02f64d43-6658-4fcb-86ea-3a710f136128 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02f64d43-6658-4fcb-86ea-3a710f136128 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[97954244-3ee5-447b-91ad-c5b40e4b42c5]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-a87cae4b-9f34-4494-a6f6-e2eef5323a75 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02f64d43-6658-4fcb-86ea-3a710f136128 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02f64d43-6658-4fcb-86ea-3a710f136128 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[e539d589-cfe2-47ef-b132-a7bb4311f748]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-a87cae4b-9f34-4494-a6f6-e2eef5323a75 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02f64d43-6658-4fcb-86ea-3a710f136128 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VeCxoGgT {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02f64d43-6658-4fcb-86ea-3a710f136128 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VeCxoGgT" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21077f9-6cf4-442d-b0a5-a169d6755a92]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-a87cae4b-9f34-4494-a6f6-e2eef5323a75 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VeCxoGgT'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02f64d43-6658-4fcb-86ea-3a710f136128 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02f64d43-6658-4fcb-86ea-3a710f136128 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe51f13-02d3-4dec-b0cd-5c7ffbff74a2]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-a87cae4b-9f34-4494-a6f6-e2eef5323a75 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8af490-91a7-4ef9-affe-1b15efe16d61]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-a87cae4b-9f34-4494-a6f6-e2eef5323a75 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722 (non-flash)
Nov 18 17:35:49 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-a87cae4b-9f34-4494-a6f6-e2eef5323a75 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722 (non-flash)
Nov 18 17:35:49 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02f64d43-6658-4fcb-86ea-3a710f136128 -p 172.16.0.220:3260 --login {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/disk.rescue --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02f64d43-6658-4fcb-86ea-3a710f136128 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a3f897-a20d-4443-b656-8335dae05b51]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:02f64d43-6658-4fcb-86ea-3a710f136128, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:02f64d43-6658-4fcb-86ea-3a710f136128, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-a87cae4b-9f34-4494-a6f6-e2eef5323a75 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:02f64d43-6658-4fcb-86ea-3a710f136128, portal: 172.16.0.220,3260]
Nov 18 17:35:49 user nova-compute[74743]: Login to [iface: default, target: iqn.2010-10.org.openstack:02f64d43-6658-4fcb-86ea-3a710f136128, portal: 172.16.0.220,3260] successful.
Nov 18 17:35:49 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02f64d43-6658-4fcb-86ea-3a710f136128 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02f64d43-6658-4fcb-86ea-3a710f136128 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad82324-96df-4805-be6e-a632e8e4d32f]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-a87cae4b-9f34-4494-a6f6-e2eef5323a75 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23a00d1-cf29-4f85-bb31-9fe6e9dddda4]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f64d43-6658-4fcb-86ea-3a710f136128 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-a87cae4b-9f34-4494-a6f6-e2eef5323a75 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722 (non-flash)
Nov 18 17:35:49 user nova-compute[74743]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f64d43-6658-4fcb-86ea-3a710f136128 (non-flash)
Nov 18 17:35:49 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-a87cae4b-9f34-4494-a6f6-e2eef5323a75 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722 (non-flash)
Nov 18 17:35:49 user nova-compute[74743]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f64d43-6658-4fcb-86ea-3a710f136128 (non-flash)
Nov 18 17:35:49 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-a87cae4b-9f34-4494-a6f6-e2eef5323a75 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02f64d43-6658-4fcb-86ea-3a710f136128" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-a87cae4b-9f34-4494-a6f6-e2eef5323a75 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Connected to 172.16.0.220:3260 {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-a87cae4b-9f34-4494-a6f6-e2eef5323a75 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=74743) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-a87cae4b-9f34-4494-a6f6-e2eef5323a75 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74743) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[753dde2d-6a5f-4319-bdd5-31ccc51568ff]: (4, ('- - 0', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-a87cae4b-9f34-4494-a6f6-e2eef5323a75 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: None {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/disk.rescue --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:35:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:35:50 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:35:50 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:35:50 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Hypervisor/Node resource view: name=user free_ram=8763MB free_disk=25.157188415527344GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74743) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 17:35:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:35:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:35:50 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:35:50 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance f9fefe0e-1346-4669-b363-9ce3e6a51502 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:35:50 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 17:35:50 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 17:35:50 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:35:50 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:35:50 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Compute_service record updated for user:user {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 17:35:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.248s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:35:50 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-a87cae4b-9f34-4494-a6f6-e2eef5323a75 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:35:50 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-a87cae4b-9f34-4494-a6f6-e2eef5323a75 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:02f64d43-6658-4fcb-86ea-3a710f136128', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VeCxoGgT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 17:35:50 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-a87cae4b-9f34-4494-a6f6-e2eef5323a75 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:35:50 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-a87cae4b-9f34-4494-a6f6-e2eef5323a75 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '26163393466373536', 'path': '/dev/sdc'} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:35:50 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a87cae4b-9f34-4494-a6f6-e2eef5323a75 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163393466373536', 'path': '/dev/sdc'} {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 17:35:50 user nova-compute[74743]: DEBUG nova.objects.instance [None req-a87cae4b-9f34-4494-a6f6-e2eef5323a75 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lazy-loading 'flavor' on Instance uuid f9fefe0e-1346-4669-b363-9ce3e6a51502 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:35:50 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-a87cae4b-9f34-4494-a6f6-e2eef5323a75 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 17:35:50 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:35:50 user nova-compute[74743]:   <source dev="/dev/sdc"/>
Nov 18 17:35:50 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:35:50 user nova-compute[74743]:   <serial>02f64d43-6658-4fcb-86ea-3a710f136128</serial>
Nov 18 17:35:50 user nova-compute[74743]: </disk>
Nov 18 17:35:50 user nova-compute[74743]:  {{(pid=74743) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 17:35:50 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:35:50 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-a87cae4b-9f34-4494-a6f6-e2eef5323a75 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:35:50 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-a87cae4b-9f34-4494-a6f6-e2eef5323a75 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:35:50 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-a87cae4b-9f34-4494-a6f6-e2eef5323a75 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] No VIF found with MAC fa:16:3e:a1:90:cd, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:35:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a87cae4b-9f34-4494-a6f6-e2eef5323a75 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "f9fefe0e-1346-4669-b363-9ce3e6a51502" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.472s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:35:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-6ffa08e5-c608-47ba-b7a2-9cbd123bce72 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquiring lock "f9fefe0e-1346-4669-b363-9ce3e6a51502" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:35:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-6ffa08e5-c608-47ba-b7a2-9cbd123bce72 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "f9fefe0e-1346-4669-b363-9ce3e6a51502" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:35:51 user nova-compute[74743]: INFO nova.compute.manager [None req-6ffa08e5-c608-47ba-b7a2-9cbd123bce72 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Detaching volume 02f64d43-6658-4fcb-86ea-3a710f136128
Nov 18 17:35:51 user nova-compute[74743]: INFO nova.virt.block_device [None req-6ffa08e5-c608-47ba-b7a2-9cbd123bce72 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Attempting to driver detach volume 02f64d43-6658-4fcb-86ea-3a710f136128 from mountpoint /dev/vdb
Nov 18 17:35:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-6ffa08e5-c608-47ba-b7a2-9cbd123bce72 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Attempting to detach device vdb from instance f9fefe0e-1346-4669-b363-9ce3e6a51502 from the persistent domain config. {{(pid=74743) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 17:35:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-6ffa08e5-c608-47ba-b7a2-9cbd123bce72 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 17:35:51 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:35:51 user nova-compute[74743]:   <source dev="/dev/sdc"/>
Nov 18 17:35:51 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:35:51 user nova-compute[74743]:   <serial>02f64d43-6658-4fcb-86ea-3a710f136128</serial>
Nov 18 17:35:51 user nova-compute[74743]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 17:35:51 user nova-compute[74743]: </disk>
Nov 18 17:35:51 user nova-compute[74743]:  {{(pid=74743) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 17:35:51 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-6ffa08e5-c608-47ba-b7a2-9cbd123bce72 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Successfully detached device vdb from instance f9fefe0e-1346-4669-b363-9ce3e6a51502 from the persistent domain config.
Nov 18 17:35:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-6ffa08e5-c608-47ba-b7a2-9cbd123bce72 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f9fefe0e-1346-4669-b363-9ce3e6a51502 from the live domain config. {{(pid=74743) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 17:35:51 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-6ffa08e5-c608-47ba-b7a2-9cbd123bce72 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 17:35:51 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:35:51 user nova-compute[74743]:   <source dev="/dev/sdc"/>
Nov 18 17:35:51 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:35:51 user nova-compute[74743]:   <serial>02f64d43-6658-4fcb-86ea-3a710f136128</serial>
Nov 18 17:35:51 user nova-compute[74743]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 17:35:51 user nova-compute[74743]: </disk>
Nov 18 17:35:51 user nova-compute[74743]:  {{(pid=74743) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 17:35:52 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-6ffa08e5-c608-47ba-b7a2-9cbd123bce72 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f9fefe0e-1346-4669-b363-9ce3e6a51502 {{(pid=74743) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 17:35:52 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:35:52 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:35:52 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:35:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:35:53 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:35:53 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Starting heal instance info cache {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 17:35:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "refresh_cache-f9fefe0e-1346-4669-b363-9ce3e6a51502" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:35:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquired lock "refresh_cache-f9fefe0e-1346-4669-b363-9ce3e6a51502" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:35:53 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Forcefully refreshing network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 17:35:53 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Updating instance_info_cache with network_info: [{"id": "fc7b67ca-67bb-4d59-afc9-28d33c907392", "address": "fa:16:3e:a1:90:cd", "network": {"id": "b03d3355-7704-43de-8af7-7a5dc1ee490d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1492507432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5502edf6a6b94cb59d58d52494efc90d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc7b67ca-67", "ovs_interfaceid": "fc7b67ca-67bb-4d59-afc9-28d33c907392", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:35:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Releasing lock "refresh_cache-f9fefe0e-1346-4669-b363-9ce3e6a51502" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:35:53 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Updated the network info_cache for instance {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 17:35:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:35:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:36:02 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:36:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:36:12 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-6ffa08e5-c608-47ba-b7a2-9cbd123bce72 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f9fefe0e-1346-4669-b363-9ce3e6a51502 is timed out.
Nov 18 17:36:12 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-6ffa08e5-c608-47ba-b7a2-9cbd123bce72 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Successfully detached device vdb from instance f9fefe0e-1346-4669-b363-9ce3e6a51502 from the live domain config.
Nov 18 17:36:12 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ffa08e5-c608-47ba-b7a2-9cbd123bce72 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] calling os-brick to detach iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 17:36:12 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffa08e5-c608-47ba-b7a2-9cbd123bce72 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, {'target_iqn': 'iqn.2010-10.org.openstack:02f64d43-6658-4fcb-86ea-3a710f136128', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VeCxoGgT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:36:12 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-6ffa08e5-c608-47ba-b7a2-9cbd123bce72 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:36:12 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-6ffa08e5-c608-47ba-b7a2-9cbd123bce72 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:36:12 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-6ffa08e5-c608-47ba-b7a2-9cbd123bce72 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:36:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:36:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:36:12 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a390795-42ba-4fde-898f-f49606a118b6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:02f64d43-6658-4fcb-86ea-3a710f136128\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:36:12 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffa08e5-c608-47ba-b7a2-9cbd123bce72 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 17:36:12 user nova-compute[74743]: No targets found.
Nov 18 17:36:12 user nova-compute[74743]: iSNS:
Nov 18 17:36:12 user nova-compute[74743]: No targets found.
Nov 18 17:36:12 user nova-compute[74743]: STATIC:
Nov 18 17:36:12 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:02f64d43-6658-4fcb-86ea-3a710f136128
Nov 18 17:36:12 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:36:12 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:36:12 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722
Nov 18 17:36:12 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:36:12 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:36:12 user nova-compute[74743]: FIRMWARE:
Nov 18 17:36:12 user nova-compute[74743]: No targets found.
Nov 18 17:36:12 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:36:12 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffa08e5-c608-47ba-b7a2-9cbd123bce72 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 17:36:12 user nova-compute[74743]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 17:36:12 user nova-compute[74743]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74743) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 17:36:12 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffa08e5-c608-47ba-b7a2-9cbd123bce72 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02f64d43-6658-4fcb-86ea-3a710f136128', 0)] {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 17:36:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:36:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:36:12 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01cb231-ccb1-4e0d-9209-39fa7f50410c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02f64d43-6658-4fcb-86ea-3a710f136128\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:36:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:36:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:36:12 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f68c21-786a-4362-a816-566b4bee3a48]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f64d43-6658-4fcb-86ea-3a710f136128 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:36:12 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffa08e5-c608-47ba-b7a2-9cbd123bce72 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722 (non-flash)
Nov 18 17:36:12 user nova-compute[74743]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f64d43-6658-4fcb-86ea-3a710f136128 (non-flash)
Nov 18 17:36:12 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:36:12 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffa08e5-c608-47ba-b7a2-9cbd123bce72 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722 (non-flash)
Nov 18 17:36:12 user nova-compute[74743]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f64d43-6658-4fcb-86ea-3a710f136128 (non-flash)
Nov 18 17:36:12 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:36:12 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffa08e5-c608-47ba-b7a2-9cbd123bce72 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb081d60e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02f64d43-6658-4fcb-86ea-3a710f136128'): ({'sdc'}, set())}) {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 17:36:12 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-6ffa08e5-c608-47ba-b7a2-9cbd123bce72 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Removing single pathed devices sdc {{(pid=74743) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 17:36:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:36:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:36:12 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7808b95-5a49-4bd1-af3a-0c1b09727616]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:36:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:36:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:36:12 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9790666-e2f0-4bc0-a0c9-ecfe6673a30a]: (4, ('ok\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:36:12 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-6ffa08e5-c608-47ba-b7a2-9cbd123bce72 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Flushing IO for device /dev/sdc {{(pid=74743) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 17:36:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:36:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:36:12 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc95ea52-689e-4231-b6b9-2bf798b92ef9]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:36:12 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-6ffa08e5-c608-47ba-b7a2-9cbd123bce72 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74743) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 17:36:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:36:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:36:12 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[945f0677-142c-46b0-9880-00b39b34e439]: (4, ('1', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:36:12 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-6ffa08e5-c608-47ba-b7a2-9cbd123bce72 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 17:36:12 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-6ffa08e5-c608-47ba-b7a2-9cbd123bce72 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] SCSI volumes sdc have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 17:36:12 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffa08e5-c608-47ba-b7a2-9cbd123bce72 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02f64d43-6658-4fcb-86ea-3a710f136128')] {{(pid=74743) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 17:36:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02f64d43-6658-4fcb-86ea-3a710f136128 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:36:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02f64d43-6658-4fcb-86ea-3a710f136128 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:36:12 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[85eda631-3931-4c75-8a65-b3cd598abc4e]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:36:12 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffa08e5-c608-47ba-b7a2-9cbd123bce72 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:36:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02f64d43-6658-4fcb-86ea-3a710f136128 -p 172.16.0.220:3260 --logout {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:36:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02f64d43-6658-4fcb-86ea-3a710f136128 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:36:12 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c04cd76-0a3b-429a-b53b-ed99d2c0cc63]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:02f64d43-6658-4fcb-86ea-3a710f136128, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:02f64d43-6658-4fcb-86ea-3a710f136128, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:36:12 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffa08e5-c608-47ba-b7a2-9cbd123bce72 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:02f64d43-6658-4fcb-86ea-3a710f136128, portal: 172.16.0.220,3260]
Nov 18 17:36:12 user nova-compute[74743]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:02f64d43-6658-4fcb-86ea-3a710f136128, portal: 172.16.0.220,3260] successful.
Nov 18 17:36:12 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:36:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02f64d43-6658-4fcb-86ea-3a710f136128 -p 172.16.0.220:3260 --op delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:36:12 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02f64d43-6658-4fcb-86ea-3a710f136128 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:36:12 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[48619dae-cc53-4f32-86dc-b69abac5c84f]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:36:12 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffa08e5-c608-47ba-b7a2-9cbd123bce72 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:36:12 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-6ffa08e5-c608-47ba-b7a2-9cbd123bce72 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:36:12 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffa08e5-c608-47ba-b7a2-9cbd123bce72 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] <== disconnect_volume: return (315ms) None {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:36:12 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ffa08e5-c608-47ba-b7a2-9cbd123bce72 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Disconnected iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 17:36:12 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:36:12 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:36:12 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74743) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 17:36:12 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:36:12 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:36:12 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:36:13 user nova-compute[74743]: DEBUG nova.objects.instance [None req-6ffa08e5-c608-47ba-b7a2-9cbd123bce72 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lazy-loading 'flavor' on Instance uuid f9fefe0e-1346-4669-b363-9ce3e6a51502 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:36:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-6ffa08e5-c608-47ba-b7a2-9cbd123bce72 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "f9fefe0e-1346-4669-b363-9ce3e6a51502" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.628s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:36:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:36:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:36:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:36:27 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:36:32 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:36:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:36:38 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:36:38 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74743) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 17:36:40 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:36:40 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:36:41 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a9975267-31f7-47c5-aaa8-c9aacb67ab27 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquiring lock "f9fefe0e-1346-4669-b363-9ce3e6a51502" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:36:41 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a9975267-31f7-47c5-aaa8-c9aacb67ab27 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "f9fefe0e-1346-4669-b363-9ce3e6a51502" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:36:41 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a9975267-31f7-47c5-aaa8-c9aacb67ab27 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquiring lock "f9fefe0e-1346-4669-b363-9ce3e6a51502-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:36:41 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a9975267-31f7-47c5-aaa8-c9aacb67ab27 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "f9fefe0e-1346-4669-b363-9ce3e6a51502-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:36:41 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a9975267-31f7-47c5-aaa8-c9aacb67ab27 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "f9fefe0e-1346-4669-b363-9ce3e6a51502-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:36:41 user nova-compute[74743]: INFO nova.compute.manager [None req-a9975267-31f7-47c5-aaa8-c9aacb67ab27 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Terminating instance
Nov 18 17:36:41 user nova-compute[74743]: DEBUG nova.compute.manager [None req-a9975267-31f7-47c5-aaa8-c9aacb67ab27 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Start destroying the instance on the hypervisor. {{(pid=74743) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 17:36:41 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:36:41 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:36:41 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:36:42 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:36:42 user nova-compute[74743]: DEBUG nova.compute.manager [req-e4bafd33-5c15-4b27-a9b8-139329ad0b70 req-97abbd8a-5c7e-43d6-be78-c73228bf787d service nova] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Received event network-vif-unplugged-fc7b67ca-67bb-4d59-afc9-28d33c907392 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:36:42 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e4bafd33-5c15-4b27-a9b8-139329ad0b70 req-97abbd8a-5c7e-43d6-be78-c73228bf787d service nova] Acquiring lock "f9fefe0e-1346-4669-b363-9ce3e6a51502-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:36:42 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e4bafd33-5c15-4b27-a9b8-139329ad0b70 req-97abbd8a-5c7e-43d6-be78-c73228bf787d service nova] Lock "f9fefe0e-1346-4669-b363-9ce3e6a51502-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:36:42 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e4bafd33-5c15-4b27-a9b8-139329ad0b70 req-97abbd8a-5c7e-43d6-be78-c73228bf787d service nova] Lock "f9fefe0e-1346-4669-b363-9ce3e6a51502-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:36:42 user nova-compute[74743]: DEBUG nova.compute.manager [req-e4bafd33-5c15-4b27-a9b8-139329ad0b70 req-97abbd8a-5c7e-43d6-be78-c73228bf787d service nova] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] No waiting events found dispatching network-vif-unplugged-fc7b67ca-67bb-4d59-afc9-28d33c907392 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:36:42 user nova-compute[74743]: DEBUG nova.compute.manager [req-e4bafd33-5c15-4b27-a9b8-139329ad0b70 req-97abbd8a-5c7e-43d6-be78-c73228bf787d service nova] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Received event network-vif-unplugged-fc7b67ca-67bb-4d59-afc9-28d33c907392 for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:36:42 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:36:42 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Instance destroyed successfully.
Nov 18 17:36:42 user nova-compute[74743]: DEBUG nova.objects.instance [None req-a9975267-31f7-47c5-aaa8-c9aacb67ab27 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lazy-loading 'resources' on Instance uuid f9fefe0e-1346-4669-b363-9ce3e6a51502 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:36:42 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-a9975267-31f7-47c5-aaa8-c9aacb67ab27 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:33:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1325740500',display_name='tempest-AttachVolumeNegativeTest-server-1325740500',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1325740500',id=46,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPhng43WTYJ2Z9fjIMsersv/XsSgsJc2EDotNaOLHR9x68yVpSX/Rz2uYbTXqbclo29o4y7rMM5MM9yBhKeU72KctcEoraq9wQi73Boo4QT6vyg6NA8IFB5/xrVa0cd3Q==',key_name='tempest-keypair-1368191867',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:33:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5502edf6a6b94cb59d58d52494efc90d',ramdisk_id='',reservation_id='r-8gfzj4rl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1149732113',owner_user_name='tempest-AttachVolumeNegativeTest-1149732113-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:33:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35aedc702bc4444eb3802772a523ba79',uuid=f9fefe0e-1346-4669-b363-9ce3e6a51502,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc7b67ca-67bb-4d59-afc9-28d33c907392", "address": "fa:16:3e:a1:90:cd", "network": {"id": "b03d3355-7704-43de-8af7-7a5dc1ee490d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1492507432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5502edf6a6b94cb59d58d52494efc90d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc7b67ca-67", "ovs_interfaceid": "fc7b67ca-67bb-4d59-afc9-28d33c907392", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:36:42 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-a9975267-31f7-47c5-aaa8-c9aacb67ab27 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Converting VIF {"id": "fc7b67ca-67bb-4d59-afc9-28d33c907392", "address": "fa:16:3e:a1:90:cd", "network": {"id": "b03d3355-7704-43de-8af7-7a5dc1ee490d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1492507432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5502edf6a6b94cb59d58d52494efc90d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc7b67ca-67", "ovs_interfaceid": "fc7b67ca-67bb-4d59-afc9-28d33c907392", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:36:42 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-a9975267-31f7-47c5-aaa8-c9aacb67ab27 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:90:cd,bridge_name='br-int',has_traffic_filtering=True,id=fc7b67ca-67bb-4d59-afc9-28d33c907392,network=Network(b03d3355-7704-43de-8af7-7a5dc1ee490d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc7b67ca-67') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:36:42 user nova-compute[74743]: DEBUG os_vif [None req-a9975267-31f7-47c5-aaa8-c9aacb67ab27 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:90:cd,bridge_name='br-int',has_traffic_filtering=True,id=fc7b67ca-67bb-4d59-afc9-28d33c907392,network=Network(b03d3355-7704-43de-8af7-7a5dc1ee490d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc7b67ca-67') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:36:42 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:36:42 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc7b67ca-67, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:36:42 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:36:42 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:36:42 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:36:42 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b22b5096-03ec-4930-b49f-ac51b7ea257b) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:36:42 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:36:42 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:36:42 user nova-compute[74743]: INFO os_vif [None req-a9975267-31f7-47c5-aaa8-c9aacb67ab27 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:90:cd,bridge_name='br-int',has_traffic_filtering=True,id=fc7b67ca-67bb-4d59-afc9-28d33c907392,network=Network(b03d3355-7704-43de-8af7-7a5dc1ee490d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc7b67ca-67')
Nov 18 17:36:42 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-a9975267-31f7-47c5-aaa8-c9aacb67ab27 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Deleting instance files /opt/stack/data/nova/instances/f9fefe0e-1346-4669-b363-9ce3e6a51502_del
Nov 18 17:36:42 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-a9975267-31f7-47c5-aaa8-c9aacb67ab27 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Deletion of /opt/stack/data/nova/instances/f9fefe0e-1346-4669-b363-9ce3e6a51502_del complete
Nov 18 17:36:42 user nova-compute[74743]: INFO nova.compute.manager [None req-a9975267-31f7-47c5-aaa8-c9aacb67ab27 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 18 17:36:42 user nova-compute[74743]: DEBUG oslo.service.loopingcall [None req-a9975267-31f7-47c5-aaa8-c9aacb67ab27 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74743) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 17:36:42 user nova-compute[74743]: DEBUG nova.compute.manager [-] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Deallocating network for instance {{(pid=74743) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 17:36:42 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] deallocate_for_instance() {{(pid=74743) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 17:36:43 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:36:43 user nova-compute[74743]: DEBUG nova.compute.manager [req-6aa70236-bc49-4a82-94eb-38eb4291a186 req-659bee16-31a0-488c-86b7-2e13c2f7906b service nova] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Received event network-vif-deleted-fc7b67ca-67bb-4d59-afc9-28d33c907392 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:36:43 user nova-compute[74743]: INFO nova.compute.manager [req-6aa70236-bc49-4a82-94eb-38eb4291a186 req-659bee16-31a0-488c-86b7-2e13c2f7906b service nova] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Neutron deleted interface fc7b67ca-67bb-4d59-afc9-28d33c907392; detaching it from the instance and deleting it from the info cache
Nov 18 17:36:43 user nova-compute[74743]: DEBUG nova.network.neutron [req-6aa70236-bc49-4a82-94eb-38eb4291a186 req-659bee16-31a0-488c-86b7-2e13c2f7906b service nova] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:36:43 user nova-compute[74743]: INFO nova.compute.manager [-] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Took 0.70 seconds to deallocate network for instance.
Nov 18 17:36:43 user nova-compute[74743]: DEBUG nova.compute.manager [req-6aa70236-bc49-4a82-94eb-38eb4291a186 req-659bee16-31a0-488c-86b7-2e13c2f7906b service nova] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Detach interface failed, port_id=fc7b67ca-67bb-4d59-afc9-28d33c907392, reason: Instance f9fefe0e-1346-4669-b363-9ce3e6a51502 could not be found. {{(pid=74743) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 17:36:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a9975267-31f7-47c5-aaa8-c9aacb67ab27 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:36:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a9975267-31f7-47c5-aaa8-c9aacb67ab27 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:36:43 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-a9975267-31f7-47c5-aaa8-c9aacb67ab27 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:36:43 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-a9975267-31f7-47c5-aaa8-c9aacb67ab27 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:36:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a9975267-31f7-47c5-aaa8-c9aacb67ab27 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.148s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:36:43 user nova-compute[74743]: INFO nova.scheduler.client.report [None req-a9975267-31f7-47c5-aaa8-c9aacb67ab27 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Deleted allocations for instance f9fefe0e-1346-4669-b363-9ce3e6a51502
Nov 18 17:36:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a9975267-31f7-47c5-aaa8-c9aacb67ab27 tempest-AttachVolumeNegativeTest-1149732113 tempest-AttachVolumeNegativeTest-1149732113-project-member] Lock "f9fefe0e-1346-4669-b363-9ce3e6a51502" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.967s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:36:44 user nova-compute[74743]: DEBUG nova.compute.manager [req-a3052fc6-d428-4d45-9bb1-ce18590ed3af req-16a6d3a1-a91f-4e15-a2db-34d97394bad0 service nova] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Received event network-vif-plugged-fc7b67ca-67bb-4d59-afc9-28d33c907392 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:36:44 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a3052fc6-d428-4d45-9bb1-ce18590ed3af req-16a6d3a1-a91f-4e15-a2db-34d97394bad0 service nova] Acquiring lock "f9fefe0e-1346-4669-b363-9ce3e6a51502-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:36:44 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a3052fc6-d428-4d45-9bb1-ce18590ed3af req-16a6d3a1-a91f-4e15-a2db-34d97394bad0 service nova] Lock "f9fefe0e-1346-4669-b363-9ce3e6a51502-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:36:44 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a3052fc6-d428-4d45-9bb1-ce18590ed3af req-16a6d3a1-a91f-4e15-a2db-34d97394bad0 service nova] Lock "f9fefe0e-1346-4669-b363-9ce3e6a51502-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:36:44 user nova-compute[74743]: DEBUG nova.compute.manager [req-a3052fc6-d428-4d45-9bb1-ce18590ed3af req-16a6d3a1-a91f-4e15-a2db-34d97394bad0 service nova] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] No waiting events found dispatching network-vif-plugged-fc7b67ca-67bb-4d59-afc9-28d33c907392 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:36:44 user nova-compute[74743]: WARNING nova.compute.manager [req-a3052fc6-d428-4d45-9bb1-ce18590ed3af req-16a6d3a1-a91f-4e15-a2db-34d97394bad0 service nova] [instance: f9fefe0e-1346-4669-b363-9ce3e6a51502] Received unexpected event network-vif-plugged-fc7b67ca-67bb-4d59-afc9-28d33c907392 for instance with vm_state deleted and task_state None.
Nov 18 17:36:46 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:36:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:36:48 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:36:49 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:36:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:36:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:36:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:36:49 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Auditing locally available compute resources for user (node: user) {{(pid=74743) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 17:36:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:36:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:36:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:36:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:36:49 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:36:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/disk.rescue --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:36:50 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:36:50 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/disk.rescue --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:36:50 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:36:50 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:36:50 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:36:50 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Hypervisor/Node resource view: name=user free_ram=8932MB free_disk=25.184059143066406GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74743) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 17:36:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:36:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:36:50 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:36:50 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 17:36:50 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 17:36:50 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:36:50 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:36:50 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Compute_service record updated for user:user {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 17:36:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:36:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:36:52 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:36:52 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:36:53 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:36:53 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Starting heal instance info cache {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 17:36:53 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Rebuilding the list of instances to heal {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 17:36:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "refresh_cache-69d7f224-23d7-4d0e-8bb5-8db35a8ee4de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:36:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquired lock "refresh_cache-69d7f224-23d7-4d0e-8bb5-8db35a8ee4de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:36:53 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Forcefully refreshing network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 17:36:53 user nova-compute[74743]: DEBUG nova.objects.instance [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lazy-loading 'info_cache' on Instance uuid 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:36:53 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Updating instance_info_cache with network_info: [{"id": "d22822e2-3327-4efc-8aa0-55a47b73c5bf", "address": "fa:16:3e:25:10:56", "network": {"id": "97b8f910-abe2-43b1-98c4-c7b52200906f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1194489190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce2bcb9ffb2749128da81f4c2df7f6c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd22822e2-33", "ovs_interfaceid": "d22822e2-3327-4efc-8aa0-55a47b73c5bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:36:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Releasing lock "refresh_cache-69d7f224-23d7-4d0e-8bb5-8db35a8ee4de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:36:53 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Updated the network info_cache for instance {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 17:36:56 user nova-compute[74743]: INFO nova.compute.manager [None req-00895f13-20b5-473e-bd94-efd5addabc0e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Unrescuing
Nov 18 17:36:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-00895f13-20b5-473e-bd94-efd5addabc0e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Acquiring lock "refresh_cache-69d7f224-23d7-4d0e-8bb5-8db35a8ee4de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:36:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-00895f13-20b5-473e-bd94-efd5addabc0e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Acquired lock "refresh_cache-69d7f224-23d7-4d0e-8bb5-8db35a8ee4de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:36:56 user nova-compute[74743]: DEBUG nova.network.neutron [None req-00895f13-20b5-473e-bd94-efd5addabc0e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:36:56 user nova-compute[74743]: DEBUG nova.network.neutron [None req-00895f13-20b5-473e-bd94-efd5addabc0e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Updating instance_info_cache with network_info: [{"id": "d22822e2-3327-4efc-8aa0-55a47b73c5bf", "address": "fa:16:3e:25:10:56", "network": {"id": "97b8f910-abe2-43b1-98c4-c7b52200906f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1194489190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce2bcb9ffb2749128da81f4c2df7f6c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd22822e2-33", "ovs_interfaceid": "d22822e2-3327-4efc-8aa0-55a47b73c5bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:36:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-00895f13-20b5-473e-bd94-efd5addabc0e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Releasing lock "refresh_cache-69d7f224-23d7-4d0e-8bb5-8db35a8ee4de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:36:56 user nova-compute[74743]: DEBUG nova.objects.instance [None req-00895f13-20b5-473e-bd94-efd5addabc0e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Lazy-loading 'flavor' on Instance uuid 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:36:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:36:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:36:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:36:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:36:56 user nova-compute[74743]: DEBUG nova.compute.manager [req-20c15d45-81dc-4a78-b548-838bfb6497cc req-21bc4ba5-b34a-4cbe-abf5-753fae165e5b service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Received event network-vif-unplugged-d22822e2-3327-4efc-8aa0-55a47b73c5bf {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:36:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-20c15d45-81dc-4a78-b548-838bfb6497cc req-21bc4ba5-b34a-4cbe-abf5-753fae165e5b service nova] Acquiring lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:36:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-20c15d45-81dc-4a78-b548-838bfb6497cc req-21bc4ba5-b34a-4cbe-abf5-753fae165e5b service nova] Lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:36:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-20c15d45-81dc-4a78-b548-838bfb6497cc req-21bc4ba5-b34a-4cbe-abf5-753fae165e5b service nova] Lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:36:56 user nova-compute[74743]: DEBUG nova.compute.manager [req-20c15d45-81dc-4a78-b548-838bfb6497cc req-21bc4ba5-b34a-4cbe-abf5-753fae165e5b service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] No waiting events found dispatching network-vif-unplugged-d22822e2-3327-4efc-8aa0-55a47b73c5bf {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:36:56 user nova-compute[74743]: WARNING nova.compute.manager [req-20c15d45-81dc-4a78-b548-838bfb6497cc req-21bc4ba5-b34a-4cbe-abf5-753fae165e5b service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Received unexpected event network-vif-unplugged-d22822e2-3327-4efc-8aa0-55a47b73c5bf for instance with vm_state rescued and task_state unrescuing.
Nov 18 17:36:57 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Instance destroyed successfully.
Nov 18 17:36:57 user nova-compute[74743]: DEBUG nova.compute.manager [req-78b34597-4551-4a4b-8bcd-ea78ff3b6c1b req-1501a773-1f13-4f12-94c6-106fc01a61e5 service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Received event network-changed-d22822e2-3327-4efc-8aa0-55a47b73c5bf {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:36:57 user nova-compute[74743]: DEBUG nova.compute.manager [req-78b34597-4551-4a4b-8bcd-ea78ff3b6c1b req-1501a773-1f13-4f12-94c6-106fc01a61e5 service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Refreshing instance network info cache due to event network-changed-d22822e2-3327-4efc-8aa0-55a47b73c5bf. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:36:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-78b34597-4551-4a4b-8bcd-ea78ff3b6c1b req-1501a773-1f13-4f12-94c6-106fc01a61e5 service nova] Acquiring lock "refresh_cache-69d7f224-23d7-4d0e-8bb5-8db35a8ee4de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:36:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-78b34597-4551-4a4b-8bcd-ea78ff3b6c1b req-1501a773-1f13-4f12-94c6-106fc01a61e5 service nova] Acquired lock "refresh_cache-69d7f224-23d7-4d0e-8bb5-8db35a8ee4de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:36:57 user nova-compute[74743]: DEBUG nova.network.neutron [req-78b34597-4551-4a4b-8bcd-ea78ff3b6c1b req-1501a773-1f13-4f12-94c6-106fc01a61e5 service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Refreshing network info cache for port d22822e2-3327-4efc-8aa0-55a47b73c5bf {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:36:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:36:57 user nova-compute[74743]: DEBUG nova.network.neutron [req-78b34597-4551-4a4b-8bcd-ea78ff3b6c1b req-1501a773-1f13-4f12-94c6-106fc01a61e5 service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Updated VIF entry in instance network info cache for port d22822e2-3327-4efc-8aa0-55a47b73c5bf. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:36:57 user nova-compute[74743]: DEBUG nova.network.neutron [req-78b34597-4551-4a4b-8bcd-ea78ff3b6c1b req-1501a773-1f13-4f12-94c6-106fc01a61e5 service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Updating instance_info_cache with network_info: [{"id": "d22822e2-3327-4efc-8aa0-55a47b73c5bf", "address": "fa:16:3e:25:10:56", "network": {"id": "97b8f910-abe2-43b1-98c4-c7b52200906f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1194489190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce2bcb9ffb2749128da81f4c2df7f6c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd22822e2-33", "ovs_interfaceid": "d22822e2-3327-4efc-8aa0-55a47b73c5bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:36:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-78b34597-4551-4a4b-8bcd-ea78ff3b6c1b req-1501a773-1f13-4f12-94c6-106fc01a61e5 service nova] Releasing lock "refresh_cache-69d7f224-23d7-4d0e-8bb5-8db35a8ee4de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:36:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:36:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:36:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:36:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:36:58 user nova-compute[74743]: DEBUG nova.compute.manager [req-060a2222-6164-4a78-acfb-1d3a9f1bdff2 req-56bb250d-024b-4d86-aaea-f39c0d25cf8e service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Received event network-vif-plugged-d22822e2-3327-4efc-8aa0-55a47b73c5bf {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:36:58 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-060a2222-6164-4a78-acfb-1d3a9f1bdff2 req-56bb250d-024b-4d86-aaea-f39c0d25cf8e service nova] Acquiring lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:36:58 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-060a2222-6164-4a78-acfb-1d3a9f1bdff2 req-56bb250d-024b-4d86-aaea-f39c0d25cf8e service nova] Lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:36:58 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-060a2222-6164-4a78-acfb-1d3a9f1bdff2 req-56bb250d-024b-4d86-aaea-f39c0d25cf8e service nova] Lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:36:58 user nova-compute[74743]: DEBUG nova.compute.manager [req-060a2222-6164-4a78-acfb-1d3a9f1bdff2 req-56bb250d-024b-4d86-aaea-f39c0d25cf8e service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] No waiting events found dispatching network-vif-plugged-d22822e2-3327-4efc-8aa0-55a47b73c5bf {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:36:58 user nova-compute[74743]: WARNING nova.compute.manager [req-060a2222-6164-4a78-acfb-1d3a9f1bdff2 req-56bb250d-024b-4d86-aaea-f39c0d25cf8e service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Received unexpected event network-vif-plugged-d22822e2-3327-4efc-8aa0-55a47b73c5bf for instance with vm_state rescued and task_state unrescuing.
Nov 18 17:36:58 user nova-compute[74743]: DEBUG nova.compute.manager [req-060a2222-6164-4a78-acfb-1d3a9f1bdff2 req-56bb250d-024b-4d86-aaea-f39c0d25cf8e service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Received event network-vif-plugged-d22822e2-3327-4efc-8aa0-55a47b73c5bf {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:36:58 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-060a2222-6164-4a78-acfb-1d3a9f1bdff2 req-56bb250d-024b-4d86-aaea-f39c0d25cf8e service nova] Acquiring lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:36:58 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-060a2222-6164-4a78-acfb-1d3a9f1bdff2 req-56bb250d-024b-4d86-aaea-f39c0d25cf8e service nova] Lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:36:58 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-060a2222-6164-4a78-acfb-1d3a9f1bdff2 req-56bb250d-024b-4d86-aaea-f39c0d25cf8e service nova] Lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:36:58 user nova-compute[74743]: DEBUG nova.compute.manager [req-060a2222-6164-4a78-acfb-1d3a9f1bdff2 req-56bb250d-024b-4d86-aaea-f39c0d25cf8e service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] No waiting events found dispatching network-vif-plugged-d22822e2-3327-4efc-8aa0-55a47b73c5bf {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:36:58 user nova-compute[74743]: WARNING nova.compute.manager [req-060a2222-6164-4a78-acfb-1d3a9f1bdff2 req-56bb250d-024b-4d86-aaea-f39c0d25cf8e service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Received unexpected event network-vif-plugged-d22822e2-3327-4efc-8aa0-55a47b73c5bf for instance with vm_state rescued and task_state unrescuing.
Nov 18 17:36:59 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:36:59 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:36:59 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:36:59 user nova-compute[74743]: DEBUG nova.compute.manager [req-05948aa2-4641-49d8-8613-77a940f369c9 req-ad1dd9fd-d055-4e0e-967d-2de99c437a1d service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Received event network-changed-d22822e2-3327-4efc-8aa0-55a47b73c5bf {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:36:59 user nova-compute[74743]: DEBUG nova.compute.manager [req-05948aa2-4641-49d8-8613-77a940f369c9 req-ad1dd9fd-d055-4e0e-967d-2de99c437a1d service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Refreshing instance network info cache due to event network-changed-d22822e2-3327-4efc-8aa0-55a47b73c5bf. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:36:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-05948aa2-4641-49d8-8613-77a940f369c9 req-ad1dd9fd-d055-4e0e-967d-2de99c437a1d service nova] Acquiring lock "refresh_cache-69d7f224-23d7-4d0e-8bb5-8db35a8ee4de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:36:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-05948aa2-4641-49d8-8613-77a940f369c9 req-ad1dd9fd-d055-4e0e-967d-2de99c437a1d service nova] Acquired lock "refresh_cache-69d7f224-23d7-4d0e-8bb5-8db35a8ee4de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:36:59 user nova-compute[74743]: DEBUG nova.network.neutron [req-05948aa2-4641-49d8-8613-77a940f369c9 req-ad1dd9fd-d055-4e0e-967d-2de99c437a1d service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Refreshing network info cache for port d22822e2-3327-4efc-8aa0-55a47b73c5bf {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:36:59 user nova-compute[74743]: DEBUG nova.network.neutron [req-05948aa2-4641-49d8-8613-77a940f369c9 req-ad1dd9fd-d055-4e0e-967d-2de99c437a1d service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Updated VIF entry in instance network info cache for port d22822e2-3327-4efc-8aa0-55a47b73c5bf. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:36:59 user nova-compute[74743]: DEBUG nova.network.neutron [req-05948aa2-4641-49d8-8613-77a940f369c9 req-ad1dd9fd-d055-4e0e-967d-2de99c437a1d service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Updating instance_info_cache with network_info: [{"id": "d22822e2-3327-4efc-8aa0-55a47b73c5bf", "address": "fa:16:3e:25:10:56", "network": {"id": "97b8f910-abe2-43b1-98c4-c7b52200906f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1194489190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce2bcb9ffb2749128da81f4c2df7f6c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd22822e2-33", "ovs_interfaceid": "d22822e2-3327-4efc-8aa0-55a47b73c5bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:36:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-05948aa2-4641-49d8-8613-77a940f369c9 req-ad1dd9fd-d055-4e0e-967d-2de99c437a1d service nova] Releasing lock "refresh_cache-69d7f224-23d7-4d0e-8bb5-8db35a8ee4de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:37:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:37:00 user nova-compute[74743]: DEBUG nova.compute.manager [None req-00895f13-20b5-473e-bd94-efd5addabc0e tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:37:00 user nova-compute[74743]: DEBUG nova.compute.manager [req-757a0121-81b5-4da5-a892-fb620cdfabd3 req-17714988-9f79-4ae7-bbbd-e69b36cf2e48 service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Received event network-vif-plugged-d22822e2-3327-4efc-8aa0-55a47b73c5bf {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:37:00 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-757a0121-81b5-4da5-a892-fb620cdfabd3 req-17714988-9f79-4ae7-bbbd-e69b36cf2e48 service nova] Acquiring lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:37:00 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-757a0121-81b5-4da5-a892-fb620cdfabd3 req-17714988-9f79-4ae7-bbbd-e69b36cf2e48 service nova] Lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:37:00 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-757a0121-81b5-4da5-a892-fb620cdfabd3 req-17714988-9f79-4ae7-bbbd-e69b36cf2e48 service nova] Lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:37:00 user nova-compute[74743]: DEBUG nova.compute.manager [req-757a0121-81b5-4da5-a892-fb620cdfabd3 req-17714988-9f79-4ae7-bbbd-e69b36cf2e48 service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] No waiting events found dispatching network-vif-plugged-d22822e2-3327-4efc-8aa0-55a47b73c5bf {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:37:00 user nova-compute[74743]: WARNING nova.compute.manager [req-757a0121-81b5-4da5-a892-fb620cdfabd3 req-17714988-9f79-4ae7-bbbd-e69b36cf2e48 service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Received unexpected event network-vif-plugged-d22822e2-3327-4efc-8aa0-55a47b73c5bf for instance with vm_state active and task_state None.
Nov 18 17:37:02 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:37:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:37:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:37:12 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:37:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:37:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:37:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:37:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:37:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:37:27 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:37:29 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-6b77ae5f-e996-435d-b19f-60733c54bcd0 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Acquiring lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:37:29 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-6b77ae5f-e996-435d-b19f-60733c54bcd0 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:37:29 user nova-compute[74743]: INFO nova.compute.manager [None req-6b77ae5f-e996-435d-b19f-60733c54bcd0 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Detaching volume 2e6dfa5b-0b85-44db-9143-5418ac8a3722
Nov 18 17:37:29 user nova-compute[74743]: INFO nova.virt.block_device [None req-6b77ae5f-e996-435d-b19f-60733c54bcd0 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Attempting to driver detach volume 2e6dfa5b-0b85-44db-9143-5418ac8a3722 from mountpoint /dev/vdb
Nov 18 17:37:29 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-6b77ae5f-e996-435d-b19f-60733c54bcd0 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Attempting to detach device vdb from instance 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de from the persistent domain config. {{(pid=74743) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 17:37:29 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-6b77ae5f-e996-435d-b19f-60733c54bcd0 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 17:37:29 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:37:29 user nova-compute[74743]:   <source dev="/dev/sdb"/>
Nov 18 17:37:29 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:37:29 user nova-compute[74743]:   <serial>2e6dfa5b-0b85-44db-9143-5418ac8a3722</serial>
Nov 18 17:37:29 user nova-compute[74743]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 17:37:29 user nova-compute[74743]: </disk>
Nov 18 17:37:29 user nova-compute[74743]:  {{(pid=74743) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 17:37:29 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-6b77ae5f-e996-435d-b19f-60733c54bcd0 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Successfully detached device vdb from instance 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de from the persistent domain config.
Nov 18 17:37:29 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-6b77ae5f-e996-435d-b19f-60733c54bcd0 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de from the live domain config. {{(pid=74743) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 17:37:29 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-6b77ae5f-e996-435d-b19f-60733c54bcd0 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 17:37:29 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:37:29 user nova-compute[74743]:   <source dev="/dev/sdb"/>
Nov 18 17:37:29 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:37:29 user nova-compute[74743]:   <serial>2e6dfa5b-0b85-44db-9143-5418ac8a3722</serial>
Nov 18 17:37:29 user nova-compute[74743]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 17:37:29 user nova-compute[74743]: </disk>
Nov 18 17:37:29 user nova-compute[74743]:  {{(pid=74743) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 17:37:29 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-6b77ae5f-e996-435d-b19f-60733c54bcd0 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de {{(pid=74743) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 17:37:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:37:32 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:37:32 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:37:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:37:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:37:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74743) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 17:37:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:37:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:37:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:37:39 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:37:39 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74743) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 17:37:41 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:37:42 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:37:42 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:37:43 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:37:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:37:48 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:37:49 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:37:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:37:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:37:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:37:49 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Auditing locally available compute resources for user (node: user) {{(pid=74743) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 17:37:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:37:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:37:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:37:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:37:50 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-6b77ae5f-e996-435d-b19f-60733c54bcd0 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de is timed out.
Nov 18 17:37:50 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-6b77ae5f-e996-435d-b19f-60733c54bcd0 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Successfully detached device vdb from instance 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de from the live domain config.
Nov 18 17:37:50 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:37:50 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:37:50 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Hypervisor/Node resource view: name=user free_ram=8948MB free_disk=25.18301773071289GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74743) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b77ae5f-e996-435d-b19f-60733c54bcd0 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] calling os-brick to detach iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b77ae5f-e996-435d-b19f-60733c54bcd0 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, {'target_iqn': 'iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YSFWduvj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:37:50 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-6b77ae5f-e996-435d-b19f-60733c54bcd0 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:37:50 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-6b77ae5f-e996-435d-b19f-60733c54bcd0 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-6b77ae5f-e996-435d-b19f-60733c54bcd0 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8983f9-550e-4606-846c-48502a9dbd3a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b77ae5f-e996-435d-b19f-60733c54bcd0 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 17:37:50 user nova-compute[74743]: No targets found.
Nov 18 17:37:50 user nova-compute[74743]: iSNS:
Nov 18 17:37:50 user nova-compute[74743]: No targets found.
Nov 18 17:37:50 user nova-compute[74743]: STATIC:
Nov 18 17:37:50 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722
Nov 18 17:37:50 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:37:50 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:37:50 user nova-compute[74743]: FIRMWARE:
Nov 18 17:37:50 user nova-compute[74743]: No targets found.
Nov 18 17:37:50 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b77ae5f-e996-435d-b19f-60733c54bcd0 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 17:37:50 user nova-compute[74743]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 17:37:50 user nova-compute[74743]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74743) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b77ae5f-e996-435d-b19f-60733c54bcd0 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722', 0)] {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b8b675-784e-4128-98d8-6b1034761441]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4d5394-27ba-47ff-b94a-c1825d9c2e1a]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b77ae5f-e996-435d-b19f-60733c54bcd0 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722 (non-flash)
Nov 18 17:37:50 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b77ae5f-e996-435d-b19f-60733c54bcd0 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722 (non-flash)
Nov 18 17:37:50 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b77ae5f-e996-435d-b19f-60733c54bcd0 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb081875b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722'): ({'sdb'}, set())}) {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-6b77ae5f-e996-435d-b19f-60733c54bcd0 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Removing single pathed devices sdb {{(pid=74743) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba31d85-a6e6-4f0e-84b8-6f3adc32aec7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c23fc21-c7c0-440d-85ba-6333541af379]: (4, ('ok\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-6b77ae5f-e996-435d-b19f-60733c54bcd0 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Flushing IO for device /dev/sdb {{(pid=74743) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[684857a7-73fa-4f00-984f-be00baa65890]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-6b77ae5f-e996-435d-b19f-60733c54bcd0 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74743) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Compute_service record updated for user:user {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.200s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc10818-999f-4a02-84a9-04cf73ba4f1c]: (4, ('1', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-6b77ae5f-e996-435d-b19f-60733c54bcd0 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-6b77ae5f-e996-435d-b19f-60733c54bcd0 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] SCSI volumes sdb have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b77ae5f-e996-435d-b19f-60733c54bcd0 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722')] {{(pid=74743) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a6a0c6-3917-40d0-9048-949d39e1524a]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b77ae5f-e996-435d-b19f-60733c54bcd0 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722 -p 172.16.0.220:3260 --logout {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[014a1321-c038-4e07-94db-fd434febf587]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b77ae5f-e996-435d-b19f-60733c54bcd0 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722, portal: 172.16.0.220,3260]
Nov 18 17:37:50 user nova-compute[74743]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722, portal: 172.16.0.220,3260] successful.
Nov 18 17:37:50 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722 -p 172.16.0.220:3260 --op delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e6dfa5b-0b85-44db-9143-5418ac8a3722 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2acc201-e5cf-4951-ac0a-dc5ea66ea475]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b77ae5f-e996-435d-b19f-60733c54bcd0 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-6b77ae5f-e996-435d-b19f-60733c54bcd0 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b77ae5f-e996-435d-b19f-60733c54bcd0 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] <== disconnect_volume: return (298ms) None {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:37:50 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b77ae5f-e996-435d-b19f-60733c54bcd0 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Disconnected iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 17:37:51 user nova-compute[74743]: DEBUG nova.objects.instance [None req-6b77ae5f-e996-435d-b19f-60733c54bcd0 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Lazy-loading 'flavor' on Instance uuid 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:37:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-6b77ae5f-e996-435d-b19f-60733c54bcd0 tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.009s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:37:51 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:37:52 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:37:52 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:37:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:37:53 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:37:53 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:37:53 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Starting heal instance info cache {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 17:37:53 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Rebuilding the list of instances to heal {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 17:37:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "refresh_cache-69d7f224-23d7-4d0e-8bb5-8db35a8ee4de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:37:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquired lock "refresh_cache-69d7f224-23d7-4d0e-8bb5-8db35a8ee4de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:37:53 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Forcefully refreshing network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 17:37:53 user nova-compute[74743]: DEBUG nova.objects.instance [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lazy-loading 'info_cache' on Instance uuid 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:37:53 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Updating instance_info_cache with network_info: [{"id": "d22822e2-3327-4efc-8aa0-55a47b73c5bf", "address": "fa:16:3e:25:10:56", "network": {"id": "97b8f910-abe2-43b1-98c4-c7b52200906f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1194489190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce2bcb9ffb2749128da81f4c2df7f6c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd22822e2-33", "ovs_interfaceid": "d22822e2-3327-4efc-8aa0-55a47b73c5bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:37:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Releasing lock "refresh_cache-69d7f224-23d7-4d0e-8bb5-8db35a8ee4de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:37:54 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Updated the network info_cache for instance {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 17:37:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:38:02 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:38:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:38:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:38:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74743) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 17:38:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:38:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:38:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:38:08 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:38:09 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:38:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:38:12 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:38:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Acquiring lock "714e6afb-3bdd-4d12-be25-48fc5bd741af" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:38:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Lock "714e6afb-3bdd-4d12-be25-48fc5bd741af" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:38:13 user nova-compute[74743]: DEBUG nova.compute.manager [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Starting instance... {{(pid=74743) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 17:38:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:38:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:38:13 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74743) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 17:38:13 user nova-compute[74743]: INFO nova.compute.claims [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Claim successful on node user
Nov 18 17:38:13 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:38:13 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:38:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.225s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:38:13 user nova-compute[74743]: DEBUG nova.compute.manager [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Start building networks asynchronously for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 17:38:13 user nova-compute[74743]: DEBUG nova.compute.manager [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Allocating IP information in the background. {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 17:38:13 user nova-compute[74743]: DEBUG nova.network.neutron [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] allocate_for_instance() {{(pid=74743) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 17:38:13 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 17:38:13 user nova-compute[74743]: DEBUG nova.compute.manager [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Start building block device mappings for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 17:38:13 user nova-compute[74743]: DEBUG nova.policy [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '27ce5e71dbc74e849f07f52577dfd9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a66a4053c694109b2855687a3e85baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74743) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 17:38:14 user nova-compute[74743]: DEBUG nova.compute.manager [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Start spawning the instance on the hypervisor. {{(pid=74743) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 17:38:14 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Creating instance directory {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 17:38:14 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Creating image(s)
Nov 18 17:38:14 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Acquiring lock "/opt/stack/data/nova/instances/714e6afb-3bdd-4d12-be25-48fc5bd741af/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:38:14 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Lock "/opt/stack/data/nova/instances/714e6afb-3bdd-4d12-be25-48fc5bd741af/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:38:14 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Lock "/opt/stack/data/nova/instances/714e6afb-3bdd-4d12-be25-48fc5bd741af/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:38:14 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:38:14 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.171s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:38:14 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Acquiring lock "c188b3a997bfafa42fa341f9dcc326545681eed9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:38:14 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:38:14 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:38:14 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.173s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:38:14 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/714e6afb-3bdd-4d12-be25-48fc5bd741af/disk 1073741824 {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:38:14 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/714e6afb-3bdd-4d12-be25-48fc5bd741af/disk 1073741824" returned: 0 in 0.049s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:38:14 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:38:14 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:38:14 user nova-compute[74743]: DEBUG nova.network.neutron [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Successfully created port: a4f0ecc1-1986-4196-b4cd-ddc23ddaf6eb {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:38:14 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.169s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:38:14 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Checking if we can resize image /opt/stack/data/nova/instances/714e6afb-3bdd-4d12-be25-48fc5bd741af/disk. size=1073741824 {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 17:38:14 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/714e6afb-3bdd-4d12-be25-48fc5bd741af/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:38:14 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/714e6afb-3bdd-4d12-be25-48fc5bd741af/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:38:14 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Cannot resize image /opt/stack/data/nova/instances/714e6afb-3bdd-4d12-be25-48fc5bd741af/disk to a smaller size. {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 17:38:14 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Created local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 17:38:14 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Ensure instance console log exists: /opt/stack/data/nova/instances/714e6afb-3bdd-4d12-be25-48fc5bd741af/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:38:14 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:38:14 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:38:14 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:38:15 user nova-compute[74743]: DEBUG nova.network.neutron [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Successfully updated port: a4f0ecc1-1986-4196-b4cd-ddc23ddaf6eb {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:38:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Acquiring lock "refresh_cache-714e6afb-3bdd-4d12-be25-48fc5bd741af" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:38:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Acquired lock "refresh_cache-714e6afb-3bdd-4d12-be25-48fc5bd741af" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:38:15 user nova-compute[74743]: DEBUG nova.network.neutron [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:38:15 user nova-compute[74743]: DEBUG nova.compute.manager [req-f8654c1b-7b85-4418-bbf4-dfee6585948f req-c2a86cbe-da04-4826-aea8-84fa61655bee service nova] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Received event network-changed-a4f0ecc1-1986-4196-b4cd-ddc23ddaf6eb {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:38:15 user nova-compute[74743]: DEBUG nova.compute.manager [req-f8654c1b-7b85-4418-bbf4-dfee6585948f req-c2a86cbe-da04-4826-aea8-84fa61655bee service nova] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Refreshing instance network info cache due to event network-changed-a4f0ecc1-1986-4196-b4cd-ddc23ddaf6eb. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:38:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f8654c1b-7b85-4418-bbf4-dfee6585948f req-c2a86cbe-da04-4826-aea8-84fa61655bee service nova] Acquiring lock "refresh_cache-714e6afb-3bdd-4d12-be25-48fc5bd741af" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:38:15 user nova-compute[74743]: DEBUG nova.network.neutron [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:38:15 user nova-compute[74743]: DEBUG nova.network.neutron [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Updating instance_info_cache with network_info: [{"id": "a4f0ecc1-1986-4196-b4cd-ddc23ddaf6eb", "address": "fa:16:3e:aa:6f:5f", "network": {"id": "9ab2e361-b754-4327-85e0-51418401dcde", "bridge": "br-int", "label": "tempest-VolumesActionsTest-7894836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a66a4053c694109b2855687a3e85baa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f0ecc1-19", "ovs_interfaceid": "a4f0ecc1-1986-4196-b4cd-ddc23ddaf6eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:38:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Releasing lock "refresh_cache-714e6afb-3bdd-4d12-be25-48fc5bd741af" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:38:15 user nova-compute[74743]: DEBUG nova.compute.manager [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Instance network_info: |[{"id": "a4f0ecc1-1986-4196-b4cd-ddc23ddaf6eb", "address": "fa:16:3e:aa:6f:5f", "network": {"id": "9ab2e361-b754-4327-85e0-51418401dcde", "bridge": "br-int", "label": "tempest-VolumesActionsTest-7894836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a66a4053c694109b2855687a3e85baa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f0ecc1-19", "ovs_interfaceid": "a4f0ecc1-1986-4196-b4cd-ddc23ddaf6eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 17:38:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f8654c1b-7b85-4418-bbf4-dfee6585948f req-c2a86cbe-da04-4826-aea8-84fa61655bee service nova] Acquired lock "refresh_cache-714e6afb-3bdd-4d12-be25-48fc5bd741af" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:38:15 user nova-compute[74743]: DEBUG nova.network.neutron [req-f8654c1b-7b85-4418-bbf4-dfee6585948f req-c2a86cbe-da04-4826-aea8-84fa61655bee service nova] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Refreshing network info cache for port a4f0ecc1-1986-4196-b4cd-ddc23ddaf6eb {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:38:15 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Start _get_guest_xml network_info=[{"id": "a4f0ecc1-1986-4196-b4cd-ddc23ddaf6eb", "address": "fa:16:3e:aa:6f:5f", "network": {"id": "9ab2e361-b754-4327-85e0-51418401dcde", "bridge": "br-int", "label": "tempest-VolumesActionsTest-7894836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a66a4053c694109b2855687a3e85baa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f0ecc1-19", "ovs_interfaceid": "a4f0ecc1-1986-4196-b4cd-ddc23ddaf6eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '9536f6cf-95c4-40e2-864a-09a91525678a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:38:15 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:38:15 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:38:15 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:38:15 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:38:15 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:38:15 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:38:15 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:38:15 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:38:15 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:38:15 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:38:15 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:38:15 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:38:15 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:38:15 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:38:15 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:38:15 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:38:15 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:38:15 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:38:15 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:38:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2065864097',display_name='tempest-VolumesActionsTest-instance-2065864097',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2065864097',id=47,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a66a4053c694109b2855687a3e85baa',ramdisk_id='',reservation_id='r-towpinyl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-721631098',owner_user_name='tempest-VolumesActionsTest-721631098-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:38:14Z,user_data=None,user_id='27ce5e71dbc74e849f07f52577dfd9b2',uuid=714e6afb-3bdd-4d12-be25-48fc5bd741af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4f0ecc1-1986-4196-b4cd-ddc23ddaf6eb", "address": "fa:16:3e:aa:6f:5f", "network": {"id": "9ab2e361-b754-4327-85e0-51418401dcde", "bridge": "br-int", "label": "tempest-VolumesActionsTest-7894836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a66a4053c694109b2855687a3e85baa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f0ecc1-19", "ovs_interfaceid": "a4f0ecc1-1986-4196-b4cd-ddc23ddaf6eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:38:15 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Converting VIF {"id": "a4f0ecc1-1986-4196-b4cd-ddc23ddaf6eb", "address": "fa:16:3e:aa:6f:5f", "network": {"id": "9ab2e361-b754-4327-85e0-51418401dcde", "bridge": "br-int", "label": "tempest-VolumesActionsTest-7894836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a66a4053c694109b2855687a3e85baa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f0ecc1-19", "ovs_interfaceid": "a4f0ecc1-1986-4196-b4cd-ddc23ddaf6eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:38:15 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:6f:5f,bridge_name='br-int',has_traffic_filtering=True,id=a4f0ecc1-1986-4196-b4cd-ddc23ddaf6eb,network=Network(9ab2e361-b754-4327-85e0-51418401dcde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4f0ecc1-19') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:38:15 user nova-compute[74743]: DEBUG nova.objects.instance [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Lazy-loading 'pci_devices' on Instance uuid 714e6afb-3bdd-4d12-be25-48fc5bd741af {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:38:15 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:38:15 user nova-compute[74743]:   <uuid>714e6afb-3bdd-4d12-be25-48fc5bd741af</uuid>
Nov 18 17:38:15 user nova-compute[74743]:   <name>instance-0000002f</name>
Nov 18 17:38:15 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:38:15 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:38:15 user nova-compute[74743]:   <metadata>
Nov 18 17:38:15 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:38:15 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:38:15 user nova-compute[74743]:       <nova:name>tempest-VolumesActionsTest-instance-2065864097</nova:name>
Nov 18 17:38:15 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:38:15</nova:creationTime>
Nov 18 17:38:15 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:38:15 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:38:15 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:38:15 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:38:15 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:38:15 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:38:15 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:38:15 user nova-compute[74743]:       <nova:owner>
Nov 18 17:38:15 user nova-compute[74743]:         <nova:user uuid="27ce5e71dbc74e849f07f52577dfd9b2">tempest-VolumesActionsTest-721631098-project-member</nova:user>
Nov 18 17:38:15 user nova-compute[74743]:         <nova:project uuid="9a66a4053c694109b2855687a3e85baa">tempest-VolumesActionsTest-721631098</nova:project>
Nov 18 17:38:15 user nova-compute[74743]:       </nova:owner>
Nov 18 17:38:15 user nova-compute[74743]:       <nova:root type="image" uuid="9536f6cf-95c4-40e2-864a-09a91525678a"/>
Nov 18 17:38:15 user nova-compute[74743]:       <nova:ports>
Nov 18 17:38:15 user nova-compute[74743]:         <nova:port uuid="a4f0ecc1-1986-4196-b4cd-ddc23ddaf6eb">
Nov 18 17:38:15 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 18 17:38:15 user nova-compute[74743]:         </nova:port>
Nov 18 17:38:15 user nova-compute[74743]:       </nova:ports>
Nov 18 17:38:15 user nova-compute[74743]:     </nova:instance>
Nov 18 17:38:15 user nova-compute[74743]:   </metadata>
Nov 18 17:38:15 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:38:15 user nova-compute[74743]:     <system>
Nov 18 17:38:15 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:38:15 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:38:15 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:38:15 user nova-compute[74743]:       <entry name="serial">714e6afb-3bdd-4d12-be25-48fc5bd741af</entry>
Nov 18 17:38:15 user nova-compute[74743]:       <entry name="uuid">714e6afb-3bdd-4d12-be25-48fc5bd741af</entry>
Nov 18 17:38:15 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:38:15 user nova-compute[74743]:     </system>
Nov 18 17:38:15 user nova-compute[74743]:   </sysinfo>
Nov 18 17:38:15 user nova-compute[74743]:   <os>
Nov 18 17:38:15 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:38:15 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:38:15 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:38:15 user nova-compute[74743]:   </os>
Nov 18 17:38:15 user nova-compute[74743]:   <features>
Nov 18 17:38:15 user nova-compute[74743]:     <acpi/>
Nov 18 17:38:15 user nova-compute[74743]:     <apic/>
Nov 18 17:38:15 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:38:15 user nova-compute[74743]:   </features>
Nov 18 17:38:15 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:38:15 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:38:15 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:38:15 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:38:15 user nova-compute[74743]:   </clock>
Nov 18 17:38:15 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:38:15 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:38:15 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:38:15 user nova-compute[74743]:   </cpu>
Nov 18 17:38:15 user nova-compute[74743]:   <devices>
Nov 18 17:38:15 user nova-compute[74743]:     <disk type="file" device="disk">
Nov 18 17:38:15 user nova-compute[74743]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 17:38:15 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/714e6afb-3bdd-4d12-be25-48fc5bd741af/disk"/>
Nov 18 17:38:15 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:38:15 user nova-compute[74743]:     </disk>
Nov 18 17:38:15 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:38:15 user nova-compute[74743]:       <mac address="fa:16:3e:aa:6f:5f"/>
Nov 18 17:38:15 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:38:15 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:38:15 user nova-compute[74743]:       <target dev="tapa4f0ecc1-19"/>
Nov 18 17:38:15 user nova-compute[74743]:     </interface>
Nov 18 17:38:15 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:38:15 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/714e6afb-3bdd-4d12-be25-48fc5bd741af/console.log" append="off"/>
Nov 18 17:38:15 user nova-compute[74743]:     </serial>
Nov 18 17:38:15 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:38:15 user nova-compute[74743]:     <video>
Nov 18 17:38:15 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:38:15 user nova-compute[74743]:     </video>
Nov 18 17:38:15 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:38:15 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:38:15 user nova-compute[74743]:     </rng>
Nov 18 17:38:15 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:38:15 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:38:15 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:38:15 user nova-compute[74743]:     </memballoon>
Nov 18 17:38:15 user nova-compute[74743]:   </devices>
Nov 18 17:38:15 user nova-compute[74743]: </domain>
Nov 18 17:38:15 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:38:15 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:38:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2065864097',display_name='tempest-VolumesActionsTest-instance-2065864097',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2065864097',id=47,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a66a4053c694109b2855687a3e85baa',ramdisk_id='',reservation_id='r-towpinyl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-721631098',owner_user_name='tempest-VolumesActionsTest-721631098-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:38:14Z,user_data=None,user_id='27ce5e71dbc74e849f07f52577dfd9b2',uuid=714e6afb-3bdd-4d12-be25-48fc5bd741af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4f0ecc1-1986-4196-b4cd-ddc23ddaf6eb", "address": "fa:16:3e:aa:6f:5f", "network": {"id": "9ab2e361-b754-4327-85e0-51418401dcde", "bridge": "br-int", "label": "tempest-VolumesActionsTest-7894836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a66a4053c694109b2855687a3e85baa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f0ecc1-19", "ovs_interfaceid": "a4f0ecc1-1986-4196-b4cd-ddc23ddaf6eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:38:15 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Converting VIF {"id": "a4f0ecc1-1986-4196-b4cd-ddc23ddaf6eb", "address": "fa:16:3e:aa:6f:5f", "network": {"id": "9ab2e361-b754-4327-85e0-51418401dcde", "bridge": "br-int", "label": "tempest-VolumesActionsTest-7894836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a66a4053c694109b2855687a3e85baa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f0ecc1-19", "ovs_interfaceid": "a4f0ecc1-1986-4196-b4cd-ddc23ddaf6eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:38:15 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:6f:5f,bridge_name='br-int',has_traffic_filtering=True,id=a4f0ecc1-1986-4196-b4cd-ddc23ddaf6eb,network=Network(9ab2e361-b754-4327-85e0-51418401dcde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4f0ecc1-19') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:38:15 user nova-compute[74743]: DEBUG os_vif [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:6f:5f,bridge_name='br-int',has_traffic_filtering=True,id=a4f0ecc1-1986-4196-b4cd-ddc23ddaf6eb,network=Network(9ab2e361-b754-4327-85e0-51418401dcde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4f0ecc1-19') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:38:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:38:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:38:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:38:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:38:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '571757f5-d248-5068-983d-9d103ff46cee', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:38:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:38:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:38:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:38:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa4f0ecc1-19, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:38:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa4f0ecc1-19, col_values=(('qos', UUID('9bcc9afc-ae41-44d5-9d4a-c570881bd927')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:38:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa4f0ecc1-19, col_values=(('external_ids', {'iface-id': 'a4f0ecc1-1986-4196-b4cd-ddc23ddaf6eb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:6f:5f', 'vm-uuid': '714e6afb-3bdd-4d12-be25-48fc5bd741af'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:38:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:38:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:38:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:38:15 user nova-compute[74743]: INFO os_vif [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:6f:5f,bridge_name='br-int',has_traffic_filtering=True,id=a4f0ecc1-1986-4196-b4cd-ddc23ddaf6eb,network=Network(9ab2e361-b754-4327-85e0-51418401dcde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4f0ecc1-19')
Nov 18 17:38:15 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:38:15 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] No VIF found with MAC fa:16:3e:aa:6f:5f, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:38:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:38:15 user nova-compute[74743]: DEBUG nova.network.neutron [req-f8654c1b-7b85-4418-bbf4-dfee6585948f req-c2a86cbe-da04-4826-aea8-84fa61655bee service nova] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Updated VIF entry in instance network info cache for port a4f0ecc1-1986-4196-b4cd-ddc23ddaf6eb. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:38:15 user nova-compute[74743]: DEBUG nova.network.neutron [req-f8654c1b-7b85-4418-bbf4-dfee6585948f req-c2a86cbe-da04-4826-aea8-84fa61655bee service nova] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Updating instance_info_cache with network_info: [{"id": "a4f0ecc1-1986-4196-b4cd-ddc23ddaf6eb", "address": "fa:16:3e:aa:6f:5f", "network": {"id": "9ab2e361-b754-4327-85e0-51418401dcde", "bridge": "br-int", "label": "tempest-VolumesActionsTest-7894836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a66a4053c694109b2855687a3e85baa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f0ecc1-19", "ovs_interfaceid": "a4f0ecc1-1986-4196-b4cd-ddc23ddaf6eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:38:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f8654c1b-7b85-4418-bbf4-dfee6585948f req-c2a86cbe-da04-4826-aea8-84fa61655bee service nova] Releasing lock "refresh_cache-714e6afb-3bdd-4d12-be25-48fc5bd741af" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:38:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:38:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:38:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:38:17 user nova-compute[74743]: DEBUG nova.compute.manager [req-787d673a-7aad-450d-be80-7fb1a663e606 req-472b48d5-7b2a-4864-94c6-ada9e00c8da8 service nova] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Received event network-vif-plugged-a4f0ecc1-1986-4196-b4cd-ddc23ddaf6eb {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:38:17 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-787d673a-7aad-450d-be80-7fb1a663e606 req-472b48d5-7b2a-4864-94c6-ada9e00c8da8 service nova] Acquiring lock "714e6afb-3bdd-4d12-be25-48fc5bd741af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:38:17 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-787d673a-7aad-450d-be80-7fb1a663e606 req-472b48d5-7b2a-4864-94c6-ada9e00c8da8 service nova] Lock "714e6afb-3bdd-4d12-be25-48fc5bd741af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:38:17 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-787d673a-7aad-450d-be80-7fb1a663e606 req-472b48d5-7b2a-4864-94c6-ada9e00c8da8 service nova] Lock "714e6afb-3bdd-4d12-be25-48fc5bd741af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:38:17 user nova-compute[74743]: DEBUG nova.compute.manager [req-787d673a-7aad-450d-be80-7fb1a663e606 req-472b48d5-7b2a-4864-94c6-ada9e00c8da8 service nova] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] No waiting events found dispatching network-vif-plugged-a4f0ecc1-1986-4196-b4cd-ddc23ddaf6eb {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:38:17 user nova-compute[74743]: WARNING nova.compute.manager [req-787d673a-7aad-450d-be80-7fb1a663e606 req-472b48d5-7b2a-4864-94c6-ada9e00c8da8 service nova] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Received unexpected event network-vif-plugged-a4f0ecc1-1986-4196-b4cd-ddc23ddaf6eb for instance with vm_state building and task_state spawning.
Nov 18 17:38:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:38:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:38:18 user nova-compute[74743]: DEBUG nova.compute.manager [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:38:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Guest created on hypervisor {{(pid=74743) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 17:38:18 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Instance spawned successfully.
Nov 18 17:38:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 17:38:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Found default for hw_cdrom_bus of ide {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:38:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Found default for hw_disk_bus of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:38:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Found default for hw_input_bus of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:38:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Found default for hw_pointer_model of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:38:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Found default for hw_video_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:38:19 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Found default for hw_vif_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:38:19 user nova-compute[74743]: INFO nova.compute.manager [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Took 5.01 seconds to spawn the instance on the hypervisor.
Nov 18 17:38:19 user nova-compute[74743]: DEBUG nova.compute.manager [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:38:19 user nova-compute[74743]: INFO nova.compute.manager [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Took 5.57 seconds to build instance.
Nov 18 17:38:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-c523caae-98da-4eb3-8195-5e254e586b8f tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Lock "714e6afb-3bdd-4d12-be25-48fc5bd741af" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.669s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:38:19 user nova-compute[74743]: DEBUG nova.compute.manager [req-6d2d3f3a-de88-4a2d-96a8-e9fce9483599 req-18c9edd3-5a86-4958-8559-1fd85b57831e service nova] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Received event network-vif-plugged-a4f0ecc1-1986-4196-b4cd-ddc23ddaf6eb {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:38:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-6d2d3f3a-de88-4a2d-96a8-e9fce9483599 req-18c9edd3-5a86-4958-8559-1fd85b57831e service nova] Acquiring lock "714e6afb-3bdd-4d12-be25-48fc5bd741af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:38:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-6d2d3f3a-de88-4a2d-96a8-e9fce9483599 req-18c9edd3-5a86-4958-8559-1fd85b57831e service nova] Lock "714e6afb-3bdd-4d12-be25-48fc5bd741af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:38:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-6d2d3f3a-de88-4a2d-96a8-e9fce9483599 req-18c9edd3-5a86-4958-8559-1fd85b57831e service nova] Lock "714e6afb-3bdd-4d12-be25-48fc5bd741af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:38:19 user nova-compute[74743]: DEBUG nova.compute.manager [req-6d2d3f3a-de88-4a2d-96a8-e9fce9483599 req-18c9edd3-5a86-4958-8559-1fd85b57831e service nova] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] No waiting events found dispatching network-vif-plugged-a4f0ecc1-1986-4196-b4cd-ddc23ddaf6eb {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:38:19 user nova-compute[74743]: WARNING nova.compute.manager [req-6d2d3f3a-de88-4a2d-96a8-e9fce9483599 req-18c9edd3-5a86-4958-8559-1fd85b57831e service nova] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Received unexpected event network-vif-plugged-a4f0ecc1-1986-4196-b4cd-ddc23ddaf6eb for instance with vm_state active and task_state None.
Nov 18 17:38:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-b8799112-ceb6-44a6-944e-76a95f085ddc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Acquiring lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:38:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-b8799112-ceb6-44a6-944e-76a95f085ddc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:38:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-b8799112-ceb6-44a6-944e-76a95f085ddc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Acquiring lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:38:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-b8799112-ceb6-44a6-944e-76a95f085ddc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:38:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-b8799112-ceb6-44a6-944e-76a95f085ddc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:38:20 user nova-compute[74743]: INFO nova.compute.manager [None req-b8799112-ceb6-44a6-944e-76a95f085ddc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Terminating instance
Nov 18 17:38:20 user nova-compute[74743]: DEBUG nova.compute.manager [None req-b8799112-ceb6-44a6-944e-76a95f085ddc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Start destroying the instance on the hypervisor. {{(pid=74743) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 17:38:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:38:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:38:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:38:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:38:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:38:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:38:20 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Instance destroyed successfully.
Nov 18 17:38:20 user nova-compute[74743]: DEBUG nova.objects.instance [None req-b8799112-ceb6-44a6-944e-76a95f085ddc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Lazy-loading 'resources' on Instance uuid 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:38:20 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-b8799112-ceb6-44a6-944e-76a95f085ddc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:31:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1530848000',display_name='tempest-ServerStableDeviceRescueTest-server-1530848000',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1530848000',id=45,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBChhBo9VaY4BOIEFz523V2/9n5F5kQpNA2Q/p8rjF0+VRwZUYTxFpwuCPuS3su+tPJHnXXaAkikoqSKB9iEmlKXcPvgT6Y454gPB2vB2hybhUh/7RHCr59TSrRv/zlM5Rg==',key_name='tempest-keypair-969517686',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:35:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ce2bcb9ffb2749128da81f4c2df7f6c1',ramdisk_id='',reservation_id='r-wquedsqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1073155627',owner_user_name='tempest-ServerStableDeviceRescueTest-1073155627-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:37:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad24aa794fd148fab6df6d7b98443a90',uuid=69d7f224-23d7-4d0e-8bb5-8db35a8ee4de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d22822e2-3327-4efc-8aa0-55a47b73c5bf", "address": "fa:16:3e:25:10:56", "network": {"id": "97b8f910-abe2-43b1-98c4-c7b52200906f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1194489190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce2bcb9ffb2749128da81f4c2df7f6c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd22822e2-33", "ovs_interfaceid": "d22822e2-3327-4efc-8aa0-55a47b73c5bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:38:20 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-b8799112-ceb6-44a6-944e-76a95f085ddc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Converting VIF {"id": "d22822e2-3327-4efc-8aa0-55a47b73c5bf", "address": "fa:16:3e:25:10:56", "network": {"id": "97b8f910-abe2-43b1-98c4-c7b52200906f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1194489190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce2bcb9ffb2749128da81f4c2df7f6c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd22822e2-33", "ovs_interfaceid": "d22822e2-3327-4efc-8aa0-55a47b73c5bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:38:20 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-b8799112-ceb6-44a6-944e-76a95f085ddc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:25:10:56,bridge_name='br-int',has_traffic_filtering=True,id=d22822e2-3327-4efc-8aa0-55a47b73c5bf,network=Network(97b8f910-abe2-43b1-98c4-c7b52200906f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd22822e2-33') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:38:20 user nova-compute[74743]: DEBUG os_vif [None req-b8799112-ceb6-44a6-944e-76a95f085ddc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:10:56,bridge_name='br-int',has_traffic_filtering=True,id=d22822e2-3327-4efc-8aa0-55a47b73c5bf,network=Network(97b8f910-abe2-43b1-98c4-c7b52200906f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd22822e2-33') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:38:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:38:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd22822e2-33, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:38:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:38:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:38:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:38:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8679494f-f768-40a2-8454-119e7e51f74d) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:38:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:38:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:38:21 user nova-compute[74743]: INFO os_vif [None req-b8799112-ceb6-44a6-944e-76a95f085ddc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:10:56,bridge_name='br-int',has_traffic_filtering=True,id=d22822e2-3327-4efc-8aa0-55a47b73c5bf,network=Network(97b8f910-abe2-43b1-98c4-c7b52200906f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd22822e2-33')
Nov 18 17:38:21 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-b8799112-ceb6-44a6-944e-76a95f085ddc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Deleting instance files /opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de_del
Nov 18 17:38:21 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-b8799112-ceb6-44a6-944e-76a95f085ddc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Deletion of /opt/stack/data/nova/instances/69d7f224-23d7-4d0e-8bb5-8db35a8ee4de_del complete
Nov 18 17:38:21 user nova-compute[74743]: INFO nova.compute.manager [None req-b8799112-ceb6-44a6-944e-76a95f085ddc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 18 17:38:21 user nova-compute[74743]: DEBUG oslo.service.loopingcall [None req-b8799112-ceb6-44a6-944e-76a95f085ddc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74743) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 17:38:21 user nova-compute[74743]: DEBUG nova.compute.manager [-] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Deallocating network for instance {{(pid=74743) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 17:38:21 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] deallocate_for_instance() {{(pid=74743) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 17:38:21 user nova-compute[74743]: DEBUG nova.compute.manager [req-b52f8bde-d347-4388-a145-6190bee5ab4f req-7c2c1c31-aa9d-471f-969a-ce6a309129fb service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Received event network-vif-unplugged-d22822e2-3327-4efc-8aa0-55a47b73c5bf {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:38:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b52f8bde-d347-4388-a145-6190bee5ab4f req-7c2c1c31-aa9d-471f-969a-ce6a309129fb service nova] Acquiring lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:38:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b52f8bde-d347-4388-a145-6190bee5ab4f req-7c2c1c31-aa9d-471f-969a-ce6a309129fb service nova] Lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:38:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b52f8bde-d347-4388-a145-6190bee5ab4f req-7c2c1c31-aa9d-471f-969a-ce6a309129fb service nova] Lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:38:21 user nova-compute[74743]: DEBUG nova.compute.manager [req-b52f8bde-d347-4388-a145-6190bee5ab4f req-7c2c1c31-aa9d-471f-969a-ce6a309129fb service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] No waiting events found dispatching network-vif-unplugged-d22822e2-3327-4efc-8aa0-55a47b73c5bf {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:38:21 user nova-compute[74743]: DEBUG nova.compute.manager [req-b52f8bde-d347-4388-a145-6190bee5ab4f req-7c2c1c31-aa9d-471f-969a-ce6a309129fb service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Received event network-vif-unplugged-d22822e2-3327-4efc-8aa0-55a47b73c5bf for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:38:21 user nova-compute[74743]: DEBUG nova.compute.manager [req-b52f8bde-d347-4388-a145-6190bee5ab4f req-7c2c1c31-aa9d-471f-969a-ce6a309129fb service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Received event network-vif-plugged-d22822e2-3327-4efc-8aa0-55a47b73c5bf {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:38:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b52f8bde-d347-4388-a145-6190bee5ab4f req-7c2c1c31-aa9d-471f-969a-ce6a309129fb service nova] Acquiring lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:38:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b52f8bde-d347-4388-a145-6190bee5ab4f req-7c2c1c31-aa9d-471f-969a-ce6a309129fb service nova] Lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:38:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b52f8bde-d347-4388-a145-6190bee5ab4f req-7c2c1c31-aa9d-471f-969a-ce6a309129fb service nova] Lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:38:21 user nova-compute[74743]: DEBUG nova.compute.manager [req-b52f8bde-d347-4388-a145-6190bee5ab4f req-7c2c1c31-aa9d-471f-969a-ce6a309129fb service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] No waiting events found dispatching network-vif-plugged-d22822e2-3327-4efc-8aa0-55a47b73c5bf {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:38:21 user nova-compute[74743]: WARNING nova.compute.manager [req-b52f8bde-d347-4388-a145-6190bee5ab4f req-7c2c1c31-aa9d-471f-969a-ce6a309129fb service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Received unexpected event network-vif-plugged-d22822e2-3327-4efc-8aa0-55a47b73c5bf for instance with vm_state active and task_state deleting.
Nov 18 17:38:21 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:38:21 user nova-compute[74743]: INFO nova.compute.manager [-] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Took 0.93 seconds to deallocate network for instance.
Nov 18 17:38:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-b8799112-ceb6-44a6-944e-76a95f085ddc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:38:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-b8799112-ceb6-44a6-944e-76a95f085ddc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:38:22 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-b8799112-ceb6-44a6-944e-76a95f085ddc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:38:22 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-b8799112-ceb6-44a6-944e-76a95f085ddc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:38:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-b8799112-ceb6-44a6-944e-76a95f085ddc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.130s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:38:22 user nova-compute[74743]: INFO nova.scheduler.client.report [None req-b8799112-ceb6-44a6-944e-76a95f085ddc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Deleted allocations for instance 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de
Nov 18 17:38:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-b8799112-ceb6-44a6-944e-76a95f085ddc tempest-ServerStableDeviceRescueTest-1073155627 tempest-ServerStableDeviceRescueTest-1073155627-project-member] Lock "69d7f224-23d7-4d0e-8bb5-8db35a8ee4de" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.116s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:38:23 user nova-compute[74743]: DEBUG nova.compute.manager [req-e1a79729-2a32-439c-866a-30cf0192cdbb req-84e2345c-9c11-4c24-8d43-ff05280de3e2 service nova] [instance: 69d7f224-23d7-4d0e-8bb5-8db35a8ee4de] Received event network-vif-deleted-d22822e2-3327-4efc-8aa0-55a47b73c5bf {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:38:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:38:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:38:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:38:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:38:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74743) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 17:38:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:38:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:38:31 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:38:35 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:38:36 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:38:40 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:38:40 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74743) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 17:38:40 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:38:41 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:38:43 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:38:43 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:38:45 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:38:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:38:48 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:38:49 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:38:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:38:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:38:49 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:38:49 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Auditing locally available compute resources for user (node: user) {{(pid=74743) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 17:38:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/714e6afb-3bdd-4d12-be25-48fc5bd741af/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:38:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/714e6afb-3bdd-4d12-be25-48fc5bd741af/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:38:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/714e6afb-3bdd-4d12-be25-48fc5bd741af/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:38:49 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/714e6afb-3bdd-4d12-be25-48fc5bd741af/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:38:50 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:38:50 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:38:50 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Hypervisor/Node resource view: name=user free_ram=8885MB free_disk=25.269817352294922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74743) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 17:38:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:38:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:38:50 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 714e6afb-3bdd-4d12-be25-48fc5bd741af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:38:50 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 17:38:50 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 17:38:50 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:38:50 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:38:50 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Compute_service record updated for user:user {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 17:38:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.207s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:38:50 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:38:51 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:38:53 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:38:53 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:38:53 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:38:55 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:38:55 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Starting heal instance info cache {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 17:38:55 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Rebuilding the list of instances to heal {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 17:38:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "refresh_cache-714e6afb-3bdd-4d12-be25-48fc5bd741af" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:38:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquired lock "refresh_cache-714e6afb-3bdd-4d12-be25-48fc5bd741af" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:38:55 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Forcefully refreshing network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 17:38:55 user nova-compute[74743]: DEBUG nova.objects.instance [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lazy-loading 'info_cache' on Instance uuid 714e6afb-3bdd-4d12-be25-48fc5bd741af {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:38:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:38:56 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Updating instance_info_cache with network_info: [{"id": "a4f0ecc1-1986-4196-b4cd-ddc23ddaf6eb", "address": "fa:16:3e:aa:6f:5f", "network": {"id": "9ab2e361-b754-4327-85e0-51418401dcde", "bridge": "br-int", "label": "tempest-VolumesActionsTest-7894836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a66a4053c694109b2855687a3e85baa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f0ecc1-19", "ovs_interfaceid": "a4f0ecc1-1986-4196-b4cd-ddc23ddaf6eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:38:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Releasing lock "refresh_cache-714e6afb-3bdd-4d12-be25-48fc5bd741af" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:38:56 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Updated the network info_cache for instance {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 17:39:01 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:39:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:39:10 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:39:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:39:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:39:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:39:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:39:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:39:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:39:10 user nova-compute[74743]: DEBUG nova.virt.libvirt.imagecache [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Verify base images {{(pid=74743) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 18 17:39:10 user nova-compute[74743]: DEBUG nova.virt.libvirt.imagecache [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Image id 9536f6cf-95c4-40e2-864a-09a91525678a yields fingerprint c188b3a997bfafa42fa341f9dcc326545681eed9 {{(pid=74743) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 18 17:39:10 user nova-compute[74743]: INFO nova.virt.libvirt.imagecache [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] image 9536f6cf-95c4-40e2-864a-09a91525678a at (/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9): checking
Nov 18 17:39:10 user nova-compute[74743]: DEBUG nova.virt.libvirt.imagecache [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] image 9536f6cf-95c4-40e2-864a-09a91525678a at (/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9): image is in use {{(pid=74743) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 18 17:39:10 user nova-compute[74743]: DEBUG nova.virt.libvirt.imagecache [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74743) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 18 17:39:10 user nova-compute[74743]: DEBUG nova.virt.libvirt.imagecache [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] 714e6afb-3bdd-4d12-be25-48fc5bd741af is a valid instance name {{(pid=74743) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 18 17:39:10 user nova-compute[74743]: DEBUG nova.virt.libvirt.imagecache [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] 714e6afb-3bdd-4d12-be25-48fc5bd741af has a disk file {{(pid=74743) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 18 17:39:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/714e6afb-3bdd-4d12-be25-48fc5bd741af/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:39:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/714e6afb-3bdd-4d12-be25-48fc5bd741af/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:39:10 user nova-compute[74743]: DEBUG nova.virt.libvirt.imagecache [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 714e6afb-3bdd-4d12-be25-48fc5bd741af is backed by c188b3a997bfafa42fa341f9dcc326545681eed9 {{(pid=74743) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 18 17:39:10 user nova-compute[74743]: WARNING nova.virt.libvirt.imagecache [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Unknown base file: /opt/stack/data/nova/instances/_base/cda49b6b8a569253893882dbae5c5938462b1c01
Nov 18 17:39:10 user nova-compute[74743]: WARNING nova.virt.libvirt.imagecache [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Unknown base file: /opt/stack/data/nova/instances/_base/6086defff6dc78d9c8c0985e5535c7c38331c8a6
Nov 18 17:39:10 user nova-compute[74743]: WARNING nova.virt.libvirt.imagecache [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Unknown base file: /opt/stack/data/nova/instances/_base/9d921a6fc57b10891f00ee1869f3c43a4c3e34ab
Nov 18 17:39:10 user nova-compute[74743]: WARNING nova.virt.libvirt.imagecache [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Unknown base file: /opt/stack/data/nova/instances/_base/8db625959abb54b8df31802a221ba4d162069606
Nov 18 17:39:10 user nova-compute[74743]: WARNING nova.virt.libvirt.imagecache [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Unknown base file: /opt/stack/data/nova/instances/_base/433841f53c5f6f2eab74d6f85731e9576770cc5d
Nov 18 17:39:10 user nova-compute[74743]: WARNING nova.virt.libvirt.imagecache [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Unknown base file: /opt/stack/data/nova/instances/_base/d533b2f6dacc26adc738fb527040eb2b7eb1698d
Nov 18 17:39:10 user nova-compute[74743]: WARNING nova.virt.libvirt.imagecache [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Unknown base file: /opt/stack/data/nova/instances/_base/4e4d7148a71162e7fd60233b84a0b98b5235793c
Nov 18 17:39:10 user nova-compute[74743]: WARNING nova.virt.libvirt.imagecache [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Unknown base file: /opt/stack/data/nova/instances/_base/2a0437643255c3c4876da1282beff5d98c3df9ca
Nov 18 17:39:10 user nova-compute[74743]: INFO nova.virt.libvirt.imagecache [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Active base files: /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9
Nov 18 17:39:10 user nova-compute[74743]: INFO nova.virt.libvirt.imagecache [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Removable base files: /opt/stack/data/nova/instances/_base/cda49b6b8a569253893882dbae5c5938462b1c01 /opt/stack/data/nova/instances/_base/6086defff6dc78d9c8c0985e5535c7c38331c8a6 /opt/stack/data/nova/instances/_base/9d921a6fc57b10891f00ee1869f3c43a4c3e34ab /opt/stack/data/nova/instances/_base/8db625959abb54b8df31802a221ba4d162069606 /opt/stack/data/nova/instances/_base/433841f53c5f6f2eab74d6f85731e9576770cc5d /opt/stack/data/nova/instances/_base/d533b2f6dacc26adc738fb527040eb2b7eb1698d /opt/stack/data/nova/instances/_base/4e4d7148a71162e7fd60233b84a0b98b5235793c /opt/stack/data/nova/instances/_base/2a0437643255c3c4876da1282beff5d98c3df9ca
Nov 18 17:39:10 user nova-compute[74743]: INFO nova.virt.libvirt.imagecache [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/cda49b6b8a569253893882dbae5c5938462b1c01
Nov 18 17:39:10 user nova-compute[74743]: INFO nova.virt.libvirt.imagecache [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6086defff6dc78d9c8c0985e5535c7c38331c8a6
Nov 18 17:39:10 user nova-compute[74743]: INFO nova.virt.libvirt.imagecache [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9d921a6fc57b10891f00ee1869f3c43a4c3e34ab
Nov 18 17:39:10 user nova-compute[74743]: INFO nova.virt.libvirt.imagecache [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8db625959abb54b8df31802a221ba4d162069606
Nov 18 17:39:10 user nova-compute[74743]: INFO nova.virt.libvirt.imagecache [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/433841f53c5f6f2eab74d6f85731e9576770cc5d
Nov 18 17:39:10 user nova-compute[74743]: INFO nova.virt.libvirt.imagecache [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d533b2f6dacc26adc738fb527040eb2b7eb1698d
Nov 18 17:39:10 user nova-compute[74743]: INFO nova.virt.libvirt.imagecache [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4e4d7148a71162e7fd60233b84a0b98b5235793c
Nov 18 17:39:10 user nova-compute[74743]: INFO nova.virt.libvirt.imagecache [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2a0437643255c3c4876da1282beff5d98c3df9ca
Nov 18 17:39:10 user nova-compute[74743]: DEBUG nova.virt.libvirt.imagecache [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Verification complete {{(pid=74743) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 18 17:39:10 user nova-compute[74743]: DEBUG nova.virt.libvirt.imagecache [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Verify swap images {{(pid=74743) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 18 17:39:10 user nova-compute[74743]: DEBUG nova.virt.libvirt.imagecache [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Verify ephemeral images {{(pid=74743) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 18 17:39:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:39:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:39:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:39:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:39:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:39:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:39:23 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:39:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:39:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:39:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Acquiring lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:39:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:39:26 user nova-compute[74743]: DEBUG nova.compute.manager [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Starting instance... {{(pid=74743) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 17:39:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:39:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:39:26 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74743) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 17:39:26 user nova-compute[74743]: INFO nova.compute.claims [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Claim successful on node user
Nov 18 17:39:26 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:39:26 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:39:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.212s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:39:26 user nova-compute[74743]: DEBUG nova.compute.manager [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Start building networks asynchronously for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 17:39:26 user nova-compute[74743]: DEBUG nova.compute.manager [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Allocating IP information in the background. {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 17:39:26 user nova-compute[74743]: DEBUG nova.network.neutron [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] allocate_for_instance() {{(pid=74743) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 17:39:26 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 17:39:26 user nova-compute[74743]: DEBUG nova.compute.manager [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Start building block device mappings for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 17:39:26 user nova-compute[74743]: DEBUG nova.policy [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8b9d8b543f4946b2918bd38c4a3c835f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790f602c532d41289c52985c8fab91d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74743) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 17:39:26 user nova-compute[74743]: DEBUG nova.compute.manager [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Start spawning the instance on the hypervisor. {{(pid=74743) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 17:39:26 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Creating instance directory {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 17:39:26 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Creating image(s)
Nov 18 17:39:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Acquiring lock "/opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:39:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "/opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:39:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "/opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:39:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:39:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.169s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:39:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Acquiring lock "c188b3a997bfafa42fa341f9dcc326545681eed9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:39:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:39:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:39:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.173s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:39:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk 1073741824 {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:39:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk 1073741824" returned: 0 in 0.054s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:39:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:39:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:39:27 user nova-compute[74743]: DEBUG nova.network.neutron [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Successfully created port: 6ba5e67e-b479-4371-89e3-97c1beceff8f {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:39:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.172s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:39:27 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk. size=1073741824 {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 17:39:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:39:27 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:39:27 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Cannot resize image /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk to a smaller size. {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 17:39:27 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Created local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 17:39:27 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Ensure instance console log exists: /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:39:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:39:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:39:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:39:28 user nova-compute[74743]: DEBUG nova.network.neutron [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Successfully updated port: 6ba5e67e-b479-4371-89e3-97c1beceff8f {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:39:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Acquiring lock "refresh_cache-9c90f34f-7bbf-40d9-8f65-983d91f0b51b" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:39:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Acquired lock "refresh_cache-9c90f34f-7bbf-40d9-8f65-983d91f0b51b" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:39:28 user nova-compute[74743]: DEBUG nova.network.neutron [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:39:28 user nova-compute[74743]: DEBUG nova.compute.manager [req-9b4b2bbe-0ac4-4737-b634-abcc7c50a78d req-a31a71d0-9a0e-4784-857a-f7c9443fba11 service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Received event network-changed-6ba5e67e-b479-4371-89e3-97c1beceff8f {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:39:28 user nova-compute[74743]: DEBUG nova.compute.manager [req-9b4b2bbe-0ac4-4737-b634-abcc7c50a78d req-a31a71d0-9a0e-4784-857a-f7c9443fba11 service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Refreshing instance network info cache due to event network-changed-6ba5e67e-b479-4371-89e3-97c1beceff8f. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:39:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-9b4b2bbe-0ac4-4737-b634-abcc7c50a78d req-a31a71d0-9a0e-4784-857a-f7c9443fba11 service nova] Acquiring lock "refresh_cache-9c90f34f-7bbf-40d9-8f65-983d91f0b51b" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:39:28 user nova-compute[74743]: DEBUG nova.network.neutron [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:39:28 user nova-compute[74743]: DEBUG nova.network.neutron [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Updating instance_info_cache with network_info: [{"id": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "address": "fa:16:3e:08:2d:e8", "network": {"id": "7cf1258c-5feb-472e-9f3f-69d95360b050", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-628054528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "790f602c532d41289c52985c8fab91d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba5e67e-b4", "ovs_interfaceid": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:39:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Releasing lock "refresh_cache-9c90f34f-7bbf-40d9-8f65-983d91f0b51b" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:39:28 user nova-compute[74743]: DEBUG nova.compute.manager [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Instance network_info: |[{"id": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "address": "fa:16:3e:08:2d:e8", "network": {"id": "7cf1258c-5feb-472e-9f3f-69d95360b050", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-628054528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "790f602c532d41289c52985c8fab91d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba5e67e-b4", "ovs_interfaceid": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 17:39:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-9b4b2bbe-0ac4-4737-b634-abcc7c50a78d req-a31a71d0-9a0e-4784-857a-f7c9443fba11 service nova] Acquired lock "refresh_cache-9c90f34f-7bbf-40d9-8f65-983d91f0b51b" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:39:28 user nova-compute[74743]: DEBUG nova.network.neutron [req-9b4b2bbe-0ac4-4737-b634-abcc7c50a78d req-a31a71d0-9a0e-4784-857a-f7c9443fba11 service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Refreshing network info cache for port 6ba5e67e-b479-4371-89e3-97c1beceff8f {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:39:28 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Start _get_guest_xml network_info=[{"id": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "address": "fa:16:3e:08:2d:e8", "network": {"id": "7cf1258c-5feb-472e-9f3f-69d95360b050", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-628054528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "790f602c532d41289c52985c8fab91d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba5e67e-b4", "ovs_interfaceid": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '9536f6cf-95c4-40e2-864a-09a91525678a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:39:28 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:39:28 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:39:28 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:39:28 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:39:28 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:39:28 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:39:28 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:39:28 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:39:28 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:39:28 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:39:28 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:39:28 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:39:28 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:39:28 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:39:28 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:39:28 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:39:28 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:39:28 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:39:28 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:39:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-412810144',display_name='tempest-AttachVolumeTestJSON-server-412810144',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-412810144',id=48,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLOX3vLKn4BPxKq/sYlRJyYxjQkfS7C5a3EAlzUWDWpfhN4MRLyKkuT1pXcPPcKSOXBLUqQkc/KRtoOHbZrTCC299l1ITOKXjAQISq5k9bKohMtNJ2/b6nyF5OqHILx6UA==',key_name='tempest-keypair-452329227',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='790f602c532d41289c52985c8fab91d4',ramdisk_id='',reservation_id='r-2otufkmn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1207996855',owner_user_name='tempest-AttachVolumeTestJSON-1207996855-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:39:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b9d8b543f4946b2918bd38c4a3c835f',uuid=9c90f34f-7bbf-40d9-8f65-983d91f0b51b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "address": "fa:16:3e:08:2d:e8", "network": {"id": "7cf1258c-5feb-472e-9f3f-69d95360b050", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-628054528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "790f602c532d41289c52985c8fab91d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba5e67e-b4", "ovs_interfaceid": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:39:28 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Converting VIF {"id": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "address": "fa:16:3e:08:2d:e8", "network": {"id": "7cf1258c-5feb-472e-9f3f-69d95360b050", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-628054528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "790f602c532d41289c52985c8fab91d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba5e67e-b4", "ovs_interfaceid": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:39:28 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:2d:e8,bridge_name='br-int',has_traffic_filtering=True,id=6ba5e67e-b479-4371-89e3-97c1beceff8f,network=Network(7cf1258c-5feb-472e-9f3f-69d95360b050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ba5e67e-b4') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:39:28 user nova-compute[74743]: DEBUG nova.objects.instance [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lazy-loading 'pci_devices' on Instance uuid 9c90f34f-7bbf-40d9-8f65-983d91f0b51b {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:39:28 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:39:28 user nova-compute[74743]:   <uuid>9c90f34f-7bbf-40d9-8f65-983d91f0b51b</uuid>
Nov 18 17:39:28 user nova-compute[74743]:   <name>instance-00000030</name>
Nov 18 17:39:28 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:39:28 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:39:28 user nova-compute[74743]:   <metadata>
Nov 18 17:39:28 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:39:28 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:39:28 user nova-compute[74743]:       <nova:name>tempest-AttachVolumeTestJSON-server-412810144</nova:name>
Nov 18 17:39:28 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:39:28</nova:creationTime>
Nov 18 17:39:28 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:39:28 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:39:28 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:39:28 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:39:28 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:39:28 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:39:28 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:39:28 user nova-compute[74743]:       <nova:owner>
Nov 18 17:39:28 user nova-compute[74743]:         <nova:user uuid="8b9d8b543f4946b2918bd38c4a3c835f">tempest-AttachVolumeTestJSON-1207996855-project-member</nova:user>
Nov 18 17:39:28 user nova-compute[74743]:         <nova:project uuid="790f602c532d41289c52985c8fab91d4">tempest-AttachVolumeTestJSON-1207996855</nova:project>
Nov 18 17:39:28 user nova-compute[74743]:       </nova:owner>
Nov 18 17:39:28 user nova-compute[74743]:       <nova:root type="image" uuid="9536f6cf-95c4-40e2-864a-09a91525678a"/>
Nov 18 17:39:28 user nova-compute[74743]:       <nova:ports>
Nov 18 17:39:28 user nova-compute[74743]:         <nova:port uuid="6ba5e67e-b479-4371-89e3-97c1beceff8f">
Nov 18 17:39:28 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 18 17:39:28 user nova-compute[74743]:         </nova:port>
Nov 18 17:39:28 user nova-compute[74743]:       </nova:ports>
Nov 18 17:39:28 user nova-compute[74743]:     </nova:instance>
Nov 18 17:39:28 user nova-compute[74743]:   </metadata>
Nov 18 17:39:28 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:39:28 user nova-compute[74743]:     <system>
Nov 18 17:39:28 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:39:28 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:39:28 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:39:28 user nova-compute[74743]:       <entry name="serial">9c90f34f-7bbf-40d9-8f65-983d91f0b51b</entry>
Nov 18 17:39:28 user nova-compute[74743]:       <entry name="uuid">9c90f34f-7bbf-40d9-8f65-983d91f0b51b</entry>
Nov 18 17:39:28 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:39:28 user nova-compute[74743]:     </system>
Nov 18 17:39:28 user nova-compute[74743]:   </sysinfo>
Nov 18 17:39:28 user nova-compute[74743]:   <os>
Nov 18 17:39:28 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:39:28 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:39:28 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:39:28 user nova-compute[74743]:   </os>
Nov 18 17:39:28 user nova-compute[74743]:   <features>
Nov 18 17:39:28 user nova-compute[74743]:     <acpi/>
Nov 18 17:39:28 user nova-compute[74743]:     <apic/>
Nov 18 17:39:28 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:39:28 user nova-compute[74743]:   </features>
Nov 18 17:39:28 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:39:28 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:39:28 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:39:28 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:39:28 user nova-compute[74743]:   </clock>
Nov 18 17:39:28 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:39:28 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:39:28 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:39:28 user nova-compute[74743]:   </cpu>
Nov 18 17:39:28 user nova-compute[74743]:   <devices>
Nov 18 17:39:28 user nova-compute[74743]:     <disk type="file" device="disk">
Nov 18 17:39:28 user nova-compute[74743]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 17:39:28 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk"/>
Nov 18 17:39:28 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:39:28 user nova-compute[74743]:     </disk>
Nov 18 17:39:28 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:39:28 user nova-compute[74743]:       <mac address="fa:16:3e:08:2d:e8"/>
Nov 18 17:39:28 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:39:28 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:39:28 user nova-compute[74743]:       <target dev="tap6ba5e67e-b4"/>
Nov 18 17:39:28 user nova-compute[74743]:     </interface>
Nov 18 17:39:28 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:39:28 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/console.log" append="off"/>
Nov 18 17:39:28 user nova-compute[74743]:     </serial>
Nov 18 17:39:28 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:39:28 user nova-compute[74743]:     <video>
Nov 18 17:39:28 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:39:28 user nova-compute[74743]:     </video>
Nov 18 17:39:28 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:39:28 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:39:28 user nova-compute[74743]:     </rng>
Nov 18 17:39:28 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:39:28 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:39:28 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:39:28 user nova-compute[74743]:     </memballoon>
Nov 18 17:39:28 user nova-compute[74743]:   </devices>
Nov 18 17:39:28 user nova-compute[74743]: </domain>
Nov 18 17:39:28 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:39:28 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:39:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-412810144',display_name='tempest-AttachVolumeTestJSON-server-412810144',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-412810144',id=48,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLOX3vLKn4BPxKq/sYlRJyYxjQkfS7C5a3EAlzUWDWpfhN4MRLyKkuT1pXcPPcKSOXBLUqQkc/KRtoOHbZrTCC299l1ITOKXjAQISq5k9bKohMtNJ2/b6nyF5OqHILx6UA==',key_name='tempest-keypair-452329227',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='790f602c532d41289c52985c8fab91d4',ramdisk_id='',reservation_id='r-2otufkmn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1207996855',owner_user_name='tempest-AttachVolumeTestJSON-1207996855-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:39:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b9d8b543f4946b2918bd38c4a3c835f',uuid=9c90f34f-7bbf-40d9-8f65-983d91f0b51b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "address": "fa:16:3e:08:2d:e8", "network": {"id": "7cf1258c-5feb-472e-9f3f-69d95360b050", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-628054528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "790f602c532d41289c52985c8fab91d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba5e67e-b4", "ovs_interfaceid": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:39:28 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Converting VIF {"id": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "address": "fa:16:3e:08:2d:e8", "network": {"id": "7cf1258c-5feb-472e-9f3f-69d95360b050", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-628054528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "790f602c532d41289c52985c8fab91d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba5e67e-b4", "ovs_interfaceid": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:39:28 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:2d:e8,bridge_name='br-int',has_traffic_filtering=True,id=6ba5e67e-b479-4371-89e3-97c1beceff8f,network=Network(7cf1258c-5feb-472e-9f3f-69d95360b050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ba5e67e-b4') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:39:28 user nova-compute[74743]: DEBUG os_vif [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:2d:e8,bridge_name='br-int',has_traffic_filtering=True,id=6ba5e67e-b479-4371-89e3-97c1beceff8f,network=Network(7cf1258c-5feb-472e-9f3f-69d95360b050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ba5e67e-b4') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:39:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:39:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:39:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:39:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:39:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dfb15587-0004-5fb2-9e60-ab6df950148a', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:39:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:39:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:39:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:39:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6ba5e67e-b4, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:39:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6ba5e67e-b4, col_values=(('qos', UUID('78de4e37-a89e-48d7-8948-895ee17c9b78')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:39:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6ba5e67e-b4, col_values=(('external_ids', {'iface-id': '6ba5e67e-b479-4371-89e3-97c1beceff8f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:2d:e8', 'vm-uuid': '9c90f34f-7bbf-40d9-8f65-983d91f0b51b'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:39:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:39:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:39:28 user nova-compute[74743]: INFO os_vif [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:2d:e8,bridge_name='br-int',has_traffic_filtering=True,id=6ba5e67e-b479-4371-89e3-97c1beceff8f,network=Network(7cf1258c-5feb-472e-9f3f-69d95360b050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ba5e67e-b4')
Nov 18 17:39:28 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:39:28 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] No VIF found with MAC fa:16:3e:08:2d:e8, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:39:28 user nova-compute[74743]: DEBUG nova.network.neutron [req-9b4b2bbe-0ac4-4737-b634-abcc7c50a78d req-a31a71d0-9a0e-4784-857a-f7c9443fba11 service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Updated VIF entry in instance network info cache for port 6ba5e67e-b479-4371-89e3-97c1beceff8f. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:39:28 user nova-compute[74743]: DEBUG nova.network.neutron [req-9b4b2bbe-0ac4-4737-b634-abcc7c50a78d req-a31a71d0-9a0e-4784-857a-f7c9443fba11 service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Updating instance_info_cache with network_info: [{"id": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "address": "fa:16:3e:08:2d:e8", "network": {"id": "7cf1258c-5feb-472e-9f3f-69d95360b050", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-628054528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "790f602c532d41289c52985c8fab91d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba5e67e-b4", "ovs_interfaceid": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:39:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-9b4b2bbe-0ac4-4737-b634-abcc7c50a78d req-a31a71d0-9a0e-4784-857a-f7c9443fba11 service nova] Releasing lock "refresh_cache-9c90f34f-7bbf-40d9-8f65-983d91f0b51b" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:39:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:39:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:39:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:39:29 user nova-compute[74743]: DEBUG nova.compute.manager [req-67274a0a-cc14-458e-8c60-2ccf8f1140f0 req-b46ee535-7cfc-4150-8dbf-fbc7dcffc33d service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Received event network-vif-plugged-6ba5e67e-b479-4371-89e3-97c1beceff8f {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:39:29 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-67274a0a-cc14-458e-8c60-2ccf8f1140f0 req-b46ee535-7cfc-4150-8dbf-fbc7dcffc33d service nova] Acquiring lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:39:29 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-67274a0a-cc14-458e-8c60-2ccf8f1140f0 req-b46ee535-7cfc-4150-8dbf-fbc7dcffc33d service nova] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:39:29 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-67274a0a-cc14-458e-8c60-2ccf8f1140f0 req-b46ee535-7cfc-4150-8dbf-fbc7dcffc33d service nova] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:39:29 user nova-compute[74743]: DEBUG nova.compute.manager [req-67274a0a-cc14-458e-8c60-2ccf8f1140f0 req-b46ee535-7cfc-4150-8dbf-fbc7dcffc33d service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] No waiting events found dispatching network-vif-plugged-6ba5e67e-b479-4371-89e3-97c1beceff8f {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:39:29 user nova-compute[74743]: WARNING nova.compute.manager [req-67274a0a-cc14-458e-8c60-2ccf8f1140f0 req-b46ee535-7cfc-4150-8dbf-fbc7dcffc33d service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Received unexpected event network-vif-plugged-6ba5e67e-b479-4371-89e3-97c1beceff8f for instance with vm_state building and task_state spawning.
Nov 18 17:39:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:39:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:39:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:39:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:39:31 user nova-compute[74743]: DEBUG nova.compute.manager [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:39:31 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Guest created on hypervisor {{(pid=74743) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 17:39:31 user nova-compute[74743]: DEBUG nova.compute.manager [req-e11a961b-fd14-4c3c-99be-dd3ce10fd472 req-70971556-8004-4d66-a0ef-4321cbed22d8 service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Received event network-vif-plugged-6ba5e67e-b479-4371-89e3-97c1beceff8f {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:39:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e11a961b-fd14-4c3c-99be-dd3ce10fd472 req-70971556-8004-4d66-a0ef-4321cbed22d8 service nova] Acquiring lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:39:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e11a961b-fd14-4c3c-99be-dd3ce10fd472 req-70971556-8004-4d66-a0ef-4321cbed22d8 service nova] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:39:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e11a961b-fd14-4c3c-99be-dd3ce10fd472 req-70971556-8004-4d66-a0ef-4321cbed22d8 service nova] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:39:31 user nova-compute[74743]: DEBUG nova.compute.manager [req-e11a961b-fd14-4c3c-99be-dd3ce10fd472 req-70971556-8004-4d66-a0ef-4321cbed22d8 service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] No waiting events found dispatching network-vif-plugged-6ba5e67e-b479-4371-89e3-97c1beceff8f {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:39:31 user nova-compute[74743]: WARNING nova.compute.manager [req-e11a961b-fd14-4c3c-99be-dd3ce10fd472 req-70971556-8004-4d66-a0ef-4321cbed22d8 service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Received unexpected event network-vif-plugged-6ba5e67e-b479-4371-89e3-97c1beceff8f for instance with vm_state building and task_state spawning.
Nov 18 17:39:31 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Instance spawned successfully.
Nov 18 17:39:31 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 17:39:31 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Found default for hw_cdrom_bus of ide {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:39:31 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Found default for hw_disk_bus of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:39:31 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Found default for hw_input_bus of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:39:31 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Found default for hw_pointer_model of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:39:31 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Found default for hw_video_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:39:31 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Found default for hw_vif_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:39:32 user nova-compute[74743]: INFO nova.compute.manager [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Took 5.08 seconds to spawn the instance on the hypervisor.
Nov 18 17:39:32 user nova-compute[74743]: DEBUG nova.compute.manager [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:39:32 user nova-compute[74743]: INFO nova.compute.manager [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Took 5.65 seconds to build instance.
Nov 18 17:39:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-708e16b7-c938-4ce9-b6ec-aeb9c359bac7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.761s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:39:33 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:39:35 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:39:38 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:39:40 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:39:42 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:39:42 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74743) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 17:39:43 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:39:44 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:39:45 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:39:45 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:39:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:39:49 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:39:50 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:39:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:39:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:39:50 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:39:50 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Auditing locally available compute resources for user (node: user) {{(pid=74743) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 17:39:50 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:39:50 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:39:50 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:39:50 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:39:50 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:39:50 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/714e6afb-3bdd-4d12-be25-48fc5bd741af/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:39:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/714e6afb-3bdd-4d12-be25-48fc5bd741af/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:39:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/714e6afb-3bdd-4d12-be25-48fc5bd741af/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:39:51 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/714e6afb-3bdd-4d12-be25-48fc5bd741af/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:39:51 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:39:51 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:39:51 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Hypervisor/Node resource view: name=user free_ram=8717MB free_disk=25.24111557006836GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74743) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 17:39:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:39:51 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:39:51 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 714e6afb-3bdd-4d12-be25-48fc5bd741af actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:39:51 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 9c90f34f-7bbf-40d9-8f65-983d91f0b51b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:39:51 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 17:39:51 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 17:39:52 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Refreshing inventories for resource provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 18 17:39:52 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Updating ProviderTree inventory for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 18 17:39:52 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Updating inventory in ProviderTree for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 18 17:39:52 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Refreshing aggregate associations for resource provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8, aggregates: None {{(pid=74743) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 18 17:39:52 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Refreshing trait associations for resource provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=74743) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 18 17:39:52 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:39:52 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:39:52 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Compute_service record updated for user:user {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 17:39:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.530s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:39:52 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:39:52 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Cleaning up deleted instances with incomplete migration  {{(pid=74743) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 18 17:39:52 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:39:52 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:39:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:39:53 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:39:55 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:39:55 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Starting heal instance info cache {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 17:39:55 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Rebuilding the list of instances to heal {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 17:39:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "refresh_cache-714e6afb-3bdd-4d12-be25-48fc5bd741af" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:39:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquired lock "refresh_cache-714e6afb-3bdd-4d12-be25-48fc5bd741af" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:39:55 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Forcefully refreshing network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 17:39:55 user nova-compute[74743]: DEBUG nova.objects.instance [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lazy-loading 'info_cache' on Instance uuid 714e6afb-3bdd-4d12-be25-48fc5bd741af {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:39:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:39:55 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Updating instance_info_cache with network_info: [{"id": "a4f0ecc1-1986-4196-b4cd-ddc23ddaf6eb", "address": "fa:16:3e:aa:6f:5f", "network": {"id": "9ab2e361-b754-4327-85e0-51418401dcde", "bridge": "br-int", "label": "tempest-VolumesActionsTest-7894836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a66a4053c694109b2855687a3e85baa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f0ecc1-19", "ovs_interfaceid": "a4f0ecc1-1986-4196-b4cd-ddc23ddaf6eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:39:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Releasing lock "refresh_cache-714e6afb-3bdd-4d12-be25-48fc5bd741af" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:39:55 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Updated the network info_cache for instance {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 17:39:55 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:39:56 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:39:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:40:00 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:40:00 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Cleaning up deleted instances {{(pid=74743) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 18 17:40:00 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] There are 0 instances to clean {{(pid=74743) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 18 17:40:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:40:03 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:40:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e6ac2cc4-4ac9-4e6e-ac0c-e627f87a8ffa tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Acquiring lock "714e6afb-3bdd-4d12-be25-48fc5bd741af" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:40:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e6ac2cc4-4ac9-4e6e-ac0c-e627f87a8ffa tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Lock "714e6afb-3bdd-4d12-be25-48fc5bd741af" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:40:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e6ac2cc4-4ac9-4e6e-ac0c-e627f87a8ffa tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Acquiring lock "714e6afb-3bdd-4d12-be25-48fc5bd741af-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:40:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e6ac2cc4-4ac9-4e6e-ac0c-e627f87a8ffa tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Lock "714e6afb-3bdd-4d12-be25-48fc5bd741af-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:40:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e6ac2cc4-4ac9-4e6e-ac0c-e627f87a8ffa tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Lock "714e6afb-3bdd-4d12-be25-48fc5bd741af-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:40:04 user nova-compute[74743]: INFO nova.compute.manager [None req-e6ac2cc4-4ac9-4e6e-ac0c-e627f87a8ffa tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Terminating instance
Nov 18 17:40:04 user nova-compute[74743]: DEBUG nova.compute.manager [None req-e6ac2cc4-4ac9-4e6e-ac0c-e627f87a8ffa tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Start destroying the instance on the hypervisor. {{(pid=74743) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 17:40:04 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:40:04 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:40:04 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:40:04 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:40:04 user nova-compute[74743]: DEBUG nova.compute.manager [req-95e62a24-bb41-423c-9c99-37eff82a0a24 req-0b0ef990-1a65-4006-aef3-dab80704819f service nova] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Received event network-vif-unplugged-a4f0ecc1-1986-4196-b4cd-ddc23ddaf6eb {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:40:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-95e62a24-bb41-423c-9c99-37eff82a0a24 req-0b0ef990-1a65-4006-aef3-dab80704819f service nova] Acquiring lock "714e6afb-3bdd-4d12-be25-48fc5bd741af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:40:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-95e62a24-bb41-423c-9c99-37eff82a0a24 req-0b0ef990-1a65-4006-aef3-dab80704819f service nova] Lock "714e6afb-3bdd-4d12-be25-48fc5bd741af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:40:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-95e62a24-bb41-423c-9c99-37eff82a0a24 req-0b0ef990-1a65-4006-aef3-dab80704819f service nova] Lock "714e6afb-3bdd-4d12-be25-48fc5bd741af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:40:04 user nova-compute[74743]: DEBUG nova.compute.manager [req-95e62a24-bb41-423c-9c99-37eff82a0a24 req-0b0ef990-1a65-4006-aef3-dab80704819f service nova] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] No waiting events found dispatching network-vif-unplugged-a4f0ecc1-1986-4196-b4cd-ddc23ddaf6eb {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:40:04 user nova-compute[74743]: DEBUG nova.compute.manager [req-95e62a24-bb41-423c-9c99-37eff82a0a24 req-0b0ef990-1a65-4006-aef3-dab80704819f service nova] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Received event network-vif-unplugged-a4f0ecc1-1986-4196-b4cd-ddc23ddaf6eb for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:40:04 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Instance destroyed successfully.
Nov 18 17:40:04 user nova-compute[74743]: DEBUG nova.objects.instance [None req-e6ac2cc4-4ac9-4e6e-ac0c-e627f87a8ffa tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Lazy-loading 'resources' on Instance uuid 714e6afb-3bdd-4d12-be25-48fc5bd741af {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:40:04 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-e6ac2cc4-4ac9-4e6e-ac0c-e627f87a8ffa tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:38:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2065864097',display_name='tempest-VolumesActionsTest-instance-2065864097',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2065864097',id=47,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:38:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9a66a4053c694109b2855687a3e85baa',ramdisk_id='',reservation_id='r-towpinyl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-721631098',owner_user_name='tempest-VolumesActionsTest-721631098-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:38:19Z,user_data=None,user_id='27ce5e71dbc74e849f07f52577dfd9b2',uuid=714e6afb-3bdd-4d12-be25-48fc5bd741af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4f0ecc1-1986-4196-b4cd-ddc23ddaf6eb", "address": "fa:16:3e:aa:6f:5f", "network": {"id": "9ab2e361-b754-4327-85e0-51418401dcde", "bridge": "br-int", "label": "tempest-VolumesActionsTest-7894836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a66a4053c694109b2855687a3e85baa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f0ecc1-19", "ovs_interfaceid": "a4f0ecc1-1986-4196-b4cd-ddc23ddaf6eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:40:04 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-e6ac2cc4-4ac9-4e6e-ac0c-e627f87a8ffa tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Converting VIF {"id": "a4f0ecc1-1986-4196-b4cd-ddc23ddaf6eb", "address": "fa:16:3e:aa:6f:5f", "network": {"id": "9ab2e361-b754-4327-85e0-51418401dcde", "bridge": "br-int", "label": "tempest-VolumesActionsTest-7894836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a66a4053c694109b2855687a3e85baa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f0ecc1-19", "ovs_interfaceid": "a4f0ecc1-1986-4196-b4cd-ddc23ddaf6eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:40:04 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-e6ac2cc4-4ac9-4e6e-ac0c-e627f87a8ffa tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:6f:5f,bridge_name='br-int',has_traffic_filtering=True,id=a4f0ecc1-1986-4196-b4cd-ddc23ddaf6eb,network=Network(9ab2e361-b754-4327-85e0-51418401dcde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4f0ecc1-19') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:40:04 user nova-compute[74743]: DEBUG os_vif [None req-e6ac2cc4-4ac9-4e6e-ac0c-e627f87a8ffa tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:6f:5f,bridge_name='br-int',has_traffic_filtering=True,id=a4f0ecc1-1986-4196-b4cd-ddc23ddaf6eb,network=Network(9ab2e361-b754-4327-85e0-51418401dcde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4f0ecc1-19') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:40:04 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:40:04 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa4f0ecc1-19, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:40:04 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:40:04 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:40:04 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:40:04 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9bcc9afc-ae41-44d5-9d4a-c570881bd927) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:40:04 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:40:04 user nova-compute[74743]: INFO os_vif [None req-e6ac2cc4-4ac9-4e6e-ac0c-e627f87a8ffa tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:6f:5f,bridge_name='br-int',has_traffic_filtering=True,id=a4f0ecc1-1986-4196-b4cd-ddc23ddaf6eb,network=Network(9ab2e361-b754-4327-85e0-51418401dcde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4f0ecc1-19')
Nov 18 17:40:04 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-e6ac2cc4-4ac9-4e6e-ac0c-e627f87a8ffa tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Deleting instance files /opt/stack/data/nova/instances/714e6afb-3bdd-4d12-be25-48fc5bd741af_del
Nov 18 17:40:04 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-e6ac2cc4-4ac9-4e6e-ac0c-e627f87a8ffa tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Deletion of /opt/stack/data/nova/instances/714e6afb-3bdd-4d12-be25-48fc5bd741af_del complete
Nov 18 17:40:04 user nova-compute[74743]: INFO nova.compute.manager [None req-e6ac2cc4-4ac9-4e6e-ac0c-e627f87a8ffa tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 18 17:40:04 user nova-compute[74743]: DEBUG oslo.service.loopingcall [None req-e6ac2cc4-4ac9-4e6e-ac0c-e627f87a8ffa tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74743) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 17:40:04 user nova-compute[74743]: DEBUG nova.compute.manager [-] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Deallocating network for instance {{(pid=74743) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 17:40:04 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] deallocate_for_instance() {{(pid=74743) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 17:40:05 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:40:05 user nova-compute[74743]: INFO nova.compute.manager [-] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Took 0.44 seconds to deallocate network for instance.
Nov 18 17:40:05 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e6ac2cc4-4ac9-4e6e-ac0c-e627f87a8ffa tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:40:05 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e6ac2cc4-4ac9-4e6e-ac0c-e627f87a8ffa tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:40:05 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-e6ac2cc4-4ac9-4e6e-ac0c-e627f87a8ffa tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:40:05 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-e6ac2cc4-4ac9-4e6e-ac0c-e627f87a8ffa tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:40:05 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e6ac2cc4-4ac9-4e6e-ac0c-e627f87a8ffa tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.134s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:40:05 user nova-compute[74743]: INFO nova.scheduler.client.report [None req-e6ac2cc4-4ac9-4e6e-ac0c-e627f87a8ffa tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Deleted allocations for instance 714e6afb-3bdd-4d12-be25-48fc5bd741af
Nov 18 17:40:05 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e6ac2cc4-4ac9-4e6e-ac0c-e627f87a8ffa tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Lock "714e6afb-3bdd-4d12-be25-48fc5bd741af" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.418s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:40:06 user nova-compute[74743]: DEBUG nova.compute.manager [req-e81b882d-28be-4315-a6cb-f819797ab442 req-02dc7bef-80fd-488d-afa8-6eb81c9ea738 service nova] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Received event network-vif-plugged-a4f0ecc1-1986-4196-b4cd-ddc23ddaf6eb {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:40:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e81b882d-28be-4315-a6cb-f819797ab442 req-02dc7bef-80fd-488d-afa8-6eb81c9ea738 service nova] Acquiring lock "714e6afb-3bdd-4d12-be25-48fc5bd741af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:40:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e81b882d-28be-4315-a6cb-f819797ab442 req-02dc7bef-80fd-488d-afa8-6eb81c9ea738 service nova] Lock "714e6afb-3bdd-4d12-be25-48fc5bd741af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:40:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e81b882d-28be-4315-a6cb-f819797ab442 req-02dc7bef-80fd-488d-afa8-6eb81c9ea738 service nova] Lock "714e6afb-3bdd-4d12-be25-48fc5bd741af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:40:06 user nova-compute[74743]: DEBUG nova.compute.manager [req-e81b882d-28be-4315-a6cb-f819797ab442 req-02dc7bef-80fd-488d-afa8-6eb81c9ea738 service nova] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] No waiting events found dispatching network-vif-plugged-a4f0ecc1-1986-4196-b4cd-ddc23ddaf6eb {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:40:06 user nova-compute[74743]: WARNING nova.compute.manager [req-e81b882d-28be-4315-a6cb-f819797ab442 req-02dc7bef-80fd-488d-afa8-6eb81c9ea738 service nova] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Received unexpected event network-vif-plugged-a4f0ecc1-1986-4196-b4cd-ddc23ddaf6eb for instance with vm_state deleted and task_state None.
Nov 18 17:40:06 user nova-compute[74743]: DEBUG nova.compute.manager [req-e81b882d-28be-4315-a6cb-f819797ab442 req-02dc7bef-80fd-488d-afa8-6eb81c9ea738 service nova] [instance: 714e6afb-3bdd-4d12-be25-48fc5bd741af] Received event network-vif-deleted-a4f0ecc1-1986-4196-b4cd-ddc23ddaf6eb {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:40:09 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:40:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:40:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:40:24 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:40:27 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._sync_power_states {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:40:27 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Triggering sync for uuid 9c90f34f-7bbf-40d9-8f65-983d91f0b51b {{(pid=74743) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 17:40:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:40:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:40:27 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.022s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:40:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:40:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:40:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:40:43 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:40:43 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74743) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 17:40:44 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:40:44 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:40:45 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:40:49 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:40:50 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:40:52 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:40:52 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:40:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:40:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:40:52 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:40:52 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Auditing locally available compute resources for user (node: user) {{(pid=74743) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 17:40:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:40:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:40:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:40:52 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:40:53 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:40:53 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:40:53 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Hypervisor/Node resource view: name=user free_ram=8916MB free_disk=25.266510009765625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74743) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 17:40:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:40:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:40:53 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 9c90f34f-7bbf-40d9-8f65-983d91f0b51b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:40:53 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 17:40:53 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 17:40:53 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:40:53 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:40:53 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Compute_service record updated for user:user {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 17:40:53 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.196s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:40:54 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:40:54 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:40:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Acquiring lock "a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:40:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Lock "a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:40:55 user nova-compute[74743]: DEBUG nova.compute.manager [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] Starting instance... {{(pid=74743) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 17:40:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:40:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:40:55 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74743) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 17:40:55 user nova-compute[74743]: INFO nova.compute.claims [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] Claim successful on node user
Nov 18 17:40:55 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:40:55 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:40:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.215s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:40:55 user nova-compute[74743]: DEBUG nova.compute.manager [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] Start building networks asynchronously for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 17:40:55 user nova-compute[74743]: DEBUG nova.compute.manager [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] Allocating IP information in the background. {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 17:40:55 user nova-compute[74743]: DEBUG nova.network.neutron [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] allocate_for_instance() {{(pid=74743) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 17:40:55 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 17:40:55 user nova-compute[74743]: DEBUG nova.compute.manager [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] Start building block device mappings for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 17:40:56 user nova-compute[74743]: DEBUG nova.compute.manager [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] Start spawning the instance on the hypervisor. {{(pid=74743) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 17:40:56 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] Creating instance directory {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 17:40:56 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] Creating image(s)
Nov 18 17:40:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Acquiring lock "/opt/stack/data/nova/instances/a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:40:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Lock "/opt/stack/data/nova/instances/a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:40:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Lock "/opt/stack/data/nova/instances/a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:40:56 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:40:56 user nova-compute[74743]: DEBUG nova.policy [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '27ce5e71dbc74e849f07f52577dfd9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a66a4053c694109b2855687a3e85baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74743) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 17:40:56 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.175s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:40:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Acquiring lock "c188b3a997bfafa42fa341f9dcc326545681eed9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:40:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:40:56 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:40:56 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.186s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:40:56 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8/disk 1073741824 {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:40:56 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:40:56 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8/disk 1073741824" returned: 0 in 0.045s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:40:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:40:56 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:40:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:40:56 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.185s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:40:56 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8/disk. size=1073741824 {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 17:40:56 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:40:56 user nova-compute[74743]: DEBUG nova.network.neutron [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] Successfully created port: e16e16ee-4773-4693-9a65-ee4dde5c035e {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:40:56 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:40:56 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Cannot resize image /opt/stack/data/nova/instances/a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8/disk to a smaller size. {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 17:40:56 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] Created local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 17:40:56 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] Ensure instance console log exists: /opt/stack/data/nova/instances/a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:40:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:40:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:40:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG nova.network.neutron [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] Successfully updated port: e16e16ee-4773-4693-9a65-ee4dde5c035e {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Acquiring lock "refresh_cache-a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Acquired lock "refresh_cache-a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG nova.network.neutron [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG nova.compute.manager [req-aa39d833-936b-4a31-90a7-e13d12831926 req-1a4fcbd2-2788-4cf8-bf92-babd17cdc270 service nova] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] Received event network-changed-e16e16ee-4773-4693-9a65-ee4dde5c035e {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG nova.compute.manager [req-aa39d833-936b-4a31-90a7-e13d12831926 req-1a4fcbd2-2788-4cf8-bf92-babd17cdc270 service nova] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] Refreshing instance network info cache due to event network-changed-e16e16ee-4773-4693-9a65-ee4dde5c035e. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-aa39d833-936b-4a31-90a7-e13d12831926 req-1a4fcbd2-2788-4cf8-bf92-babd17cdc270 service nova] Acquiring lock "refresh_cache-a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG nova.network.neutron [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Starting heal instance info cache {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "refresh_cache-9c90f34f-7bbf-40d9-8f65-983d91f0b51b" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquired lock "refresh_cache-9c90f34f-7bbf-40d9-8f65-983d91f0b51b" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Forcefully refreshing network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG nova.network.neutron [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] Updating instance_info_cache with network_info: [{"id": "e16e16ee-4773-4693-9a65-ee4dde5c035e", "address": "fa:16:3e:a6:8a:cc", "network": {"id": "9ab2e361-b754-4327-85e0-51418401dcde", "bridge": "br-int", "label": "tempest-VolumesActionsTest-7894836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a66a4053c694109b2855687a3e85baa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape16e16ee-47", "ovs_interfaceid": "e16e16ee-4773-4693-9a65-ee4dde5c035e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Releasing lock "refresh_cache-a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG nova.compute.manager [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] Instance network_info: |[{"id": "e16e16ee-4773-4693-9a65-ee4dde5c035e", "address": "fa:16:3e:a6:8a:cc", "network": {"id": "9ab2e361-b754-4327-85e0-51418401dcde", "bridge": "br-int", "label": "tempest-VolumesActionsTest-7894836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a66a4053c694109b2855687a3e85baa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape16e16ee-47", "ovs_interfaceid": "e16e16ee-4773-4693-9a65-ee4dde5c035e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-aa39d833-936b-4a31-90a7-e13d12831926 req-1a4fcbd2-2788-4cf8-bf92-babd17cdc270 service nova] Acquired lock "refresh_cache-a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG nova.network.neutron [req-aa39d833-936b-4a31-90a7-e13d12831926 req-1a4fcbd2-2788-4cf8-bf92-babd17cdc270 service nova] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] Refreshing network info cache for port e16e16ee-4773-4693-9a65-ee4dde5c035e {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] Start _get_guest_xml network_info=[{"id": "e16e16ee-4773-4693-9a65-ee4dde5c035e", "address": "fa:16:3e:a6:8a:cc", "network": {"id": "9ab2e361-b754-4327-85e0-51418401dcde", "bridge": "br-int", "label": "tempest-VolumesActionsTest-7894836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a66a4053c694109b2855687a3e85baa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape16e16ee-47", "ovs_interfaceid": "e16e16ee-4773-4693-9a65-ee4dde5c035e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '9536f6cf-95c4-40e2-864a-09a91525678a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:40:57 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:40:57 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:40:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:40:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-886271934',display_name='tempest-VolumesActionsTest-instance-886271934',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-886271934',id=49,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a66a4053c694109b2855687a3e85baa',ramdisk_id='',reservation_id='r-770qpxan',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-721631098',owner_user_name='tempest-VolumesActionsTest-721631098-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:40:56Z,user_data=None,user_id='27ce5e71dbc74e849f07f52577dfd9b2',uuid=a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e16e16ee-4773-4693-9a65-ee4dde5c035e", "address": "fa:16:3e:a6:8a:cc", "network": {"id": "9ab2e361-b754-4327-85e0-51418401dcde", "bridge": "br-int", "label": "tempest-VolumesActionsTest-7894836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a66a4053c694109b2855687a3e85baa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape16e16ee-47", "ovs_interfaceid": "e16e16ee-4773-4693-9a65-ee4dde5c035e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Converting VIF {"id": "e16e16ee-4773-4693-9a65-ee4dde5c035e", "address": "fa:16:3e:a6:8a:cc", "network": {"id": "9ab2e361-b754-4327-85e0-51418401dcde", "bridge": "br-int", "label": "tempest-VolumesActionsTest-7894836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a66a4053c694109b2855687a3e85baa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape16e16ee-47", "ovs_interfaceid": "e16e16ee-4773-4693-9a65-ee4dde5c035e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:8a:cc,bridge_name='br-int',has_traffic_filtering=True,id=e16e16ee-4773-4693-9a65-ee4dde5c035e,network=Network(9ab2e361-b754-4327-85e0-51418401dcde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape16e16ee-47') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG nova.objects.instance [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Lazy-loading 'pci_devices' on Instance uuid a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:40:57 user nova-compute[74743]:   <uuid>a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8</uuid>
Nov 18 17:40:57 user nova-compute[74743]:   <name>instance-00000031</name>
Nov 18 17:40:57 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:40:57 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:40:57 user nova-compute[74743]:   <metadata>
Nov 18 17:40:57 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:40:57 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:40:57 user nova-compute[74743]:       <nova:name>tempest-VolumesActionsTest-instance-886271934</nova:name>
Nov 18 17:40:57 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:40:57</nova:creationTime>
Nov 18 17:40:57 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:40:57 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:40:57 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:40:57 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:40:57 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:40:57 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:40:57 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:40:57 user nova-compute[74743]:       <nova:owner>
Nov 18 17:40:57 user nova-compute[74743]:         <nova:user uuid="27ce5e71dbc74e849f07f52577dfd9b2">tempest-VolumesActionsTest-721631098-project-member</nova:user>
Nov 18 17:40:57 user nova-compute[74743]:         <nova:project uuid="9a66a4053c694109b2855687a3e85baa">tempest-VolumesActionsTest-721631098</nova:project>
Nov 18 17:40:57 user nova-compute[74743]:       </nova:owner>
Nov 18 17:40:57 user nova-compute[74743]:       <nova:root type="image" uuid="9536f6cf-95c4-40e2-864a-09a91525678a"/>
Nov 18 17:40:57 user nova-compute[74743]:       <nova:ports>
Nov 18 17:40:57 user nova-compute[74743]:         <nova:port uuid="e16e16ee-4773-4693-9a65-ee4dde5c035e">
Nov 18 17:40:57 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 18 17:40:57 user nova-compute[74743]:         </nova:port>
Nov 18 17:40:57 user nova-compute[74743]:       </nova:ports>
Nov 18 17:40:57 user nova-compute[74743]:     </nova:instance>
Nov 18 17:40:57 user nova-compute[74743]:   </metadata>
Nov 18 17:40:57 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:40:57 user nova-compute[74743]:     <system>
Nov 18 17:40:57 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:40:57 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:40:57 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:40:57 user nova-compute[74743]:       <entry name="serial">a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8</entry>
Nov 18 17:40:57 user nova-compute[74743]:       <entry name="uuid">a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8</entry>
Nov 18 17:40:57 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:40:57 user nova-compute[74743]:     </system>
Nov 18 17:40:57 user nova-compute[74743]:   </sysinfo>
Nov 18 17:40:57 user nova-compute[74743]:   <os>
Nov 18 17:40:57 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:40:57 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:40:57 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:40:57 user nova-compute[74743]:   </os>
Nov 18 17:40:57 user nova-compute[74743]:   <features>
Nov 18 17:40:57 user nova-compute[74743]:     <acpi/>
Nov 18 17:40:57 user nova-compute[74743]:     <apic/>
Nov 18 17:40:57 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:40:57 user nova-compute[74743]:   </features>
Nov 18 17:40:57 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:40:57 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:40:57 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:40:57 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:40:57 user nova-compute[74743]:   </clock>
Nov 18 17:40:57 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:40:57 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:40:57 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:40:57 user nova-compute[74743]:   </cpu>
Nov 18 17:40:57 user nova-compute[74743]:   <devices>
Nov 18 17:40:57 user nova-compute[74743]:     <disk type="file" device="disk">
Nov 18 17:40:57 user nova-compute[74743]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 17:40:57 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8/disk"/>
Nov 18 17:40:57 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:40:57 user nova-compute[74743]:     </disk>
Nov 18 17:40:57 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:40:57 user nova-compute[74743]:       <mac address="fa:16:3e:a6:8a:cc"/>
Nov 18 17:40:57 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:40:57 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:40:57 user nova-compute[74743]:       <target dev="tape16e16ee-47"/>
Nov 18 17:40:57 user nova-compute[74743]:     </interface>
Nov 18 17:40:57 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:40:57 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8/console.log" append="off"/>
Nov 18 17:40:57 user nova-compute[74743]:     </serial>
Nov 18 17:40:57 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:40:57 user nova-compute[74743]:     <video>
Nov 18 17:40:57 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:40:57 user nova-compute[74743]:     </video>
Nov 18 17:40:57 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:40:57 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:40:57 user nova-compute[74743]:     </rng>
Nov 18 17:40:57 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:40:57 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:40:57 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:40:57 user nova-compute[74743]:     </memballoon>
Nov 18 17:40:57 user nova-compute[74743]:   </devices>
Nov 18 17:40:57 user nova-compute[74743]: </domain>
Nov 18 17:40:57 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:40:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-886271934',display_name='tempest-VolumesActionsTest-instance-886271934',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-886271934',id=49,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a66a4053c694109b2855687a3e85baa',ramdisk_id='',reservation_id='r-770qpxan',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-721631098',owner_user_name='tempest-VolumesActionsTest-721631098-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:40:56Z,user_data=None,user_id='27ce5e71dbc74e849f07f52577dfd9b2',uuid=a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e16e16ee-4773-4693-9a65-ee4dde5c035e", "address": "fa:16:3e:a6:8a:cc", "network": {"id": "9ab2e361-b754-4327-85e0-51418401dcde", "bridge": "br-int", "label": "tempest-VolumesActionsTest-7894836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a66a4053c694109b2855687a3e85baa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape16e16ee-47", "ovs_interfaceid": "e16e16ee-4773-4693-9a65-ee4dde5c035e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Converting VIF {"id": "e16e16ee-4773-4693-9a65-ee4dde5c035e", "address": "fa:16:3e:a6:8a:cc", "network": {"id": "9ab2e361-b754-4327-85e0-51418401dcde", "bridge": "br-int", "label": "tempest-VolumesActionsTest-7894836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a66a4053c694109b2855687a3e85baa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape16e16ee-47", "ovs_interfaceid": "e16e16ee-4773-4693-9a65-ee4dde5c035e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:8a:cc,bridge_name='br-int',has_traffic_filtering=True,id=e16e16ee-4773-4693-9a65-ee4dde5c035e,network=Network(9ab2e361-b754-4327-85e0-51418401dcde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape16e16ee-47') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG os_vif [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:8a:cc,bridge_name='br-int',has_traffic_filtering=True,id=e16e16ee-4773-4693-9a65-ee4dde5c035e,network=Network(9ab2e361-b754-4327-85e0-51418401dcde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape16e16ee-47') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e361335a-1dff-5465-a36a-54678f6d575f', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape16e16ee-47, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape16e16ee-47, col_values=(('qos', UUID('0d9a4618-3a1e-4ace-a2c8-07f6a028874d')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape16e16ee-47, col_values=(('external_ids', {'iface-id': 'e16e16ee-4773-4693-9a65-ee4dde5c035e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:8a:cc', 'vm-uuid': 'a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:40:57 user nova-compute[74743]: INFO os_vif [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:8a:cc,bridge_name='br-int',has_traffic_filtering=True,id=e16e16ee-4773-4693-9a65-ee4dde5c035e,network=Network(9ab2e361-b754-4327-85e0-51418401dcde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape16e16ee-47')
Nov 18 17:40:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] No VIF found with MAC fa:16:3e:a6:8a:cc, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Updating instance_info_cache with network_info: [{"id": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "address": "fa:16:3e:08:2d:e8", "network": {"id": "7cf1258c-5feb-472e-9f3f-69d95360b050", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-628054528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "790f602c532d41289c52985c8fab91d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba5e67e-b4", "ovs_interfaceid": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Releasing lock "refresh_cache-9c90f34f-7bbf-40d9-8f65-983d91f0b51b" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:40:57 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Updated the network info_cache for instance {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 17:40:58 user nova-compute[74743]: DEBUG nova.network.neutron [req-aa39d833-936b-4a31-90a7-e13d12831926 req-1a4fcbd2-2788-4cf8-bf92-babd17cdc270 service nova] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] Updated VIF entry in instance network info cache for port e16e16ee-4773-4693-9a65-ee4dde5c035e. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:40:58 user nova-compute[74743]: DEBUG nova.network.neutron [req-aa39d833-936b-4a31-90a7-e13d12831926 req-1a4fcbd2-2788-4cf8-bf92-babd17cdc270 service nova] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] Updating instance_info_cache with network_info: [{"id": "e16e16ee-4773-4693-9a65-ee4dde5c035e", "address": "fa:16:3e:a6:8a:cc", "network": {"id": "9ab2e361-b754-4327-85e0-51418401dcde", "bridge": "br-int", "label": "tempest-VolumesActionsTest-7894836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a66a4053c694109b2855687a3e85baa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape16e16ee-47", "ovs_interfaceid": "e16e16ee-4773-4693-9a65-ee4dde5c035e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:40:58 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-aa39d833-936b-4a31-90a7-e13d12831926 req-1a4fcbd2-2788-4cf8-bf92-babd17cdc270 service nova] Releasing lock "refresh_cache-a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:40:59 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:40:59 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:40:59 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:40:59 user nova-compute[74743]: DEBUG nova.compute.manager [req-972e9383-650f-4fca-8c6d-214518903c51 req-a434b68f-d46c-41cc-b7b4-83331a120712 service nova] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] Received event network-vif-plugged-e16e16ee-4773-4693-9a65-ee4dde5c035e {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:40:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-972e9383-650f-4fca-8c6d-214518903c51 req-a434b68f-d46c-41cc-b7b4-83331a120712 service nova] Acquiring lock "a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:40:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-972e9383-650f-4fca-8c6d-214518903c51 req-a434b68f-d46c-41cc-b7b4-83331a120712 service nova] Lock "a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:40:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-972e9383-650f-4fca-8c6d-214518903c51 req-a434b68f-d46c-41cc-b7b4-83331a120712 service nova] Lock "a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:40:59 user nova-compute[74743]: DEBUG nova.compute.manager [req-972e9383-650f-4fca-8c6d-214518903c51 req-a434b68f-d46c-41cc-b7b4-83331a120712 service nova] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] No waiting events found dispatching network-vif-plugged-e16e16ee-4773-4693-9a65-ee4dde5c035e {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:40:59 user nova-compute[74743]: WARNING nova.compute.manager [req-972e9383-650f-4fca-8c6d-214518903c51 req-a434b68f-d46c-41cc-b7b4-83331a120712 service nova] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] Received unexpected event network-vif-plugged-e16e16ee-4773-4693-9a65-ee4dde5c035e for instance with vm_state building and task_state spawning.
Nov 18 17:40:59 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:40:59 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:41:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:41:01 user nova-compute[74743]: DEBUG nova.compute.manager [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:41:01 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] Guest created on hypervisor {{(pid=74743) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 17:41:01 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] Instance spawned successfully.
Nov 18 17:41:01 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 17:41:01 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] Found default for hw_cdrom_bus of ide {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:41:01 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] Found default for hw_disk_bus of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:41:01 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] Found default for hw_input_bus of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:41:01 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] Found default for hw_pointer_model of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:41:01 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] Found default for hw_video_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:41:01 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] Found default for hw_vif_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:41:01 user nova-compute[74743]: INFO nova.compute.manager [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] Took 5.15 seconds to spawn the instance on the hypervisor.
Nov 18 17:41:01 user nova-compute[74743]: DEBUG nova.compute.manager [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:41:01 user nova-compute[74743]: INFO nova.compute.manager [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] Took 5.71 seconds to build instance.
Nov 18 17:41:01 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-120d6ce1-37ec-4010-9f57-5ba1c80e07f1 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Lock "a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.804s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:41:01 user nova-compute[74743]: DEBUG nova.compute.manager [req-3e2757a7-ace0-478e-920a-1a33ce41b249 req-8db240b5-2621-464b-8f20-3173e3d1c8d9 service nova] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] Received event network-vif-plugged-e16e16ee-4773-4693-9a65-ee4dde5c035e {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:41:01 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3e2757a7-ace0-478e-920a-1a33ce41b249 req-8db240b5-2621-464b-8f20-3173e3d1c8d9 service nova] Acquiring lock "a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:41:01 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3e2757a7-ace0-478e-920a-1a33ce41b249 req-8db240b5-2621-464b-8f20-3173e3d1c8d9 service nova] Lock "a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:41:01 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3e2757a7-ace0-478e-920a-1a33ce41b249 req-8db240b5-2621-464b-8f20-3173e3d1c8d9 service nova] Lock "a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:41:01 user nova-compute[74743]: DEBUG nova.compute.manager [req-3e2757a7-ace0-478e-920a-1a33ce41b249 req-8db240b5-2621-464b-8f20-3173e3d1c8d9 service nova] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] No waiting events found dispatching network-vif-plugged-e16e16ee-4773-4693-9a65-ee4dde5c035e {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:41:01 user nova-compute[74743]: WARNING nova.compute.manager [req-3e2757a7-ace0-478e-920a-1a33ce41b249 req-8db240b5-2621-464b-8f20-3173e3d1c8d9 service nova] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] Received unexpected event network-vif-plugged-e16e16ee-4773-4693-9a65-ee4dde5c035e for instance with vm_state active and task_state None.
Nov 18 17:41:02 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:41:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:41:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:41:12 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:41:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:41:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:41:17 user nova-compute[74743]: DEBUG nova.compute.manager [req-c22c40c8-2b0b-4eca-be85-ed4cf457709e req-b80dee74-af34-4a6f-b9ed-2746199b8722 service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Received event network-changed-6ba5e67e-b479-4371-89e3-97c1beceff8f {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:41:17 user nova-compute[74743]: DEBUG nova.compute.manager [req-c22c40c8-2b0b-4eca-be85-ed4cf457709e req-b80dee74-af34-4a6f-b9ed-2746199b8722 service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Refreshing instance network info cache due to event network-changed-6ba5e67e-b479-4371-89e3-97c1beceff8f. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:41:17 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-c22c40c8-2b0b-4eca-be85-ed4cf457709e req-b80dee74-af34-4a6f-b9ed-2746199b8722 service nova] Acquiring lock "refresh_cache-9c90f34f-7bbf-40d9-8f65-983d91f0b51b" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:41:17 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-c22c40c8-2b0b-4eca-be85-ed4cf457709e req-b80dee74-af34-4a6f-b9ed-2746199b8722 service nova] Acquired lock "refresh_cache-9c90f34f-7bbf-40d9-8f65-983d91f0b51b" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:41:17 user nova-compute[74743]: DEBUG nova.network.neutron [req-c22c40c8-2b0b-4eca-be85-ed4cf457709e req-b80dee74-af34-4a6f-b9ed-2746199b8722 service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Refreshing network info cache for port 6ba5e67e-b479-4371-89e3-97c1beceff8f {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:41:18 user nova-compute[74743]: DEBUG nova.network.neutron [req-c22c40c8-2b0b-4eca-be85-ed4cf457709e req-b80dee74-af34-4a6f-b9ed-2746199b8722 service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Updated VIF entry in instance network info cache for port 6ba5e67e-b479-4371-89e3-97c1beceff8f. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:41:18 user nova-compute[74743]: DEBUG nova.network.neutron [req-c22c40c8-2b0b-4eca-be85-ed4cf457709e req-b80dee74-af34-4a6f-b9ed-2746199b8722 service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Updating instance_info_cache with network_info: [{"id": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "address": "fa:16:3e:08:2d:e8", "network": {"id": "7cf1258c-5feb-472e-9f3f-69d95360b050", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-628054528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "790f602c532d41289c52985c8fab91d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba5e67e-b4", "ovs_interfaceid": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:41:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-c22c40c8-2b0b-4eca-be85-ed4cf457709e req-b80dee74-af34-4a6f-b9ed-2746199b8722 service nova] Releasing lock "refresh_cache-9c90f34f-7bbf-40d9-8f65-983d91f0b51b" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:41:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:41:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7206b6b6-7580-4c29-bcb4-ce39111616f7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Acquiring lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:41:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7206b6b6-7580-4c29-bcb4-ce39111616f7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:41:20 user nova-compute[74743]: DEBUG nova.objects.instance [None req-7206b6b6-7580-4c29-bcb4-ce39111616f7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lazy-loading 'flavor' on Instance uuid 9c90f34f-7bbf-40d9-8f65-983d91f0b51b {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:41:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7206b6b6-7580-4c29-bcb4-ce39111616f7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.084s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:41:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7206b6b6-7580-4c29-bcb4-ce39111616f7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Acquiring lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:41:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7206b6b6-7580-4c29-bcb4-ce39111616f7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:41:20 user nova-compute[74743]: INFO nova.compute.manager [None req-7206b6b6-7580-4c29-bcb4-ce39111616f7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Attaching volume 7555ca1f-df6a-42d1-951d-129bfb5ba817 to /dev/vdb
Nov 18 17:41:21 user nova-compute[74743]: DEBUG os_brick.utils [None req-7206b6b6-7580-4c29-bcb4-ce39111616f7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:41:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:41:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:41:21 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f52804-fd18-4e61-8e89-0f2f1e54ab57]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1116acd8874d\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:41:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:41:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:41:21 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a42d53-8561-4272-be3a-83492b4b39e2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:41:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:41:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:41:21 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d5b498-2e52-479a-8a37-5b7c645cfb17]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:41:21 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[8975c0a8-3ecc-46ff-89d5-cc4a91b316cf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:41:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-7206b6b6-7580-4c29-bcb4-ce39111616f7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Running cmd (subprocess): nvme version {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:41:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-7206b6b6-7580-4c29-bcb4-ce39111616f7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] 'nvme version' failed. Not Retrying. {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:41:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7206b6b6-7580-4c29-bcb4-ce39111616f7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] nvme not present on system {{(pid=74743) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 17:41:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:41:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:41:21 user nova-compute[74743]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 17:41:21 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e0685d-c761-4b8f-b2b7-7091b4b48e9f]: (4, '') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:41:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-7206b6b6-7580-4c29-bcb4-ce39111616f7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74743) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 17:41:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-7206b6b6-7580-4c29-bcb4-ce39111616f7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 17:41:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-7206b6b6-7580-4c29-bcb4-ce39111616f7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] LIGHTOS: no hostnqn found. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 17:41:21 user nova-compute[74743]: DEBUG os_brick.utils [None req-7206b6b6-7580-4c29-bcb4-ce39111616f7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1116acd8874d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:41:21 user nova-compute[74743]: DEBUG nova.virt.block_device [None req-7206b6b6-7580-4c29-bcb4-ce39111616f7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Updating existing volume attachment record: 039fa0f2-251b-40e2-8032-68e2cf5dfccb {{(pid=74743) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 17:41:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:41:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:41:26 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7206b6b6-7580-4c29-bcb4-ce39111616f7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Calling os-brick to attach iSCSI Volume {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 17:41:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-7206b6b6-7580-4c29-bcb4-ce39111616f7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mYTIuhbJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:41:26 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-7206b6b6-7580-4c29-bcb4-ce39111616f7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:41:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-7206b6b6-7580-4c29-bcb4-ce39111616f7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:41:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-7206b6b6-7580-4c29-bcb4-ce39111616f7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:41:26 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-7206b6b6-7580-4c29-bcb4-ce39111616f7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:41:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-7206b6b6-7580-4c29-bcb4-ce39111616f7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:41:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-7206b6b6-7580-4c29-bcb4-ce39111616f7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:41:26 user nova-compute[74743]: INFO os_brick.initiator.connectors.iscsi [None req-7206b6b6-7580-4c29-bcb4-ce39111616f7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 17:41:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 -p 172.16.0.220:3260 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:41:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:41:26 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ee4e42-12c9-4b22-a762-b6b646ad8e5b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:41:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-7206b6b6-7580-4c29-bcb4-ce39111616f7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 17:41:26 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:41:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 -p 172.16.0.220:3260 --interface default --op new {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:41:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:41:26 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0114327-3d39-4b9c-8536-ce3e6eb67b47]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817] added\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:41:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-7206b6b6-7580-4c29-bcb4-ce39111616f7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817] added
Nov 18 17:41:26 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:41:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:41:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:41:26 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae03cf6-ad43-4bcb-b70d-3dd39ef9f240]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:41:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-7206b6b6-7580-4c29-bcb4-ce39111616f7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:41:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:41:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:41:26 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b825a21c-3038-400e-9337-24b5329216d1]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:41:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-7206b6b6-7580-4c29-bcb4-ce39111616f7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:41:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mYTIuhbJ {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:41:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mYTIuhbJ" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:41:26 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbac6eb-58bd-400a-b1ad-5cf89c8e3f28]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:41:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-7206b6b6-7580-4c29-bcb4-ce39111616f7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mYTIuhbJ'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:41:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:41:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:41:26 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[8453d3b0-5eef-45f3-b1ce-c220cc865d1f]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:41:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-7206b6b6-7580-4c29-bcb4-ce39111616f7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:41:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:41:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:41:26 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d2f958-cd2d-4082-983c-2983396c449d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:41:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-7206b6b6-7580-4c29-bcb4-ce39111616f7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 18 17:41:26 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:41:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-7206b6b6-7580-4c29-bcb4-ce39111616f7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 18 17:41:26 user nova-compute[74743]:  {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:41:26 user nova-compute[74743]: WARNING os_brick.initiator.connectors.iscsi [None req-7206b6b6-7580-4c29-bcb4-ce39111616f7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 18 17:41:26 user nova-compute[74743]: 
Nov 18 17:41:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 -p 172.16.0.220:3260 --login {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:41:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:41:26 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7a89e4-a47f-4c3d-9269-08fe5165e022]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:41:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-7206b6b6-7580-4c29-bcb4-ce39111616f7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817, portal: 172.16.0.220,3260]
Nov 18 17:41:26 user nova-compute[74743]: Login to [iface: default, target: iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817, portal: 172.16.0.220,3260] successful.
Nov 18 17:41:26 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:41:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:41:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:41:26 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6a19b3-925c-43c6-b36e-541198d10de5]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:41:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-7206b6b6-7580-4c29-bcb4-ce39111616f7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:41:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:41:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:41:26 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c75d2e-701e-4fb4-9dbd-c68400860086]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:41:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-7206b6b6-7580-4c29-bcb4-ce39111616f7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 (non-flash)
Nov 18 17:41:26 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:41:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-7206b6b6-7580-4c29-bcb4-ce39111616f7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 (non-flash)
Nov 18 17:41:26 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:41:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-7206b6b6-7580-4c29-bcb4-ce39111616f7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:41:26 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-7206b6b6-7580-4c29-bcb4-ce39111616f7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Connected to 172.16.0.220:3260 {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 17:41:26 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-7206b6b6-7580-4c29-bcb4-ce39111616f7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=74743) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 17:41:26 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-7206b6b6-7580-4c29-bcb4-ce39111616f7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74743) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 17:41:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:41:26 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:41:26 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0fd74d2-deab-4c85-af4e-e8c4ef62af9b]: (4, ('- - 0', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:41:26 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-7206b6b6-7580-4c29-bcb4-ce39111616f7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: None {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:41:27 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-7206b6b6-7580-4c29-bcb4-ce39111616f7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:41:27 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-7206b6b6-7580-4c29-bcb4-ce39111616f7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mYTIuhbJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 17:41:27 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-7206b6b6-7580-4c29-bcb4-ce39111616f7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:41:27 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-7206b6b6-7580-4c29-bcb4-ce39111616f7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '26135393838646364', 'path': '/dev/sdb'} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:41:27 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7206b6b6-7580-4c29-bcb4-ce39111616f7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135393838646364', 'path': '/dev/sdb'} {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 17:41:27 user nova-compute[74743]: DEBUG nova.objects.instance [None req-7206b6b6-7580-4c29-bcb4-ce39111616f7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lazy-loading 'flavor' on Instance uuid 9c90f34f-7bbf-40d9-8f65-983d91f0b51b {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:41:27 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-7206b6b6-7580-4c29-bcb4-ce39111616f7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 17:41:27 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:41:27 user nova-compute[74743]:   <source dev="/dev/sdb"/>
Nov 18 17:41:27 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:41:27 user nova-compute[74743]:   <serial>7555ca1f-df6a-42d1-951d-129bfb5ba817</serial>
Nov 18 17:41:27 user nova-compute[74743]: </disk>
Nov 18 17:41:27 user nova-compute[74743]:  {{(pid=74743) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 17:41:27 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:41:28 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-7206b6b6-7580-4c29-bcb4-ce39111616f7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:41:28 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-7206b6b6-7580-4c29-bcb4-ce39111616f7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:41:28 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-7206b6b6-7580-4c29-bcb4-ce39111616f7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] No VIF found with MAC fa:16:3e:08:2d:e8, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:41:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-7206b6b6-7580-4c29-bcb4-ce39111616f7 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.294s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:41:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-510690c9-d15d-41b9-83d0-ea85870dd3f9 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Acquiring lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:41:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-510690c9-d15d-41b9-83d0-ea85870dd3f9 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:41:28 user nova-compute[74743]: DEBUG nova.compute.manager [None req-510690c9-d15d-41b9-83d0-ea85870dd3f9 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:41:28 user nova-compute[74743]: DEBUG nova.compute.manager [None req-510690c9-d15d-41b9-83d0-ea85870dd3f9 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74743) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 18 17:41:28 user nova-compute[74743]: DEBUG nova.objects.instance [None req-510690c9-d15d-41b9-83d0-ea85870dd3f9 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lazy-loading 'flavor' on Instance uuid 9c90f34f-7bbf-40d9-8f65-983d91f0b51b {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:41:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:41:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:41:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:41:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:41:29 user nova-compute[74743]: DEBUG nova.compute.manager [req-69c9cd18-7350-4a17-9dce-28ccc621d60f req-0dc0628a-e2f3-4c34-bffd-59081ac536fd service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Received event network-vif-unplugged-6ba5e67e-b479-4371-89e3-97c1beceff8f {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:41:29 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-69c9cd18-7350-4a17-9dce-28ccc621d60f req-0dc0628a-e2f3-4c34-bffd-59081ac536fd service nova] Acquiring lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:41:29 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-69c9cd18-7350-4a17-9dce-28ccc621d60f req-0dc0628a-e2f3-4c34-bffd-59081ac536fd service nova] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:41:29 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-69c9cd18-7350-4a17-9dce-28ccc621d60f req-0dc0628a-e2f3-4c34-bffd-59081ac536fd service nova] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:41:29 user nova-compute[74743]: DEBUG nova.compute.manager [req-69c9cd18-7350-4a17-9dce-28ccc621d60f req-0dc0628a-e2f3-4c34-bffd-59081ac536fd service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] No waiting events found dispatching network-vif-unplugged-6ba5e67e-b479-4371-89e3-97c1beceff8f {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:41:29 user nova-compute[74743]: WARNING nova.compute.manager [req-69c9cd18-7350-4a17-9dce-28ccc621d60f req-0dc0628a-e2f3-4c34-bffd-59081ac536fd service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Received unexpected event network-vif-unplugged-6ba5e67e-b479-4371-89e3-97c1beceff8f for instance with vm_state active and task_state powering-off.
Nov 18 17:41:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:41:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:41:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:41:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:41:29 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:41:29 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Instance destroyed successfully.
Nov 18 17:41:29 user nova-compute[74743]: DEBUG nova.compute.manager [None req-510690c9-d15d-41b9-83d0-ea85870dd3f9 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:41:29 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-510690c9-d15d-41b9-83d0-ea85870dd3f9 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.951s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:41:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:41:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:41:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:41:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:41:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:41:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:41:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:41:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:41:31 user nova-compute[74743]: DEBUG nova.compute.manager [req-f213167f-51ab-4a13-a1e2-dc7e2c85886c req-695991c3-0a7f-4ca0-a7db-e76b0059b46f service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Received event network-vif-plugged-6ba5e67e-b479-4371-89e3-97c1beceff8f {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:41:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f213167f-51ab-4a13-a1e2-dc7e2c85886c req-695991c3-0a7f-4ca0-a7db-e76b0059b46f service nova] Acquiring lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:41:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f213167f-51ab-4a13-a1e2-dc7e2c85886c req-695991c3-0a7f-4ca0-a7db-e76b0059b46f service nova] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:41:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f213167f-51ab-4a13-a1e2-dc7e2c85886c req-695991c3-0a7f-4ca0-a7db-e76b0059b46f service nova] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:41:31 user nova-compute[74743]: DEBUG nova.compute.manager [req-f213167f-51ab-4a13-a1e2-dc7e2c85886c req-695991c3-0a7f-4ca0-a7db-e76b0059b46f service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] No waiting events found dispatching network-vif-plugged-6ba5e67e-b479-4371-89e3-97c1beceff8f {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:41:31 user nova-compute[74743]: WARNING nova.compute.manager [req-f213167f-51ab-4a13-a1e2-dc7e2c85886c req-695991c3-0a7f-4ca0-a7db-e76b0059b46f service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Received unexpected event network-vif-plugged-6ba5e67e-b479-4371-89e3-97c1beceff8f for instance with vm_state stopped and task_state None.
Nov 18 17:41:31 user nova-compute[74743]: DEBUG nova.compute.manager [req-f213167f-51ab-4a13-a1e2-dc7e2c85886c req-695991c3-0a7f-4ca0-a7db-e76b0059b46f service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Received event network-vif-plugged-6ba5e67e-b479-4371-89e3-97c1beceff8f {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:41:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f213167f-51ab-4a13-a1e2-dc7e2c85886c req-695991c3-0a7f-4ca0-a7db-e76b0059b46f service nova] Acquiring lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:41:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f213167f-51ab-4a13-a1e2-dc7e2c85886c req-695991c3-0a7f-4ca0-a7db-e76b0059b46f service nova] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:41:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f213167f-51ab-4a13-a1e2-dc7e2c85886c req-695991c3-0a7f-4ca0-a7db-e76b0059b46f service nova] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:41:31 user nova-compute[74743]: DEBUG nova.compute.manager [req-f213167f-51ab-4a13-a1e2-dc7e2c85886c req-695991c3-0a7f-4ca0-a7db-e76b0059b46f service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] No waiting events found dispatching network-vif-plugged-6ba5e67e-b479-4371-89e3-97c1beceff8f {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:41:31 user nova-compute[74743]: WARNING nova.compute.manager [req-f213167f-51ab-4a13-a1e2-dc7e2c85886c req-695991c3-0a7f-4ca0-a7db-e76b0059b46f service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Received unexpected event network-vif-plugged-6ba5e67e-b479-4371-89e3-97c1beceff8f for instance with vm_state stopped and task_state None.
Nov 18 17:41:31 user nova-compute[74743]: DEBUG nova.compute.manager [req-f213167f-51ab-4a13-a1e2-dc7e2c85886c req-695991c3-0a7f-4ca0-a7db-e76b0059b46f service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Received event network-vif-plugged-6ba5e67e-b479-4371-89e3-97c1beceff8f {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:41:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f213167f-51ab-4a13-a1e2-dc7e2c85886c req-695991c3-0a7f-4ca0-a7db-e76b0059b46f service nova] Acquiring lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:41:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f213167f-51ab-4a13-a1e2-dc7e2c85886c req-695991c3-0a7f-4ca0-a7db-e76b0059b46f service nova] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:41:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f213167f-51ab-4a13-a1e2-dc7e2c85886c req-695991c3-0a7f-4ca0-a7db-e76b0059b46f service nova] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:41:31 user nova-compute[74743]: DEBUG nova.compute.manager [req-f213167f-51ab-4a13-a1e2-dc7e2c85886c req-695991c3-0a7f-4ca0-a7db-e76b0059b46f service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] No waiting events found dispatching network-vif-plugged-6ba5e67e-b479-4371-89e3-97c1beceff8f {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:41:31 user nova-compute[74743]: WARNING nova.compute.manager [req-f213167f-51ab-4a13-a1e2-dc7e2c85886c req-695991c3-0a7f-4ca0-a7db-e76b0059b46f service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Received unexpected event network-vif-plugged-6ba5e67e-b479-4371-89e3-97c1beceff8f for instance with vm_state stopped and task_state None.
Nov 18 17:41:31 user nova-compute[74743]: DEBUG nova.compute.manager [req-f213167f-51ab-4a13-a1e2-dc7e2c85886c req-695991c3-0a7f-4ca0-a7db-e76b0059b46f service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Received event network-vif-unplugged-6ba5e67e-b479-4371-89e3-97c1beceff8f {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:41:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f213167f-51ab-4a13-a1e2-dc7e2c85886c req-695991c3-0a7f-4ca0-a7db-e76b0059b46f service nova] Acquiring lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:41:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f213167f-51ab-4a13-a1e2-dc7e2c85886c req-695991c3-0a7f-4ca0-a7db-e76b0059b46f service nova] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:41:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f213167f-51ab-4a13-a1e2-dc7e2c85886c req-695991c3-0a7f-4ca0-a7db-e76b0059b46f service nova] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:41:31 user nova-compute[74743]: DEBUG nova.compute.manager [req-f213167f-51ab-4a13-a1e2-dc7e2c85886c req-695991c3-0a7f-4ca0-a7db-e76b0059b46f service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] No waiting events found dispatching network-vif-unplugged-6ba5e67e-b479-4371-89e3-97c1beceff8f {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:41:31 user nova-compute[74743]: WARNING nova.compute.manager [req-f213167f-51ab-4a13-a1e2-dc7e2c85886c req-695991c3-0a7f-4ca0-a7db-e76b0059b46f service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Received unexpected event network-vif-unplugged-6ba5e67e-b479-4371-89e3-97c1beceff8f for instance with vm_state stopped and task_state None.
Nov 18 17:41:31 user nova-compute[74743]: DEBUG nova.compute.manager [req-f213167f-51ab-4a13-a1e2-dc7e2c85886c req-695991c3-0a7f-4ca0-a7db-e76b0059b46f service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Received event network-vif-plugged-6ba5e67e-b479-4371-89e3-97c1beceff8f {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:41:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f213167f-51ab-4a13-a1e2-dc7e2c85886c req-695991c3-0a7f-4ca0-a7db-e76b0059b46f service nova] Acquiring lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:41:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f213167f-51ab-4a13-a1e2-dc7e2c85886c req-695991c3-0a7f-4ca0-a7db-e76b0059b46f service nova] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:41:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f213167f-51ab-4a13-a1e2-dc7e2c85886c req-695991c3-0a7f-4ca0-a7db-e76b0059b46f service nova] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:41:31 user nova-compute[74743]: DEBUG nova.compute.manager [req-f213167f-51ab-4a13-a1e2-dc7e2c85886c req-695991c3-0a7f-4ca0-a7db-e76b0059b46f service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] No waiting events found dispatching network-vif-plugged-6ba5e67e-b479-4371-89e3-97c1beceff8f {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:41:31 user nova-compute[74743]: WARNING nova.compute.manager [req-f213167f-51ab-4a13-a1e2-dc7e2c85886c req-695991c3-0a7f-4ca0-a7db-e76b0059b46f service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Received unexpected event network-vif-plugged-6ba5e67e-b479-4371-89e3-97c1beceff8f for instance with vm_state stopped and task_state None.
Nov 18 17:41:32 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:41:35 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:41:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:41:42 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:41:45 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:41:45 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:41:45 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74743) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 17:41:46 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:41:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:41:50 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:41:51 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:41:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:41:53 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:41:54 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:41:54 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:41:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:41:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:41:54 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:41:54 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Auditing locally available compute resources for user (node: user) {{(pid=74743) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 17:41:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:41:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:41:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:41:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:41:54 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:41:54 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:41:55 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:41:55 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:41:55 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:41:55 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:41:55 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:41:55 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Hypervisor/Node resource view: name=user free_ram=8879MB free_disk=25.228652954101562GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74743) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 17:41:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:41:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:41:55 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 9c90f34f-7bbf-40d9-8f65-983d91f0b51b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:41:55 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:41:55 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 17:41:55 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 17:41:55 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:41:55 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:41:55 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Compute_service record updated for user:user {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 17:41:55 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.216s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:41:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:41:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:41:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74743) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 17:41:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:41:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:41:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:41:58 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:41:58 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Starting heal instance info cache {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 17:41:58 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Rebuilding the list of instances to heal {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 17:41:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "refresh_cache-9c90f34f-7bbf-40d9-8f65-983d91f0b51b" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:41:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquired lock "refresh_cache-9c90f34f-7bbf-40d9-8f65-983d91f0b51b" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:41:59 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Forcefully refreshing network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 17:41:59 user nova-compute[74743]: DEBUG nova.objects.instance [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lazy-loading 'info_cache' on Instance uuid 9c90f34f-7bbf-40d9-8f65-983d91f0b51b {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:41:59 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Updating instance_info_cache with network_info: [{"id": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "address": "fa:16:3e:08:2d:e8", "network": {"id": "7cf1258c-5feb-472e-9f3f-69d95360b050", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-628054528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "790f602c532d41289c52985c8fab91d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba5e67e-b4", "ovs_interfaceid": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:41:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Releasing lock "refresh_cache-9c90f34f-7bbf-40d9-8f65-983d91f0b51b" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:41:59 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Updated the network info_cache for instance {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 17:41:59 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:42:02 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:42:02 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:42:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:42:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:42:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74743) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 17:42:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:42:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:42:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:42:12 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:42:12 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:42:12 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74743) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 17:42:12 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:42:12 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:42:12 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:42:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:42:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:42:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:42:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74743) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 17:42:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:42:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:42:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:42:27 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:42:32 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:42:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:42:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:42:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74743) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 17:42:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:42:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:42:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:42:42 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:42:46 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-af3bdcd6-992d-4e98-b0f9-d7042434c006 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Acquiring lock "a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:42:46 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-af3bdcd6-992d-4e98-b0f9-d7042434c006 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Lock "a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:42:46 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-af3bdcd6-992d-4e98-b0f9-d7042434c006 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Acquiring lock "a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:42:46 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-af3bdcd6-992d-4e98-b0f9-d7042434c006 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Lock "a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:42:46 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-af3bdcd6-992d-4e98-b0f9-d7042434c006 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Lock "a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:42:46 user nova-compute[74743]: INFO nova.compute.manager [None req-af3bdcd6-992d-4e98-b0f9-d7042434c006 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] Terminating instance
Nov 18 17:42:46 user nova-compute[74743]: DEBUG nova.compute.manager [None req-af3bdcd6-992d-4e98-b0f9-d7042434c006 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] Start destroying the instance on the hypervisor. {{(pid=74743) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 17:42:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:42:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:42:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:42:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:42:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:42:46 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:42:46 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74743) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 17:42:46 user nova-compute[74743]: DEBUG nova.compute.manager [req-a4f3069c-ee65-4f82-8759-68e829c274dd req-b15858c8-342f-4000-a71d-0adcd28638b3 service nova] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] Received event network-vif-unplugged-e16e16ee-4773-4693-9a65-ee4dde5c035e {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:42:46 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a4f3069c-ee65-4f82-8759-68e829c274dd req-b15858c8-342f-4000-a71d-0adcd28638b3 service nova] Acquiring lock "a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:42:46 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a4f3069c-ee65-4f82-8759-68e829c274dd req-b15858c8-342f-4000-a71d-0adcd28638b3 service nova] Lock "a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:42:46 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a4f3069c-ee65-4f82-8759-68e829c274dd req-b15858c8-342f-4000-a71d-0adcd28638b3 service nova] Lock "a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:42:46 user nova-compute[74743]: DEBUG nova.compute.manager [req-a4f3069c-ee65-4f82-8759-68e829c274dd req-b15858c8-342f-4000-a71d-0adcd28638b3 service nova] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] No waiting events found dispatching network-vif-unplugged-e16e16ee-4773-4693-9a65-ee4dde5c035e {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:42:46 user nova-compute[74743]: DEBUG nova.compute.manager [req-a4f3069c-ee65-4f82-8759-68e829c274dd req-b15858c8-342f-4000-a71d-0adcd28638b3 service nova] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] Received event network-vif-unplugged-e16e16ee-4773-4693-9a65-ee4dde5c035e for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:42:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:42:46 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] Instance destroyed successfully.
Nov 18 17:42:46 user nova-compute[74743]: DEBUG nova.objects.instance [None req-af3bdcd6-992d-4e98-b0f9-d7042434c006 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Lazy-loading 'resources' on Instance uuid a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:42:46 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-af3bdcd6-992d-4e98-b0f9-d7042434c006 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:40:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-886271934',display_name='tempest-VolumesActionsTest-instance-886271934',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-886271934',id=49,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:41:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9a66a4053c694109b2855687a3e85baa',ramdisk_id='',reservation_id='r-770qpxan',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-721631098',owner_user_name='tempest-VolumesActionsTest-721631098-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:41:01Z,user_data=None,user_id='27ce5e71dbc74e849f07f52577dfd9b2',uuid=a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e16e16ee-4773-4693-9a65-ee4dde5c035e", "address": "fa:16:3e:a6:8a:cc", "network": {"id": "9ab2e361-b754-4327-85e0-51418401dcde", "bridge": "br-int", "label": "tempest-VolumesActionsTest-7894836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a66a4053c694109b2855687a3e85baa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape16e16ee-47", "ovs_interfaceid": "e16e16ee-4773-4693-9a65-ee4dde5c035e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:42:46 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-af3bdcd6-992d-4e98-b0f9-d7042434c006 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Converting VIF {"id": "e16e16ee-4773-4693-9a65-ee4dde5c035e", "address": "fa:16:3e:a6:8a:cc", "network": {"id": "9ab2e361-b754-4327-85e0-51418401dcde", "bridge": "br-int", "label": "tempest-VolumesActionsTest-7894836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a66a4053c694109b2855687a3e85baa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape16e16ee-47", "ovs_interfaceid": "e16e16ee-4773-4693-9a65-ee4dde5c035e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:42:46 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-af3bdcd6-992d-4e98-b0f9-d7042434c006 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:8a:cc,bridge_name='br-int',has_traffic_filtering=True,id=e16e16ee-4773-4693-9a65-ee4dde5c035e,network=Network(9ab2e361-b754-4327-85e0-51418401dcde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape16e16ee-47') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:42:46 user nova-compute[74743]: DEBUG os_vif [None req-af3bdcd6-992d-4e98-b0f9-d7042434c006 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:8a:cc,bridge_name='br-int',has_traffic_filtering=True,id=e16e16ee-4773-4693-9a65-ee4dde5c035e,network=Network(9ab2e361-b754-4327-85e0-51418401dcde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape16e16ee-47') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:42:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:42:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape16e16ee-47, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:42:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:42:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:42:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:42:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:42:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0d9a4618-3a1e-4ace-a2c8-07f6a028874d) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:42:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:42:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:42:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:42:46 user nova-compute[74743]: INFO os_vif [None req-af3bdcd6-992d-4e98-b0f9-d7042434c006 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:8a:cc,bridge_name='br-int',has_traffic_filtering=True,id=e16e16ee-4773-4693-9a65-ee4dde5c035e,network=Network(9ab2e361-b754-4327-85e0-51418401dcde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape16e16ee-47')
Nov 18 17:42:46 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-af3bdcd6-992d-4e98-b0f9-d7042434c006 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] Deleting instance files /opt/stack/data/nova/instances/a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8_del
Nov 18 17:42:46 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-af3bdcd6-992d-4e98-b0f9-d7042434c006 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] Deletion of /opt/stack/data/nova/instances/a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8_del complete
Nov 18 17:42:46 user nova-compute[74743]: INFO nova.compute.manager [None req-af3bdcd6-992d-4e98-b0f9-d7042434c006 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] Took 0.69 seconds to destroy the instance on the hypervisor.
Nov 18 17:42:46 user nova-compute[74743]: DEBUG oslo.service.loopingcall [None req-af3bdcd6-992d-4e98-b0f9-d7042434c006 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74743) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 17:42:46 user nova-compute[74743]: DEBUG nova.compute.manager [-] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] Deallocating network for instance {{(pid=74743) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 17:42:46 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] deallocate_for_instance() {{(pid=74743) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 17:42:47 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:42:47 user nova-compute[74743]: INFO nova.compute.manager [-] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] Took 0.55 seconds to deallocate network for instance.
Nov 18 17:42:47 user nova-compute[74743]: DEBUG nova.compute.manager [req-e50e7564-7685-40c4-8ad8-88fc0ba7ea13 req-1e383bbe-986d-40d1-9108-01d9b2beeb73 service nova] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] Received event network-vif-deleted-e16e16ee-4773-4693-9a65-ee4dde5c035e {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:42:47 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:42:47 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:42:47 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-af3bdcd6-992d-4e98-b0f9-d7042434c006 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:42:47 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-af3bdcd6-992d-4e98-b0f9-d7042434c006 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:42:47 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-af3bdcd6-992d-4e98-b0f9-d7042434c006 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:42:47 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-af3bdcd6-992d-4e98-b0f9-d7042434c006 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:42:47 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-af3bdcd6-992d-4e98-b0f9-d7042434c006 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.135s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:42:47 user nova-compute[74743]: INFO nova.scheduler.client.report [None req-af3bdcd6-992d-4e98-b0f9-d7042434c006 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Deleted allocations for instance a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8
Nov 18 17:42:47 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-af3bdcd6-992d-4e98-b0f9-d7042434c006 tempest-VolumesActionsTest-721631098 tempest-VolumesActionsTest-721631098-project-member] Lock "a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.566s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:42:48 user nova-compute[74743]: DEBUG nova.compute.manager [req-b8012231-ce9c-4383-912e-1fe7b6543f4e req-2620b207-949b-4497-9d67-1c113fa0d420 service nova] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] Received event network-vif-plugged-e16e16ee-4773-4693-9a65-ee4dde5c035e {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:42:48 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b8012231-ce9c-4383-912e-1fe7b6543f4e req-2620b207-949b-4497-9d67-1c113fa0d420 service nova] Acquiring lock "a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:42:48 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b8012231-ce9c-4383-912e-1fe7b6543f4e req-2620b207-949b-4497-9d67-1c113fa0d420 service nova] Lock "a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:42:48 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b8012231-ce9c-4383-912e-1fe7b6543f4e req-2620b207-949b-4497-9d67-1c113fa0d420 service nova] Lock "a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:42:48 user nova-compute[74743]: DEBUG nova.compute.manager [req-b8012231-ce9c-4383-912e-1fe7b6543f4e req-2620b207-949b-4497-9d67-1c113fa0d420 service nova] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] No waiting events found dispatching network-vif-plugged-e16e16ee-4773-4693-9a65-ee4dde5c035e {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:42:48 user nova-compute[74743]: WARNING nova.compute.manager [req-b8012231-ce9c-4383-912e-1fe7b6543f4e req-2620b207-949b-4497-9d67-1c113fa0d420 service nova] [instance: a5ecd8e0-be7b-4d14-84cc-bbb99a810eb8] Received unexpected event network-vif-plugged-e16e16ee-4773-4693-9a65-ee4dde5c035e for instance with vm_state deleted and task_state None.
Nov 18 17:42:51 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:42:53 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:42:54 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:42:56 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:42:56 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:42:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:42:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:42:56 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:42:56 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Auditing locally available compute resources for user (node: user) {{(pid=74743) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 17:42:56 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:42:56 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:42:56 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:42:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:42:56 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:42:56 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:42:57 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:42:57 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:42:57 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Hypervisor/Node resource view: name=user free_ram=9057MB free_disk=25.25580596923828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74743) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 17:42:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:42:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:42:57 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 9c90f34f-7bbf-40d9-8f65-983d91f0b51b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:42:57 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 17:42:57 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 17:42:57 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:42:57 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:42:57 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Compute_service record updated for user:user {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 17:42:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.339s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:42:58 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:43:00 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:43:00 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Starting heal instance info cache {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 17:43:00 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Didn't find any instances for network info cache update. {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 18 17:43:01 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:43:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:43:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:43:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:43:19 user nova-compute[74743]: DEBUG nova.objects.instance [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lazy-loading 'flavor' on Instance uuid 9c90f34f-7bbf-40d9-8f65-983d91f0b51b {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:43:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Acquiring lock "refresh_cache-9c90f34f-7bbf-40d9-8f65-983d91f0b51b" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:43:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Acquired lock "refresh_cache-9c90f34f-7bbf-40d9-8f65-983d91f0b51b" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:43:19 user nova-compute[74743]: DEBUG nova.network.neutron [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:43:19 user nova-compute[74743]: DEBUG nova.objects.instance [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lazy-loading 'info_cache' on Instance uuid 9c90f34f-7bbf-40d9-8f65-983d91f0b51b {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:43:19 user nova-compute[74743]: DEBUG nova.objects.base [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Object Instance<9c90f34f-7bbf-40d9-8f65-983d91f0b51b> lazy-loaded attributes: flavor,info_cache {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:43:19 user nova-compute[74743]: DEBUG nova.network.neutron [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Updating instance_info_cache with network_info: [{"id": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "address": "fa:16:3e:08:2d:e8", "network": {"id": "7cf1258c-5feb-472e-9f3f-69d95360b050", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-628054528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "790f602c532d41289c52985c8fab91d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba5e67e-b4", "ovs_interfaceid": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Releasing lock "refresh_cache-9c90f34f-7bbf-40d9-8f65-983d91f0b51b" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:43:20 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Instance destroyed successfully.
Nov 18 17:43:20 user nova-compute[74743]: DEBUG nova.objects.instance [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lazy-loading 'resources' on Instance uuid 9c90f34f-7bbf-40d9-8f65-983d91f0b51b {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG nova.objects.base [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Object Instance<9c90f34f-7bbf-40d9-8f65-983d91f0b51b> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:39:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-412810144',display_name='tempest-AttachVolumeTestJSON-server-412810144',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-412810144',id=48,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLOX3vLKn4BPxKq/sYlRJyYxjQkfS7C5a3EAlzUWDWpfhN4MRLyKkuT1pXcPPcKSOXBLUqQkc/KRtoOHbZrTCC299l1ITOKXjAQISq5k9bKohMtNJ2/b6nyF5OqHILx6UA==',key_name='tempest-keypair-452329227',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:39:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='790f602c532d41289c52985c8fab91d4',ramdisk_id='',reservation_id='r-2otufkmn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1207996855',owner_user_name='tempest-AttachVolumeTestJSON-1207996855-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:41:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b9d8b543f4946b2918bd38c4a3c835f',uuid=9c90f34f-7bbf-40d9-8f65-983d91f0b51b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "address": "fa:16:3e:08:2d:e8", "network": {"id": "7cf1258c-5feb-472e-9f3f-69d95360b050", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-628054528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "790f602c532d41289c52985c8fab91d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba5e67e-b4", "ovs_interfaceid": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Converting VIF {"id": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "address": "fa:16:3e:08:2d:e8", "network": {"id": "7cf1258c-5feb-472e-9f3f-69d95360b050", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-628054528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "790f602c532d41289c52985c8fab91d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba5e67e-b4", "ovs_interfaceid": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:2d:e8,bridge_name='br-int',has_traffic_filtering=True,id=6ba5e67e-b479-4371-89e3-97c1beceff8f,network=Network(7cf1258c-5feb-472e-9f3f-69d95360b050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ba5e67e-b4') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG os_vif [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:2d:e8,bridge_name='br-int',has_traffic_filtering=True,id=6ba5e67e-b479-4371-89e3-97c1beceff8f,network=Network(7cf1258c-5feb-472e-9f3f-69d95360b050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ba5e67e-b4') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6ba5e67e-b4, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=78de4e37-a89e-48d7-8948-895ee17c9b78) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:43:20 user nova-compute[74743]: INFO os_vif [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:2d:e8,bridge_name='br-int',has_traffic_filtering=True,id=6ba5e67e-b479-4371-89e3-97c1beceff8f,network=Network(7cf1258c-5feb-472e-9f3f-69d95360b050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ba5e67e-b4')
Nov 18 17:43:20 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] calling os-brick to detach iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, {'target_iqn': 'iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mYTIuhbJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:43:20 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:43:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f1ca62-748b-4be4-a24c-b3d3590c783f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 17:43:20 user nova-compute[74743]: No targets found.
Nov 18 17:43:20 user nova-compute[74743]: iSNS:
Nov 18 17:43:20 user nova-compute[74743]: No targets found.
Nov 18 17:43:20 user nova-compute[74743]: STATIC:
Nov 18 17:43:20 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817
Nov 18 17:43:20 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:43:20 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:43:20 user nova-compute[74743]: FIRMWARE:
Nov 18 17:43:20 user nova-compute[74743]: No targets found.
Nov 18 17:43:20 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 17:43:20 user nova-compute[74743]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 17:43:20 user nova-compute[74743]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74743) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817', 0)] {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33f114c-d38e-44af-a875-6d2c7c7a2ce9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f7d0c2-17e8-4702-aed2-19ca013c1881]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 (non-flash)
Nov 18 17:43:20 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 (non-flash)
Nov 18 17:43:20 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb2858f490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817'): ({'sdb'}, set())}) {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Removing single pathed devices sdb {{(pid=74743) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea34ce3-a811-44c7-8df6-b8a102954b6d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[624a4dbe-1dc8-4097-a0ad-291bec12f94e]: (4, ('ok\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Flushing IO for device /dev/sdb {{(pid=74743) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad40224-499a-4375-976f-116ab404394b]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74743) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ed72e8-9856-4052-aed4-8c7e1e424c58]: (4, ('1', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] SCSI volumes sdb have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817')] {{(pid=74743) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[af41212b-dc54-4d5e-8348-32c3d6c806b1]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 -p 172.16.0.220:3260 --logout {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[f646c00d-2398-4cd4-aae0-f4afc30af4c1]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817, portal: 172.16.0.220,3260]
Nov 18 17:43:20 user nova-compute[74743]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817, portal: 172.16.0.220,3260] successful.
Nov 18 17:43:20 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 -p 172.16.0.220:3260 --op delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f04d9fa-7bc1-4500-972a-bb1f7a6d3b1e]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] <== disconnect_volume: return (283ms) None {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Disconnected iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Start _get_guest_xml network_info=[{"id": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "address": "fa:16:3e:08:2d:e8", "network": {"id": "7cf1258c-5feb-472e-9f3f-69d95360b050", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-628054528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "790f602c532d41289c52985c8fab91d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba5e67e-b4", "ovs_interfaceid": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '9536f6cf-95c4-40e2-864a-09a91525678a'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': False, 'boot_index': None, 'mount_device': '/dev/vdb', 'attachment_id': '039fa0f2-251b-40e2-8032-68e2cf5dfccb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mYTIuhbJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '9c90f34f-7bbf-40d9-8f65-983d91f0b51b', 'attached_at': '', 'detached_at': '', 'volume_id': '7555ca1f-df6a-42d1-951d-129bfb5ba817', 'serial': '7555ca1f-df6a-42d1-951d-129bfb5ba817'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG nova.objects.instance [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lazy-loading 'numa_topology' on Instance uuid 9c90f34f-7bbf-40d9-8f65-983d91f0b51b {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG nova.objects.base [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Object Instance<9c90f34f-7bbf-40d9-8f65-983d91f0b51b> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:43:20 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:43:20 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:43:20 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG nova.objects.instance [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9c90f34f-7bbf-40d9-8f65-983d91f0b51b {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG nova.objects.base [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Object Instance<9c90f34f-7bbf-40d9-8f65-983d91f0b51b> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Calling os-brick to attach iSCSI Volume {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mYTIuhbJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:43:20 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:43:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:43:20 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:43:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:43:20 user nova-compute[74743]: INFO os_brick.initiator.connectors.iscsi [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 -p 172.16.0.220:3260 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[56137065-c7d1-4a49-be5d-66aab16acba8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 17:43:20 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 -p 172.16.0.220:3260 --interface default --op new {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba77b282-58e4-4787-bb8e-e053e816c07f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817] added\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817] added
Nov 18 17:43:20 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e3b35d-6f15-4db4-875d-ad7be5db59b7]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d3e60e-abe1-4493-8320-efbc2f38d826]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mYTIuhbJ {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mYTIuhbJ" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba1b18e-2e3b-4248-a660-67aaf0d8744d]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mYTIuhbJ'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[38939c62-370b-4b54-9b48-8295a4a5cfc7]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6d198e-ef43-4eab-b13c-1b8d52b9cc26]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 18 17:43:20 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 18 17:43:20 user nova-compute[74743]:  {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:43:20 user nova-compute[74743]: WARNING os_brick.initiator.connectors.iscsi [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 18 17:43:20 user nova-compute[74743]: 
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 -p 172.16.0.220:3260 --login {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc03c902-27bc-4a71-bed4-546f1aabd855]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817, portal: 172.16.0.220,3260]
Nov 18 17:43:20 user nova-compute[74743]: Login to [iface: default, target: iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817, portal: 172.16.0.220,3260] successful.
Nov 18 17:43:20 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[484a5cfb-c032-4958-a5fe-1d75beadc84d]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[91aa2a91-d8f7-4b59-95a9-950caa3812e9]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 (non-flash)
Nov 18 17:43:20 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 (non-flash)
Nov 18 17:43:20 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.236s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Connected to 172.16.0.220:3260 {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=74743) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74743) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2a33dc-f86b-48ab-9758-041624177d17]: (4, ('- - 0', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:43:20 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: None {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:43:21 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:43:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mYTIuhbJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 17:43:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.264s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:43:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] <== connect_volume: return (1266ms) {'type': 'block', 'scsi_wwn': '26135393838646364', 'path': '/dev/sdb'} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:43:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135393838646364', 'path': '/dev/sdb'} {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 17:43:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:39:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-412810144',display_name='tempest-AttachVolumeTestJSON-server-412810144',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-412810144',id=48,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLOX3vLKn4BPxKq/sYlRJyYxjQkfS7C5a3EAlzUWDWpfhN4MRLyKkuT1pXcPPcKSOXBLUqQkc/KRtoOHbZrTCC299l1ITOKXjAQISq5k9bKohMtNJ2/b6nyF5OqHILx6UA==',key_name='tempest-keypair-452329227',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:39:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='790f602c532d41289c52985c8fab91d4',ramdisk_id='',reservation_id='r-2otufkmn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1207996855',owner_user_name='tempest-AttachVolumeTestJSON-1207996855-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:41:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b9d8b543f4946b2918bd38c4a3c835f',uuid=9c90f34f-7bbf-40d9-8f65-983d91f0b51b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "address": "fa:16:3e:08:2d:e8", "network": {"id": "7cf1258c-5feb-472e-9f3f-69d95360b050", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-628054528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "790f602c532d41289c52985c8fab91d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba5e67e-b4", "ovs_interfaceid": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:43:21 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Converting VIF {"id": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "address": "fa:16:3e:08:2d:e8", "network": {"id": "7cf1258c-5feb-472e-9f3f-69d95360b050", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-628054528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "790f602c532d41289c52985c8fab91d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba5e67e-b4", "ovs_interfaceid": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:43:21 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:2d:e8,bridge_name='br-int',has_traffic_filtering=True,id=6ba5e67e-b479-4371-89e3-97c1beceff8f,network=Network(7cf1258c-5feb-472e-9f3f-69d95360b050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ba5e67e-b4') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:43:21 user nova-compute[74743]: DEBUG nova.objects.instance [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lazy-loading 'pci_devices' on Instance uuid 9c90f34f-7bbf-40d9-8f65-983d91f0b51b {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:43:21 user nova-compute[74743]: DEBUG nova.objects.base [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Object Instance<9c90f34f-7bbf-40d9-8f65-983d91f0b51b> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:43:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:43:21 user nova-compute[74743]:   <uuid>9c90f34f-7bbf-40d9-8f65-983d91f0b51b</uuid>
Nov 18 17:43:21 user nova-compute[74743]:   <name>instance-00000030</name>
Nov 18 17:43:21 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:43:21 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:43:21 user nova-compute[74743]:   <metadata>
Nov 18 17:43:21 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:43:21 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:43:21 user nova-compute[74743]:       <nova:name>tempest-AttachVolumeTestJSON-server-412810144</nova:name>
Nov 18 17:43:21 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:43:20</nova:creationTime>
Nov 18 17:43:21 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:43:21 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:43:21 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:43:21 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:43:21 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:43:21 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:43:21 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:43:21 user nova-compute[74743]:       <nova:owner>
Nov 18 17:43:21 user nova-compute[74743]:         <nova:user uuid="8b9d8b543f4946b2918bd38c4a3c835f">tempest-AttachVolumeTestJSON-1207996855-project-member</nova:user>
Nov 18 17:43:21 user nova-compute[74743]:         <nova:project uuid="790f602c532d41289c52985c8fab91d4">tempest-AttachVolumeTestJSON-1207996855</nova:project>
Nov 18 17:43:21 user nova-compute[74743]:       </nova:owner>
Nov 18 17:43:21 user nova-compute[74743]:       <nova:root type="image" uuid="9536f6cf-95c4-40e2-864a-09a91525678a"/>
Nov 18 17:43:21 user nova-compute[74743]:       <nova:ports>
Nov 18 17:43:21 user nova-compute[74743]:         <nova:port uuid="6ba5e67e-b479-4371-89e3-97c1beceff8f">
Nov 18 17:43:21 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 18 17:43:21 user nova-compute[74743]:         </nova:port>
Nov 18 17:43:21 user nova-compute[74743]:       </nova:ports>
Nov 18 17:43:21 user nova-compute[74743]:     </nova:instance>
Nov 18 17:43:21 user nova-compute[74743]:   </metadata>
Nov 18 17:43:21 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:43:21 user nova-compute[74743]:     <system>
Nov 18 17:43:21 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:43:21 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:43:21 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:43:21 user nova-compute[74743]:       <entry name="serial">9c90f34f-7bbf-40d9-8f65-983d91f0b51b</entry>
Nov 18 17:43:21 user nova-compute[74743]:       <entry name="uuid">9c90f34f-7bbf-40d9-8f65-983d91f0b51b</entry>
Nov 18 17:43:21 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:43:21 user nova-compute[74743]:     </system>
Nov 18 17:43:21 user nova-compute[74743]:   </sysinfo>
Nov 18 17:43:21 user nova-compute[74743]:   <os>
Nov 18 17:43:21 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:43:21 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:43:21 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:43:21 user nova-compute[74743]:   </os>
Nov 18 17:43:21 user nova-compute[74743]:   <features>
Nov 18 17:43:21 user nova-compute[74743]:     <acpi/>
Nov 18 17:43:21 user nova-compute[74743]:     <apic/>
Nov 18 17:43:21 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:43:21 user nova-compute[74743]:   </features>
Nov 18 17:43:21 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:43:21 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:43:21 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:43:21 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:43:21 user nova-compute[74743]:   </clock>
Nov 18 17:43:21 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:43:21 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:43:21 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:43:21 user nova-compute[74743]:   </cpu>
Nov 18 17:43:21 user nova-compute[74743]:   <devices>
Nov 18 17:43:21 user nova-compute[74743]:     <disk type="file" device="disk">
Nov 18 17:43:21 user nova-compute[74743]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 17:43:21 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk"/>
Nov 18 17:43:21 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:43:21 user nova-compute[74743]:     </disk>
Nov 18 17:43:21 user nova-compute[74743]:     <disk type="block" device="disk">
Nov 18 17:43:21 user nova-compute[74743]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:43:21 user nova-compute[74743]:       <source dev="/dev/sdb"/>
Nov 18 17:43:21 user nova-compute[74743]:       <target dev="vdb" bus="virtio"/>
Nov 18 17:43:21 user nova-compute[74743]:       <serial>7555ca1f-df6a-42d1-951d-129bfb5ba817</serial>
Nov 18 17:43:21 user nova-compute[74743]:     </disk>
Nov 18 17:43:21 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:43:21 user nova-compute[74743]:       <mac address="fa:16:3e:08:2d:e8"/>
Nov 18 17:43:21 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:43:21 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:43:21 user nova-compute[74743]:       <target dev="tap6ba5e67e-b4"/>
Nov 18 17:43:21 user nova-compute[74743]:     </interface>
Nov 18 17:43:21 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:43:21 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/console.log" append="off"/>
Nov 18 17:43:21 user nova-compute[74743]:     </serial>
Nov 18 17:43:21 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:43:21 user nova-compute[74743]:     <video>
Nov 18 17:43:21 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:43:21 user nova-compute[74743]:     </video>
Nov 18 17:43:21 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:43:21 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:43:21 user nova-compute[74743]:     </rng>
Nov 18 17:43:21 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:43:21 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:43:21 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:43:21 user nova-compute[74743]:     </memballoon>
Nov 18 17:43:21 user nova-compute[74743]:   </devices>
Nov 18 17:43:21 user nova-compute[74743]: </domain>
Nov 18 17:43:21 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:43:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:43:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:43:21 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:43:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:43:22 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:43:22 user nova-compute[74743]: DEBUG nova.objects.instance [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9c90f34f-7bbf-40d9-8f65-983d91f0b51b {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:43:22 user nova-compute[74743]: DEBUG nova.objects.base [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Object Instance<9c90f34f-7bbf-40d9-8f65-983d91f0b51b> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:43:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:43:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.178s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:43:22 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk. size=1073741824 {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 17:43:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:43:22 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:43:22 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Cannot resize image /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk to a smaller size. {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 17:43:22 user nova-compute[74743]: DEBUG nova.objects.instance [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lazy-loading 'migration_context' on Instance uuid 9c90f34f-7bbf-40d9-8f65-983d91f0b51b {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:43:22 user nova-compute[74743]: DEBUG nova.objects.base [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Object Instance<9c90f34f-7bbf-40d9-8f65-983d91f0b51b> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:43:22 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:39:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-412810144',display_name='tempest-AttachVolumeTestJSON-server-412810144',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-412810144',id=48,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLOX3vLKn4BPxKq/sYlRJyYxjQkfS7C5a3EAlzUWDWpfhN4MRLyKkuT1pXcPPcKSOXBLUqQkc/KRtoOHbZrTCC299l1ITOKXjAQISq5k9bKohMtNJ2/b6nyF5OqHILx6UA==',key_name='tempest-keypair-452329227',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:39:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='790f602c532d41289c52985c8fab91d4',ramdisk_id='',reservation_id='r-2otufkmn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1207996855',owner_user_name='tempest-AttachVolumeTestJSON-1207996855-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:41:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b9d8b543f4946b2918bd38c4a3c835f',uuid=9c90f34f-7bbf-40d9-8f65-983d91f0b51b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "address": "fa:16:3e:08:2d:e8", "network": {"id": "7cf1258c-5feb-472e-9f3f-69d95360b050", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-628054528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "790f602c532d41289c52985c8fab91d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba5e67e-b4", "ovs_interfaceid": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:43:22 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Converting VIF {"id": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "address": "fa:16:3e:08:2d:e8", "network": {"id": "7cf1258c-5feb-472e-9f3f-69d95360b050", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-628054528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "790f602c532d41289c52985c8fab91d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba5e67e-b4", "ovs_interfaceid": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:43:22 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:2d:e8,bridge_name='br-int',has_traffic_filtering=True,id=6ba5e67e-b479-4371-89e3-97c1beceff8f,network=Network(7cf1258c-5feb-472e-9f3f-69d95360b050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ba5e67e-b4') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:43:22 user nova-compute[74743]: DEBUG os_vif [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:2d:e8,bridge_name='br-int',has_traffic_filtering=True,id=6ba5e67e-b479-4371-89e3-97c1beceff8f,network=Network(7cf1258c-5feb-472e-9f3f-69d95360b050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ba5e67e-b4') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:43:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:43:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:43:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:43:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:43:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dfb15587-0004-5fb2-9e60-ab6df950148a', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:43:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:43:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:43:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:43:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6ba5e67e-b4, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:43:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6ba5e67e-b4, col_values=(('qos', UUID('a6ce8615-9dba-4a68-87c6-c3979eed115c')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:43:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6ba5e67e-b4, col_values=(('external_ids', {'iface-id': '6ba5e67e-b479-4371-89e3-97c1beceff8f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:2d:e8', 'vm-uuid': '9c90f34f-7bbf-40d9-8f65-983d91f0b51b'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:43:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:43:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:43:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:43:22 user nova-compute[74743]: INFO os_vif [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:2d:e8,bridge_name='br-int',has_traffic_filtering=True,id=6ba5e67e-b479-4371-89e3-97c1beceff8f,network=Network(7cf1258c-5feb-472e-9f3f-69d95360b050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ba5e67e-b4')
Nov 18 17:43:23 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:43:23 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:43:23 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:43:24 user nova-compute[74743]: DEBUG nova.compute.manager [req-400bfe3b-4b45-419c-9882-a4d208a04d66 req-75e5edca-8a7f-4be0-a3ea-bdfefe1f76e7 service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Received event network-vif-plugged-6ba5e67e-b479-4371-89e3-97c1beceff8f {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:43:24 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-400bfe3b-4b45-419c-9882-a4d208a04d66 req-75e5edca-8a7f-4be0-a3ea-bdfefe1f76e7 service nova] Acquiring lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:43:24 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-400bfe3b-4b45-419c-9882-a4d208a04d66 req-75e5edca-8a7f-4be0-a3ea-bdfefe1f76e7 service nova] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:43:24 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-400bfe3b-4b45-419c-9882-a4d208a04d66 req-75e5edca-8a7f-4be0-a3ea-bdfefe1f76e7 service nova] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:43:24 user nova-compute[74743]: DEBUG nova.compute.manager [req-400bfe3b-4b45-419c-9882-a4d208a04d66 req-75e5edca-8a7f-4be0-a3ea-bdfefe1f76e7 service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] No waiting events found dispatching network-vif-plugged-6ba5e67e-b479-4371-89e3-97c1beceff8f {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:43:24 user nova-compute[74743]: WARNING nova.compute.manager [req-400bfe3b-4b45-419c-9882-a4d208a04d66 req-75e5edca-8a7f-4be0-a3ea-bdfefe1f76e7 service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Received unexpected event network-vif-plugged-6ba5e67e-b479-4371-89e3-97c1beceff8f for instance with vm_state stopped and task_state powering-on.
Nov 18 17:43:24 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:43:24 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:43:24 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:43:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:43:25 user nova-compute[74743]: DEBUG nova.compute.manager [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:43:25 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Instance rebooted successfully.
Nov 18 17:43:25 user nova-compute[74743]: DEBUG nova.compute.manager [None req-d4c983fb-dd24-46a7-865f-d5b5b30c1d96 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:43:26 user nova-compute[74743]: DEBUG nova.compute.manager [req-453f5d91-c337-4af3-b97a-ab7283c49306 req-298951e7-a510-49d1-96bf-c90ed41583a1 service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Received event network-vif-plugged-6ba5e67e-b479-4371-89e3-97c1beceff8f {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:43:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-453f5d91-c337-4af3-b97a-ab7283c49306 req-298951e7-a510-49d1-96bf-c90ed41583a1 service nova] Acquiring lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:43:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-453f5d91-c337-4af3-b97a-ab7283c49306 req-298951e7-a510-49d1-96bf-c90ed41583a1 service nova] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:43:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-453f5d91-c337-4af3-b97a-ab7283c49306 req-298951e7-a510-49d1-96bf-c90ed41583a1 service nova] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:43:26 user nova-compute[74743]: DEBUG nova.compute.manager [req-453f5d91-c337-4af3-b97a-ab7283c49306 req-298951e7-a510-49d1-96bf-c90ed41583a1 service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] No waiting events found dispatching network-vif-plugged-6ba5e67e-b479-4371-89e3-97c1beceff8f {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:43:26 user nova-compute[74743]: WARNING nova.compute.manager [req-453f5d91-c337-4af3-b97a-ab7283c49306 req-298951e7-a510-49d1-96bf-c90ed41583a1 service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Received unexpected event network-vif-plugged-6ba5e67e-b479-4371-89e3-97c1beceff8f for instance with vm_state active and task_state None.
Nov 18 17:43:27 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:43:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:43:32 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:43:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:43:40 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:43:42 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:43:45 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:43:47 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:43:47 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74743) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 17:43:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:43:49 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:43:49 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:43:50 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:43:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:43:53 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:43:55 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:43:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:43:56 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:43:57 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:43:57 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:43:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:43:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:43:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:43:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:43:57 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Auditing locally available compute resources for user (node: user) {{(pid=74743) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 17:43:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:43:58 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk --force-share --output=json" returned: 0 in 0.483s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:43:58 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:43:58 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:43:58 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:43:59 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:43:59 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:43:59 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Hypervisor/Node resource view: name=user free_ram=8908MB free_disk=24.33014678955078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74743) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 17:43:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:43:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:43:59 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 9c90f34f-7bbf-40d9-8f65-983d91f0b51b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:43:59 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 17:43:59 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 17:43:59 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:43:59 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:44:00 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Compute_service record updated for user:user {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 17:44:00 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.594s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:44:02 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:44:04 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:44:04 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:44:04 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Starting heal instance info cache {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 17:44:04 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Rebuilding the list of instances to heal {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 17:44:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "refresh_cache-9c90f34f-7bbf-40d9-8f65-983d91f0b51b" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:44:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquired lock "refresh_cache-9c90f34f-7bbf-40d9-8f65-983d91f0b51b" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:44:04 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Forcefully refreshing network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 17:44:04 user nova-compute[74743]: DEBUG nova.objects.instance [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lazy-loading 'info_cache' on Instance uuid 9c90f34f-7bbf-40d9-8f65-983d91f0b51b {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:44:04 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Updating instance_info_cache with network_info: [{"id": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "address": "fa:16:3e:08:2d:e8", "network": {"id": "7cf1258c-5feb-472e-9f3f-69d95360b050", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-628054528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "790f602c532d41289c52985c8fab91d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba5e67e-b4", "ovs_interfaceid": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:44:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Releasing lock "refresh_cache-9c90f34f-7bbf-40d9-8f65-983d91f0b51b" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:44:04 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Updated the network info_cache for instance {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 17:44:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:44:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:44:09 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:44:12 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:44:14 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:44:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:44:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:44:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:44:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:44:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:44:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:44:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:44:27 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:44:29 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Acquiring lock "8e73f77d-40ca-43d7-80ca-33ffda8583de" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:44:29 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Lock "8e73f77d-40ca-43d7-80ca-33ffda8583de" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:44:29 user nova-compute[74743]: DEBUG nova.compute.manager [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Starting instance... {{(pid=74743) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 17:44:29 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:44:29 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:44:29 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74743) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 17:44:29 user nova-compute[74743]: INFO nova.compute.claims [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Claim successful on node user
Nov 18 17:44:29 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:44:29 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:44:29 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.206s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:44:29 user nova-compute[74743]: DEBUG nova.compute.manager [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Start building networks asynchronously for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 17:44:29 user nova-compute[74743]: DEBUG nova.compute.manager [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Allocating IP information in the background. {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 17:44:29 user nova-compute[74743]: DEBUG nova.network.neutron [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] allocate_for_instance() {{(pid=74743) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 17:44:29 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 17:44:29 user nova-compute[74743]: DEBUG nova.compute.manager [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Start building block device mappings for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 17:44:29 user nova-compute[74743]: DEBUG nova.policy [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '09337734209f48cbbc4670a3ffedf7e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec05d713c50b4049896c839299c8edcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74743) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 17:44:29 user nova-compute[74743]: INFO nova.virt.block_device [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Booting with volume 8d7d6f43-8314-410b-941b-c548291d2b6e at /dev/vda
Nov 18 17:44:29 user nova-compute[74743]: DEBUG os_brick.utils [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:44:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:44:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:44:29 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf2536d-fa8e-4218-b34d-401686f27043]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1116acd8874d\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:44:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:44:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:44:29 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[46627c51-6522-43ee-bf9d-6b23d4d279ea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:44:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:44:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:44:29 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec5a0a7-4b16-4b07-a3ff-ae86e9b1e7b2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:44:29 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[9085ddf7-55c7-4214-a815-b2c5acaafe72]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:44:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Running cmd (subprocess): nvme version {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:44:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] 'nvme version' failed. Not Retrying. {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:44:29 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] nvme not present on system {{(pid=74743) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 17:44:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:44:29 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:44:29 user nova-compute[74743]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 17:44:29 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2dc6ee-93b2-4da0-9c37-767dce8b8e8c]: (4, '') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:44:29 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74743) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 17:44:29 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 17:44:29 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] LIGHTOS: no hostnqn found. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 17:44:29 user nova-compute[74743]: DEBUG os_brick.utils [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1116acd8874d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:44:29 user nova-compute[74743]: DEBUG nova.virt.block_device [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Updating existing volume attachment record: f5bd0d78-d6eb-48c4-bcd1-9353f791a422 {{(pid=74743) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 17:44:30 user nova-compute[74743]: DEBUG nova.network.neutron [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Successfully created port: 0045eadc-4afc-4176-b629-567d68625689 {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:44:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:44:30 user nova-compute[74743]: DEBUG nova.network.neutron [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Successfully updated port: 0045eadc-4afc-4176-b629-567d68625689 {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:44:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Acquiring lock "refresh_cache-8e73f77d-40ca-43d7-80ca-33ffda8583de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:44:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Acquired lock "refresh_cache-8e73f77d-40ca-43d7-80ca-33ffda8583de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:44:30 user nova-compute[74743]: DEBUG nova.network.neutron [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:44:30 user nova-compute[74743]: DEBUG nova.compute.manager [req-a35e0891-b812-464d-8d71-9015ce0d97d9 req-8beb7e8b-8b26-4eb6-83a2-18e3efe1a875 service nova] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Received event network-changed-0045eadc-4afc-4176-b629-567d68625689 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:44:30 user nova-compute[74743]: DEBUG nova.compute.manager [req-a35e0891-b812-464d-8d71-9015ce0d97d9 req-8beb7e8b-8b26-4eb6-83a2-18e3efe1a875 service nova] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Refreshing instance network info cache due to event network-changed-0045eadc-4afc-4176-b629-567d68625689. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:44:30 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a35e0891-b812-464d-8d71-9015ce0d97d9 req-8beb7e8b-8b26-4eb6-83a2-18e3efe1a875 service nova] Acquiring lock "refresh_cache-8e73f77d-40ca-43d7-80ca-33ffda8583de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:44:31 user nova-compute[74743]: DEBUG nova.network.neutron [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:44:31 user nova-compute[74743]: DEBUG nova.network.neutron [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Updating instance_info_cache with network_info: [{"id": "0045eadc-4afc-4176-b629-567d68625689", "address": "fa:16:3e:23:0a:17", "network": {"id": "d47540e7-8348-419d-acc3-51b7a034b940", "bridge": "br-int", "label": "tempest-TestShelveInstance-1342322227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec05d713c50b4049896c839299c8edcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0045eadc-4a", "ovs_interfaceid": "0045eadc-4afc-4176-b629-567d68625689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:44:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Releasing lock "refresh_cache-8e73f77d-40ca-43d7-80ca-33ffda8583de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:44:31 user nova-compute[74743]: DEBUG nova.compute.manager [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Instance network_info: |[{"id": "0045eadc-4afc-4176-b629-567d68625689", "address": "fa:16:3e:23:0a:17", "network": {"id": "d47540e7-8348-419d-acc3-51b7a034b940", "bridge": "br-int", "label": "tempest-TestShelveInstance-1342322227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec05d713c50b4049896c839299c8edcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0045eadc-4a", "ovs_interfaceid": "0045eadc-4afc-4176-b629-567d68625689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 17:44:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a35e0891-b812-464d-8d71-9015ce0d97d9 req-8beb7e8b-8b26-4eb6-83a2-18e3efe1a875 service nova] Acquired lock "refresh_cache-8e73f77d-40ca-43d7-80ca-33ffda8583de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:44:31 user nova-compute[74743]: DEBUG nova.network.neutron [req-a35e0891-b812-464d-8d71-9015ce0d97d9 req-8beb7e8b-8b26-4eb6-83a2-18e3efe1a875 service nova] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Refreshing network info cache for port 0045eadc-4afc-4176-b629-567d68625689 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:44:31 user nova-compute[74743]: DEBUG nova.network.neutron [req-a35e0891-b812-464d-8d71-9015ce0d97d9 req-8beb7e8b-8b26-4eb6-83a2-18e3efe1a875 service nova] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Updated VIF entry in instance network info cache for port 0045eadc-4afc-4176-b629-567d68625689. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:44:31 user nova-compute[74743]: DEBUG nova.network.neutron [req-a35e0891-b812-464d-8d71-9015ce0d97d9 req-8beb7e8b-8b26-4eb6-83a2-18e3efe1a875 service nova] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Updating instance_info_cache with network_info: [{"id": "0045eadc-4afc-4176-b629-567d68625689", "address": "fa:16:3e:23:0a:17", "network": {"id": "d47540e7-8348-419d-acc3-51b7a034b940", "bridge": "br-int", "label": "tempest-TestShelveInstance-1342322227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec05d713c50b4049896c839299c8edcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0045eadc-4a", "ovs_interfaceid": "0045eadc-4afc-4176-b629-567d68625689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:44:31 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a35e0891-b812-464d-8d71-9015ce0d97d9 req-8beb7e8b-8b26-4eb6-83a2-18e3efe1a875 service nova] Releasing lock "refresh_cache-8e73f77d-40ca-43d7-80ca-33ffda8583de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:44:32 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG nova.compute.manager [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Start spawning the instance on the hypervisor. {{(pid=74743) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Creating instance directory {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 17:44:35 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Creating image(s)
Nov 18 17:44:35 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Did not create local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Ensure instance console log exists: /opt/stack/data/nova/instances/8e73f77d-40ca-43d7-80ca-33ffda8583de/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Start _get_guest_xml network_info=[{"id": "0045eadc-4afc-4176-b629-567d68625689", "address": "fa:16:3e:23:0a:17", "network": {"id": "d47540e7-8348-419d-acc3-51b7a034b940", "bridge": "br-int", "label": "tempest-TestShelveInstance-1342322227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec05d713c50b4049896c839299c8edcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0045eadc-4a", "ovs_interfaceid": "0045eadc-4afc-4176-b629-567d68625689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': 'f5bd0d78-d6eb-48c4-bcd1-9353f791a422', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BfRFxQla', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8e73f77d-40ca-43d7-80ca-33ffda8583de', 'attached_at': '', 'detached_at': '', 'volume_id': '8d7d6f43-8314-410b-941b-c548291d2b6e', 'serial': '8d7d6f43-8314-410b-941b-c548291d2b6e'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:44:35 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:44:35 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:44:35 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Calling os-brick to attach iSCSI Volume {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BfRFxQla', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:44:35 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:44:35 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:44:35 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:44:35 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:44:35 user nova-compute[74743]: INFO os_brick.initiator.connectors.iscsi [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 17:44:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e -p 172.16.0.220:3260 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[4674c414-14b1-4c11-8c59-436ad7a74d82]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 17:44:35 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e -p 172.16.0.220:3260 --interface default --op new {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[706b2909-5f8b-4ef2-9bb0-1138653962a2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e] added\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e] added
Nov 18 17:44:35 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda28914-823d-43ce-b7e9-95311f2dc391]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1abadeb-445a-481f-a21b-0cfd80ce87da]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BfRFxQla {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BfRFxQla" returned: 0 in 0.027s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ccf5f8-e575-4b61-bbea-092bd0f4f106]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BfRFxQla'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d140b9-1f15-4446-8727-52f9d82d25de]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[493e14ab-ce48-450b-93f2-62eedc58d6d1]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 (non-flash)
Nov 18 17:44:35 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 (non-flash)
Nov 18 17:44:35 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e -p 172.16.0.220:3260 --login {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[4232470f-6aa3-46e0-ab5a-f633d47e69e0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e, portal: 172.16.0.220,3260]
Nov 18 17:44:35 user nova-compute[74743]: Login to [iface: default, target: iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e, portal: 172.16.0.220,3260] successful.
Nov 18 17:44:35 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:44:35 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:44:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:44:36 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22565ae-b1eb-4423-876a-5ce6f62ec711]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:44:36 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:44:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:44:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:44:36 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a56835b-1ba3-4c72-b7ff-161c0509ddc0]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:44:36 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 (non-flash)
Nov 18 17:44:36 user nova-compute[74743]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e (non-flash)
Nov 18 17:44:36 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:44:36 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 (non-flash)
Nov 18 17:44:36 user nova-compute[74743]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e (non-flash)
Nov 18 17:44:36 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:44:36 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:44:36 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Connected to 172.16.0.220:3260 {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 17:44:36 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=74743) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 17:44:36 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74743) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 17:44:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:44:36 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:44:36 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6bc4c5f-d1c0-40dc-ae34-20a918cde56c]: (4, ('- - 0', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:44:36 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:44:36 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BfRFxQla', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 17:44:37 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:44:37 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '26363613839306234', 'path': '/dev/sdc'} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:44:37 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363613839306234', 'path': '/dev/sdc'} {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 17:44:37 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:44:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1346766668',display_name='tempest-TestShelveInstance-server-1346766668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1346766668',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7aYbhvlbM1cToEexq8kd0tHLbcKOWu0Vj54xJXYDV2+2rqruzg+wTTJX04FpFBnB8ox38G88mO/CnhyhIoTsX1UlyKi/yZuLqTCXuUbf+LXRD8anyhwVVR9+pQHu6pYw==',key_name='tempest-TestShelveInstance-1062282570',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec05d713c50b4049896c839299c8edcd',ramdisk_id='',reservation_id='r-83y4v011',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1526121326',owner_user_name='tempest-TestShelveInstance-1526121326-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:44:30Z,user_data=None,user_id='09337734209f48cbbc4670a3ffedf7e1',uuid=8e73f77d-40ca-43d7-80ca-33ffda8583de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0045eadc-4afc-4176-b629-567d68625689", "address": "fa:16:3e:23:0a:17", "network": {"id": "d47540e7-8348-419d-acc3-51b7a034b940", "bridge": "br-int", "label": "tempest-TestShelveInstance-1342322227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec05d713c50b4049896c839299c8edcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0045eadc-4a", "ovs_interfaceid": "0045eadc-4afc-4176-b629-567d68625689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:44:37 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Converting VIF {"id": "0045eadc-4afc-4176-b629-567d68625689", "address": "fa:16:3e:23:0a:17", "network": {"id": "d47540e7-8348-419d-acc3-51b7a034b940", "bridge": "br-int", "label": "tempest-TestShelveInstance-1342322227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec05d713c50b4049896c839299c8edcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0045eadc-4a", "ovs_interfaceid": "0045eadc-4afc-4176-b629-567d68625689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:44:37 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:0a:17,bridge_name='br-int',has_traffic_filtering=True,id=0045eadc-4afc-4176-b629-567d68625689,network=Network(d47540e7-8348-419d-acc3-51b7a034b940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0045eadc-4a') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:44:37 user nova-compute[74743]: DEBUG nova.objects.instance [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e73f77d-40ca-43d7-80ca-33ffda8583de {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:44:37 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:44:37 user nova-compute[74743]:   <uuid>8e73f77d-40ca-43d7-80ca-33ffda8583de</uuid>
Nov 18 17:44:37 user nova-compute[74743]:   <name>instance-00000032</name>
Nov 18 17:44:37 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:44:37 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:44:37 user nova-compute[74743]:   <metadata>
Nov 18 17:44:37 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:44:37 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:44:37 user nova-compute[74743]:       <nova:name>tempest-TestShelveInstance-server-1346766668</nova:name>
Nov 18 17:44:37 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:44:35</nova:creationTime>
Nov 18 17:44:37 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:44:37 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:44:37 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:44:37 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:44:37 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:44:37 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:44:37 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:44:37 user nova-compute[74743]:       <nova:owner>
Nov 18 17:44:37 user nova-compute[74743]:         <nova:user uuid="09337734209f48cbbc4670a3ffedf7e1">tempest-TestShelveInstance-1526121326-project-member</nova:user>
Nov 18 17:44:37 user nova-compute[74743]:         <nova:project uuid="ec05d713c50b4049896c839299c8edcd">tempest-TestShelveInstance-1526121326</nova:project>
Nov 18 17:44:37 user nova-compute[74743]:       </nova:owner>
Nov 18 17:44:37 user nova-compute[74743]:       <nova:ports>
Nov 18 17:44:37 user nova-compute[74743]:         <nova:port uuid="0045eadc-4afc-4176-b629-567d68625689">
Nov 18 17:44:37 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 18 17:44:37 user nova-compute[74743]:         </nova:port>
Nov 18 17:44:37 user nova-compute[74743]:       </nova:ports>
Nov 18 17:44:37 user nova-compute[74743]:     </nova:instance>
Nov 18 17:44:37 user nova-compute[74743]:   </metadata>
Nov 18 17:44:37 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:44:37 user nova-compute[74743]:     <system>
Nov 18 17:44:37 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:44:37 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:44:37 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:44:37 user nova-compute[74743]:       <entry name="serial">8e73f77d-40ca-43d7-80ca-33ffda8583de</entry>
Nov 18 17:44:37 user nova-compute[74743]:       <entry name="uuid">8e73f77d-40ca-43d7-80ca-33ffda8583de</entry>
Nov 18 17:44:37 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:44:37 user nova-compute[74743]:     </system>
Nov 18 17:44:37 user nova-compute[74743]:   </sysinfo>
Nov 18 17:44:37 user nova-compute[74743]:   <os>
Nov 18 17:44:37 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:44:37 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:44:37 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:44:37 user nova-compute[74743]:   </os>
Nov 18 17:44:37 user nova-compute[74743]:   <features>
Nov 18 17:44:37 user nova-compute[74743]:     <acpi/>
Nov 18 17:44:37 user nova-compute[74743]:     <apic/>
Nov 18 17:44:37 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:44:37 user nova-compute[74743]:   </features>
Nov 18 17:44:37 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:44:37 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:44:37 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:44:37 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:44:37 user nova-compute[74743]:   </clock>
Nov 18 17:44:37 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:44:37 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:44:37 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:44:37 user nova-compute[74743]:   </cpu>
Nov 18 17:44:37 user nova-compute[74743]:   <devices>
Nov 18 17:44:37 user nova-compute[74743]:     <disk type="block" device="disk">
Nov 18 17:44:37 user nova-compute[74743]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:44:37 user nova-compute[74743]:       <source dev="/dev/sdc"/>
Nov 18 17:44:37 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:44:37 user nova-compute[74743]:       <serial>8d7d6f43-8314-410b-941b-c548291d2b6e</serial>
Nov 18 17:44:37 user nova-compute[74743]:     </disk>
Nov 18 17:44:37 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:44:37 user nova-compute[74743]:       <mac address="fa:16:3e:23:0a:17"/>
Nov 18 17:44:37 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:44:37 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:44:37 user nova-compute[74743]:       <target dev="tap0045eadc-4a"/>
Nov 18 17:44:37 user nova-compute[74743]:     </interface>
Nov 18 17:44:37 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:44:37 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/8e73f77d-40ca-43d7-80ca-33ffda8583de/console.log" append="off"/>
Nov 18 17:44:37 user nova-compute[74743]:     </serial>
Nov 18 17:44:37 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:44:37 user nova-compute[74743]:     <video>
Nov 18 17:44:37 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:44:37 user nova-compute[74743]:     </video>
Nov 18 17:44:37 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:44:37 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:44:37 user nova-compute[74743]:     </rng>
Nov 18 17:44:37 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:44:37 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:44:37 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:44:37 user nova-compute[74743]:     </memballoon>
Nov 18 17:44:37 user nova-compute[74743]:   </devices>
Nov 18 17:44:37 user nova-compute[74743]: </domain>
Nov 18 17:44:37 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:44:37 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:44:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1346766668',display_name='tempest-TestShelveInstance-server-1346766668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1346766668',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7aYbhvlbM1cToEexq8kd0tHLbcKOWu0Vj54xJXYDV2+2rqruzg+wTTJX04FpFBnB8ox38G88mO/CnhyhIoTsX1UlyKi/yZuLqTCXuUbf+LXRD8anyhwVVR9+pQHu6pYw==',key_name='tempest-TestShelveInstance-1062282570',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec05d713c50b4049896c839299c8edcd',ramdisk_id='',reservation_id='r-83y4v011',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1526121326',owner_user_name='tempest-TestShelveInstance-1526121326-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:44:30Z,user_data=None,user_id='09337734209f48cbbc4670a3ffedf7e1',uuid=8e73f77d-40ca-43d7-80ca-33ffda8583de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0045eadc-4afc-4176-b629-567d68625689", "address": "fa:16:3e:23:0a:17", "network": {"id": "d47540e7-8348-419d-acc3-51b7a034b940", "bridge": "br-int", "label": "tempest-TestShelveInstance-1342322227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec05d713c50b4049896c839299c8edcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0045eadc-4a", "ovs_interfaceid": "0045eadc-4afc-4176-b629-567d68625689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:44:37 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Converting VIF {"id": "0045eadc-4afc-4176-b629-567d68625689", "address": "fa:16:3e:23:0a:17", "network": {"id": "d47540e7-8348-419d-acc3-51b7a034b940", "bridge": "br-int", "label": "tempest-TestShelveInstance-1342322227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec05d713c50b4049896c839299c8edcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0045eadc-4a", "ovs_interfaceid": "0045eadc-4afc-4176-b629-567d68625689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:44:37 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:0a:17,bridge_name='br-int',has_traffic_filtering=True,id=0045eadc-4afc-4176-b629-567d68625689,network=Network(d47540e7-8348-419d-acc3-51b7a034b940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0045eadc-4a') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:44:37 user nova-compute[74743]: DEBUG os_vif [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:0a:17,bridge_name='br-int',has_traffic_filtering=True,id=0045eadc-4afc-4176-b629-567d68625689,network=Network(d47540e7-8348-419d-acc3-51b7a034b940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0045eadc-4a') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:44:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:44:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:44:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:44:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:44:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '60ed27cd-75fa-5858-9986-7ba150c6ed94', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:44:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:44:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:44:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:44:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0045eadc-4a, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:44:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0045eadc-4a, col_values=(('qos', UUID('fbc8c7e6-a04b-4d51-9800-83c866ffca0b')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:44:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0045eadc-4a, col_values=(('external_ids', {'iface-id': '0045eadc-4afc-4176-b629-567d68625689', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:0a:17', 'vm-uuid': '8e73f77d-40ca-43d7-80ca-33ffda8583de'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:44:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:44:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:44:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:44:37 user nova-compute[74743]: INFO os_vif [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:0a:17,bridge_name='br-int',has_traffic_filtering=True,id=0045eadc-4afc-4176-b629-567d68625689,network=Network(d47540e7-8348-419d-acc3-51b7a034b940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0045eadc-4a')
Nov 18 17:44:37 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:44:37 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] No VIF found with MAC fa:16:3e:23:0a:17, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:44:38 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:44:38 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:44:38 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:44:38 user nova-compute[74743]: DEBUG nova.compute.manager [req-f75e6435-48e6-4d89-ac84-546fa9bbf722 req-e559d3c0-519b-49da-894e-c0a096d88eb0 service nova] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Received event network-vif-plugged-0045eadc-4afc-4176-b629-567d68625689 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:44:38 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f75e6435-48e6-4d89-ac84-546fa9bbf722 req-e559d3c0-519b-49da-894e-c0a096d88eb0 service nova] Acquiring lock "8e73f77d-40ca-43d7-80ca-33ffda8583de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:44:38 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f75e6435-48e6-4d89-ac84-546fa9bbf722 req-e559d3c0-519b-49da-894e-c0a096d88eb0 service nova] Lock "8e73f77d-40ca-43d7-80ca-33ffda8583de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:44:38 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f75e6435-48e6-4d89-ac84-546fa9bbf722 req-e559d3c0-519b-49da-894e-c0a096d88eb0 service nova] Lock "8e73f77d-40ca-43d7-80ca-33ffda8583de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:44:38 user nova-compute[74743]: DEBUG nova.compute.manager [req-f75e6435-48e6-4d89-ac84-546fa9bbf722 req-e559d3c0-519b-49da-894e-c0a096d88eb0 service nova] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] No waiting events found dispatching network-vif-plugged-0045eadc-4afc-4176-b629-567d68625689 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:44:38 user nova-compute[74743]: WARNING nova.compute.manager [req-f75e6435-48e6-4d89-ac84-546fa9bbf722 req-e559d3c0-519b-49da-894e-c0a096d88eb0 service nova] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Received unexpected event network-vif-plugged-0045eadc-4afc-4176-b629-567d68625689 for instance with vm_state building and task_state spawning.
Nov 18 17:44:38 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:44:39 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:44:40 user nova-compute[74743]: DEBUG nova.compute.manager [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:44:40 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Guest created on hypervisor {{(pid=74743) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 17:44:40 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Instance spawned successfully.
Nov 18 17:44:40 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 17:44:40 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Found default for hw_cdrom_bus of ide {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:44:40 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Found default for hw_disk_bus of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:44:40 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Found default for hw_input_bus of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:44:40 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Found default for hw_pointer_model of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:44:40 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Found default for hw_video_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:44:40 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Found default for hw_vif_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:44:40 user nova-compute[74743]: INFO nova.compute.manager [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Took 5.14 seconds to spawn the instance on the hypervisor.
Nov 18 17:44:40 user nova-compute[74743]: DEBUG nova.compute.manager [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:44:40 user nova-compute[74743]: DEBUG nova.compute.manager [req-4237af4a-72aa-45e4-99de-7fc7671777c8 req-b5f5cd58-87c3-4149-8342-a6064af7e1e4 service nova] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Received event network-vif-plugged-0045eadc-4afc-4176-b629-567d68625689 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:44:40 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4237af4a-72aa-45e4-99de-7fc7671777c8 req-b5f5cd58-87c3-4149-8342-a6064af7e1e4 service nova] Acquiring lock "8e73f77d-40ca-43d7-80ca-33ffda8583de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:44:40 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4237af4a-72aa-45e4-99de-7fc7671777c8 req-b5f5cd58-87c3-4149-8342-a6064af7e1e4 service nova] Lock "8e73f77d-40ca-43d7-80ca-33ffda8583de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:44:40 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-4237af4a-72aa-45e4-99de-7fc7671777c8 req-b5f5cd58-87c3-4149-8342-a6064af7e1e4 service nova] Lock "8e73f77d-40ca-43d7-80ca-33ffda8583de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:44:40 user nova-compute[74743]: DEBUG nova.compute.manager [req-4237af4a-72aa-45e4-99de-7fc7671777c8 req-b5f5cd58-87c3-4149-8342-a6064af7e1e4 service nova] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] No waiting events found dispatching network-vif-plugged-0045eadc-4afc-4176-b629-567d68625689 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:44:40 user nova-compute[74743]: WARNING nova.compute.manager [req-4237af4a-72aa-45e4-99de-7fc7671777c8 req-b5f5cd58-87c3-4149-8342-a6064af7e1e4 service nova] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Received unexpected event network-vif-plugged-0045eadc-4afc-4176-b629-567d68625689 for instance with vm_state building and task_state spawning.
Nov 18 17:44:40 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:44:40 user nova-compute[74743]: INFO nova.compute.manager [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Took 11.53 seconds to build instance.
Nov 18 17:44:40 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8c26a1d4-ecae-49d2-9805-b7282a37153d tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Lock "8e73f77d-40ca-43d7-80ca-33ffda8583de" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.625s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:44:42 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:44:45 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:44:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:44:47 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:44:47 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74743) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 17:44:50 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:44:51 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:44:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:44:53 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:44:55 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:44:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:44:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:44:57 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:44:57 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:44:57 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:44:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:44:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:44:57 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:44:57 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Auditing locally available compute resources for user (node: user) {{(pid=74743) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 17:44:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:44:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:44:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:44:57 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:44:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:44:57 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:44:58 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:44:58 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:44:58 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Hypervisor/Node resource view: name=user free_ram=8713MB free_disk=25.25090789794922GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74743) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 17:44:58 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:44:58 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:44:58 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 9c90f34f-7bbf-40d9-8f65-983d91f0b51b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:44:58 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 8e73f77d-40ca-43d7-80ca-33ffda8583de actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:44:58 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 17:44:58 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 17:44:58 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Refreshing inventories for resource provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 18 17:44:58 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Updating ProviderTree inventory for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 18 17:44:58 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Updating inventory in ProviderTree for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 18 17:44:58 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Refreshing aggregate associations for resource provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8, aggregates: None {{(pid=74743) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 18 17:44:58 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Refreshing trait associations for resource provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=74743) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 18 17:44:58 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:44:58 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:44:58 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Compute_service record updated for user:user {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 17:44:58 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.438s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:45:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:45:01 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:45:01 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Cleaning up deleted instances {{(pid=74743) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 18 17:45:01 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] There are 0 instances to clean {{(pid=74743) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 18 17:45:02 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:45:02 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:45:03 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:45:03 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Cleaning up deleted instances with incomplete migration  {{(pid=74743) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 18 17:45:04 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:45:04 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Starting heal instance info cache {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 17:45:04 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Rebuilding the list of instances to heal {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 17:45:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "refresh_cache-9c90f34f-7bbf-40d9-8f65-983d91f0b51b" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:45:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquired lock "refresh_cache-9c90f34f-7bbf-40d9-8f65-983d91f0b51b" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:45:04 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Forcefully refreshing network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 17:45:04 user nova-compute[74743]: DEBUG nova.objects.instance [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lazy-loading 'info_cache' on Instance uuid 9c90f34f-7bbf-40d9-8f65-983d91f0b51b {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:45:04 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Updating instance_info_cache with network_info: [{"id": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "address": "fa:16:3e:08:2d:e8", "network": {"id": "7cf1258c-5feb-472e-9f3f-69d95360b050", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-628054528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "790f602c532d41289c52985c8fab91d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba5e67e-b4", "ovs_interfaceid": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:45:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Releasing lock "refresh_cache-9c90f34f-7bbf-40d9-8f65-983d91f0b51b" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:45:04 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Updated the network info_cache for instance {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 17:45:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:45:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:45:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-0fb7204c-5362-45e9-b6db-0e122f9eb70a tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Acquiring lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:45:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-0fb7204c-5362-45e9-b6db-0e122f9eb70a tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:45:10 user nova-compute[74743]: INFO nova.compute.manager [None req-0fb7204c-5362-45e9-b6db-0e122f9eb70a tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Detaching volume 7555ca1f-df6a-42d1-951d-129bfb5ba817
Nov 18 17:45:10 user nova-compute[74743]: INFO nova.virt.block_device [None req-0fb7204c-5362-45e9-b6db-0e122f9eb70a tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Attempting to driver detach volume 7555ca1f-df6a-42d1-951d-129bfb5ba817 from mountpoint /dev/vdb
Nov 18 17:45:10 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-0fb7204c-5362-45e9-b6db-0e122f9eb70a tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Attempting to detach device vdb from instance 9c90f34f-7bbf-40d9-8f65-983d91f0b51b from the persistent domain config. {{(pid=74743) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 17:45:10 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-0fb7204c-5362-45e9-b6db-0e122f9eb70a tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 17:45:10 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:45:10 user nova-compute[74743]:   <source dev="/dev/sdb"/>
Nov 18 17:45:10 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:45:10 user nova-compute[74743]:   <serial>7555ca1f-df6a-42d1-951d-129bfb5ba817</serial>
Nov 18 17:45:10 user nova-compute[74743]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 18 17:45:10 user nova-compute[74743]: </disk>
Nov 18 17:45:10 user nova-compute[74743]:  {{(pid=74743) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 17:45:10 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-0fb7204c-5362-45e9-b6db-0e122f9eb70a tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Successfully detached device vdb from instance 9c90f34f-7bbf-40d9-8f65-983d91f0b51b from the persistent domain config.
Nov 18 17:45:10 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-0fb7204c-5362-45e9-b6db-0e122f9eb70a tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9c90f34f-7bbf-40d9-8f65-983d91f0b51b from the live domain config. {{(pid=74743) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 17:45:10 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-0fb7204c-5362-45e9-b6db-0e122f9eb70a tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 17:45:10 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:45:10 user nova-compute[74743]:   <source dev="/dev/sdb"/>
Nov 18 17:45:10 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:45:10 user nova-compute[74743]:   <serial>7555ca1f-df6a-42d1-951d-129bfb5ba817</serial>
Nov 18 17:45:10 user nova-compute[74743]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 18 17:45:10 user nova-compute[74743]: </disk>
Nov 18 17:45:10 user nova-compute[74743]:  {{(pid=74743) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 17:45:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:45:11 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-0fb7204c-5362-45e9-b6db-0e122f9eb70a tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9c90f34f-7bbf-40d9-8f65-983d91f0b51b {{(pid=74743) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 17:45:12 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:45:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:45:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:45:27 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:45:31 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-0fb7204c-5362-45e9-b6db-0e122f9eb70a tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9c90f34f-7bbf-40d9-8f65-983d91f0b51b is timed out.
Nov 18 17:45:31 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-0fb7204c-5362-45e9-b6db-0e122f9eb70a tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Successfully detached device vdb from instance 9c90f34f-7bbf-40d9-8f65-983d91f0b51b from the live domain config.
Nov 18 17:45:31 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fb7204c-5362-45e9-b6db-0e122f9eb70a tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] calling os-brick to detach iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 17:45:31 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb7204c-5362-45e9-b6db-0e122f9eb70a tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, {'target_iqn': 'iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mYTIuhbJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:45:31 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-0fb7204c-5362-45e9-b6db-0e122f9eb70a tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:45:31 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-0fb7204c-5362-45e9-b6db-0e122f9eb70a tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:45:31 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-0fb7204c-5362-45e9-b6db-0e122f9eb70a tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:45:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:45:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:45:31 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7fe809a-9163-489c-a726-783233e2bb07]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:45:31 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb7204c-5362-45e9-b6db-0e122f9eb70a tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 17:45:31 user nova-compute[74743]: No targets found.
Nov 18 17:45:31 user nova-compute[74743]: iSNS:
Nov 18 17:45:31 user nova-compute[74743]: No targets found.
Nov 18 17:45:31 user nova-compute[74743]: STATIC:
Nov 18 17:45:31 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817
Nov 18 17:45:31 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:45:31 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:45:31 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e
Nov 18 17:45:31 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:45:31 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:45:31 user nova-compute[74743]: FIRMWARE:
Nov 18 17:45:31 user nova-compute[74743]: No targets found.
Nov 18 17:45:31 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:45:31 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb7204c-5362-45e9-b6db-0e122f9eb70a tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 17:45:31 user nova-compute[74743]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 17:45:31 user nova-compute[74743]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74743) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 17:45:31 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb7204c-5362-45e9-b6db-0e122f9eb70a tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817', 0)] {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 17:45:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:45:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:45:31 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0ddf20-dbf8-41c0-90ba-3f536ace9cb8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:45:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:45:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:45:31 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70a3953-9f03-4fb1-9594-357fdcd02c4d]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:45:31 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb7204c-5362-45e9-b6db-0e122f9eb70a tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 (non-flash)
Nov 18 17:45:31 user nova-compute[74743]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e (non-flash)
Nov 18 17:45:31 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:45:31 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb7204c-5362-45e9-b6db-0e122f9eb70a tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 (non-flash)
Nov 18 17:45:31 user nova-compute[74743]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e (non-flash)
Nov 18 17:45:31 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:45:31 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb7204c-5362-45e9-b6db-0e122f9eb70a tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffae9f2c3a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817'): ({'sdb'}, set())}) {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 17:45:31 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-0fb7204c-5362-45e9-b6db-0e122f9eb70a tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Removing single pathed devices sdb {{(pid=74743) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 17:45:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:45:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:45:31 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff771c5-ad0c-41d7-8611-cf7234035a55]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:45:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:45:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:45:31 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e014219-7470-48b9-8896-db0a872ef107]: (4, ('ok\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:45:31 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-0fb7204c-5362-45e9-b6db-0e122f9eb70a tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Flushing IO for device /dev/sdb {{(pid=74743) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 17:45:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:45:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:45:31 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[55979844-5c3c-4fd5-adb2-9f6a8bfe0d54]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:45:31 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-0fb7204c-5362-45e9-b6db-0e122f9eb70a tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74743) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 17:45:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:45:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:45:31 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9de1580-6677-4006-9149-ff426e77c182]: (4, ('1', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:45:31 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-0fb7204c-5362-45e9-b6db-0e122f9eb70a tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 17:45:31 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-0fb7204c-5362-45e9-b6db-0e122f9eb70a tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] SCSI volumes sdb have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 17:45:31 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb7204c-5362-45e9-b6db-0e122f9eb70a tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817')] {{(pid=74743) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 17:45:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:45:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:45:31 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[96520723-b1c7-48d1-a0dd-36808dcb16c6]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:45:31 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb7204c-5362-45e9-b6db-0e122f9eb70a tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:45:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 -p 172.16.0.220:3260 --logout {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:45:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:45:31 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b9a505-cd02-46e6-98b1-ad0f05706f63]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:45:31 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb7204c-5362-45e9-b6db-0e122f9eb70a tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817, portal: 172.16.0.220,3260]
Nov 18 17:45:31 user nova-compute[74743]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817, portal: 172.16.0.220,3260] successful.
Nov 18 17:45:31 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:45:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 -p 172.16.0.220:3260 --op delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:45:31 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7555ca1f-df6a-42d1-951d-129bfb5ba817 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:45:31 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f76f27a-0657-40e0-9830-2356cd16b320]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:45:31 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb7204c-5362-45e9-b6db-0e122f9eb70a tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:45:31 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-0fb7204c-5362-45e9-b6db-0e122f9eb70a tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:45:31 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb7204c-5362-45e9-b6db-0e122f9eb70a tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] <== disconnect_volume: return (304ms) None {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:45:31 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fb7204c-5362-45e9-b6db-0e122f9eb70a tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Disconnected iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 17:45:32 user nova-compute[74743]: DEBUG nova.objects.instance [None req-0fb7204c-5362-45e9-b6db-0e122f9eb70a tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lazy-loading 'flavor' on Instance uuid 9c90f34f-7bbf-40d9-8f65-983d91f0b51b {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:45:32 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:45:32 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-0fb7204c-5362-45e9-b6db-0e122f9eb70a tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.596s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:45:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-52815455-3abe-4171-b650-969bccebedc2 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Acquiring lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:45:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-52815455-3abe-4171-b650-969bccebedc2 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:45:33 user nova-compute[74743]: DEBUG nova.compute.manager [None req-52815455-3abe-4171-b650-969bccebedc2 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:45:33 user nova-compute[74743]: DEBUG nova.compute.manager [None req-52815455-3abe-4171-b650-969bccebedc2 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74743) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 18 17:45:33 user nova-compute[74743]: DEBUG nova.objects.instance [None req-52815455-3abe-4171-b650-969bccebedc2 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lazy-loading 'flavor' on Instance uuid 9c90f34f-7bbf-40d9-8f65-983d91f0b51b {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:45:33 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:45:33 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:45:33 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:45:33 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:45:33 user nova-compute[74743]: DEBUG nova.compute.manager [req-73ec16e8-1655-4f47-a001-e0ea3aabb675 req-6f2a41d1-29a2-4d4b-aad5-dc400e20a48d service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Received event network-vif-unplugged-6ba5e67e-b479-4371-89e3-97c1beceff8f {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:45:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-73ec16e8-1655-4f47-a001-e0ea3aabb675 req-6f2a41d1-29a2-4d4b-aad5-dc400e20a48d service nova] Acquiring lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:45:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-73ec16e8-1655-4f47-a001-e0ea3aabb675 req-6f2a41d1-29a2-4d4b-aad5-dc400e20a48d service nova] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:45:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-73ec16e8-1655-4f47-a001-e0ea3aabb675 req-6f2a41d1-29a2-4d4b-aad5-dc400e20a48d service nova] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:45:33 user nova-compute[74743]: DEBUG nova.compute.manager [req-73ec16e8-1655-4f47-a001-e0ea3aabb675 req-6f2a41d1-29a2-4d4b-aad5-dc400e20a48d service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] No waiting events found dispatching network-vif-unplugged-6ba5e67e-b479-4371-89e3-97c1beceff8f {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:45:33 user nova-compute[74743]: WARNING nova.compute.manager [req-73ec16e8-1655-4f47-a001-e0ea3aabb675 req-6f2a41d1-29a2-4d4b-aad5-dc400e20a48d service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Received unexpected event network-vif-unplugged-6ba5e67e-b479-4371-89e3-97c1beceff8f for instance with vm_state active and task_state powering-off.
Nov 18 17:45:33 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:45:33 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:45:33 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:45:33 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:45:33 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Instance destroyed successfully.
Nov 18 17:45:33 user nova-compute[74743]: DEBUG nova.compute.manager [None req-52815455-3abe-4171-b650-969bccebedc2 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:45:33 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:45:33 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-52815455-3abe-4171-b650-969bccebedc2 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.851s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:45:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:45:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:45:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:45:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:45:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:45:34 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:45:35 user nova-compute[74743]: DEBUG nova.compute.manager [req-e7cae41a-4392-4b69-a1c8-d733c8791d32 req-58c1a8ec-9dfc-4bbb-a21b-eadb8f92495f service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Received event network-vif-plugged-6ba5e67e-b479-4371-89e3-97c1beceff8f {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:45:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e7cae41a-4392-4b69-a1c8-d733c8791d32 req-58c1a8ec-9dfc-4bbb-a21b-eadb8f92495f service nova] Acquiring lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:45:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e7cae41a-4392-4b69-a1c8-d733c8791d32 req-58c1a8ec-9dfc-4bbb-a21b-eadb8f92495f service nova] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:45:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e7cae41a-4392-4b69-a1c8-d733c8791d32 req-58c1a8ec-9dfc-4bbb-a21b-eadb8f92495f service nova] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:45:35 user nova-compute[74743]: DEBUG nova.compute.manager [req-e7cae41a-4392-4b69-a1c8-d733c8791d32 req-58c1a8ec-9dfc-4bbb-a21b-eadb8f92495f service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] No waiting events found dispatching network-vif-plugged-6ba5e67e-b479-4371-89e3-97c1beceff8f {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:45:35 user nova-compute[74743]: WARNING nova.compute.manager [req-e7cae41a-4392-4b69-a1c8-d733c8791d32 req-58c1a8ec-9dfc-4bbb-a21b-eadb8f92495f service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Received unexpected event network-vif-plugged-6ba5e67e-b479-4371-89e3-97c1beceff8f for instance with vm_state stopped and task_state None.
Nov 18 17:45:35 user nova-compute[74743]: DEBUG nova.compute.manager [req-e7cae41a-4392-4b69-a1c8-d733c8791d32 req-58c1a8ec-9dfc-4bbb-a21b-eadb8f92495f service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Received event network-vif-plugged-6ba5e67e-b479-4371-89e3-97c1beceff8f {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:45:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e7cae41a-4392-4b69-a1c8-d733c8791d32 req-58c1a8ec-9dfc-4bbb-a21b-eadb8f92495f service nova] Acquiring lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:45:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e7cae41a-4392-4b69-a1c8-d733c8791d32 req-58c1a8ec-9dfc-4bbb-a21b-eadb8f92495f service nova] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:45:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e7cae41a-4392-4b69-a1c8-d733c8791d32 req-58c1a8ec-9dfc-4bbb-a21b-eadb8f92495f service nova] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:45:35 user nova-compute[74743]: DEBUG nova.compute.manager [req-e7cae41a-4392-4b69-a1c8-d733c8791d32 req-58c1a8ec-9dfc-4bbb-a21b-eadb8f92495f service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] No waiting events found dispatching network-vif-plugged-6ba5e67e-b479-4371-89e3-97c1beceff8f {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:45:35 user nova-compute[74743]: WARNING nova.compute.manager [req-e7cae41a-4392-4b69-a1c8-d733c8791d32 req-58c1a8ec-9dfc-4bbb-a21b-eadb8f92495f service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Received unexpected event network-vif-plugged-6ba5e67e-b479-4371-89e3-97c1beceff8f for instance with vm_state stopped and task_state None.
Nov 18 17:45:35 user nova-compute[74743]: DEBUG nova.compute.manager [req-e7cae41a-4392-4b69-a1c8-d733c8791d32 req-58c1a8ec-9dfc-4bbb-a21b-eadb8f92495f service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Received event network-vif-plugged-6ba5e67e-b479-4371-89e3-97c1beceff8f {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:45:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e7cae41a-4392-4b69-a1c8-d733c8791d32 req-58c1a8ec-9dfc-4bbb-a21b-eadb8f92495f service nova] Acquiring lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:45:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e7cae41a-4392-4b69-a1c8-d733c8791d32 req-58c1a8ec-9dfc-4bbb-a21b-eadb8f92495f service nova] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:45:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e7cae41a-4392-4b69-a1c8-d733c8791d32 req-58c1a8ec-9dfc-4bbb-a21b-eadb8f92495f service nova] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:45:35 user nova-compute[74743]: DEBUG nova.compute.manager [req-e7cae41a-4392-4b69-a1c8-d733c8791d32 req-58c1a8ec-9dfc-4bbb-a21b-eadb8f92495f service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] No waiting events found dispatching network-vif-plugged-6ba5e67e-b479-4371-89e3-97c1beceff8f {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:45:35 user nova-compute[74743]: WARNING nova.compute.manager [req-e7cae41a-4392-4b69-a1c8-d733c8791d32 req-58c1a8ec-9dfc-4bbb-a21b-eadb8f92495f service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Received unexpected event network-vif-plugged-6ba5e67e-b479-4371-89e3-97c1beceff8f for instance with vm_state stopped and task_state None.
Nov 18 17:45:35 user nova-compute[74743]: DEBUG nova.compute.manager [req-e7cae41a-4392-4b69-a1c8-d733c8791d32 req-58c1a8ec-9dfc-4bbb-a21b-eadb8f92495f service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Received event network-vif-unplugged-6ba5e67e-b479-4371-89e3-97c1beceff8f {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:45:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e7cae41a-4392-4b69-a1c8-d733c8791d32 req-58c1a8ec-9dfc-4bbb-a21b-eadb8f92495f service nova] Acquiring lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:45:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e7cae41a-4392-4b69-a1c8-d733c8791d32 req-58c1a8ec-9dfc-4bbb-a21b-eadb8f92495f service nova] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:45:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e7cae41a-4392-4b69-a1c8-d733c8791d32 req-58c1a8ec-9dfc-4bbb-a21b-eadb8f92495f service nova] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:45:35 user nova-compute[74743]: DEBUG nova.compute.manager [req-e7cae41a-4392-4b69-a1c8-d733c8791d32 req-58c1a8ec-9dfc-4bbb-a21b-eadb8f92495f service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] No waiting events found dispatching network-vif-unplugged-6ba5e67e-b479-4371-89e3-97c1beceff8f {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:45:35 user nova-compute[74743]: WARNING nova.compute.manager [req-e7cae41a-4392-4b69-a1c8-d733c8791d32 req-58c1a8ec-9dfc-4bbb-a21b-eadb8f92495f service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Received unexpected event network-vif-unplugged-6ba5e67e-b479-4371-89e3-97c1beceff8f for instance with vm_state stopped and task_state None.
Nov 18 17:45:35 user nova-compute[74743]: DEBUG nova.compute.manager [req-e7cae41a-4392-4b69-a1c8-d733c8791d32 req-58c1a8ec-9dfc-4bbb-a21b-eadb8f92495f service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Received event network-vif-plugged-6ba5e67e-b479-4371-89e3-97c1beceff8f {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:45:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e7cae41a-4392-4b69-a1c8-d733c8791d32 req-58c1a8ec-9dfc-4bbb-a21b-eadb8f92495f service nova] Acquiring lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:45:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e7cae41a-4392-4b69-a1c8-d733c8791d32 req-58c1a8ec-9dfc-4bbb-a21b-eadb8f92495f service nova] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:45:35 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e7cae41a-4392-4b69-a1c8-d733c8791d32 req-58c1a8ec-9dfc-4bbb-a21b-eadb8f92495f service nova] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:45:35 user nova-compute[74743]: DEBUG nova.compute.manager [req-e7cae41a-4392-4b69-a1c8-d733c8791d32 req-58c1a8ec-9dfc-4bbb-a21b-eadb8f92495f service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] No waiting events found dispatching network-vif-plugged-6ba5e67e-b479-4371-89e3-97c1beceff8f {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:45:35 user nova-compute[74743]: WARNING nova.compute.manager [req-e7cae41a-4392-4b69-a1c8-d733c8791d32 req-58c1a8ec-9dfc-4bbb-a21b-eadb8f92495f service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Received unexpected event network-vif-plugged-6ba5e67e-b479-4371-89e3-97c1beceff8f for instance with vm_state stopped and task_state None.
Nov 18 17:45:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:45:42 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:45:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:45:49 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:45:49 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74743) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 17:45:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:45:52 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:45:53 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:45:55 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:45:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:45:57 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:45:57 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:45:58 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:45:59 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:45:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:45:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:45:59 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:45:59 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Auditing locally available compute resources for user (node: user) {{(pid=74743) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 17:45:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:45:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:45:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:45:59 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:45:59 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:46:00 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:46:00 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:46:00 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Hypervisor/Node resource view: name=user free_ram=8883MB free_disk=25.242019653320312GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74743) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 17:46:00 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:46:00 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:46:00 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 9c90f34f-7bbf-40d9-8f65-983d91f0b51b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:46:00 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 8e73f77d-40ca-43d7-80ca-33ffda8583de actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:46:00 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 17:46:00 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 17:46:00 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:46:00 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:46:00 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Compute_service record updated for user:user {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 17:46:00 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.240s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:46:02 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:46:04 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:46:04 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:46:04 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Starting heal instance info cache {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 17:46:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "refresh_cache-8e73f77d-40ca-43d7-80ca-33ffda8583de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:46:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquired lock "refresh_cache-8e73f77d-40ca-43d7-80ca-33ffda8583de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:46:04 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Forcefully refreshing network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 17:46:05 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Updating instance_info_cache with network_info: [{"id": "0045eadc-4afc-4176-b629-567d68625689", "address": "fa:16:3e:23:0a:17", "network": {"id": "d47540e7-8348-419d-acc3-51b7a034b940", "bridge": "br-int", "label": "tempest-TestShelveInstance-1342322227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec05d713c50b4049896c839299c8edcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0045eadc-4a", "ovs_interfaceid": "0045eadc-4afc-4176-b629-567d68625689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:46:05 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Releasing lock "refresh_cache-8e73f77d-40ca-43d7-80ca-33ffda8583de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:46:05 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Updated the network info_cache for instance {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 17:46:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:46:12 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:46:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:46:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:46:20 user nova-compute[74743]: DEBUG nova.compute.manager [req-f3bea798-0229-4926-b7d4-6d9c20d7dd71 req-1b000f9a-bc0b-4f80-aa46-f37ac4e48eee service nova] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Received event network-changed-0045eadc-4afc-4176-b629-567d68625689 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:46:20 user nova-compute[74743]: DEBUG nova.compute.manager [req-f3bea798-0229-4926-b7d4-6d9c20d7dd71 req-1b000f9a-bc0b-4f80-aa46-f37ac4e48eee service nova] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Refreshing instance network info cache due to event network-changed-0045eadc-4afc-4176-b629-567d68625689. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:46:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f3bea798-0229-4926-b7d4-6d9c20d7dd71 req-1b000f9a-bc0b-4f80-aa46-f37ac4e48eee service nova] Acquiring lock "refresh_cache-8e73f77d-40ca-43d7-80ca-33ffda8583de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:46:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f3bea798-0229-4926-b7d4-6d9c20d7dd71 req-1b000f9a-bc0b-4f80-aa46-f37ac4e48eee service nova] Acquired lock "refresh_cache-8e73f77d-40ca-43d7-80ca-33ffda8583de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:46:20 user nova-compute[74743]: DEBUG nova.network.neutron [req-f3bea798-0229-4926-b7d4-6d9c20d7dd71 req-1b000f9a-bc0b-4f80-aa46-f37ac4e48eee service nova] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Refreshing network info cache for port 0045eadc-4afc-4176-b629-567d68625689 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:46:21 user nova-compute[74743]: DEBUG nova.network.neutron [req-f3bea798-0229-4926-b7d4-6d9c20d7dd71 req-1b000f9a-bc0b-4f80-aa46-f37ac4e48eee service nova] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Updated VIF entry in instance network info cache for port 0045eadc-4afc-4176-b629-567d68625689. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:46:21 user nova-compute[74743]: DEBUG nova.network.neutron [req-f3bea798-0229-4926-b7d4-6d9c20d7dd71 req-1b000f9a-bc0b-4f80-aa46-f37ac4e48eee service nova] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Updating instance_info_cache with network_info: [{"id": "0045eadc-4afc-4176-b629-567d68625689", "address": "fa:16:3e:23:0a:17", "network": {"id": "d47540e7-8348-419d-acc3-51b7a034b940", "bridge": "br-int", "label": "tempest-TestShelveInstance-1342322227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec05d713c50b4049896c839299c8edcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0045eadc-4a", "ovs_interfaceid": "0045eadc-4afc-4176-b629-567d68625689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:46:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-f3bea798-0229-4926-b7d4-6d9c20d7dd71 req-1b000f9a-bc0b-4f80-aa46-f37ac4e48eee service nova] Releasing lock "refresh_cache-8e73f77d-40ca-43d7-80ca-33ffda8583de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:46:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-9eeeeeeb-a55b-4a73-bb08-d74fb5f34d82 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Acquiring lock "8e73f77d-40ca-43d7-80ca-33ffda8583de" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:46:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-9eeeeeeb-a55b-4a73-bb08-d74fb5f34d82 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Lock "8e73f77d-40ca-43d7-80ca-33ffda8583de" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:46:21 user nova-compute[74743]: INFO nova.compute.manager [None req-9eeeeeeb-a55b-4a73-bb08-d74fb5f34d82 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Shelve offloading
Nov 18 17:46:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:46:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:46:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:46:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:46:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:46:21 user nova-compute[74743]: DEBUG nova.compute.manager [req-6b34a062-ccf3-4247-9923-a25a32b9fdb4 req-e94e90eb-fcb2-4d6b-aa38-0d8389278fc8 service nova] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Received event network-vif-unplugged-0045eadc-4afc-4176-b629-567d68625689 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:46:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-6b34a062-ccf3-4247-9923-a25a32b9fdb4 req-e94e90eb-fcb2-4d6b-aa38-0d8389278fc8 service nova] Acquiring lock "8e73f77d-40ca-43d7-80ca-33ffda8583de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:46:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-6b34a062-ccf3-4247-9923-a25a32b9fdb4 req-e94e90eb-fcb2-4d6b-aa38-0d8389278fc8 service nova] Lock "8e73f77d-40ca-43d7-80ca-33ffda8583de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:46:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-6b34a062-ccf3-4247-9923-a25a32b9fdb4 req-e94e90eb-fcb2-4d6b-aa38-0d8389278fc8 service nova] Lock "8e73f77d-40ca-43d7-80ca-33ffda8583de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:46:21 user nova-compute[74743]: DEBUG nova.compute.manager [req-6b34a062-ccf3-4247-9923-a25a32b9fdb4 req-e94e90eb-fcb2-4d6b-aa38-0d8389278fc8 service nova] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] No waiting events found dispatching network-vif-unplugged-0045eadc-4afc-4176-b629-567d68625689 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:46:21 user nova-compute[74743]: WARNING nova.compute.manager [req-6b34a062-ccf3-4247-9923-a25a32b9fdb4 req-e94e90eb-fcb2-4d6b-aa38-0d8389278fc8 service nova] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Received unexpected event network-vif-unplugged-0045eadc-4afc-4176-b629-567d68625689 for instance with vm_state active and task_state shelving.
Nov 18 17:46:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:46:22 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Instance destroyed successfully.
Nov 18 17:46:22 user nova-compute[74743]: DEBUG nova.compute.manager [None req-9eeeeeeb-a55b-4a73-bb08-d74fb5f34d82 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:46:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-9eeeeeeb-a55b-4a73-bb08-d74fb5f34d82 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Acquiring lock "refresh_cache-8e73f77d-40ca-43d7-80ca-33ffda8583de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:46:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-9eeeeeeb-a55b-4a73-bb08-d74fb5f34d82 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Acquired lock "refresh_cache-8e73f77d-40ca-43d7-80ca-33ffda8583de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:46:22 user nova-compute[74743]: DEBUG nova.network.neutron [None req-9eeeeeeb-a55b-4a73-bb08-d74fb5f34d82 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:46:22 user nova-compute[74743]: DEBUG nova.network.neutron [None req-9eeeeeeb-a55b-4a73-bb08-d74fb5f34d82 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Updating instance_info_cache with network_info: [{"id": "0045eadc-4afc-4176-b629-567d68625689", "address": "fa:16:3e:23:0a:17", "network": {"id": "d47540e7-8348-419d-acc3-51b7a034b940", "bridge": "br-int", "label": "tempest-TestShelveInstance-1342322227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec05d713c50b4049896c839299c8edcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0045eadc-4a", "ovs_interfaceid": "0045eadc-4afc-4176-b629-567d68625689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:46:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-9eeeeeeb-a55b-4a73-bb08-d74fb5f34d82 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Releasing lock "refresh_cache-8e73f77d-40ca-43d7-80ca-33ffda8583de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:46:23 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Instance destroyed successfully.
Nov 18 17:46:23 user nova-compute[74743]: DEBUG nova.objects.instance [None req-9eeeeeeb-a55b-4a73-bb08-d74fb5f34d82 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Lazy-loading 'resources' on Instance uuid 8e73f77d-40ca-43d7-80ca-33ffda8583de {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-9eeeeeeb-a55b-4a73-bb08-d74fb5f34d82 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:44:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1346766668',display_name='tempest-TestShelveInstance-server-1346766668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1346766668',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7aYbhvlbM1cToEexq8kd0tHLbcKOWu0Vj54xJXYDV2+2rqruzg+wTTJX04FpFBnB8ox38G88mO/CnhyhIoTsX1UlyKi/yZuLqTCXuUbf+LXRD8anyhwVVR9+pQHu6pYw==',key_name='tempest-TestShelveInstance-1062282570',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:44:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ec05d713c50b4049896c839299c8edcd',ramdisk_id='',reservation_id='r-83y4v011',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1526121326',owner_user_name='tempest-TestShelveInstance-1526121326-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:44:41Z,user_data=None,user_id='09337734209f48cbbc4670a3ffedf7e1',uuid=8e73f77d-40ca-43d7-80ca-33ffda8583de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0045eadc-4afc-4176-b629-567d68625689", "address": "fa:16:3e:23:0a:17", "network": {"id": "d47540e7-8348-419d-acc3-51b7a034b940", "bridge": "br-int", "label": "tempest-TestShelveInstance-1342322227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec05d713c50b4049896c839299c8edcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0045eadc-4a", "ovs_interfaceid": "0045eadc-4afc-4176-b629-567d68625689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-9eeeeeeb-a55b-4a73-bb08-d74fb5f34d82 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Converting VIF {"id": "0045eadc-4afc-4176-b629-567d68625689", "address": "fa:16:3e:23:0a:17", "network": {"id": "d47540e7-8348-419d-acc3-51b7a034b940", "bridge": "br-int", "label": "tempest-TestShelveInstance-1342322227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec05d713c50b4049896c839299c8edcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0045eadc-4a", "ovs_interfaceid": "0045eadc-4afc-4176-b629-567d68625689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-9eeeeeeb-a55b-4a73-bb08-d74fb5f34d82 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:0a:17,bridge_name='br-int',has_traffic_filtering=True,id=0045eadc-4afc-4176-b629-567d68625689,network=Network(d47540e7-8348-419d-acc3-51b7a034b940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0045eadc-4a') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG os_vif [None req-9eeeeeeb-a55b-4a73-bb08-d74fb5f34d82 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:0a:17,bridge_name='br-int',has_traffic_filtering=True,id=0045eadc-4afc-4176-b629-567d68625689,network=Network(d47540e7-8348-419d-acc3-51b7a034b940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0045eadc-4a') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0045eadc-4a, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG nova.compute.manager [req-95edccec-e687-47fb-aae9-8de5531248b2 req-ff7e546a-e515-4859-b4c0-fa71eedb8bec service nova] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Received event network-changed-0045eadc-4afc-4176-b629-567d68625689 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG nova.compute.manager [req-95edccec-e687-47fb-aae9-8de5531248b2 req-ff7e546a-e515-4859-b4c0-fa71eedb8bec service nova] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Refreshing instance network info cache due to event network-changed-0045eadc-4afc-4176-b629-567d68625689. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-95edccec-e687-47fb-aae9-8de5531248b2 req-ff7e546a-e515-4859-b4c0-fa71eedb8bec service nova] Acquiring lock "refresh_cache-8e73f77d-40ca-43d7-80ca-33ffda8583de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-95edccec-e687-47fb-aae9-8de5531248b2 req-ff7e546a-e515-4859-b4c0-fa71eedb8bec service nova] Acquired lock "refresh_cache-8e73f77d-40ca-43d7-80ca-33ffda8583de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG nova.network.neutron [req-95edccec-e687-47fb-aae9-8de5531248b2 req-ff7e546a-e515-4859-b4c0-fa71eedb8bec service nova] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Refreshing network info cache for port 0045eadc-4afc-4176-b629-567d68625689 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fbc8c7e6-a04b-4d51-9800-83c866ffca0b) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:46:23 user nova-compute[74743]: INFO os_vif [None req-9eeeeeeb-a55b-4a73-bb08-d74fb5f34d82 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:0a:17,bridge_name='br-int',has_traffic_filtering=True,id=0045eadc-4afc-4176-b629-567d68625689,network=Network(d47540e7-8348-419d-acc3-51b7a034b940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0045eadc-4a')
Nov 18 17:46:23 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9eeeeeeb-a55b-4a73-bb08-d74fb5f34d82 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] calling os-brick to detach iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eeeeeeb-a55b-4a73-bb08-d74fb5f34d82 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, {'target_iqn': 'iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BfRFxQla', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:46:23 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-9eeeeeeb-a55b-4a73-bb08-d74fb5f34d82 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:46:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-9eeeeeeb-a55b-4a73-bb08-d74fb5f34d82 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-9eeeeeeb-a55b-4a73-bb08-d74fb5f34d82 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7847471-6dc2-4dee-a6d3-7e2501a9440e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eeeeeeb-a55b-4a73-bb08-d74fb5f34d82 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 17:46:23 user nova-compute[74743]: No targets found.
Nov 18 17:46:23 user nova-compute[74743]: iSNS:
Nov 18 17:46:23 user nova-compute[74743]: No targets found.
Nov 18 17:46:23 user nova-compute[74743]: STATIC:
Nov 18 17:46:23 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e
Nov 18 17:46:23 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:46:23 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:46:23 user nova-compute[74743]: FIRMWARE:
Nov 18 17:46:23 user nova-compute[74743]: No targets found.
Nov 18 17:46:23 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eeeeeeb-a55b-4a73-bb08-d74fb5f34d82 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 17:46:23 user nova-compute[74743]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 17:46:23 user nova-compute[74743]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74743) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eeeeeeb-a55b-4a73-bb08-d74fb5f34d82 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e', 0)] {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[61411ac7-caa8-4312-8cfa-7be77e4b35b8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9fe5de-0af7-4dde-9ee6-37da2cd1956d]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eeeeeeb-a55b-4a73-bb08-d74fb5f34d82 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e (non-flash)
Nov 18 17:46:23 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eeeeeeb-a55b-4a73-bb08-d74fb5f34d82 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e (non-flash)
Nov 18 17:46:23 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eeeeeeb-a55b-4a73-bb08-d74fb5f34d82 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb0829a9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e'): ({'sdc'}, set())}) {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-9eeeeeeb-a55b-4a73-bb08-d74fb5f34d82 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Removing single pathed devices sdc {{(pid=74743) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f141e35-bd07-4cb5-adb8-ee522f617832]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e73df1-f285-4c97-99ad-80374d857a38]: (4, ('ok\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-9eeeeeeb-a55b-4a73-bb08-d74fb5f34d82 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Flushing IO for device /dev/sdc {{(pid=74743) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[512c74b0-b537-4cfb-8b0b-b6c741388c2a]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-9eeeeeeb-a55b-4a73-bb08-d74fb5f34d82 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74743) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a410eede-fce1-4afa-96f6-50f97e8521e4]: (4, ('1', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-9eeeeeeb-a55b-4a73-bb08-d74fb5f34d82 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-9eeeeeeb-a55b-4a73-bb08-d74fb5f34d82 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] SCSI volumes sdc have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eeeeeeb-a55b-4a73-bb08-d74fb5f34d82 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e')] {{(pid=74743) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2f00e0-6a50-450c-8206-49957c2ca059]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eeeeeeb-a55b-4a73-bb08-d74fb5f34d82 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e -p 172.16.0.220:3260 --logout {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[999512c4-a241-4fd2-a6ae-ea0187d05956]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eeeeeeb-a55b-4a73-bb08-d74fb5f34d82 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e, portal: 172.16.0.220,3260]
Nov 18 17:46:23 user nova-compute[74743]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e, portal: 172.16.0.220,3260] successful.
Nov 18 17:46:23 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e -p 172.16.0.220:3260 --op delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f2e63e-f758-46dc-a461-13b8995e6f81]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eeeeeeb-a55b-4a73-bb08-d74fb5f34d82 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-9eeeeeeb-a55b-4a73-bb08-d74fb5f34d82 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eeeeeeb-a55b-4a73-bb08-d74fb5f34d82 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] <== disconnect_volume: return (295ms) None {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9eeeeeeb-a55b-4a73-bb08-d74fb5f34d82 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Disconnected iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 17:46:23 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-9eeeeeeb-a55b-4a73-bb08-d74fb5f34d82 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Deleting instance files /opt/stack/data/nova/instances/8e73f77d-40ca-43d7-80ca-33ffda8583de_del
Nov 18 17:46:23 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-9eeeeeeb-a55b-4a73-bb08-d74fb5f34d82 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Deletion of /opt/stack/data/nova/instances/8e73f77d-40ca-43d7-80ca-33ffda8583de_del complete
Nov 18 17:46:23 user nova-compute[74743]: DEBUG nova.network.neutron [req-95edccec-e687-47fb-aae9-8de5531248b2 req-ff7e546a-e515-4859-b4c0-fa71eedb8bec service nova] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Updated VIF entry in instance network info cache for port 0045eadc-4afc-4176-b629-567d68625689. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG nova.network.neutron [req-95edccec-e687-47fb-aae9-8de5531248b2 req-ff7e546a-e515-4859-b4c0-fa71eedb8bec service nova] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Updating instance_info_cache with network_info: [{"id": "0045eadc-4afc-4176-b629-567d68625689", "address": "fa:16:3e:23:0a:17", "network": {"id": "d47540e7-8348-419d-acc3-51b7a034b940", "bridge": null, "label": "tempest-TestShelveInstance-1342322227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec05d713c50b4049896c839299c8edcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap0045eadc-4a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-95edccec-e687-47fb-aae9-8de5531248b2 req-ff7e546a-e515-4859-b4c0-fa71eedb8bec service nova] Releasing lock "refresh_cache-8e73f77d-40ca-43d7-80ca-33ffda8583de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG nova.compute.manager [req-33d5a192-0580-4975-9b2c-a5baa98991ea req-de39fc91-2c0a-43c3-8b04-e2dab293fbdd service nova] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Received event network-vif-plugged-0045eadc-4afc-4176-b629-567d68625689 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-33d5a192-0580-4975-9b2c-a5baa98991ea req-de39fc91-2c0a-43c3-8b04-e2dab293fbdd service nova] Acquiring lock "8e73f77d-40ca-43d7-80ca-33ffda8583de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-33d5a192-0580-4975-9b2c-a5baa98991ea req-de39fc91-2c0a-43c3-8b04-e2dab293fbdd service nova] Lock "8e73f77d-40ca-43d7-80ca-33ffda8583de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-33d5a192-0580-4975-9b2c-a5baa98991ea req-de39fc91-2c0a-43c3-8b04-e2dab293fbdd service nova] Lock "8e73f77d-40ca-43d7-80ca-33ffda8583de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:46:23 user nova-compute[74743]: DEBUG nova.compute.manager [req-33d5a192-0580-4975-9b2c-a5baa98991ea req-de39fc91-2c0a-43c3-8b04-e2dab293fbdd service nova] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] No waiting events found dispatching network-vif-plugged-0045eadc-4afc-4176-b629-567d68625689 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:46:23 user nova-compute[74743]: WARNING nova.compute.manager [req-33d5a192-0580-4975-9b2c-a5baa98991ea req-de39fc91-2c0a-43c3-8b04-e2dab293fbdd service nova] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Received unexpected event network-vif-plugged-0045eadc-4afc-4176-b629-567d68625689 for instance with vm_state active and task_state shelving.
Nov 18 17:46:24 user nova-compute[74743]: INFO nova.scheduler.client.report [None req-9eeeeeeb-a55b-4a73-bb08-d74fb5f34d82 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Deleted allocations for instance 8e73f77d-40ca-43d7-80ca-33ffda8583de
Nov 18 17:46:24 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-9eeeeeeb-a55b-4a73-bb08-d74fb5f34d82 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:46:24 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-9eeeeeeb-a55b-4a73-bb08-d74fb5f34d82 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:46:24 user nova-compute[74743]: DEBUG nova.objects.instance [None req-9eeeeeeb-a55b-4a73-bb08-d74fb5f34d82 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Lazy-loading 'numa_topology' on Instance uuid 8e73f77d-40ca-43d7-80ca-33ffda8583de {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:46:24 user nova-compute[74743]: DEBUG nova.objects.base [None req-9eeeeeeb-a55b-4a73-bb08-d74fb5f34d82 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Object Instance<8e73f77d-40ca-43d7-80ca-33ffda8583de> lazy-loaded attributes: resources,numa_topology {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:46:24 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-9eeeeeeb-a55b-4a73-bb08-d74fb5f34d82 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:46:24 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-9eeeeeeb-a55b-4a73-bb08-d74fb5f34d82 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:46:24 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-9eeeeeeb-a55b-4a73-bb08-d74fb5f34d82 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.122s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:46:24 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-9eeeeeeb-a55b-4a73-bb08-d74fb5f34d82 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Lock "8e73f77d-40ca-43d7-80ca-33ffda8583de" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.246s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:46:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:46:28 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:46:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:46:33 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:46:35 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:46:38 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:46:43 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:46:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:46:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:46:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74743) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 17:46:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:46:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:46:48 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:46:50 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:46:50 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74743) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 17:46:53 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:46:53 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:46:53 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:46:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:46:56 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:46:57 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:46:57 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:46:58 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:46:59 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:47:00 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:47:00 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:47:00 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:47:00 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:47:00 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Auditing locally available compute resources for user (node: user) {{(pid=74743) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 17:47:00 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:47:00 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:47:00 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:47:00 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:47:01 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:47:01 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:47:01 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Hypervisor/Node resource view: name=user free_ram=9060MB free_disk=25.241180419921875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74743) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 17:47:01 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:47:01 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:47:01 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 9c90f34f-7bbf-40d9-8f65-983d91f0b51b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:47:01 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 17:47:01 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 17:47:01 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:47:01 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:47:01 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Compute_service record updated for user:user {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 17:47:01 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.193s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:47:03 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:47:03 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:47:03 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74743) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 17:47:03 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:47:03 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:47:03 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:47:06 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:47:06 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Starting heal instance info cache {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 17:47:06 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Rebuilding the list of instances to heal {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 17:47:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "refresh_cache-9c90f34f-7bbf-40d9-8f65-983d91f0b51b" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:47:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquired lock "refresh_cache-9c90f34f-7bbf-40d9-8f65-983d91f0b51b" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:47:06 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Forcefully refreshing network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 17:47:06 user nova-compute[74743]: DEBUG nova.objects.instance [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lazy-loading 'info_cache' on Instance uuid 9c90f34f-7bbf-40d9-8f65-983d91f0b51b {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:47:06 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Updating instance_info_cache with network_info: [{"id": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "address": "fa:16:3e:08:2d:e8", "network": {"id": "7cf1258c-5feb-472e-9f3f-69d95360b050", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-628054528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "790f602c532d41289c52985c8fab91d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba5e67e-b4", "ovs_interfaceid": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:47:07 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Releasing lock "refresh_cache-9c90f34f-7bbf-40d9-8f65-983d91f0b51b" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:47:07 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Updated the network info_cache for instance {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 17:47:08 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:47:13 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:47:18 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:47:23 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:47:23 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:47:23 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74743) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 17:47:23 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:47:23 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:47:23 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:47:23 user nova-compute[74743]: DEBUG nova.objects.instance [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lazy-loading 'flavor' on Instance uuid 9c90f34f-7bbf-40d9-8f65-983d91f0b51b {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:47:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Acquiring lock "refresh_cache-9c90f34f-7bbf-40d9-8f65-983d91f0b51b" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:47:23 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Acquired lock "refresh_cache-9c90f34f-7bbf-40d9-8f65-983d91f0b51b" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:47:23 user nova-compute[74743]: DEBUG nova.network.neutron [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:47:23 user nova-compute[74743]: DEBUG nova.objects.instance [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lazy-loading 'info_cache' on Instance uuid 9c90f34f-7bbf-40d9-8f65-983d91f0b51b {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:47:23 user nova-compute[74743]: DEBUG nova.objects.base [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Object Instance<9c90f34f-7bbf-40d9-8f65-983d91f0b51b> lazy-loaded attributes: flavor,info_cache {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:47:24 user nova-compute[74743]: DEBUG nova.network.neutron [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Updating instance_info_cache with network_info: [{"id": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "address": "fa:16:3e:08:2d:e8", "network": {"id": "7cf1258c-5feb-472e-9f3f-69d95360b050", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-628054528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "790f602c532d41289c52985c8fab91d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba5e67e-b4", "ovs_interfaceid": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:47:24 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Releasing lock "refresh_cache-9c90f34f-7bbf-40d9-8f65-983d91f0b51b" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:47:24 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Instance destroyed successfully.
Nov 18 17:47:24 user nova-compute[74743]: DEBUG nova.objects.instance [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lazy-loading 'resources' on Instance uuid 9c90f34f-7bbf-40d9-8f65-983d91f0b51b {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:47:24 user nova-compute[74743]: DEBUG nova.objects.base [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Object Instance<9c90f34f-7bbf-40d9-8f65-983d91f0b51b> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:47:24 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:39:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-412810144',display_name='tempest-AttachVolumeTestJSON-server-412810144',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-412810144',id=48,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLOX3vLKn4BPxKq/sYlRJyYxjQkfS7C5a3EAlzUWDWpfhN4MRLyKkuT1pXcPPcKSOXBLUqQkc/KRtoOHbZrTCC299l1ITOKXjAQISq5k9bKohMtNJ2/b6nyF5OqHILx6UA==',key_name='tempest-keypair-452329227',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:39:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='790f602c532d41289c52985c8fab91d4',ramdisk_id='',reservation_id='r-2otufkmn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1207996855',owner_user_name='tempest-AttachVolumeTestJSON-1207996855-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:45:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b9d8b543f4946b2918bd38c4a3c835f',uuid=9c90f34f-7bbf-40d9-8f65-983d91f0b51b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "address": "fa:16:3e:08:2d:e8", "network": {"id": "7cf1258c-5feb-472e-9f3f-69d95360b050", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-628054528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "790f602c532d41289c52985c8fab91d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba5e67e-b4", "ovs_interfaceid": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:47:24 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Converting VIF {"id": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "address": "fa:16:3e:08:2d:e8", "network": {"id": "7cf1258c-5feb-472e-9f3f-69d95360b050", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-628054528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "790f602c532d41289c52985c8fab91d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba5e67e-b4", "ovs_interfaceid": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:47:24 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:2d:e8,bridge_name='br-int',has_traffic_filtering=True,id=6ba5e67e-b479-4371-89e3-97c1beceff8f,network=Network(7cf1258c-5feb-472e-9f3f-69d95360b050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ba5e67e-b4') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:47:24 user nova-compute[74743]: DEBUG os_vif [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:2d:e8,bridge_name='br-int',has_traffic_filtering=True,id=6ba5e67e-b479-4371-89e3-97c1beceff8f,network=Network(7cf1258c-5feb-472e-9f3f-69d95360b050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ba5e67e-b4') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:47:24 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:47:24 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6ba5e67e-b4, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:47:24 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:47:24 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:47:24 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:47:24 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a6ce8615-9dba-4a68-87c6-c3979eed115c) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:47:24 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:47:24 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:47:24 user nova-compute[74743]: INFO os_vif [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:2d:e8,bridge_name='br-int',has_traffic_filtering=True,id=6ba5e67e-b479-4371-89e3-97c1beceff8f,network=Network(7cf1258c-5feb-472e-9f3f-69d95360b050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ba5e67e-b4')
Nov 18 17:47:24 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Start _get_guest_xml network_info=[{"id": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "address": "fa:16:3e:08:2d:e8", "network": {"id": "7cf1258c-5feb-472e-9f3f-69d95360b050", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-628054528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "790f602c532d41289c52985c8fab91d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba5e67e-b4", "ovs_interfaceid": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '9536f6cf-95c4-40e2-864a-09a91525678a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:47:24 user nova-compute[74743]: DEBUG nova.objects.instance [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lazy-loading 'numa_topology' on Instance uuid 9c90f34f-7bbf-40d9-8f65-983d91f0b51b {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:47:24 user nova-compute[74743]: DEBUG nova.objects.base [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Object Instance<9c90f34f-7bbf-40d9-8f65-983d91f0b51b> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:47:24 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:47:24 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:47:24 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:47:24 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:47:24 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:47:24 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:47:24 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:47:24 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:47:24 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:47:24 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:47:24 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:47:24 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:47:24 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:47:24 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:47:24 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:47:24 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:47:24 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:47:24 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:47:24 user nova-compute[74743]: DEBUG nova.objects.instance [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9c90f34f-7bbf-40d9-8f65-983d91f0b51b {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:47:24 user nova-compute[74743]: DEBUG nova.objects.base [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Object Instance<9c90f34f-7bbf-40d9-8f65-983d91f0b51b> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:47:24 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:39:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-412810144',display_name='tempest-AttachVolumeTestJSON-server-412810144',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-412810144',id=48,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLOX3vLKn4BPxKq/sYlRJyYxjQkfS7C5a3EAlzUWDWpfhN4MRLyKkuT1pXcPPcKSOXBLUqQkc/KRtoOHbZrTCC299l1ITOKXjAQISq5k9bKohMtNJ2/b6nyF5OqHILx6UA==',key_name='tempest-keypair-452329227',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:39:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='790f602c532d41289c52985c8fab91d4',ramdisk_id='',reservation_id='r-2otufkmn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1207996855',owner_user_name='tempest-AttachVolumeTestJSON-1207996855-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:45:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b9d8b543f4946b2918bd38c4a3c835f',uuid=9c90f34f-7bbf-40d9-8f65-983d91f0b51b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "address": "fa:16:3e:08:2d:e8", "network": {"id": "7cf1258c-5feb-472e-9f3f-69d95360b050", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-628054528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "790f602c532d41289c52985c8fab91d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba5e67e-b4", "ovs_interfaceid": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:47:24 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Converting VIF {"id": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "address": "fa:16:3e:08:2d:e8", "network": {"id": "7cf1258c-5feb-472e-9f3f-69d95360b050", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-628054528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "790f602c532d41289c52985c8fab91d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba5e67e-b4", "ovs_interfaceid": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:47:24 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:2d:e8,bridge_name='br-int',has_traffic_filtering=True,id=6ba5e67e-b479-4371-89e3-97c1beceff8f,network=Network(7cf1258c-5feb-472e-9f3f-69d95360b050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ba5e67e-b4') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:47:24 user nova-compute[74743]: DEBUG nova.objects.instance [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lazy-loading 'pci_devices' on Instance uuid 9c90f34f-7bbf-40d9-8f65-983d91f0b51b {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:47:24 user nova-compute[74743]: DEBUG nova.objects.base [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Object Instance<9c90f34f-7bbf-40d9-8f65-983d91f0b51b> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:47:24 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:47:24 user nova-compute[74743]:   <uuid>9c90f34f-7bbf-40d9-8f65-983d91f0b51b</uuid>
Nov 18 17:47:24 user nova-compute[74743]:   <name>instance-00000030</name>
Nov 18 17:47:24 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:47:24 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:47:24 user nova-compute[74743]:   <metadata>
Nov 18 17:47:24 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:47:24 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:47:24 user nova-compute[74743]:       <nova:name>tempest-AttachVolumeTestJSON-server-412810144</nova:name>
Nov 18 17:47:24 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:47:24</nova:creationTime>
Nov 18 17:47:24 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:47:24 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:47:24 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:47:24 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:47:24 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:47:24 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:47:24 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:47:24 user nova-compute[74743]:       <nova:owner>
Nov 18 17:47:24 user nova-compute[74743]:         <nova:user uuid="8b9d8b543f4946b2918bd38c4a3c835f">tempest-AttachVolumeTestJSON-1207996855-project-member</nova:user>
Nov 18 17:47:24 user nova-compute[74743]:         <nova:project uuid="790f602c532d41289c52985c8fab91d4">tempest-AttachVolumeTestJSON-1207996855</nova:project>
Nov 18 17:47:24 user nova-compute[74743]:       </nova:owner>
Nov 18 17:47:24 user nova-compute[74743]:       <nova:root type="image" uuid="9536f6cf-95c4-40e2-864a-09a91525678a"/>
Nov 18 17:47:24 user nova-compute[74743]:       <nova:ports>
Nov 18 17:47:24 user nova-compute[74743]:         <nova:port uuid="6ba5e67e-b479-4371-89e3-97c1beceff8f">
Nov 18 17:47:24 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 18 17:47:24 user nova-compute[74743]:         </nova:port>
Nov 18 17:47:24 user nova-compute[74743]:       </nova:ports>
Nov 18 17:47:24 user nova-compute[74743]:     </nova:instance>
Nov 18 17:47:24 user nova-compute[74743]:   </metadata>
Nov 18 17:47:24 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:47:24 user nova-compute[74743]:     <system>
Nov 18 17:47:24 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:47:24 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:47:24 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:47:24 user nova-compute[74743]:       <entry name="serial">9c90f34f-7bbf-40d9-8f65-983d91f0b51b</entry>
Nov 18 17:47:24 user nova-compute[74743]:       <entry name="uuid">9c90f34f-7bbf-40d9-8f65-983d91f0b51b</entry>
Nov 18 17:47:24 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:47:24 user nova-compute[74743]:     </system>
Nov 18 17:47:24 user nova-compute[74743]:   </sysinfo>
Nov 18 17:47:24 user nova-compute[74743]:   <os>
Nov 18 17:47:24 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:47:24 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:47:24 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:47:24 user nova-compute[74743]:   </os>
Nov 18 17:47:24 user nova-compute[74743]:   <features>
Nov 18 17:47:24 user nova-compute[74743]:     <acpi/>
Nov 18 17:47:24 user nova-compute[74743]:     <apic/>
Nov 18 17:47:24 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:47:24 user nova-compute[74743]:   </features>
Nov 18 17:47:24 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:47:24 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:47:24 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:47:24 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:47:24 user nova-compute[74743]:   </clock>
Nov 18 17:47:24 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:47:24 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:47:24 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:47:24 user nova-compute[74743]:   </cpu>
Nov 18 17:47:24 user nova-compute[74743]:   <devices>
Nov 18 17:47:24 user nova-compute[74743]:     <disk type="file" device="disk">
Nov 18 17:47:24 user nova-compute[74743]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 17:47:24 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk"/>
Nov 18 17:47:24 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:47:24 user nova-compute[74743]:     </disk>
Nov 18 17:47:24 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:47:24 user nova-compute[74743]:       <mac address="fa:16:3e:08:2d:e8"/>
Nov 18 17:47:24 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:47:24 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:47:24 user nova-compute[74743]:       <target dev="tap6ba5e67e-b4"/>
Nov 18 17:47:24 user nova-compute[74743]:     </interface>
Nov 18 17:47:24 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:47:24 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/console.log" append="off"/>
Nov 18 17:47:24 user nova-compute[74743]:     </serial>
Nov 18 17:47:24 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:47:24 user nova-compute[74743]:     <video>
Nov 18 17:47:24 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:47:24 user nova-compute[74743]:     </video>
Nov 18 17:47:24 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:47:24 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:47:24 user nova-compute[74743]:     </rng>
Nov 18 17:47:24 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:47:24 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:47:24 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:47:24 user nova-compute[74743]:     </memballoon>
Nov 18 17:47:24 user nova-compute[74743]:   </devices>
Nov 18 17:47:24 user nova-compute[74743]: </domain>
Nov 18 17:47:24 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:47:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:47:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:47:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:47:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:47:24 user nova-compute[74743]: DEBUG nova.objects.instance [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9c90f34f-7bbf-40d9-8f65-983d91f0b51b {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:47:24 user nova-compute[74743]: DEBUG nova.objects.base [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Object Instance<9c90f34f-7bbf-40d9-8f65-983d91f0b51b> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:47:24 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:47:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.168s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:47:25 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk. size=1073741824 {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 17:47:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:47:25 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:47:25 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Cannot resize image /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk to a smaller size. {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 17:47:25 user nova-compute[74743]: DEBUG nova.objects.instance [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lazy-loading 'migration_context' on Instance uuid 9c90f34f-7bbf-40d9-8f65-983d91f0b51b {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:47:25 user nova-compute[74743]: DEBUG nova.objects.base [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Object Instance<9c90f34f-7bbf-40d9-8f65-983d91f0b51b> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:47:25 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:39:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-412810144',display_name='tempest-AttachVolumeTestJSON-server-412810144',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-412810144',id=48,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLOX3vLKn4BPxKq/sYlRJyYxjQkfS7C5a3EAlzUWDWpfhN4MRLyKkuT1pXcPPcKSOXBLUqQkc/KRtoOHbZrTCC299l1ITOKXjAQISq5k9bKohMtNJ2/b6nyF5OqHILx6UA==',key_name='tempest-keypair-452329227',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:39:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='790f602c532d41289c52985c8fab91d4',ramdisk_id='',reservation_id='r-2otufkmn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1207996855',owner_user_name='tempest-AttachVolumeTestJSON-1207996855-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:45:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b9d8b543f4946b2918bd38c4a3c835f',uuid=9c90f34f-7bbf-40d9-8f65-983d91f0b51b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "address": "fa:16:3e:08:2d:e8", "network": {"id": "7cf1258c-5feb-472e-9f3f-69d95360b050", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-628054528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "790f602c532d41289c52985c8fab91d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba5e67e-b4", "ovs_interfaceid": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:47:25 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Converting VIF {"id": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "address": "fa:16:3e:08:2d:e8", "network": {"id": "7cf1258c-5feb-472e-9f3f-69d95360b050", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-628054528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "790f602c532d41289c52985c8fab91d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba5e67e-b4", "ovs_interfaceid": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:47:25 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:2d:e8,bridge_name='br-int',has_traffic_filtering=True,id=6ba5e67e-b479-4371-89e3-97c1beceff8f,network=Network(7cf1258c-5feb-472e-9f3f-69d95360b050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ba5e67e-b4') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:47:25 user nova-compute[74743]: DEBUG os_vif [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:2d:e8,bridge_name='br-int',has_traffic_filtering=True,id=6ba5e67e-b479-4371-89e3-97c1beceff8f,network=Network(7cf1258c-5feb-472e-9f3f-69d95360b050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ba5e67e-b4') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:47:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:47:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:47:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:47:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:47:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dfb15587-0004-5fb2-9e60-ab6df950148a', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:47:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:47:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:47:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:47:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6ba5e67e-b4, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:47:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6ba5e67e-b4, col_values=(('qos', UUID('930e9597-b9c5-48dc-9bf9-de83247ab612')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:47:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6ba5e67e-b4, col_values=(('external_ids', {'iface-id': '6ba5e67e-b479-4371-89e3-97c1beceff8f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:2d:e8', 'vm-uuid': '9c90f34f-7bbf-40d9-8f65-983d91f0b51b'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:47:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:47:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:47:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:47:25 user nova-compute[74743]: INFO os_vif [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:2d:e8,bridge_name='br-int',has_traffic_filtering=True,id=6ba5e67e-b479-4371-89e3-97c1beceff8f,network=Network(7cf1258c-5feb-472e-9f3f-69d95360b050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ba5e67e-b4')
Nov 18 17:47:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:47:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:47:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:47:26 user nova-compute[74743]: DEBUG nova.compute.manager [req-11583540-09b0-4f50-861b-2c02ca9d21c3 req-bb04a65d-3910-40c1-90ae-8216bbc34116 service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Received event network-vif-plugged-6ba5e67e-b479-4371-89e3-97c1beceff8f {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:47:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-11583540-09b0-4f50-861b-2c02ca9d21c3 req-bb04a65d-3910-40c1-90ae-8216bbc34116 service nova] Acquiring lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:47:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-11583540-09b0-4f50-861b-2c02ca9d21c3 req-bb04a65d-3910-40c1-90ae-8216bbc34116 service nova] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:47:26 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-11583540-09b0-4f50-861b-2c02ca9d21c3 req-bb04a65d-3910-40c1-90ae-8216bbc34116 service nova] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:47:26 user nova-compute[74743]: DEBUG nova.compute.manager [req-11583540-09b0-4f50-861b-2c02ca9d21c3 req-bb04a65d-3910-40c1-90ae-8216bbc34116 service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] No waiting events found dispatching network-vif-plugged-6ba5e67e-b479-4371-89e3-97c1beceff8f {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:47:26 user nova-compute[74743]: WARNING nova.compute.manager [req-11583540-09b0-4f50-861b-2c02ca9d21c3 req-bb04a65d-3910-40c1-90ae-8216bbc34116 service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Received unexpected event network-vif-plugged-6ba5e67e-b479-4371-89e3-97c1beceff8f for instance with vm_state stopped and task_state powering-on.
Nov 18 17:47:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:47:27 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:47:27 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:47:28 user nova-compute[74743]: DEBUG nova.compute.manager [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:47:28 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Instance rebooted successfully.
Nov 18 17:47:28 user nova-compute[74743]: DEBUG nova.compute.manager [None req-a73dab08-3613-4740-9739-39c2076e9b3d tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:47:28 user nova-compute[74743]: DEBUG nova.compute.manager [req-a2958790-df14-4588-8379-91c3d1712256 req-694c6692-1b4c-4ddf-a046-ac100dae42a4 service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Received event network-vif-plugged-6ba5e67e-b479-4371-89e3-97c1beceff8f {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:47:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a2958790-df14-4588-8379-91c3d1712256 req-694c6692-1b4c-4ddf-a046-ac100dae42a4 service nova] Acquiring lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:47:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a2958790-df14-4588-8379-91c3d1712256 req-694c6692-1b4c-4ddf-a046-ac100dae42a4 service nova] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:47:28 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-a2958790-df14-4588-8379-91c3d1712256 req-694c6692-1b4c-4ddf-a046-ac100dae42a4 service nova] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:47:28 user nova-compute[74743]: DEBUG nova.compute.manager [req-a2958790-df14-4588-8379-91c3d1712256 req-694c6692-1b4c-4ddf-a046-ac100dae42a4 service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] No waiting events found dispatching network-vif-plugged-6ba5e67e-b479-4371-89e3-97c1beceff8f {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:47:28 user nova-compute[74743]: WARNING nova.compute.manager [req-a2958790-df14-4588-8379-91c3d1712256 req-694c6692-1b4c-4ddf-a046-ac100dae42a4 service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Received unexpected event network-vif-plugged-6ba5e67e-b479-4371-89e3-97c1beceff8f for instance with vm_state active and task_state None.
Nov 18 17:47:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:47:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:47:35 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:47:40 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:47:45 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:47:45 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:47:50 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:47:50 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:47:50 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74743) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 17:47:50 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:47:53 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:47:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:47:55 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:47:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:47:57 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:47:57 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:47:58 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:48:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:48:00 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:48:00 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:48:00 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:48:00 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:48:00 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:48:00 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Auditing locally available compute resources for user (node: user) {{(pid=74743) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 17:48:00 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:48:00 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:48:00 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:48:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:48:00 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:48:01 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:48:01 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:48:01 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Hypervisor/Node resource view: name=user free_ram=8907MB free_disk=25.239761352539062GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74743) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 17:48:01 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:48:01 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:48:01 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 9c90f34f-7bbf-40d9-8f65-983d91f0b51b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:48:01 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 17:48:01 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 17:48:01 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:48:01 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:48:01 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Compute_service record updated for user:user {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 17:48:01 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.218s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:48:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:48:06 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:48:06 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:48:06 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Starting heal instance info cache {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 17:48:06 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Rebuilding the list of instances to heal {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 17:48:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "refresh_cache-9c90f34f-7bbf-40d9-8f65-983d91f0b51b" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:48:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquired lock "refresh_cache-9c90f34f-7bbf-40d9-8f65-983d91f0b51b" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:48:06 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Forcefully refreshing network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 17:48:06 user nova-compute[74743]: DEBUG nova.objects.instance [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lazy-loading 'info_cache' on Instance uuid 9c90f34f-7bbf-40d9-8f65-983d91f0b51b {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:48:07 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Updating instance_info_cache with network_info: [{"id": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "address": "fa:16:3e:08:2d:e8", "network": {"id": "7cf1258c-5feb-472e-9f3f-69d95360b050", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-628054528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "790f602c532d41289c52985c8fab91d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba5e67e-b4", "ovs_interfaceid": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:48:07 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Releasing lock "refresh_cache-9c90f34f-7bbf-40d9-8f65-983d91f0b51b" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:48:07 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Updated the network info_cache for instance {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 17:48:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:48:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Acquiring lock "8e73f77d-40ca-43d7-80ca-33ffda8583de" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:48:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Lock "8e73f77d-40ca-43d7-80ca-33ffda8583de" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:48:12 user nova-compute[74743]: INFO nova.compute.manager [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Unshelving
Nov 18 17:48:12 user nova-compute[74743]: INFO nova.virt.block_device [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Booting with volume 8d7d6f43-8314-410b-941b-c548291d2b6e at /dev/vda
Nov 18 17:48:13 user nova-compute[74743]: DEBUG os_brick.utils [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:48:13 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:48:13 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:48:13 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2fc81c-9b10-4d12-a404-ab9f5f820afa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1116acd8874d\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:48:13 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:48:13 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:48:13 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c24e485-a764-42f4-a6a6-67b5c2a9c865]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:48:13 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:48:13 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:48:13 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[312089a0-1d41-47b6-a7f8-170639a64766]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:48:13 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a33bb2-5f6b-4fec-8a3d-1fe3dead1670]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:48:13 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Running cmd (subprocess): nvme version {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:48:13 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] 'nvme version' failed. Not Retrying. {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:48:13 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.nvmeof [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] nvme not present on system {{(pid=74743) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 17:48:13 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:48:13 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:48:13 user nova-compute[74743]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 17:48:13 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[e082af36-d50a-41af-9b64-1a963f7825f5]: (4, '') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:48:13 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74743) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 17:48:13 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 17:48:13 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] LIGHTOS: no hostnqn found. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 17:48:13 user nova-compute[74743]: DEBUG os_brick.utils [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1116acd8874d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:48:13 user nova-compute[74743]: DEBUG nova.virt.block_device [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Updating existing volume attachment record: 3f0bd7ed-65b8-42ec-9aae-fda849b5425b {{(pid=74743) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 17:48:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:48:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:48:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:48:18 user nova-compute[74743]: DEBUG nova.objects.instance [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Lazy-loading 'pci_requests' on Instance uuid 8e73f77d-40ca-43d7-80ca-33ffda8583de {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:48:18 user nova-compute[74743]: DEBUG nova.objects.instance [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Lazy-loading 'numa_topology' on Instance uuid 8e73f77d-40ca-43d7-80ca-33ffda8583de {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:48:18 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74743) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 17:48:18 user nova-compute[74743]: INFO nova.compute.claims [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Claim successful on node user
Nov 18 17:48:18 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:48:18 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:48:18 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.250s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:48:18 user nova-compute[74743]: INFO nova.network.neutron [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Updating port 0045eadc-4afc-4176-b629-567d68625689 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 18 17:48:19 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:48:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Acquiring lock "refresh_cache-8e73f77d-40ca-43d7-80ca-33ffda8583de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:48:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Acquired lock "refresh_cache-8e73f77d-40ca-43d7-80ca-33ffda8583de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:48:19 user nova-compute[74743]: DEBUG nova.network.neutron [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:48:19 user nova-compute[74743]: DEBUG nova.compute.manager [req-b6673a77-8e89-4248-8c3d-a365b0f2c972 req-8f32a981-fb20-4300-bc33-53422d8f3c95 service nova] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Received event network-changed-0045eadc-4afc-4176-b629-567d68625689 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:48:19 user nova-compute[74743]: DEBUG nova.compute.manager [req-b6673a77-8e89-4248-8c3d-a365b0f2c972 req-8f32a981-fb20-4300-bc33-53422d8f3c95 service nova] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Refreshing instance network info cache due to event network-changed-0045eadc-4afc-4176-b629-567d68625689. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:48:19 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b6673a77-8e89-4248-8c3d-a365b0f2c972 req-8f32a981-fb20-4300-bc33-53422d8f3c95 service nova] Acquiring lock "refresh_cache-8e73f77d-40ca-43d7-80ca-33ffda8583de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG nova.network.neutron [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Updating instance_info_cache with network_info: [{"id": "0045eadc-4afc-4176-b629-567d68625689", "address": "fa:16:3e:23:0a:17", "network": {"id": "d47540e7-8348-419d-acc3-51b7a034b940", "bridge": "br-int", "label": "tempest-TestShelveInstance-1342322227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec05d713c50b4049896c839299c8edcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0045eadc-4a", "ovs_interfaceid": "0045eadc-4afc-4176-b629-567d68625689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Releasing lock "refresh_cache-8e73f77d-40ca-43d7-80ca-33ffda8583de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Creating instance directory {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 17:48:20 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Creating image(s)
Nov 18 17:48:20 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Did not create local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Ensure instance console log exists: /opt/stack/data/nova/instances/8e73f77d-40ca-43d7-80ca-33ffda8583de/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Start _get_guest_xml network_info=[{"id": "0045eadc-4afc-4176-b629-567d68625689", "address": "fa:16:3e:23:0a:17", "network": {"id": "d47540e7-8348-419d-acc3-51b7a034b940", "bridge": "br-int", "label": "tempest-TestShelveInstance-1342322227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec05d713c50b4049896c839299c8edcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0045eadc-4a", "ovs_interfaceid": "0045eadc-4afc-4176-b629-567d68625689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '3f0bd7ed-65b8-42ec-9aae-fda849b5425b', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BfRFxQla', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8e73f77d-40ca-43d7-80ca-33ffda8583de', 'attached_at': '', 'detached_at': '', 'volume_id': '8d7d6f43-8314-410b-941b-c548291d2b6e', 'serial': '8d7d6f43-8314-410b-941b-c548291d2b6e'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b6673a77-8e89-4248-8c3d-a365b0f2c972 req-8f32a981-fb20-4300-bc33-53422d8f3c95 service nova] Acquired lock "refresh_cache-8e73f77d-40ca-43d7-80ca-33ffda8583de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG nova.network.neutron [req-b6673a77-8e89-4248-8c3d-a365b0f2c972 req-8f32a981-fb20-4300-bc33-53422d8f3c95 service nova] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Refreshing network info cache for port 0045eadc-4afc-4176-b629-567d68625689 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:48:20 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:48:20 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:48:20 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG nova.objects.instance [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8e73f77d-40ca-43d7-80ca-33ffda8583de {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG nova.objects.base [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Object Instance<8e73f77d-40ca-43d7-80ca-33ffda8583de> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Calling os-brick to attach iSCSI Volume {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BfRFxQla', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:48:20 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:48:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:48:20 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:48:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:48:20 user nova-compute[74743]: INFO os_brick.initiator.connectors.iscsi [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 17:48:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e -p 172.16.0.220:3260 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6fd9f7-0b04-4d29-b146-7bf166fd0a5b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 17:48:20 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e -p 172.16.0.220:3260 --interface default --op new {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a795784d-732c-4abb-be15-5f76d5d168f8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e] added\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e] added
Nov 18 17:48:20 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0feed142-0055-4c67-82c9-963bd85b0d27]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[c828b5d6-ee78-4936-96c3-dc7650594b08]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BfRFxQla {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BfRFxQla" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[36915fd7-6e2c-4a93-bf52-1cd8b9dacb80]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BfRFxQla'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb2ea93-62c5-4478-b401-c5a8d60a08f5]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d61776b-6222-479f-9d5c-a136b976cc0f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 18 17:48:20 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 18 17:48:20 user nova-compute[74743]:  {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:48:20 user nova-compute[74743]: WARNING os_brick.initiator.connectors.iscsi [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 18 17:48:20 user nova-compute[74743]: 
Nov 18 17:48:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e -p 172.16.0.220:3260 --login {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[7724636d-59e3-4fa6-9c39-1d24be129c81]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e, portal: 172.16.0.220,3260]
Nov 18 17:48:20 user nova-compute[74743]: Login to [iface: default, target: iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e, portal: 172.16.0.220,3260] successful.
Nov 18 17:48:20 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[69170aba-bbc3-4f14-8488-b4abe3e23f0a]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[85cfe992-00b9-4c51-b4b8-71e665089bfa]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e (non-flash)
Nov 18 17:48:20 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e (non-flash)
Nov 18 17:48:20 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.242s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Connected to 172.16.0.220:3260 {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=74743) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74743) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb07794-2fcd-482f-8701-7d1bf58e34ae]: (4, ('- - 0', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BfRFxQla', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG nova.network.neutron [req-b6673a77-8e89-4248-8c3d-a365b0f2c972 req-8f32a981-fb20-4300-bc33-53422d8f3c95 service nova] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Updated VIF entry in instance network info cache for port 0045eadc-4afc-4176-b629-567d68625689. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG nova.network.neutron [req-b6673a77-8e89-4248-8c3d-a365b0f2c972 req-8f32a981-fb20-4300-bc33-53422d8f3c95 service nova] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Updating instance_info_cache with network_info: [{"id": "0045eadc-4afc-4176-b629-567d68625689", "address": "fa:16:3e:23:0a:17", "network": {"id": "d47540e7-8348-419d-acc3-51b7a034b940", "bridge": "br-int", "label": "tempest-TestShelveInstance-1342322227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec05d713c50b4049896c839299c8edcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0045eadc-4a", "ovs_interfaceid": "0045eadc-4afc-4176-b629-567d68625689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:48:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b6673a77-8e89-4248-8c3d-a365b0f2c972 req-8f32a981-fb20-4300-bc33-53422d8f3c95 service nova] Releasing lock "refresh_cache-8e73f77d-40ca-43d7-80ca-33ffda8583de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:48:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.270s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:48:21 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] <== connect_volume: return (1271ms) {'type': 'block', 'scsi_wwn': '26363613839306234', 'path': '/dev/sdb'} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:48:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363613839306234', 'path': '/dev/sdb'} {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 17:48:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-18T17:44:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1346766668',display_name='tempest-TestShelveInstance-server-1346766668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1346766668',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1062282570',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:44:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ec05d713c50b4049896c839299c8edcd',ramdisk_id='',reservation_id='r-83y4v011',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1526121326',owner_user_name='tempest-TestShelveInstance-1526121326-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:48:13Z,user_data=None,user_id='09337734209f48cbbc4670a3ffedf7e1',uuid=8e73f77d-40ca-43d7-80ca-33ffda8583de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0045eadc-4afc-4176-b629-567d68625689", "address": "fa:16:3e:23:0a:17", "network": {"id": "d47540e7-8348-419d-acc3-51b7a034b940", "bridge": "br-int", "label": "tempest-TestShelveInstance-1342322227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec05d713c50b4049896c839299c8edcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0045eadc-4a", "ovs_interfaceid": "0045eadc-4afc-4176-b629-567d68625689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:48:21 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Converting VIF {"id": "0045eadc-4afc-4176-b629-567d68625689", "address": "fa:16:3e:23:0a:17", "network": {"id": "d47540e7-8348-419d-acc3-51b7a034b940", "bridge": "br-int", "label": "tempest-TestShelveInstance-1342322227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec05d713c50b4049896c839299c8edcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0045eadc-4a", "ovs_interfaceid": "0045eadc-4afc-4176-b629-567d68625689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:48:21 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:0a:17,bridge_name='br-int',has_traffic_filtering=True,id=0045eadc-4afc-4176-b629-567d68625689,network=Network(d47540e7-8348-419d-acc3-51b7a034b940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0045eadc-4a') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:48:21 user nova-compute[74743]: DEBUG nova.objects.instance [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e73f77d-40ca-43d7-80ca-33ffda8583de {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:48:21 user nova-compute[74743]: DEBUG nova.objects.base [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Object Instance<8e73f77d-40ca-43d7-80ca-33ffda8583de> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74743) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 17:48:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:48:21 user nova-compute[74743]:   <uuid>8e73f77d-40ca-43d7-80ca-33ffda8583de</uuid>
Nov 18 17:48:21 user nova-compute[74743]:   <name>instance-00000032</name>
Nov 18 17:48:21 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:48:21 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:48:21 user nova-compute[74743]:   <metadata>
Nov 18 17:48:21 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:48:21 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:48:21 user nova-compute[74743]:       <nova:name>tempest-TestShelveInstance-server-1346766668</nova:name>
Nov 18 17:48:21 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:48:20</nova:creationTime>
Nov 18 17:48:21 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:48:21 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:48:21 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:48:21 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:48:21 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:48:21 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:48:21 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:48:21 user nova-compute[74743]:       <nova:owner>
Nov 18 17:48:21 user nova-compute[74743]:         <nova:user uuid="09337734209f48cbbc4670a3ffedf7e1">tempest-TestShelveInstance-1526121326-project-member</nova:user>
Nov 18 17:48:21 user nova-compute[74743]:         <nova:project uuid="ec05d713c50b4049896c839299c8edcd">tempest-TestShelveInstance-1526121326</nova:project>
Nov 18 17:48:21 user nova-compute[74743]:       </nova:owner>
Nov 18 17:48:21 user nova-compute[74743]:       <nova:ports>
Nov 18 17:48:21 user nova-compute[74743]:         <nova:port uuid="0045eadc-4afc-4176-b629-567d68625689">
Nov 18 17:48:21 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 18 17:48:21 user nova-compute[74743]:         </nova:port>
Nov 18 17:48:21 user nova-compute[74743]:       </nova:ports>
Nov 18 17:48:21 user nova-compute[74743]:     </nova:instance>
Nov 18 17:48:21 user nova-compute[74743]:   </metadata>
Nov 18 17:48:21 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:48:21 user nova-compute[74743]:     <system>
Nov 18 17:48:21 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:48:21 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:48:21 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:48:21 user nova-compute[74743]:       <entry name="serial">8e73f77d-40ca-43d7-80ca-33ffda8583de</entry>
Nov 18 17:48:21 user nova-compute[74743]:       <entry name="uuid">8e73f77d-40ca-43d7-80ca-33ffda8583de</entry>
Nov 18 17:48:21 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:48:21 user nova-compute[74743]:     </system>
Nov 18 17:48:21 user nova-compute[74743]:   </sysinfo>
Nov 18 17:48:21 user nova-compute[74743]:   <os>
Nov 18 17:48:21 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:48:21 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:48:21 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:48:21 user nova-compute[74743]:   </os>
Nov 18 17:48:21 user nova-compute[74743]:   <features>
Nov 18 17:48:21 user nova-compute[74743]:     <acpi/>
Nov 18 17:48:21 user nova-compute[74743]:     <apic/>
Nov 18 17:48:21 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:48:21 user nova-compute[74743]:   </features>
Nov 18 17:48:21 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:48:21 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:48:21 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:48:21 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:48:21 user nova-compute[74743]:   </clock>
Nov 18 17:48:21 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:48:21 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:48:21 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:48:21 user nova-compute[74743]:   </cpu>
Nov 18 17:48:21 user nova-compute[74743]:   <devices>
Nov 18 17:48:21 user nova-compute[74743]:     <disk type="block" device="disk">
Nov 18 17:48:21 user nova-compute[74743]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:48:21 user nova-compute[74743]:       <source dev="/dev/sdb"/>
Nov 18 17:48:21 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:48:21 user nova-compute[74743]:       <serial>8d7d6f43-8314-410b-941b-c548291d2b6e</serial>
Nov 18 17:48:21 user nova-compute[74743]:     </disk>
Nov 18 17:48:21 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:48:21 user nova-compute[74743]:       <mac address="fa:16:3e:23:0a:17"/>
Nov 18 17:48:21 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:48:21 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:48:21 user nova-compute[74743]:       <target dev="tap0045eadc-4a"/>
Nov 18 17:48:21 user nova-compute[74743]:     </interface>
Nov 18 17:48:21 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:48:21 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/8e73f77d-40ca-43d7-80ca-33ffda8583de/console.log" append="off"/>
Nov 18 17:48:21 user nova-compute[74743]:     </serial>
Nov 18 17:48:21 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:48:21 user nova-compute[74743]:     <video>
Nov 18 17:48:21 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:48:21 user nova-compute[74743]:     </video>
Nov 18 17:48:21 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:48:21 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:48:21 user nova-compute[74743]:     </rng>
Nov 18 17:48:21 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:48:21 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:48:21 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:48:21 user nova-compute[74743]:     </memballoon>
Nov 18 17:48:21 user nova-compute[74743]:   </devices>
Nov 18 17:48:21 user nova-compute[74743]: </domain>
Nov 18 17:48:21 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:48:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-18T17:44:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1346766668',display_name='tempest-TestShelveInstance-server-1346766668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1346766668',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1062282570',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:44:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ec05d713c50b4049896c839299c8edcd',ramdisk_id='',reservation_id='r-83y4v011',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1526121326',owner_user_name='tempest-TestShelveInstance-1526121326-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:48:13Z,user_data=None,user_id='09337734209f48cbbc4670a3ffedf7e1',uuid=8e73f77d-40ca-43d7-80ca-33ffda8583de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0045eadc-4afc-4176-b629-567d68625689", "address": "fa:16:3e:23:0a:17", "network": {"id": "d47540e7-8348-419d-acc3-51b7a034b940", "bridge": "br-int", "label": "tempest-TestShelveInstance-1342322227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec05d713c50b4049896c839299c8edcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0045eadc-4a", "ovs_interfaceid": "0045eadc-4afc-4176-b629-567d68625689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:48:21 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Converting VIF {"id": "0045eadc-4afc-4176-b629-567d68625689", "address": "fa:16:3e:23:0a:17", "network": {"id": "d47540e7-8348-419d-acc3-51b7a034b940", "bridge": "br-int", "label": "tempest-TestShelveInstance-1342322227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec05d713c50b4049896c839299c8edcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0045eadc-4a", "ovs_interfaceid": "0045eadc-4afc-4176-b629-567d68625689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:48:21 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:0a:17,bridge_name='br-int',has_traffic_filtering=True,id=0045eadc-4afc-4176-b629-567d68625689,network=Network(d47540e7-8348-419d-acc3-51b7a034b940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0045eadc-4a') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:48:21 user nova-compute[74743]: DEBUG os_vif [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:0a:17,bridge_name='br-int',has_traffic_filtering=True,id=0045eadc-4afc-4176-b629-567d68625689,network=Network(d47540e7-8348-419d-acc3-51b7a034b940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0045eadc-4a') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:48:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:48:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:48:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:48:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:48:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '60ed27cd-75fa-5858-9986-7ba150c6ed94', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:48:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:48:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:48:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:48:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0045eadc-4a, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:48:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0045eadc-4a, col_values=(('qos', UUID('03f12c49-e1ee-41d1-8de3-a8491e4e85de')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:48:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0045eadc-4a, col_values=(('external_ids', {'iface-id': '0045eadc-4afc-4176-b629-567d68625689', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:0a:17', 'vm-uuid': '8e73f77d-40ca-43d7-80ca-33ffda8583de'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:48:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:48:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:48:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:48:21 user nova-compute[74743]: INFO os_vif [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:0a:17,bridge_name='br-int',has_traffic_filtering=True,id=0045eadc-4afc-4176-b629-567d68625689,network=Network(d47540e7-8348-419d-acc3-51b7a034b940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0045eadc-4a')
Nov 18 17:48:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:48:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] No VIF found with MAC fa:16:3e:23:0a:17, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:48:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:48:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:48:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:48:22 user nova-compute[74743]: DEBUG nova.compute.manager [req-aefeb460-c2ab-4844-a872-c8f4096e1d29 req-700f0c88-ed86-436a-9e37-8e10e49a3f50 service nova] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Received event network-vif-plugged-0045eadc-4afc-4176-b629-567d68625689 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:48:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-aefeb460-c2ab-4844-a872-c8f4096e1d29 req-700f0c88-ed86-436a-9e37-8e10e49a3f50 service nova] Acquiring lock "8e73f77d-40ca-43d7-80ca-33ffda8583de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:48:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-aefeb460-c2ab-4844-a872-c8f4096e1d29 req-700f0c88-ed86-436a-9e37-8e10e49a3f50 service nova] Lock "8e73f77d-40ca-43d7-80ca-33ffda8583de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:48:22 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-aefeb460-c2ab-4844-a872-c8f4096e1d29 req-700f0c88-ed86-436a-9e37-8e10e49a3f50 service nova] Lock "8e73f77d-40ca-43d7-80ca-33ffda8583de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:48:22 user nova-compute[74743]: DEBUG nova.compute.manager [req-aefeb460-c2ab-4844-a872-c8f4096e1d29 req-700f0c88-ed86-436a-9e37-8e10e49a3f50 service nova] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] No waiting events found dispatching network-vif-plugged-0045eadc-4afc-4176-b629-567d68625689 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:48:22 user nova-compute[74743]: WARNING nova.compute.manager [req-aefeb460-c2ab-4844-a872-c8f4096e1d29 req-700f0c88-ed86-436a-9e37-8e10e49a3f50 service nova] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Received unexpected event network-vif-plugged-0045eadc-4afc-4176-b629-567d68625689 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 18 17:48:23 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:48:23 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:48:23 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:48:23 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:48:24 user nova-compute[74743]: DEBUG nova.compute.manager [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:48:24 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Guest created on hypervisor {{(pid=74743) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 17:48:24 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Instance spawned successfully.
Nov 18 17:48:24 user nova-compute[74743]: DEBUG nova.compute.manager [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:48:24 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-69fe82b6-a239-40fc-9ef2-556cb28699b3 tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Lock "8e73f77d-40ca-43d7-80ca-33ffda8583de" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.995s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:48:24 user nova-compute[74743]: DEBUG nova.compute.manager [req-ea1b4f48-4b6d-404b-9052-39c9c37dc213 req-1e94f980-54dc-4d80-b946-3cc7d130b6d0 service nova] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Received event network-vif-plugged-0045eadc-4afc-4176-b629-567d68625689 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:48:24 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ea1b4f48-4b6d-404b-9052-39c9c37dc213 req-1e94f980-54dc-4d80-b946-3cc7d130b6d0 service nova] Acquiring lock "8e73f77d-40ca-43d7-80ca-33ffda8583de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:48:24 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ea1b4f48-4b6d-404b-9052-39c9c37dc213 req-1e94f980-54dc-4d80-b946-3cc7d130b6d0 service nova] Lock "8e73f77d-40ca-43d7-80ca-33ffda8583de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:48:24 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-ea1b4f48-4b6d-404b-9052-39c9c37dc213 req-1e94f980-54dc-4d80-b946-3cc7d130b6d0 service nova] Lock "8e73f77d-40ca-43d7-80ca-33ffda8583de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:48:24 user nova-compute[74743]: DEBUG nova.compute.manager [req-ea1b4f48-4b6d-404b-9052-39c9c37dc213 req-1e94f980-54dc-4d80-b946-3cc7d130b6d0 service nova] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] No waiting events found dispatching network-vif-plugged-0045eadc-4afc-4176-b629-567d68625689 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:48:24 user nova-compute[74743]: WARNING nova.compute.manager [req-ea1b4f48-4b6d-404b-9052-39c9c37dc213 req-1e94f980-54dc-4d80-b946-3cc7d130b6d0 service nova] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Received unexpected event network-vif-plugged-0045eadc-4afc-4176-b629-567d68625689 for instance with vm_state active and task_state None.
Nov 18 17:48:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:48:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:48:31 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:48:36 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:48:40 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:48:41 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:48:45 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:48:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:48:50 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:48:51 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:48:52 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:48:52 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74743) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 17:48:55 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:48:55 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:48:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:48:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:48:57 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:48:57 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:48:58 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:49:01 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:49:01 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:49:01 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74743) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 17:49:01 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:49:01 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:49:01 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:49:02 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:49:02 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:49:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:49:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:49:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:49:02 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Auditing locally available compute resources for user (node: user) {{(pid=74743) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 17:49:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:49:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:49:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:49:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:49:02 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:49:03 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:49:03 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:49:03 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Hypervisor/Node resource view: name=user free_ram=8778MB free_disk=25.238178253173828GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74743) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 17:49:03 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:49:03 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:49:03 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 9c90f34f-7bbf-40d9-8f65-983d91f0b51b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:49:03 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 8e73f77d-40ca-43d7-80ca-33ffda8583de actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:49:03 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 17:49:03 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 17:49:03 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:49:03 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:49:03 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Compute_service record updated for user:user {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 17:49:03 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.250s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:49:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:49:09 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:49:09 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Starting heal instance info cache {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 17:49:09 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Rebuilding the list of instances to heal {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 17:49:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "refresh_cache-9c90f34f-7bbf-40d9-8f65-983d91f0b51b" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:49:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquired lock "refresh_cache-9c90f34f-7bbf-40d9-8f65-983d91f0b51b" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:49:09 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Forcefully refreshing network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 17:49:09 user nova-compute[74743]: DEBUG nova.objects.instance [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lazy-loading 'info_cache' on Instance uuid 9c90f34f-7bbf-40d9-8f65-983d91f0b51b {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:49:10 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Updating instance_info_cache with network_info: [{"id": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "address": "fa:16:3e:08:2d:e8", "network": {"id": "7cf1258c-5feb-472e-9f3f-69d95360b050", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-628054528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "790f602c532d41289c52985c8fab91d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba5e67e-b4", "ovs_interfaceid": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:49:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Releasing lock "refresh_cache-9c90f34f-7bbf-40d9-8f65-983d91f0b51b" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:49:10 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Updated the network info_cache for instance {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 17:49:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:49:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-eb0b5ed5-2ab8-47fe-b877-90a9c75862a2 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Acquiring lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:49:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-eb0b5ed5-2ab8-47fe-b877-90a9c75862a2 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:49:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-eb0b5ed5-2ab8-47fe-b877-90a9c75862a2 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Acquiring lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:49:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-eb0b5ed5-2ab8-47fe-b877-90a9c75862a2 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:49:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-eb0b5ed5-2ab8-47fe-b877-90a9c75862a2 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:49:15 user nova-compute[74743]: INFO nova.compute.manager [None req-eb0b5ed5-2ab8-47fe-b877-90a9c75862a2 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Terminating instance
Nov 18 17:49:15 user nova-compute[74743]: DEBUG nova.compute.manager [None req-eb0b5ed5-2ab8-47fe-b877-90a9c75862a2 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Start destroying the instance on the hypervisor. {{(pid=74743) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 17:49:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:49:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:49:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:49:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:49:15 user nova-compute[74743]: DEBUG nova.compute.manager [req-604971b2-e189-40ad-912b-d720ec622c3a req-fa3003a2-27e6-447e-8d6f-b16c19df007d service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Received event network-vif-unplugged-6ba5e67e-b479-4371-89e3-97c1beceff8f {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:49:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-604971b2-e189-40ad-912b-d720ec622c3a req-fa3003a2-27e6-447e-8d6f-b16c19df007d service nova] Acquiring lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:49:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-604971b2-e189-40ad-912b-d720ec622c3a req-fa3003a2-27e6-447e-8d6f-b16c19df007d service nova] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:49:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-604971b2-e189-40ad-912b-d720ec622c3a req-fa3003a2-27e6-447e-8d6f-b16c19df007d service nova] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:49:15 user nova-compute[74743]: DEBUG nova.compute.manager [req-604971b2-e189-40ad-912b-d720ec622c3a req-fa3003a2-27e6-447e-8d6f-b16c19df007d service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] No waiting events found dispatching network-vif-unplugged-6ba5e67e-b479-4371-89e3-97c1beceff8f {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:49:15 user nova-compute[74743]: DEBUG nova.compute.manager [req-604971b2-e189-40ad-912b-d720ec622c3a req-fa3003a2-27e6-447e-8d6f-b16c19df007d service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Received event network-vif-unplugged-6ba5e67e-b479-4371-89e3-97c1beceff8f for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:49:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:49:15 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Instance destroyed successfully.
Nov 18 17:49:15 user nova-compute[74743]: DEBUG nova.objects.instance [None req-eb0b5ed5-2ab8-47fe-b877-90a9c75862a2 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lazy-loading 'resources' on Instance uuid 9c90f34f-7bbf-40d9-8f65-983d91f0b51b {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:49:15 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-eb0b5ed5-2ab8-47fe-b877-90a9c75862a2 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:39:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-412810144',display_name='tempest-AttachVolumeTestJSON-server-412810144',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-412810144',id=48,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLOX3vLKn4BPxKq/sYlRJyYxjQkfS7C5a3EAlzUWDWpfhN4MRLyKkuT1pXcPPcKSOXBLUqQkc/KRtoOHbZrTCC299l1ITOKXjAQISq5k9bKohMtNJ2/b6nyF5OqHILx6UA==',key_name='tempest-keypair-452329227',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:39:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='790f602c532d41289c52985c8fab91d4',ramdisk_id='',reservation_id='r-2otufkmn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1207996855',owner_user_name='tempest-AttachVolumeTestJSON-1207996855-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:47:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b9d8b543f4946b2918bd38c4a3c835f',uuid=9c90f34f-7bbf-40d9-8f65-983d91f0b51b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "address": "fa:16:3e:08:2d:e8", "network": {"id": "7cf1258c-5feb-472e-9f3f-69d95360b050", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-628054528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "790f602c532d41289c52985c8fab91d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba5e67e-b4", "ovs_interfaceid": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:49:15 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-eb0b5ed5-2ab8-47fe-b877-90a9c75862a2 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Converting VIF {"id": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "address": "fa:16:3e:08:2d:e8", "network": {"id": "7cf1258c-5feb-472e-9f3f-69d95360b050", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-628054528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "790f602c532d41289c52985c8fab91d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba5e67e-b4", "ovs_interfaceid": "6ba5e67e-b479-4371-89e3-97c1beceff8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:49:15 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-eb0b5ed5-2ab8-47fe-b877-90a9c75862a2 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:2d:e8,bridge_name='br-int',has_traffic_filtering=True,id=6ba5e67e-b479-4371-89e3-97c1beceff8f,network=Network(7cf1258c-5feb-472e-9f3f-69d95360b050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ba5e67e-b4') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:49:15 user nova-compute[74743]: DEBUG os_vif [None req-eb0b5ed5-2ab8-47fe-b877-90a9c75862a2 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:2d:e8,bridge_name='br-int',has_traffic_filtering=True,id=6ba5e67e-b479-4371-89e3-97c1beceff8f,network=Network(7cf1258c-5feb-472e-9f3f-69d95360b050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ba5e67e-b4') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:49:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:49:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6ba5e67e-b4, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:49:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:49:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:49:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:49:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=930e9597-b9c5-48dc-9bf9-de83247ab612) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:49:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:49:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:49:15 user nova-compute[74743]: INFO os_vif [None req-eb0b5ed5-2ab8-47fe-b877-90a9c75862a2 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:2d:e8,bridge_name='br-int',has_traffic_filtering=True,id=6ba5e67e-b479-4371-89e3-97c1beceff8f,network=Network(7cf1258c-5feb-472e-9f3f-69d95360b050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ba5e67e-b4')
Nov 18 17:49:15 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-eb0b5ed5-2ab8-47fe-b877-90a9c75862a2 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Deleting instance files /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b_del
Nov 18 17:49:15 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-eb0b5ed5-2ab8-47fe-b877-90a9c75862a2 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Deletion of /opt/stack/data/nova/instances/9c90f34f-7bbf-40d9-8f65-983d91f0b51b_del complete
Nov 18 17:49:15 user nova-compute[74743]: INFO nova.compute.manager [None req-eb0b5ed5-2ab8-47fe-b877-90a9c75862a2 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Took 0.66 seconds to destroy the instance on the hypervisor.
Nov 18 17:49:15 user nova-compute[74743]: DEBUG oslo.service.loopingcall [None req-eb0b5ed5-2ab8-47fe-b877-90a9c75862a2 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74743) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 17:49:15 user nova-compute[74743]: DEBUG nova.compute.manager [-] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Deallocating network for instance {{(pid=74743) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 17:49:15 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] deallocate_for_instance() {{(pid=74743) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 17:49:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:49:16 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:49:16 user nova-compute[74743]: INFO nova.compute.manager [-] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Took 0.73 seconds to deallocate network for instance.
Nov 18 17:49:16 user nova-compute[74743]: DEBUG nova.compute.manager [req-d695ab14-71fe-4086-9b46-a07a6b673c69 req-6b47d0ec-3818-425e-b884-5522749ab79b service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Received event network-vif-deleted-6ba5e67e-b479-4371-89e3-97c1beceff8f {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:49:16 user nova-compute[74743]: INFO nova.compute.manager [req-d695ab14-71fe-4086-9b46-a07a6b673c69 req-6b47d0ec-3818-425e-b884-5522749ab79b service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Neutron deleted interface 6ba5e67e-b479-4371-89e3-97c1beceff8f; detaching it from the instance and deleting it from the info cache
Nov 18 17:49:16 user nova-compute[74743]: DEBUG nova.network.neutron [req-d695ab14-71fe-4086-9b46-a07a6b673c69 req-6b47d0ec-3818-425e-b884-5522749ab79b service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:49:16 user nova-compute[74743]: DEBUG nova.compute.manager [req-d695ab14-71fe-4086-9b46-a07a6b673c69 req-6b47d0ec-3818-425e-b884-5522749ab79b service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Detach interface failed, port_id=6ba5e67e-b479-4371-89e3-97c1beceff8f, reason: Instance 9c90f34f-7bbf-40d9-8f65-983d91f0b51b could not be found. {{(pid=74743) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 17:49:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-eb0b5ed5-2ab8-47fe-b877-90a9c75862a2 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:49:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-eb0b5ed5-2ab8-47fe-b877-90a9c75862a2 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:49:16 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-eb0b5ed5-2ab8-47fe-b877-90a9c75862a2 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:49:16 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-eb0b5ed5-2ab8-47fe-b877-90a9c75862a2 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:49:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-eb0b5ed5-2ab8-47fe-b877-90a9c75862a2 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.127s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:49:16 user nova-compute[74743]: INFO nova.scheduler.client.report [None req-eb0b5ed5-2ab8-47fe-b877-90a9c75862a2 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Deleted allocations for instance 9c90f34f-7bbf-40d9-8f65-983d91f0b51b
Nov 18 17:49:16 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-eb0b5ed5-2ab8-47fe-b877-90a9c75862a2 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.704s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:49:17 user nova-compute[74743]: DEBUG nova.compute.manager [req-8a81b593-e7cb-42f7-bcb2-bd77de0433d5 req-b04d2b67-07c1-4cb5-95d9-17d7bd7edaf9 service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Received event network-vif-plugged-6ba5e67e-b479-4371-89e3-97c1beceff8f {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:49:17 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-8a81b593-e7cb-42f7-bcb2-bd77de0433d5 req-b04d2b67-07c1-4cb5-95d9-17d7bd7edaf9 service nova] Acquiring lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:49:17 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-8a81b593-e7cb-42f7-bcb2-bd77de0433d5 req-b04d2b67-07c1-4cb5-95d9-17d7bd7edaf9 service nova] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:49:17 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-8a81b593-e7cb-42f7-bcb2-bd77de0433d5 req-b04d2b67-07c1-4cb5-95d9-17d7bd7edaf9 service nova] Lock "9c90f34f-7bbf-40d9-8f65-983d91f0b51b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:49:17 user nova-compute[74743]: DEBUG nova.compute.manager [req-8a81b593-e7cb-42f7-bcb2-bd77de0433d5 req-b04d2b67-07c1-4cb5-95d9-17d7bd7edaf9 service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] No waiting events found dispatching network-vif-plugged-6ba5e67e-b479-4371-89e3-97c1beceff8f {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:49:17 user nova-compute[74743]: WARNING nova.compute.manager [req-8a81b593-e7cb-42f7-bcb2-bd77de0433d5 req-b04d2b67-07c1-4cb5-95d9-17d7bd7edaf9 service nova] [instance: 9c90f34f-7bbf-40d9-8f65-983d91f0b51b] Received unexpected event network-vif-plugged-6ba5e67e-b479-4371-89e3-97c1beceff8f for instance with vm_state deleted and task_state None.
Nov 18 17:49:20 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:49:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:49:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:49:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74743) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 17:49:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:49:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:49:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:49:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:49:35 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:49:40 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:49:45 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:49:50 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:49:54 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:49:54 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74743) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 17:49:55 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:49:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:49:56 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:49:58 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:49:58 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:49:59 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:50:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:50:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:50:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74743) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 17:50:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:50:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:50:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:50:03 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:50:03 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:50:03 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:50:03 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:50:03 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Auditing locally available compute resources for user (node: user) {{(pid=74743) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 17:50:03 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74743) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 17:50:03 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:50:03 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:50:03 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:50:03 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Hypervisor/Node resource view: name=user free_ram=8914MB free_disk=25.265628814697266GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74743) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 17:50:03 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:50:03 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:50:04 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 8e73f77d-40ca-43d7-80ca-33ffda8583de actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:50:04 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 17:50:04 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 17:50:04 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Refreshing inventories for resource provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 18 17:50:04 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Updating ProviderTree inventory for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 18 17:50:04 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Updating inventory in ProviderTree for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 18 17:50:04 user nova-compute[74743]: DEBUG nova.compute.manager [req-52f53419-45a6-44d7-a6a7-f006d6ae1930 req-d484c273-a3d0-4aaa-8826-02f4cce0243c service nova] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Received event network-changed-0045eadc-4afc-4176-b629-567d68625689 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:50:04 user nova-compute[74743]: DEBUG nova.compute.manager [req-52f53419-45a6-44d7-a6a7-f006d6ae1930 req-d484c273-a3d0-4aaa-8826-02f4cce0243c service nova] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Refreshing instance network info cache due to event network-changed-0045eadc-4afc-4176-b629-567d68625689. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:50:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-52f53419-45a6-44d7-a6a7-f006d6ae1930 req-d484c273-a3d0-4aaa-8826-02f4cce0243c service nova] Acquiring lock "refresh_cache-8e73f77d-40ca-43d7-80ca-33ffda8583de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:50:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-52f53419-45a6-44d7-a6a7-f006d6ae1930 req-d484c273-a3d0-4aaa-8826-02f4cce0243c service nova] Acquired lock "refresh_cache-8e73f77d-40ca-43d7-80ca-33ffda8583de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:50:04 user nova-compute[74743]: DEBUG nova.network.neutron [req-52f53419-45a6-44d7-a6a7-f006d6ae1930 req-d484c273-a3d0-4aaa-8826-02f4cce0243c service nova] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Refreshing network info cache for port 0045eadc-4afc-4176-b629-567d68625689 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:50:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ea00d2ef-ba48-498a-9cf1-1070a572c18f tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Acquiring lock "8e73f77d-40ca-43d7-80ca-33ffda8583de" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:50:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ea00d2ef-ba48-498a-9cf1-1070a572c18f tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Lock "8e73f77d-40ca-43d7-80ca-33ffda8583de" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:50:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ea00d2ef-ba48-498a-9cf1-1070a572c18f tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Acquiring lock "8e73f77d-40ca-43d7-80ca-33ffda8583de-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:50:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ea00d2ef-ba48-498a-9cf1-1070a572c18f tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Lock "8e73f77d-40ca-43d7-80ca-33ffda8583de-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:50:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ea00d2ef-ba48-498a-9cf1-1070a572c18f tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Lock "8e73f77d-40ca-43d7-80ca-33ffda8583de-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:50:04 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Refreshing aggregate associations for resource provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8, aggregates: None {{(pid=74743) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 18 17:50:04 user nova-compute[74743]: INFO nova.compute.manager [None req-ea00d2ef-ba48-498a-9cf1-1070a572c18f tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Terminating instance
Nov 18 17:50:04 user nova-compute[74743]: DEBUG nova.compute.manager [None req-ea00d2ef-ba48-498a-9cf1-1070a572c18f tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Start destroying the instance on the hypervisor. {{(pid=74743) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 17:50:04 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Refreshing trait associations for resource provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=74743) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 18 17:50:04 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:50:04 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:50:04 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:50:04 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:50:04 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:50:04 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Compute_service record updated for user:user {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 17:50:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.405s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:50:04 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:50:04 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:50:04 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Cleaning up deleted instances {{(pid=74743) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 18 17:50:04 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] There are 0 instances to clean {{(pid=74743) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 18 17:50:04 user nova-compute[74743]: DEBUG nova.compute.manager [req-e3db42c5-d93f-4b48-a550-fdaa26945e8e req-21366b39-5855-4bf3-ba71-2bbe5b975186 service nova] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Received event network-vif-unplugged-0045eadc-4afc-4176-b629-567d68625689 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:50:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e3db42c5-d93f-4b48-a550-fdaa26945e8e req-21366b39-5855-4bf3-ba71-2bbe5b975186 service nova] Acquiring lock "8e73f77d-40ca-43d7-80ca-33ffda8583de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:50:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e3db42c5-d93f-4b48-a550-fdaa26945e8e req-21366b39-5855-4bf3-ba71-2bbe5b975186 service nova] Lock "8e73f77d-40ca-43d7-80ca-33ffda8583de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:50:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-e3db42c5-d93f-4b48-a550-fdaa26945e8e req-21366b39-5855-4bf3-ba71-2bbe5b975186 service nova] Lock "8e73f77d-40ca-43d7-80ca-33ffda8583de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:50:04 user nova-compute[74743]: DEBUG nova.compute.manager [req-e3db42c5-d93f-4b48-a550-fdaa26945e8e req-21366b39-5855-4bf3-ba71-2bbe5b975186 service nova] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] No waiting events found dispatching network-vif-unplugged-0045eadc-4afc-4176-b629-567d68625689 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:50:04 user nova-compute[74743]: DEBUG nova.compute.manager [req-e3db42c5-d93f-4b48-a550-fdaa26945e8e req-21366b39-5855-4bf3-ba71-2bbe5b975186 service nova] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Received event network-vif-unplugged-0045eadc-4afc-4176-b629-567d68625689 for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:50:04 user nova-compute[74743]: DEBUG nova.network.neutron [req-52f53419-45a6-44d7-a6a7-f006d6ae1930 req-d484c273-a3d0-4aaa-8826-02f4cce0243c service nova] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Updated VIF entry in instance network info cache for port 0045eadc-4afc-4176-b629-567d68625689. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:50:04 user nova-compute[74743]: DEBUG nova.network.neutron [req-52f53419-45a6-44d7-a6a7-f006d6ae1930 req-d484c273-a3d0-4aaa-8826-02f4cce0243c service nova] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Updating instance_info_cache with network_info: [{"id": "0045eadc-4afc-4176-b629-567d68625689", "address": "fa:16:3e:23:0a:17", "network": {"id": "d47540e7-8348-419d-acc3-51b7a034b940", "bridge": "br-int", "label": "tempest-TestShelveInstance-1342322227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec05d713c50b4049896c839299c8edcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0045eadc-4a", "ovs_interfaceid": "0045eadc-4afc-4176-b629-567d68625689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:50:04 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-52f53419-45a6-44d7-a6a7-f006d6ae1930 req-d484c273-a3d0-4aaa-8826-02f4cce0243c service nova] Releasing lock "refresh_cache-8e73f77d-40ca-43d7-80ca-33ffda8583de" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:50:04 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Instance destroyed successfully.
Nov 18 17:50:04 user nova-compute[74743]: DEBUG nova.objects.instance [None req-ea00d2ef-ba48-498a-9cf1-1070a572c18f tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Lazy-loading 'resources' on Instance uuid 8e73f77d-40ca-43d7-80ca-33ffda8583de {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:50:04 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-ea00d2ef-ba48-498a-9cf1-1070a572c18f tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-18T17:44:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1346766668',display_name='tempest-TestShelveInstance-server-1346766668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1346766668',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7aYbhvlbM1cToEexq8kd0tHLbcKOWu0Vj54xJXYDV2+2rqruzg+wTTJX04FpFBnB8ox38G88mO/CnhyhIoTsX1UlyKi/yZuLqTCXuUbf+LXRD8anyhwVVR9+pQHu6pYw==',key_name='tempest-TestShelveInstance-1062282570',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:48:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ec05d713c50b4049896c839299c8edcd',ramdisk_id='',reservation_id='r-83y4v011',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1526121326',owner_user_name='tempest-TestShelveInstance-1526121326-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:48:25Z,user_data=None,user_id='09337734209f48cbbc4670a3ffedf7e1',uuid=8e73f77d-40ca-43d7-80ca-33ffda8583de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0045eadc-4afc-4176-b629-567d68625689", "address": "fa:16:3e:23:0a:17", "network": {"id": "d47540e7-8348-419d-acc3-51b7a034b940", "bridge": "br-int", "label": "tempest-TestShelveInstance-1342322227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec05d713c50b4049896c839299c8edcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0045eadc-4a", "ovs_interfaceid": "0045eadc-4afc-4176-b629-567d68625689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:50:04 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-ea00d2ef-ba48-498a-9cf1-1070a572c18f tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Converting VIF {"id": "0045eadc-4afc-4176-b629-567d68625689", "address": "fa:16:3e:23:0a:17", "network": {"id": "d47540e7-8348-419d-acc3-51b7a034b940", "bridge": "br-int", "label": "tempest-TestShelveInstance-1342322227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec05d713c50b4049896c839299c8edcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0045eadc-4a", "ovs_interfaceid": "0045eadc-4afc-4176-b629-567d68625689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:50:04 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-ea00d2ef-ba48-498a-9cf1-1070a572c18f tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:0a:17,bridge_name='br-int',has_traffic_filtering=True,id=0045eadc-4afc-4176-b629-567d68625689,network=Network(d47540e7-8348-419d-acc3-51b7a034b940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0045eadc-4a') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:50:04 user nova-compute[74743]: DEBUG os_vif [None req-ea00d2ef-ba48-498a-9cf1-1070a572c18f tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:0a:17,bridge_name='br-int',has_traffic_filtering=True,id=0045eadc-4afc-4176-b629-567d68625689,network=Network(d47540e7-8348-419d-acc3-51b7a034b940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0045eadc-4a') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:50:04 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:50:04 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0045eadc-4a, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:50:04 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:50:04 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:50:04 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=03f12c49-e1ee-41d1-8de3-a8491e4e85de) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:50:05 user nova-compute[74743]: INFO os_vif [None req-ea00d2ef-ba48-498a-9cf1-1070a572c18f tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:0a:17,bridge_name='br-int',has_traffic_filtering=True,id=0045eadc-4afc-4176-b629-567d68625689,network=Network(d47540e7-8348-419d-acc3-51b7a034b940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0045eadc-4a')
Nov 18 17:50:05 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea00d2ef-ba48-498a-9cf1-1070a572c18f tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] calling os-brick to detach iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea00d2ef-ba48-498a-9cf1-1070a572c18f tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, {'target_iqn': 'iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BfRFxQla', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:50:05 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-ea00d2ef-ba48-498a-9cf1-1070a572c18f tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:50:05 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-ea00d2ef-ba48-498a-9cf1-1070a572c18f tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-ea00d2ef-ba48-498a-9cf1-1070a572c18f tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65bf177-c1f2-4b25-ac3c-9ec364c30160]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea00d2ef-ba48-498a-9cf1-1070a572c18f tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 17:50:05 user nova-compute[74743]: No targets found.
Nov 18 17:50:05 user nova-compute[74743]: iSNS:
Nov 18 17:50:05 user nova-compute[74743]: No targets found.
Nov 18 17:50:05 user nova-compute[74743]: STATIC:
Nov 18 17:50:05 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e
Nov 18 17:50:05 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:50:05 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:50:05 user nova-compute[74743]: FIRMWARE:
Nov 18 17:50:05 user nova-compute[74743]: No targets found.
Nov 18 17:50:05 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea00d2ef-ba48-498a-9cf1-1070a572c18f tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 17:50:05 user nova-compute[74743]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 17:50:05 user nova-compute[74743]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74743) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea00d2ef-ba48-498a-9cf1-1070a572c18f tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e', 0)] {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a08ed1-5edb-476f-bd1d-275931ada405]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[20042398-e0eb-4e6e-89c9-01305cb0a3bc]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea00d2ef-ba48-498a-9cf1-1070a572c18f tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e (non-flash)
Nov 18 17:50:05 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea00d2ef-ba48-498a-9cf1-1070a572c18f tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e (non-flash)
Nov 18 17:50:05 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea00d2ef-ba48-498a-9cf1-1070a572c18f tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb082ef1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e'): ({'sdb'}, set())}) {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-ea00d2ef-ba48-498a-9cf1-1070a572c18f tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Removing single pathed devices sdb {{(pid=74743) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3297a37-208f-4454-a2c9-8d19e771418c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[f791de71-1ad6-4424-a0bc-49ae59324d88]: (4, ('ok\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-ea00d2ef-ba48-498a-9cf1-1070a572c18f tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Flushing IO for device /dev/sdb {{(pid=74743) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6b66b4-baf9-4b24-b33e-a286f9ea7185]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-ea00d2ef-ba48-498a-9cf1-1070a572c18f tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74743) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[069d39b6-a798-4d35-bf66-c2abfec6428c]: (4, ('1', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-ea00d2ef-ba48-498a-9cf1-1070a572c18f tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-ea00d2ef-ba48-498a-9cf1-1070a572c18f tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] SCSI volumes sdb have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_20e713a1', '/dev/disk/by-id/scsi-1SCST_BIO20e713a1-cca890b4ebd6bc7a', '/dev/disk/by-id/scsi-26363613839306234') {{(pid=85244) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[76717105-1033-4f5b-a09b-f1f5a48862e1]: (4, None) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea00d2ef-ba48-498a-9cf1-1070a572c18f tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e')] {{(pid=74743) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[86fab6dd-fc9c-49ca-8152-5ecaf2912b3e]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea00d2ef-ba48-498a-9cf1-1070a572c18f tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e -p 172.16.0.220:3260 --logout {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[736d4549-c077-4c70-a9d6-73b0d83f371c]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea00d2ef-ba48-498a-9cf1-1070a572c18f tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e, portal: 172.16.0.220,3260]
Nov 18 17:50:05 user nova-compute[74743]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e, portal: 172.16.0.220,3260] successful.
Nov 18 17:50:05 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e -p 172.16.0.220:3260 --op delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d7d6f43-8314-410b-941b-c548291d2b6e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3afadb-cfa2-4497-ac5f-83d652b9060a]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea00d2ef-ba48-498a-9cf1-1070a572c18f tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-ea00d2ef-ba48-498a-9cf1-1070a572c18f tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea00d2ef-ba48-498a-9cf1-1070a572c18f tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] <== disconnect_volume: return (308ms) None {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea00d2ef-ba48-498a-9cf1-1070a572c18f tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Disconnected iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 17:50:05 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-ea00d2ef-ba48-498a-9cf1-1070a572c18f tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Deleting instance files /opt/stack/data/nova/instances/8e73f77d-40ca-43d7-80ca-33ffda8583de_del
Nov 18 17:50:05 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-ea00d2ef-ba48-498a-9cf1-1070a572c18f tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Deletion of /opt/stack/data/nova/instances/8e73f77d-40ca-43d7-80ca-33ffda8583de_del complete
Nov 18 17:50:05 user nova-compute[74743]: INFO nova.compute.manager [None req-ea00d2ef-ba48-498a-9cf1-1070a572c18f tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 18 17:50:05 user nova-compute[74743]: DEBUG oslo.service.loopingcall [None req-ea00d2ef-ba48-498a-9cf1-1070a572c18f tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74743) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG nova.compute.manager [-] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Deallocating network for instance {{(pid=74743) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] deallocate_for_instance() {{(pid=74743) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 17:50:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:50:06 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:50:06 user nova-compute[74743]: INFO nova.compute.manager [-] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Took 0.70 seconds to deallocate network for instance.
Nov 18 17:50:06 user nova-compute[74743]: DEBUG nova.compute.manager [req-0706399d-4622-40e5-a6fd-b47d8a22d4c7 req-c5abf00e-a8ff-4888-b414-1eface5c5a5c service nova] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Received event network-vif-deleted-0045eadc-4afc-4176-b629-567d68625689 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:50:06 user nova-compute[74743]: INFO nova.compute.manager [req-0706399d-4622-40e5-a6fd-b47d8a22d4c7 req-c5abf00e-a8ff-4888-b414-1eface5c5a5c service nova] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Neutron deleted interface 0045eadc-4afc-4176-b629-567d68625689; detaching it from the instance and deleting it from the info cache
Nov 18 17:50:06 user nova-compute[74743]: DEBUG nova.network.neutron [req-0706399d-4622-40e5-a6fd-b47d8a22d4c7 req-c5abf00e-a8ff-4888-b414-1eface5c5a5c service nova] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:50:06 user nova-compute[74743]: DEBUG nova.compute.manager [req-0706399d-4622-40e5-a6fd-b47d8a22d4c7 req-c5abf00e-a8ff-4888-b414-1eface5c5a5c service nova] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Detach interface failed, port_id=0045eadc-4afc-4176-b629-567d68625689, reason: Instance 8e73f77d-40ca-43d7-80ca-33ffda8583de could not be found. {{(pid=74743) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 17:50:06 user nova-compute[74743]: DEBUG nova.compute.manager [req-42474cd8-0058-4f85-9044-df4145f629d3 req-70e78d52-c8ae-48a0-b244-9150d168fcfd service nova] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Received event network-vif-plugged-0045eadc-4afc-4176-b629-567d68625689 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:50:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-42474cd8-0058-4f85-9044-df4145f629d3 req-70e78d52-c8ae-48a0-b244-9150d168fcfd service nova] Acquiring lock "8e73f77d-40ca-43d7-80ca-33ffda8583de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:50:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-42474cd8-0058-4f85-9044-df4145f629d3 req-70e78d52-c8ae-48a0-b244-9150d168fcfd service nova] Lock "8e73f77d-40ca-43d7-80ca-33ffda8583de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:50:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-42474cd8-0058-4f85-9044-df4145f629d3 req-70e78d52-c8ae-48a0-b244-9150d168fcfd service nova] Lock "8e73f77d-40ca-43d7-80ca-33ffda8583de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:50:06 user nova-compute[74743]: DEBUG nova.compute.manager [req-42474cd8-0058-4f85-9044-df4145f629d3 req-70e78d52-c8ae-48a0-b244-9150d168fcfd service nova] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] No waiting events found dispatching network-vif-plugged-0045eadc-4afc-4176-b629-567d68625689 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:50:06 user nova-compute[74743]: WARNING nova.compute.manager [req-42474cd8-0058-4f85-9044-df4145f629d3 req-70e78d52-c8ae-48a0-b244-9150d168fcfd service nova] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Received unexpected event network-vif-plugged-0045eadc-4afc-4176-b629-567d68625689 for instance with vm_state active and task_state deleting.
Nov 18 17:50:06 user nova-compute[74743]: INFO nova.compute.manager [None req-ea00d2ef-ba48-498a-9cf1-1070a572c18f tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Took 0.77 seconds to detach 1 volumes for instance.
Nov 18 17:50:06 user nova-compute[74743]: DEBUG nova.compute.manager [None req-ea00d2ef-ba48-498a-9cf1-1070a572c18f tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] [instance: 8e73f77d-40ca-43d7-80ca-33ffda8583de] Deleting volume: 8d7d6f43-8314-410b-941b-c548291d2b6e {{(pid=74743) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 18 17:50:07 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ea00d2ef-ba48-498a-9cf1-1070a572c18f tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:50:07 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ea00d2ef-ba48-498a-9cf1-1070a572c18f tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:50:07 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-ea00d2ef-ba48-498a-9cf1-1070a572c18f tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:50:07 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-ea00d2ef-ba48-498a-9cf1-1070a572c18f tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:50:07 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ea00d2ef-ba48-498a-9cf1-1070a572c18f tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.110s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:50:07 user nova-compute[74743]: INFO nova.scheduler.client.report [None req-ea00d2ef-ba48-498a-9cf1-1070a572c18f tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Deleted allocations for instance 8e73f77d-40ca-43d7-80ca-33ffda8583de
Nov 18 17:50:07 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-ea00d2ef-ba48-498a-9cf1-1070a572c18f tempest-TestShelveInstance-1526121326 tempest-TestShelveInstance-1526121326-project-member] Lock "8e73f77d-40ca-43d7-80ca-33ffda8583de" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.021s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:50:08 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:50:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Acquiring lock "668be004-de85-4eb4-9037-1b232245c561" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:50:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "668be004-de85-4eb4-9037-1b232245c561" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:50:09 user nova-compute[74743]: DEBUG nova.compute.manager [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 668be004-de85-4eb4-9037-1b232245c561] Starting instance... {{(pid=74743) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 17:50:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:50:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:50:09 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74743) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 17:50:09 user nova-compute[74743]: INFO nova.compute.claims [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 668be004-de85-4eb4-9037-1b232245c561] Claim successful on node user
Nov 18 17:50:09 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:50:09 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:50:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.197s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:50:09 user nova-compute[74743]: DEBUG nova.compute.manager [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 668be004-de85-4eb4-9037-1b232245c561] Start building networks asynchronously for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 17:50:09 user nova-compute[74743]: DEBUG nova.compute.manager [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 668be004-de85-4eb4-9037-1b232245c561] Allocating IP information in the background. {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 17:50:09 user nova-compute[74743]: DEBUG nova.network.neutron [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 668be004-de85-4eb4-9037-1b232245c561] allocate_for_instance() {{(pid=74743) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 17:50:09 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 668be004-de85-4eb4-9037-1b232245c561] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 17:50:09 user nova-compute[74743]: DEBUG nova.compute.manager [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 668be004-de85-4eb4-9037-1b232245c561] Start building block device mappings for instance. {{(pid=74743) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 17:50:09 user nova-compute[74743]: DEBUG nova.policy [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8b9d8b543f4946b2918bd38c4a3c835f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790f602c532d41289c52985c8fab91d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74743) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 17:50:09 user nova-compute[74743]: DEBUG nova.compute.manager [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 668be004-de85-4eb4-9037-1b232245c561] Start spawning the instance on the hypervisor. {{(pid=74743) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 17:50:09 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 668be004-de85-4eb4-9037-1b232245c561] Creating instance directory {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 17:50:09 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 668be004-de85-4eb4-9037-1b232245c561] Creating image(s)
Nov 18 17:50:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Acquiring lock "/opt/stack/data/nova/instances/668be004-de85-4eb4-9037-1b232245c561/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:50:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "/opt/stack/data/nova/instances/668be004-de85-4eb4-9037-1b232245c561/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:50:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "/opt/stack/data/nova/instances/668be004-de85-4eb4-9037-1b232245c561/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:50:09 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:50:09 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.173s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:50:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Acquiring lock "c188b3a997bfafa42fa341f9dcc326545681eed9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:50:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:50:09 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:50:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:50:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.177s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:50:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/668be004-de85-4eb4-9037-1b232245c561/disk 1073741824 {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:50:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9,backing_fmt=raw /opt/stack/data/nova/instances/668be004-de85-4eb4-9037-1b232245c561/disk 1073741824" returned: 0 in 0.057s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:50:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "c188b3a997bfafa42fa341f9dcc326545681eed9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:50:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:50:10 user nova-compute[74743]: DEBUG nova.network.neutron [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 668be004-de85-4eb4-9037-1b232245c561] Successfully created port: a69113f5-77da-415b-8738-f46c120221c1 {{(pid=74743) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 17:50:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c188b3a997bfafa42fa341f9dcc326545681eed9 --force-share --output=json" returned: 0 in 0.181s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:50:10 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Checking if we can resize image /opt/stack/data/nova/instances/668be004-de85-4eb4-9037-1b232245c561/disk. size=1073741824 {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 17:50:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668be004-de85-4eb4-9037-1b232245c561/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:50:10 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668be004-de85-4eb4-9037-1b232245c561/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:50:10 user nova-compute[74743]: DEBUG nova.virt.disk.api [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Cannot resize image /opt/stack/data/nova/instances/668be004-de85-4eb4-9037-1b232245c561/disk to a smaller size. {{(pid=74743) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 17:50:10 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 668be004-de85-4eb4-9037-1b232245c561] Created local disks {{(pid=74743) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 17:50:10 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 668be004-de85-4eb4-9037-1b232245c561] Ensure instance console log exists: /opt/stack/data/nova/instances/668be004-de85-4eb4-9037-1b232245c561/console.log {{(pid=74743) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 17:50:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:50:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:50:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:50:10 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:50:10 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Starting heal instance info cache {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 17:50:10 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Didn't find any instances for network info cache update. {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 18 17:50:10 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:50:10 user nova-compute[74743]: DEBUG nova.network.neutron [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 668be004-de85-4eb4-9037-1b232245c561] Successfully updated port: a69113f5-77da-415b-8738-f46c120221c1 {{(pid=74743) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 17:50:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Acquiring lock "refresh_cache-668be004-de85-4eb4-9037-1b232245c561" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:50:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Acquired lock "refresh_cache-668be004-de85-4eb4-9037-1b232245c561" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:50:10 user nova-compute[74743]: DEBUG nova.network.neutron [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 668be004-de85-4eb4-9037-1b232245c561] Building network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 17:50:10 user nova-compute[74743]: DEBUG nova.compute.manager [req-fc3ce233-086c-4163-9263-f1b5c69a9e9c req-d6d27d9c-e4f2-46ab-aadb-af1faffd5a5c service nova] [instance: 668be004-de85-4eb4-9037-1b232245c561] Received event network-changed-a69113f5-77da-415b-8738-f46c120221c1 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:50:10 user nova-compute[74743]: DEBUG nova.compute.manager [req-fc3ce233-086c-4163-9263-f1b5c69a9e9c req-d6d27d9c-e4f2-46ab-aadb-af1faffd5a5c service nova] [instance: 668be004-de85-4eb4-9037-1b232245c561] Refreshing instance network info cache due to event network-changed-a69113f5-77da-415b-8738-f46c120221c1. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:50:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-fc3ce233-086c-4163-9263-f1b5c69a9e9c req-d6d27d9c-e4f2-46ab-aadb-af1faffd5a5c service nova] Acquiring lock "refresh_cache-668be004-de85-4eb4-9037-1b232245c561" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:50:10 user nova-compute[74743]: DEBUG nova.network.neutron [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 668be004-de85-4eb4-9037-1b232245c561] Instance cache missing network info. {{(pid=74743) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 17:50:11 user nova-compute[74743]: DEBUG nova.network.neutron [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 668be004-de85-4eb4-9037-1b232245c561] Updating instance_info_cache with network_info: [{"id": "a69113f5-77da-415b-8738-f46c120221c1", "address": "fa:16:3e:2b:89:d7", "network": {"id": "7cf1258c-5feb-472e-9f3f-69d95360b050", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-628054528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "790f602c532d41289c52985c8fab91d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa69113f5-77", "ovs_interfaceid": "a69113f5-77da-415b-8738-f46c120221c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:50:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Releasing lock "refresh_cache-668be004-de85-4eb4-9037-1b232245c561" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:50:11 user nova-compute[74743]: DEBUG nova.compute.manager [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 668be004-de85-4eb4-9037-1b232245c561] Instance network_info: |[{"id": "a69113f5-77da-415b-8738-f46c120221c1", "address": "fa:16:3e:2b:89:d7", "network": {"id": "7cf1258c-5feb-472e-9f3f-69d95360b050", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-628054528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "790f602c532d41289c52985c8fab91d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa69113f5-77", "ovs_interfaceid": "a69113f5-77da-415b-8738-f46c120221c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74743) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 17:50:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-fc3ce233-086c-4163-9263-f1b5c69a9e9c req-d6d27d9c-e4f2-46ab-aadb-af1faffd5a5c service nova] Acquired lock "refresh_cache-668be004-de85-4eb4-9037-1b232245c561" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:50:11 user nova-compute[74743]: DEBUG nova.network.neutron [req-fc3ce233-086c-4163-9263-f1b5c69a9e9c req-d6d27d9c-e4f2-46ab-aadb-af1faffd5a5c service nova] [instance: 668be004-de85-4eb4-9037-1b232245c561] Refreshing network info cache for port a69113f5-77da-415b-8738-f46c120221c1 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:50:11 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 668be004-de85-4eb4-9037-1b232245c561] Start _get_guest_xml network_info=[{"id": "a69113f5-77da-415b-8738-f46c120221c1", "address": "fa:16:3e:2b:89:d7", "network": {"id": "7cf1258c-5feb-472e-9f3f-69d95360b050", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-628054528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "790f602c532d41289c52985c8fab91d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa69113f5-77", "ovs_interfaceid": "a69113f5-77da-415b-8738-f46c120221c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '9536f6cf-95c4-40e2-864a-09a91525678a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 17:50:11 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:50:11 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:50:11 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 17:50:11 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] CPU controller missing on host. {{(pid=74743) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 17:50:11 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 17:50:11 user nova-compute[74743]: DEBUG nova.virt.libvirt.host [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] CPU controller found on host. {{(pid=74743) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 17:50:11 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74743) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 17:50:11 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T16:59:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:59:39Z,direct_url=<?>,disk_format='qcow2',id=9536f6cf-95c4-40e2-864a-09a91525678a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e135c3aa00df41149fab95db3d88532f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:59:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 17:50:11 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Flavor limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 17:50:11 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Image limits 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 17:50:11 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Flavor pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 17:50:11 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Image pref 0:0:0 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 17:50:11 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 17:50:11 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 17:50:11 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 17:50:11 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Got 1 possible topologies {{(pid=74743) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 17:50:11 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 17:50:11 user nova-compute[74743]: DEBUG nova.virt.hardware [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74743) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 17:50:11 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:50:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-70674154',display_name='tempest-AttachVolumeTestJSON-server-70674154',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-70674154',id=51,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+iv0TJ3kWY7P7r3h9yOxtBVyXtBugt+Qu78sfKg/4ijI+YTuFuq0BIMmHIdHbkxSDRUjIJE/6/ZlFzlGEj15fgt1hRwmzv2sOeENIMlV8T1Mr7IsUBtZc8Gr7TO5FvWw==',key_name='tempest-keypair-700447340',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='790f602c532d41289c52985c8fab91d4',ramdisk_id='',reservation_id='r-5w81mvye',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1207996855',owner_user_name='tempest-AttachVolumeTestJSON-1207996855-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:50:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b9d8b543f4946b2918bd38c4a3c835f',uuid=668be004-de85-4eb4-9037-1b232245c561,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a69113f5-77da-415b-8738-f46c120221c1", "address": "fa:16:3e:2b:89:d7", "network": {"id": "7cf1258c-5feb-472e-9f3f-69d95360b050", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-628054528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "790f602c532d41289c52985c8fab91d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa69113f5-77", "ovs_interfaceid": "a69113f5-77da-415b-8738-f46c120221c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74743) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 17:50:11 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Converting VIF {"id": "a69113f5-77da-415b-8738-f46c120221c1", "address": "fa:16:3e:2b:89:d7", "network": {"id": "7cf1258c-5feb-472e-9f3f-69d95360b050", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-628054528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "790f602c532d41289c52985c8fab91d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa69113f5-77", "ovs_interfaceid": "a69113f5-77da-415b-8738-f46c120221c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:50:11 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:89:d7,bridge_name='br-int',has_traffic_filtering=True,id=a69113f5-77da-415b-8738-f46c120221c1,network=Network(7cf1258c-5feb-472e-9f3f-69d95360b050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa69113f5-77') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:50:11 user nova-compute[74743]: DEBUG nova.objects.instance [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lazy-loading 'pci_devices' on Instance uuid 668be004-de85-4eb4-9037-1b232245c561 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:50:11 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 668be004-de85-4eb4-9037-1b232245c561] End _get_guest_xml xml=<domain type="kvm">
Nov 18 17:50:11 user nova-compute[74743]:   <uuid>668be004-de85-4eb4-9037-1b232245c561</uuid>
Nov 18 17:50:11 user nova-compute[74743]:   <name>instance-00000033</name>
Nov 18 17:50:11 user nova-compute[74743]:   <memory>524288</memory>
Nov 18 17:50:11 user nova-compute[74743]:   <vcpu>1</vcpu>
Nov 18 17:50:11 user nova-compute[74743]:   <metadata>
Nov 18 17:50:11 user nova-compute[74743]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 17:50:11 user nova-compute[74743]:       <nova:package version="0.0.0"/>
Nov 18 17:50:11 user nova-compute[74743]:       <nova:name>tempest-AttachVolumeTestJSON-server-70674154</nova:name>
Nov 18 17:50:11 user nova-compute[74743]:       <nova:creationTime>2023-11-18 17:50:11</nova:creationTime>
Nov 18 17:50:11 user nova-compute[74743]:       <nova:flavor name="m1.tiny">
Nov 18 17:50:11 user nova-compute[74743]:         <nova:memory>512</nova:memory>
Nov 18 17:50:11 user nova-compute[74743]:         <nova:disk>1</nova:disk>
Nov 18 17:50:11 user nova-compute[74743]:         <nova:swap>0</nova:swap>
Nov 18 17:50:11 user nova-compute[74743]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 17:50:11 user nova-compute[74743]:         <nova:vcpus>1</nova:vcpus>
Nov 18 17:50:11 user nova-compute[74743]:       </nova:flavor>
Nov 18 17:50:11 user nova-compute[74743]:       <nova:owner>
Nov 18 17:50:11 user nova-compute[74743]:         <nova:user uuid="8b9d8b543f4946b2918bd38c4a3c835f">tempest-AttachVolumeTestJSON-1207996855-project-member</nova:user>
Nov 18 17:50:11 user nova-compute[74743]:         <nova:project uuid="790f602c532d41289c52985c8fab91d4">tempest-AttachVolumeTestJSON-1207996855</nova:project>
Nov 18 17:50:11 user nova-compute[74743]:       </nova:owner>
Nov 18 17:50:11 user nova-compute[74743]:       <nova:root type="image" uuid="9536f6cf-95c4-40e2-864a-09a91525678a"/>
Nov 18 17:50:11 user nova-compute[74743]:       <nova:ports>
Nov 18 17:50:11 user nova-compute[74743]:         <nova:port uuid="a69113f5-77da-415b-8738-f46c120221c1">
Nov 18 17:50:11 user nova-compute[74743]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 18 17:50:11 user nova-compute[74743]:         </nova:port>
Nov 18 17:50:11 user nova-compute[74743]:       </nova:ports>
Nov 18 17:50:11 user nova-compute[74743]:     </nova:instance>
Nov 18 17:50:11 user nova-compute[74743]:   </metadata>
Nov 18 17:50:11 user nova-compute[74743]:   <sysinfo type="smbios">
Nov 18 17:50:11 user nova-compute[74743]:     <system>
Nov 18 17:50:11 user nova-compute[74743]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 17:50:11 user nova-compute[74743]:       <entry name="product">OpenStack Nova</entry>
Nov 18 17:50:11 user nova-compute[74743]:       <entry name="version">0.0.0</entry>
Nov 18 17:50:11 user nova-compute[74743]:       <entry name="serial">668be004-de85-4eb4-9037-1b232245c561</entry>
Nov 18 17:50:11 user nova-compute[74743]:       <entry name="uuid">668be004-de85-4eb4-9037-1b232245c561</entry>
Nov 18 17:50:11 user nova-compute[74743]:       <entry name="family">Virtual Machine</entry>
Nov 18 17:50:11 user nova-compute[74743]:     </system>
Nov 18 17:50:11 user nova-compute[74743]:   </sysinfo>
Nov 18 17:50:11 user nova-compute[74743]:   <os>
Nov 18 17:50:11 user nova-compute[74743]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 17:50:11 user nova-compute[74743]:     <boot dev="hd"/>
Nov 18 17:50:11 user nova-compute[74743]:     <smbios mode="sysinfo"/>
Nov 18 17:50:11 user nova-compute[74743]:   </os>
Nov 18 17:50:11 user nova-compute[74743]:   <features>
Nov 18 17:50:11 user nova-compute[74743]:     <acpi/>
Nov 18 17:50:11 user nova-compute[74743]:     <apic/>
Nov 18 17:50:11 user nova-compute[74743]:     <vmcoreinfo/>
Nov 18 17:50:11 user nova-compute[74743]:   </features>
Nov 18 17:50:11 user nova-compute[74743]:   <clock offset="utc">
Nov 18 17:50:11 user nova-compute[74743]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 17:50:11 user nova-compute[74743]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 17:50:11 user nova-compute[74743]:     <timer name="hpet" present="no"/>
Nov 18 17:50:11 user nova-compute[74743]:   </clock>
Nov 18 17:50:11 user nova-compute[74743]:   <cpu mode="custom" match="exact">
Nov 18 17:50:11 user nova-compute[74743]:     <model>Nehalem</model>
Nov 18 17:50:11 user nova-compute[74743]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 17:50:11 user nova-compute[74743]:   </cpu>
Nov 18 17:50:11 user nova-compute[74743]:   <devices>
Nov 18 17:50:11 user nova-compute[74743]:     <disk type="file" device="disk">
Nov 18 17:50:11 user nova-compute[74743]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 17:50:11 user nova-compute[74743]:       <source file="/opt/stack/data/nova/instances/668be004-de85-4eb4-9037-1b232245c561/disk"/>
Nov 18 17:50:11 user nova-compute[74743]:       <target dev="vda" bus="virtio"/>
Nov 18 17:50:11 user nova-compute[74743]:     </disk>
Nov 18 17:50:11 user nova-compute[74743]:     <interface type="ethernet">
Nov 18 17:50:11 user nova-compute[74743]:       <mac address="fa:16:3e:2b:89:d7"/>
Nov 18 17:50:11 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:50:11 user nova-compute[74743]:       <mtu size="1442"/>
Nov 18 17:50:11 user nova-compute[74743]:       <target dev="tapa69113f5-77"/>
Nov 18 17:50:11 user nova-compute[74743]:     </interface>
Nov 18 17:50:11 user nova-compute[74743]:     <serial type="pty">
Nov 18 17:50:11 user nova-compute[74743]:       <log file="/opt/stack/data/nova/instances/668be004-de85-4eb4-9037-1b232245c561/console.log" append="off"/>
Nov 18 17:50:11 user nova-compute[74743]:     </serial>
Nov 18 17:50:11 user nova-compute[74743]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 17:50:11 user nova-compute[74743]:     <video>
Nov 18 17:50:11 user nova-compute[74743]:       <model type="virtio"/>
Nov 18 17:50:11 user nova-compute[74743]:     </video>
Nov 18 17:50:11 user nova-compute[74743]:     <rng model="virtio">
Nov 18 17:50:11 user nova-compute[74743]:       <backend model="random">/dev/urandom</backend>
Nov 18 17:50:11 user nova-compute[74743]:     </rng>
Nov 18 17:50:11 user nova-compute[74743]:     <controller type="usb" index="0" model="none"/>
Nov 18 17:50:11 user nova-compute[74743]:     <memballoon model="virtio">
Nov 18 17:50:11 user nova-compute[74743]:       <stats period="10"/>
Nov 18 17:50:11 user nova-compute[74743]:     </memballoon>
Nov 18 17:50:11 user nova-compute[74743]:   </devices>
Nov 18 17:50:11 user nova-compute[74743]: </domain>
Nov 18 17:50:11 user nova-compute[74743]:  {{(pid=74743) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 17:50:11 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:50:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-70674154',display_name='tempest-AttachVolumeTestJSON-server-70674154',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-70674154',id=51,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+iv0TJ3kWY7P7r3h9yOxtBVyXtBugt+Qu78sfKg/4ijI+YTuFuq0BIMmHIdHbkxSDRUjIJE/6/ZlFzlGEj15fgt1hRwmzv2sOeENIMlV8T1Mr7IsUBtZc8Gr7TO5FvWw==',key_name='tempest-keypair-700447340',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='790f602c532d41289c52985c8fab91d4',ramdisk_id='',reservation_id='r-5w81mvye',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1207996855',owner_user_name='tempest-AttachVolumeTestJSON-1207996855-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T17:50:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b9d8b543f4946b2918bd38c4a3c835f',uuid=668be004-de85-4eb4-9037-1b232245c561,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a69113f5-77da-415b-8738-f46c120221c1", "address": "fa:16:3e:2b:89:d7", "network": {"id": "7cf1258c-5feb-472e-9f3f-69d95360b050", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-628054528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "790f602c532d41289c52985c8fab91d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa69113f5-77", "ovs_interfaceid": "a69113f5-77da-415b-8738-f46c120221c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 17:50:11 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Converting VIF {"id": "a69113f5-77da-415b-8738-f46c120221c1", "address": "fa:16:3e:2b:89:d7", "network": {"id": "7cf1258c-5feb-472e-9f3f-69d95360b050", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-628054528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "790f602c532d41289c52985c8fab91d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa69113f5-77", "ovs_interfaceid": "a69113f5-77da-415b-8738-f46c120221c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:50:11 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:89:d7,bridge_name='br-int',has_traffic_filtering=True,id=a69113f5-77da-415b-8738-f46c120221c1,network=Network(7cf1258c-5feb-472e-9f3f-69d95360b050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa69113f5-77') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:50:11 user nova-compute[74743]: DEBUG os_vif [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:89:d7,bridge_name='br-int',has_traffic_filtering=True,id=a69113f5-77da-415b-8738-f46c120221c1,network=Network(7cf1258c-5feb-472e-9f3f-69d95360b050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa69113f5-77') {{(pid=74743) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 17:50:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:50:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:50:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 17:50:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:50:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fc6879ad-7f9b-5617-85c1-92475a5a42aa', '_type': 'linux-noop'}}, row=False) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:50:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:50:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:50:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:50:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa69113f5-77, may_exist=True, interface_attrs={}) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:50:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa69113f5-77, col_values=(('qos', UUID('4268f614-f833-46a4-8e4f-96e23f723802')),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:50:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa69113f5-77, col_values=(('external_ids', {'iface-id': 'a69113f5-77da-415b-8738-f46c120221c1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:89:d7', 'vm-uuid': '668be004-de85-4eb4-9037-1b232245c561'}),), if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:50:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:50:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:50:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:50:11 user nova-compute[74743]: INFO os_vif [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:89:d7,bridge_name='br-int',has_traffic_filtering=True,id=a69113f5-77da-415b-8738-f46c120221c1,network=Network(7cf1258c-5feb-472e-9f3f-69d95360b050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa69113f5-77')
Nov 18 17:50:11 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:50:11 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] No VIF found with MAC fa:16:3e:2b:89:d7, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:50:11 user nova-compute[74743]: DEBUG nova.network.neutron [req-fc3ce233-086c-4163-9263-f1b5c69a9e9c req-d6d27d9c-e4f2-46ab-aadb-af1faffd5a5c service nova] [instance: 668be004-de85-4eb4-9037-1b232245c561] Updated VIF entry in instance network info cache for port a69113f5-77da-415b-8738-f46c120221c1. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:50:11 user nova-compute[74743]: DEBUG nova.network.neutron [req-fc3ce233-086c-4163-9263-f1b5c69a9e9c req-d6d27d9c-e4f2-46ab-aadb-af1faffd5a5c service nova] [instance: 668be004-de85-4eb4-9037-1b232245c561] Updating instance_info_cache with network_info: [{"id": "a69113f5-77da-415b-8738-f46c120221c1", "address": "fa:16:3e:2b:89:d7", "network": {"id": "7cf1258c-5feb-472e-9f3f-69d95360b050", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-628054528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "790f602c532d41289c52985c8fab91d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa69113f5-77", "ovs_interfaceid": "a69113f5-77da-415b-8738-f46c120221c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:50:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-fc3ce233-086c-4163-9263-f1b5c69a9e9c req-d6d27d9c-e4f2-46ab-aadb-af1faffd5a5c service nova] Releasing lock "refresh_cache-668be004-de85-4eb4-9037-1b232245c561" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:50:12 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:50:12 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:50:12 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:50:12 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:50:12 user nova-compute[74743]: DEBUG nova.compute.manager [req-c24ebff8-325e-41d9-8570-d2cab8d07b40 req-bccec23c-1dcb-4b6a-b060-c70aae245bf4 service nova] [instance: 668be004-de85-4eb4-9037-1b232245c561] Received event network-vif-plugged-a69113f5-77da-415b-8738-f46c120221c1 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:50:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-c24ebff8-325e-41d9-8570-d2cab8d07b40 req-bccec23c-1dcb-4b6a-b060-c70aae245bf4 service nova] Acquiring lock "668be004-de85-4eb4-9037-1b232245c561-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:50:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-c24ebff8-325e-41d9-8570-d2cab8d07b40 req-bccec23c-1dcb-4b6a-b060-c70aae245bf4 service nova] Lock "668be004-de85-4eb4-9037-1b232245c561-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:50:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-c24ebff8-325e-41d9-8570-d2cab8d07b40 req-bccec23c-1dcb-4b6a-b060-c70aae245bf4 service nova] Lock "668be004-de85-4eb4-9037-1b232245c561-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:50:12 user nova-compute[74743]: DEBUG nova.compute.manager [req-c24ebff8-325e-41d9-8570-d2cab8d07b40 req-bccec23c-1dcb-4b6a-b060-c70aae245bf4 service nova] [instance: 668be004-de85-4eb4-9037-1b232245c561] No waiting events found dispatching network-vif-plugged-a69113f5-77da-415b-8738-f46c120221c1 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:50:12 user nova-compute[74743]: WARNING nova.compute.manager [req-c24ebff8-325e-41d9-8570-d2cab8d07b40 req-bccec23c-1dcb-4b6a-b060-c70aae245bf4 service nova] [instance: 668be004-de85-4eb4-9037-1b232245c561] Received unexpected event network-vif-plugged-a69113f5-77da-415b-8738-f46c120221c1 for instance with vm_state building and task_state spawning.
Nov 18 17:50:13 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:50:13 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:50:14 user nova-compute[74743]: DEBUG nova.compute.manager [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 668be004-de85-4eb4-9037-1b232245c561] Instance event wait completed in 0 seconds for  {{(pid=74743) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 17:50:14 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 668be004-de85-4eb4-9037-1b232245c561] Guest created on hypervisor {{(pid=74743) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 17:50:14 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 668be004-de85-4eb4-9037-1b232245c561] Instance spawned successfully.
Nov 18 17:50:14 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 668be004-de85-4eb4-9037-1b232245c561] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 17:50:14 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 668be004-de85-4eb4-9037-1b232245c561] Found default for hw_cdrom_bus of ide {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:50:14 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 668be004-de85-4eb4-9037-1b232245c561] Found default for hw_disk_bus of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:50:14 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 668be004-de85-4eb4-9037-1b232245c561] Found default for hw_input_bus of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:50:14 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 668be004-de85-4eb4-9037-1b232245c561] Found default for hw_pointer_model of None {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:50:14 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 668be004-de85-4eb4-9037-1b232245c561] Found default for hw_video_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:50:14 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 668be004-de85-4eb4-9037-1b232245c561] Found default for hw_vif_model of virtio {{(pid=74743) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 17:50:14 user nova-compute[74743]: INFO nova.compute.manager [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 668be004-de85-4eb4-9037-1b232245c561] Took 5.26 seconds to spawn the instance on the hypervisor.
Nov 18 17:50:14 user nova-compute[74743]: DEBUG nova.compute.manager [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 668be004-de85-4eb4-9037-1b232245c561] Checking state {{(pid=74743) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 17:50:14 user nova-compute[74743]: INFO nova.compute.manager [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 668be004-de85-4eb4-9037-1b232245c561] Took 5.79 seconds to build instance.
Nov 18 17:50:14 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-8f53fc40-6bbd-4c7b-a7bc-1ae291c682bd tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "668be004-de85-4eb4-9037-1b232245c561" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.226s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:50:15 user nova-compute[74743]: DEBUG nova.compute.manager [req-b6c04fe2-9bc0-4c93-8205-1ec66b186512 req-1ad7d0f8-ed7f-4cde-a19d-2ca198006c75 service nova] [instance: 668be004-de85-4eb4-9037-1b232245c561] Received event network-vif-plugged-a69113f5-77da-415b-8738-f46c120221c1 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:50:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b6c04fe2-9bc0-4c93-8205-1ec66b186512 req-1ad7d0f8-ed7f-4cde-a19d-2ca198006c75 service nova] Acquiring lock "668be004-de85-4eb4-9037-1b232245c561-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:50:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b6c04fe2-9bc0-4c93-8205-1ec66b186512 req-1ad7d0f8-ed7f-4cde-a19d-2ca198006c75 service nova] Lock "668be004-de85-4eb4-9037-1b232245c561-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:50:15 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-b6c04fe2-9bc0-4c93-8205-1ec66b186512 req-1ad7d0f8-ed7f-4cde-a19d-2ca198006c75 service nova] Lock "668be004-de85-4eb4-9037-1b232245c561-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:50:15 user nova-compute[74743]: DEBUG nova.compute.manager [req-b6c04fe2-9bc0-4c93-8205-1ec66b186512 req-1ad7d0f8-ed7f-4cde-a19d-2ca198006c75 service nova] [instance: 668be004-de85-4eb4-9037-1b232245c561] No waiting events found dispatching network-vif-plugged-a69113f5-77da-415b-8738-f46c120221c1 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:50:15 user nova-compute[74743]: WARNING nova.compute.manager [req-b6c04fe2-9bc0-4c93-8205-1ec66b186512 req-1ad7d0f8-ed7f-4cde-a19d-2ca198006c75 service nova] [instance: 668be004-de85-4eb4-9037-1b232245c561] Received unexpected event network-vif-plugged-a69113f5-77da-415b-8738-f46c120221c1 for instance with vm_state active and task_state None.
Nov 18 17:50:15 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:50:15 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Cleaning up deleted instances with incomplete migration  {{(pid=74743) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 18 17:50:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:50:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:50:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:50:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:50:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74743) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 17:50:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:50:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:50:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:50:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:50:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:50:31 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:50:35 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:50:36 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:50:40 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:50:41 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:50:45 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._sync_power_states {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:50:45 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Triggering sync for uuid 668be004-de85-4eb4-9037-1b232245c561 {{(pid=74743) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 17:50:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "668be004-de85-4eb4-9037-1b232245c561" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:50:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "668be004-de85-4eb4-9037-1b232245c561" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:50:45 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "668be004-de85-4eb4-9037-1b232245c561" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:50:45 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:50:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:50:51 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:50:55 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:50:55 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74743) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 17:50:55 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:50:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:50:56 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:50:56 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:50:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:50:58 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:51:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:51:00 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:51:01 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:51:01 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:51:05 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:51:05 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:51:05 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:51:05 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:51:05 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Auditing locally available compute resources for user (node: user) {{(pid=74743) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 17:51:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668be004-de85-4eb4-9037-1b232245c561/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:51:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668be004-de85-4eb4-9037-1b232245c561/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:51:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668be004-de85-4eb4-9037-1b232245c561/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:51:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668be004-de85-4eb4-9037-1b232245c561/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:51:06 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:51:06 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:51:06 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Hypervisor/Node resource view: name=user free_ram=8947MB free_disk=25.235157012939453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74743) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 17:51:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:51:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:51:06 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 668be004-de85-4eb4-9037-1b232245c561 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:51:06 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 17:51:06 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 17:51:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:51:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:51:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74743) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 17:51:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:51:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:51:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:51:06 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:51:06 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:51:06 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Compute_service record updated for user:user {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 17:51:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.210s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:51:07 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:51:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:51:11 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:51:11 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Starting heal instance info cache {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 17:51:11 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Rebuilding the list of instances to heal {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 17:51:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "refresh_cache-668be004-de85-4eb4-9037-1b232245c561" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:51:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquired lock "refresh_cache-668be004-de85-4eb4-9037-1b232245c561" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:51:11 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 668be004-de85-4eb4-9037-1b232245c561] Forcefully refreshing network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 17:51:11 user nova-compute[74743]: DEBUG nova.objects.instance [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lazy-loading 'info_cache' on Instance uuid 668be004-de85-4eb4-9037-1b232245c561 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:51:11 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 668be004-de85-4eb4-9037-1b232245c561] Updating instance_info_cache with network_info: [{"id": "a69113f5-77da-415b-8738-f46c120221c1", "address": "fa:16:3e:2b:89:d7", "network": {"id": "7cf1258c-5feb-472e-9f3f-69d95360b050", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-628054528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "790f602c532d41289c52985c8fab91d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa69113f5-77", "ovs_interfaceid": "a69113f5-77da-415b-8738-f46c120221c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:51:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Releasing lock "refresh_cache-668be004-de85-4eb4-9037-1b232245c561" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:51:12 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 668be004-de85-4eb4-9037-1b232245c561] Updated the network info_cache for instance {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 17:51:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:51:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:51:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:51:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74743) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 17:51:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:51:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:51:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:51:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:51:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:51:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74743) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 17:51:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:51:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:51:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:51:31 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:51:36 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:51:41 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:51:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:51:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:51:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74743) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 17:51:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:51:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:51:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:51:51 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:51:51 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:51:51 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74743) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 17:51:51 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:51:51 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:51:51 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:51:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:51:56 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:51:56 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74743) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 17:51:57 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:51:57 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:51:58 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:52:00 user nova-compute[74743]: DEBUG nova.compute.manager [req-1da7ce3e-31d8-43b0-a5e8-6ae24638c1c9 req-44ea394f-16c7-4a32-80ea-9fc784b4c4b0 service nova] [instance: 668be004-de85-4eb4-9037-1b232245c561] Received event network-changed-a69113f5-77da-415b-8738-f46c120221c1 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:52:00 user nova-compute[74743]: DEBUG nova.compute.manager [req-1da7ce3e-31d8-43b0-a5e8-6ae24638c1c9 req-44ea394f-16c7-4a32-80ea-9fc784b4c4b0 service nova] [instance: 668be004-de85-4eb4-9037-1b232245c561] Refreshing instance network info cache due to event network-changed-a69113f5-77da-415b-8738-f46c120221c1. {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 17:52:00 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-1da7ce3e-31d8-43b0-a5e8-6ae24638c1c9 req-44ea394f-16c7-4a32-80ea-9fc784b4c4b0 service nova] Acquiring lock "refresh_cache-668be004-de85-4eb4-9037-1b232245c561" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:52:00 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-1da7ce3e-31d8-43b0-a5e8-6ae24638c1c9 req-44ea394f-16c7-4a32-80ea-9fc784b4c4b0 service nova] Acquired lock "refresh_cache-668be004-de85-4eb4-9037-1b232245c561" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:52:00 user nova-compute[74743]: DEBUG nova.network.neutron [req-1da7ce3e-31d8-43b0-a5e8-6ae24638c1c9 req-44ea394f-16c7-4a32-80ea-9fc784b4c4b0 service nova] [instance: 668be004-de85-4eb4-9037-1b232245c561] Refreshing network info cache for port a69113f5-77da-415b-8738-f46c120221c1 {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 17:52:00 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:52:00 user nova-compute[74743]: DEBUG nova.network.neutron [req-1da7ce3e-31d8-43b0-a5e8-6ae24638c1c9 req-44ea394f-16c7-4a32-80ea-9fc784b4c4b0 service nova] [instance: 668be004-de85-4eb4-9037-1b232245c561] Updated VIF entry in instance network info cache for port a69113f5-77da-415b-8738-f46c120221c1. {{(pid=74743) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 17:52:00 user nova-compute[74743]: DEBUG nova.network.neutron [req-1da7ce3e-31d8-43b0-a5e8-6ae24638c1c9 req-44ea394f-16c7-4a32-80ea-9fc784b4c4b0 service nova] [instance: 668be004-de85-4eb4-9037-1b232245c561] Updating instance_info_cache with network_info: [{"id": "a69113f5-77da-415b-8738-f46c120221c1", "address": "fa:16:3e:2b:89:d7", "network": {"id": "7cf1258c-5feb-472e-9f3f-69d95360b050", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-628054528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "790f602c532d41289c52985c8fab91d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa69113f5-77", "ovs_interfaceid": "a69113f5-77da-415b-8738-f46c120221c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:52:00 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-1da7ce3e-31d8-43b0-a5e8-6ae24638c1c9 req-44ea394f-16c7-4a32-80ea-9fc784b4c4b0 service nova] Releasing lock "refresh_cache-668be004-de85-4eb4-9037-1b232245c561" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:52:00 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:52:01 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:52:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e749b952-391f-4e9f-b111-639b9f0a9f68 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Acquiring lock "668be004-de85-4eb4-9037-1b232245c561" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:52:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e749b952-391f-4e9f-b111-639b9f0a9f68 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "668be004-de85-4eb4-9037-1b232245c561" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:52:02 user nova-compute[74743]: DEBUG nova.objects.instance [None req-e749b952-391f-4e9f-b111-639b9f0a9f68 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lazy-loading 'flavor' on Instance uuid 668be004-de85-4eb4-9037-1b232245c561 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:52:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e749b952-391f-4e9f-b111-639b9f0a9f68 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "668be004-de85-4eb4-9037-1b232245c561" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:52:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e749b952-391f-4e9f-b111-639b9f0a9f68 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Acquiring lock "668be004-de85-4eb4-9037-1b232245c561" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:52:02 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e749b952-391f-4e9f-b111-639b9f0a9f68 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "668be004-de85-4eb4-9037-1b232245c561" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:52:02 user nova-compute[74743]: INFO nova.compute.manager [None req-e749b952-391f-4e9f-b111-639b9f0a9f68 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 668be004-de85-4eb4-9037-1b232245c561] Attaching volume 45680174-3907-4340-96e8-1439c5dba041 to /dev/vdb
Nov 18 17:52:02 user nova-compute[74743]: DEBUG os_brick.utils [None req-e749b952-391f-4e9f-b111-639b9f0a9f68 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:52:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:52:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:52:02 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8224a26-e5ef-4b26-bbfb-84fd3678b9ed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1116acd8874d\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:52:02 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:52:03 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:52:03 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[81184390-79ea-4770-8da9-57376782f72d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:52:03 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:52:03 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:52:03 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9be7bc5-51f8-43f8-b159-0045eafc4594]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:52:03 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1f2cbb-49eb-48ce-8fb9-845e74828294]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:52:03 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-e749b952-391f-4e9f-b111-639b9f0a9f68 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Running cmd (subprocess): nvme version {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:52:03 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-e749b952-391f-4e9f-b111-639b9f0a9f68 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] 'nvme version' failed. Not Retrying. {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:52:03 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e749b952-391f-4e9f-b111-639b9f0a9f68 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] nvme not present on system {{(pid=74743) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 17:52:03 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:52:03 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:52:03 user nova-compute[74743]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 17:52:03 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[839d1351-cc6e-4166-a613-092f68eb2992]: (4, '') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:52:03 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-e749b952-391f-4e9f-b111-639b9f0a9f68 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74743) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 17:52:03 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-e749b952-391f-4e9f-b111-639b9f0a9f68 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 17:52:03 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-e749b952-391f-4e9f-b111-639b9f0a9f68 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] LIGHTOS: no hostnqn found. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 17:52:03 user nova-compute[74743]: DEBUG os_brick.utils [None req-e749b952-391f-4e9f-b111-639b9f0a9f68 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1116acd8874d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:52:03 user nova-compute[74743]: DEBUG nova.virt.block_device [None req-e749b952-391f-4e9f-b111-639b9f0a9f68 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 668be004-de85-4eb4-9037-1b232245c561] Updating existing volume attachment record: 2611b2dd-467d-4278-9f75-fda00553964b {{(pid=74743) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 17:52:03 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:52:05 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:52:05 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:52:05 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:52:05 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:52:05 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Auditing locally available compute resources for user (node: user) {{(pid=74743) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 17:52:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668be004-de85-4eb4-9037-1b232245c561/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:52:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668be004-de85-4eb4-9037-1b232245c561/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:52:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668be004-de85-4eb4-9037-1b232245c561/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:52:05 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:52:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668be004-de85-4eb4-9037-1b232245c561/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:52:06 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:52:06 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:52:06 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Hypervisor/Node resource view: name=user free_ram=8965MB free_disk=25.23440170288086GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74743) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 17:52:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:52:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:52:06 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 668be004-de85-4eb4-9037-1b232245c561 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:52:06 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 17:52:06 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 17:52:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:52:06 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:52:06 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:52:06 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Compute_service record updated for user:user {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 17:52:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.210s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:52:07 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:52:08 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e749b952-391f-4e9f-b111-639b9f0a9f68 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 668be004-de85-4eb4-9037-1b232245c561] Calling os-brick to attach iSCSI Volume {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 17:52:08 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e749b952-391f-4e9f-b111-639b9f0a9f68 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:45680174-3907-4340-96e8-1439c5dba041', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nsZgJthW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:52:08 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-e749b952-391f-4e9f-b111-639b9f0a9f68 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:52:08 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-e749b952-391f-4e9f-b111-639b9f0a9f68 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:52:08 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-e749b952-391f-4e9f-b111-639b9f0a9f68 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:52:08 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-e749b952-391f-4e9f-b111-639b9f0a9f68 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:52:08 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-e749b952-391f-4e9f-b111-639b9f0a9f68 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45680174-3907-4340-96e8-1439c5dba041" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:52:08 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-e749b952-391f-4e9f-b111-639b9f0a9f68 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45680174-3907-4340-96e8-1439c5dba041" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:52:08 user nova-compute[74743]: INFO os_brick.initiator.connectors.iscsi [None req-e749b952-391f-4e9f-b111-639b9f0a9f68 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 17:52:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45680174-3907-4340-96e8-1439c5dba041 -p 172.16.0.220:3260 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:52:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45680174-3907-4340-96e8-1439c5dba041 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:52:08 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64ad901-ed5b-496c-83c5-53b6336110f9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:52:08 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e749b952-391f-4e9f-b111-639b9f0a9f68 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 17:52:08 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:52:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45680174-3907-4340-96e8-1439c5dba041 -p 172.16.0.220:3260 --interface default --op new {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:52:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45680174-3907-4340-96e8-1439c5dba041 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:52:08 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d77541-ef50-44c7-ab08-39fe5a3ccab9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45680174-3907-4340-96e8-1439c5dba041] added\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:52:08 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e749b952-391f-4e9f-b111-639b9f0a9f68 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45680174-3907-4340-96e8-1439c5dba041] added
Nov 18 17:52:08 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:52:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45680174-3907-4340-96e8-1439c5dba041 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:52:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45680174-3907-4340-96e8-1439c5dba041 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:52:08 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55c0f48-039b-42d4-805f-b35476cb1e08]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:52:08 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e749b952-391f-4e9f-b111-639b9f0a9f68 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:52:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45680174-3907-4340-96e8-1439c5dba041 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:52:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45680174-3907-4340-96e8-1439c5dba041 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:52:08 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e25c8e-1509-4453-b3a3-8fd294e817e1]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:52:08 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e749b952-391f-4e9f-b111-639b9f0a9f68 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:52:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45680174-3907-4340-96e8-1439c5dba041 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nsZgJthW {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:52:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45680174-3907-4340-96e8-1439c5dba041 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nsZgJthW" returned: 0 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:52:08 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d666d9-ff40-4328-ab7a-3ad81eab5673]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:52:08 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e749b952-391f-4e9f-b111-639b9f0a9f68 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nsZgJthW'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:52:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45680174-3907-4340-96e8-1439c5dba041 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:52:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45680174-3907-4340-96e8-1439c5dba041 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:52:08 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[225393bf-f5bc-4f28-8416-f8c32126b90c]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:52:08 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e749b952-391f-4e9f-b111-639b9f0a9f68 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:52:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:52:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:52:08 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:52:08 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[58243d79-f8b6-450f-9920-60eee26cbb50]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:52:08 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e749b952-391f-4e9f-b111-639b9f0a9f68 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 18 17:52:08 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:52:08 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e749b952-391f-4e9f-b111-639b9f0a9f68 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 18 17:52:08 user nova-compute[74743]:  {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:52:08 user nova-compute[74743]: WARNING os_brick.initiator.connectors.iscsi [None req-e749b952-391f-4e9f-b111-639b9f0a9f68 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 18 17:52:08 user nova-compute[74743]: 
Nov 18 17:52:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45680174-3907-4340-96e8-1439c5dba041 -p 172.16.0.220:3260 --login {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:52:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45680174-3907-4340-96e8-1439c5dba041 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:52:08 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[4367050d-bfc0-4b5e-936a-d947487df8bd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:45680174-3907-4340-96e8-1439c5dba041, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:45680174-3907-4340-96e8-1439c5dba041, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:52:08 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e749b952-391f-4e9f-b111-639b9f0a9f68 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:45680174-3907-4340-96e8-1439c5dba041, portal: 172.16.0.220,3260]
Nov 18 17:52:08 user nova-compute[74743]: Login to [iface: default, target: iqn.2010-10.org.openstack:45680174-3907-4340-96e8-1439c5dba041, portal: 172.16.0.220,3260] successful.
Nov 18 17:52:08 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:52:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45680174-3907-4340-96e8-1439c5dba041 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:52:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45680174-3907-4340-96e8-1439c5dba041 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:52:08 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4e262a-6b23-4dfe-bf29-e2504379d425]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:52:08 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e749b952-391f-4e9f-b111-639b9f0a9f68 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:52:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:52:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:52:08 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fac0067-74c3-4a42-b5bb-08919dcd3261]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45680174-3907-4340-96e8-1439c5dba041 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:52:08 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e749b952-391f-4e9f-b111-639b9f0a9f68 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45680174-3907-4340-96e8-1439c5dba041 (non-flash)
Nov 18 17:52:08 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:52:08 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e749b952-391f-4e9f-b111-639b9f0a9f68 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45680174-3907-4340-96e8-1439c5dba041 (non-flash)
Nov 18 17:52:08 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:52:08 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-e749b952-391f-4e9f-b111-639b9f0a9f68 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45680174-3907-4340-96e8-1439c5dba041" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:52:08 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e749b952-391f-4e9f-b111-639b9f0a9f68 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Connected to 172.16.0.220:3260 {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 17:52:08 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-e749b952-391f-4e9f-b111-639b9f0a9f68 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=74743) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 17:52:08 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-e749b952-391f-4e9f-b111-639b9f0a9f68 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74743) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 17:52:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:52:08 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:52:08 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cab35fd-2a17-4982-823b-430a797be287]: (4, ('- - 0', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:52:08 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-e749b952-391f-4e9f-b111-639b9f0a9f68 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:52:08 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e749b952-391f-4e9f-b111-639b9f0a9f68 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:45680174-3907-4340-96e8-1439c5dba041', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nsZgJthW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 17:52:09 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-e749b952-391f-4e9f-b111-639b9f0a9f68 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.274s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:52:09 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-e749b952-391f-4e9f-b111-639b9f0a9f68 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] <== connect_volume: return (1276ms) {'type': 'block', 'scsi_wwn': '23033383362356662', 'path': '/dev/sdb'} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:52:09 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e749b952-391f-4e9f-b111-639b9f0a9f68 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 668be004-de85-4eb4-9037-1b232245c561] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033383362356662', 'path': '/dev/sdb'} {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 17:52:09 user nova-compute[74743]: DEBUG nova.objects.instance [None req-e749b952-391f-4e9f-b111-639b9f0a9f68 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lazy-loading 'flavor' on Instance uuid 668be004-de85-4eb4-9037-1b232245c561 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:52:09 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-e749b952-391f-4e9f-b111-639b9f0a9f68 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 17:52:09 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:52:09 user nova-compute[74743]:   <source dev="/dev/sdb"/>
Nov 18 17:52:09 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:52:09 user nova-compute[74743]:   <serial>45680174-3907-4340-96e8-1439c5dba041</serial>
Nov 18 17:52:09 user nova-compute[74743]: </disk>
Nov 18 17:52:09 user nova-compute[74743]:  {{(pid=74743) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 17:52:10 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-e749b952-391f-4e9f-b111-639b9f0a9f68 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:52:10 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-e749b952-391f-4e9f-b111-639b9f0a9f68 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:52:10 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-e749b952-391f-4e9f-b111-639b9f0a9f68 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] No VIF found with MAC fa:16:3e:2b:89:d7, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:52:10 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-e749b952-391f-4e9f-b111-639b9f0a9f68 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "668be004-de85-4eb4-9037-1b232245c561" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.300s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:52:10 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:52:11 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:52:11 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:52:11 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Starting heal instance info cache {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 17:52:11 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Rebuilding the list of instances to heal {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 17:52:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "refresh_cache-668be004-de85-4eb4-9037-1b232245c561" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 17:52:11 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquired lock "refresh_cache-668be004-de85-4eb4-9037-1b232245c561" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 17:52:11 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 668be004-de85-4eb4-9037-1b232245c561] Forcefully refreshing network info cache for instance {{(pid=74743) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 17:52:11 user nova-compute[74743]: DEBUG nova.objects.instance [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lazy-loading 'info_cache' on Instance uuid 668be004-de85-4eb4-9037-1b232245c561 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:52:12 user nova-compute[74743]: DEBUG nova.network.neutron [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 668be004-de85-4eb4-9037-1b232245c561] Updating instance_info_cache with network_info: [{"id": "a69113f5-77da-415b-8738-f46c120221c1", "address": "fa:16:3e:2b:89:d7", "network": {"id": "7cf1258c-5feb-472e-9f3f-69d95360b050", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-628054528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "790f602c532d41289c52985c8fab91d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa69113f5-77", "ovs_interfaceid": "a69113f5-77da-415b-8738-f46c120221c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:52:12 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Releasing lock "refresh_cache-668be004-de85-4eb4-9037-1b232245c561" {{(pid=74743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 17:52:12 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] [instance: 668be004-de85-4eb4-9037-1b232245c561] Updated the network info_cache for instance {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 17:52:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-6e5360c5-bdc5-4299-853c-ab51e58b4133 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Acquiring lock "668be004-de85-4eb4-9037-1b232245c561" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:52:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-6e5360c5-bdc5-4299-853c-ab51e58b4133 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "668be004-de85-4eb4-9037-1b232245c561" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:52:13 user nova-compute[74743]: DEBUG nova.objects.instance [None req-6e5360c5-bdc5-4299-853c-ab51e58b4133 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lazy-loading 'flavor' on Instance uuid 668be004-de85-4eb4-9037-1b232245c561 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:52:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-6e5360c5-bdc5-4299-853c-ab51e58b4133 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "668be004-de85-4eb4-9037-1b232245c561" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:52:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-6e5360c5-bdc5-4299-853c-ab51e58b4133 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Acquiring lock "668be004-de85-4eb4-9037-1b232245c561" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:52:13 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-6e5360c5-bdc5-4299-853c-ab51e58b4133 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "668be004-de85-4eb4-9037-1b232245c561" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:52:13 user nova-compute[74743]: INFO nova.compute.manager [None req-6e5360c5-bdc5-4299-853c-ab51e58b4133 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 668be004-de85-4eb4-9037-1b232245c561] Attaching volume 731e9b94-f271-45dc-90d4-8c0666180552 to /dev/vdc
Nov 18 17:52:13 user nova-compute[74743]: DEBUG os_brick.utils [None req-6e5360c5-bdc5-4299-853c-ab51e58b4133 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:52:13 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:52:13 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:52:13 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26a5ba2-e3bb-4f7c-b08b-b887aff26f15]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1116acd8874d\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:52:13 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:52:13 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:52:13 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[29860838-b264-4fa4-a5e8-86de34ce7496]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:52:13 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:52:13 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:52:13 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95c4882-5095-4b39-a321-4501a5757427]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:52:13 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8f690a-fb81-459d-82f0-6839297a7206]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:52:13 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-6e5360c5-bdc5-4299-853c-ab51e58b4133 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Running cmd (subprocess): nvme version {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:52:13 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-6e5360c5-bdc5-4299-853c-ab51e58b4133 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] 'nvme version' failed. Not Retrying. {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:52:13 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6e5360c5-bdc5-4299-853c-ab51e58b4133 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] nvme not present on system {{(pid=74743) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 17:52:13 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:52:13 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 17:52:13 user nova-compute[74743]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 17:52:13 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b70cbd-d3e9-4d83-9d7f-98b633763955]: (4, '') {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:52:13 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-6e5360c5-bdc5-4299-853c-ab51e58b4133 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74743) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 17:52:13 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-6e5360c5-bdc5-4299-853c-ab51e58b4133 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 17:52:13 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.lightos [None req-6e5360c5-bdc5-4299-853c-ab51e58b4133 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] LIGHTOS: no hostnqn found. {{(pid=74743) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 17:52:13 user nova-compute[74743]: DEBUG os_brick.utils [None req-6e5360c5-bdc5-4299-853c-ab51e58b4133 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1116acd8874d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:52:13 user nova-compute[74743]: DEBUG nova.virt.block_device [None req-6e5360c5-bdc5-4299-853c-ab51e58b4133 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 668be004-de85-4eb4-9037-1b232245c561] Updating existing volume attachment record: 29600ada-ccdb-46b1-b05d-e48d59c89875 {{(pid=74743) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 17:52:15 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:52:16 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:52:18 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e5360c5-bdc5-4299-853c-ab51e58b4133 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 668be004-de85-4eb4-9037-1b232245c561] Calling os-brick to attach iSCSI Volume {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 17:52:18 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5360c5-bdc5-4299-853c-ab51e58b4133 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:731e9b94-f271-45dc-90d4-8c0666180552', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KbpgVdLw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:52:18 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-6e5360c5-bdc5-4299-853c-ab51e58b4133 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:52:18 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-6e5360c5-bdc5-4299-853c-ab51e58b4133 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:52:18 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-6e5360c5-bdc5-4299-853c-ab51e58b4133 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:52:18 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-6e5360c5-bdc5-4299-853c-ab51e58b4133 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:52:18 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-6e5360c5-bdc5-4299-853c-ab51e58b4133 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:731e9b94-f271-45dc-90d4-8c0666180552" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:52:18 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-6e5360c5-bdc5-4299-853c-ab51e58b4133 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:731e9b94-f271-45dc-90d4-8c0666180552" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:52:18 user nova-compute[74743]: INFO os_brick.initiator.connectors.iscsi [None req-6e5360c5-bdc5-4299-853c-ab51e58b4133 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 17:52:18 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:731e9b94-f271-45dc-90d4-8c0666180552 -p 172.16.0.220:3260 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:52:18 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:731e9b94-f271-45dc-90d4-8c0666180552 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:52:18 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be94152-b02d-4dd9-9bc8-5fd15f415a15]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:52:18 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5360c5-bdc5-4299-853c-ab51e58b4133 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 17:52:18 user nova-compute[74743]:  {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:52:18 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:731e9b94-f271-45dc-90d4-8c0666180552 -p 172.16.0.220:3260 --interface default --op new {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:52:18 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:731e9b94-f271-45dc-90d4-8c0666180552 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:52:18 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e07feb3-6bc1-495e-bfe3-4d31eb5ce3fe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:731e9b94-f271-45dc-90d4-8c0666180552] added\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:52:18 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5360c5-bdc5-4299-853c-ab51e58b4133 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:731e9b94-f271-45dc-90d4-8c0666180552] added
Nov 18 17:52:18 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:52:18 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:731e9b94-f271-45dc-90d4-8c0666180552 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:52:18 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:731e9b94-f271-45dc-90d4-8c0666180552 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:52:18 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5fff5b-3599-4b6e-a45f-ae1909c046d5]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:52:18 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5360c5-bdc5-4299-853c-ab51e58b4133 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:52:18 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:731e9b94-f271-45dc-90d4-8c0666180552 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:52:18 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:731e9b94-f271-45dc-90d4-8c0666180552 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:52:18 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9508b31-22a4-4d2e-b368-06e3f6651b36]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:52:18 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5360c5-bdc5-4299-853c-ab51e58b4133 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:52:18 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:731e9b94-f271-45dc-90d4-8c0666180552 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KbpgVdLw {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:52:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:731e9b94-f271-45dc-90d4-8c0666180552 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KbpgVdLw" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:52:19 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2c684a-c8b9-4f6c-bfde-841d8b85b5f3]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:52:19 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5360c5-bdc5-4299-853c-ab51e58b4133 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KbpgVdLw'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:52:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:731e9b94-f271-45dc-90d4-8c0666180552 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:52:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:731e9b94-f271-45dc-90d4-8c0666180552 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:52:19 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf3eba9-58ca-4a31-9ac4-778ad2f58cd2]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:52:19 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5360c5-bdc5-4299-853c-ab51e58b4133 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:52:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:52:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:52:19 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8300dff-0499-4681-ac64-e1c57f403f8d]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45680174-3907-4340-96e8-1439c5dba041 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:52:19 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5360c5-bdc5-4299-853c-ab51e58b4133 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45680174-3907-4340-96e8-1439c5dba041 (non-flash)
Nov 18 17:52:19 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:52:19 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5360c5-bdc5-4299-853c-ab51e58b4133 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45680174-3907-4340-96e8-1439c5dba041 (non-flash)
Nov 18 17:52:19 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:52:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:731e9b94-f271-45dc-90d4-8c0666180552 -p 172.16.0.220:3260 --login {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:52:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:731e9b94-f271-45dc-90d4-8c0666180552 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:52:19 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[90261e72-64fd-416f-8534-e2f12f9cc4c3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:731e9b94-f271-45dc-90d4-8c0666180552, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:731e9b94-f271-45dc-90d4-8c0666180552, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:52:19 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5360c5-bdc5-4299-853c-ab51e58b4133 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:731e9b94-f271-45dc-90d4-8c0666180552, portal: 172.16.0.220,3260]
Nov 18 17:52:19 user nova-compute[74743]: Login to [iface: default, target: iqn.2010-10.org.openstack:731e9b94-f271-45dc-90d4-8c0666180552, portal: 172.16.0.220,3260] successful.
Nov 18 17:52:19 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:52:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:731e9b94-f271-45dc-90d4-8c0666180552 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:52:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:731e9b94-f271-45dc-90d4-8c0666180552 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:52:19 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba54a6d-1a67-47ef-b89f-6c5ff0f21d45]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:52:19 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5360c5-bdc5-4299-853c-ab51e58b4133 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:52:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:52:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:52:19 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee657f6-d443-4d3f-9c17-97118c1b0981]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45680174-3907-4340-96e8-1439c5dba041 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731e9b94-f271-45dc-90d4-8c0666180552 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:52:19 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5360c5-bdc5-4299-853c-ab51e58b4133 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45680174-3907-4340-96e8-1439c5dba041 (non-flash)
Nov 18 17:52:19 user nova-compute[74743]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731e9b94-f271-45dc-90d4-8c0666180552 (non-flash)
Nov 18 17:52:19 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:52:19 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5360c5-bdc5-4299-853c-ab51e58b4133 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45680174-3907-4340-96e8-1439c5dba041 (non-flash)
Nov 18 17:52:19 user nova-compute[74743]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731e9b94-f271-45dc-90d4-8c0666180552 (non-flash)
Nov 18 17:52:19 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:52:19 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-6e5360c5-bdc5-4299-853c-ab51e58b4133 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:731e9b94-f271-45dc-90d4-8c0666180552" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:52:19 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5360c5-bdc5-4299-853c-ab51e58b4133 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Connected to 172.16.0.220:3260 {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 17:52:19 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-6e5360c5-bdc5-4299-853c-ab51e58b4133 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] HCTL ('34', '-', '-', 0) found on session 59 with lun 0 {{(pid=74743) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 17:52:19 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-6e5360c5-bdc5-4299-853c-ab51e58b4133 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74743) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 17:52:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:52:19 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:52:19 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad986ac-b7d9-4460-9f91-81d5140d14a7]: (4, ('- - 0', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:52:19 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-6e5360c5-bdc5-4299-853c-ab51e58b4133 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74743) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 17:52:19 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5360c5-bdc5-4299-853c-ab51e58b4133 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:731e9b94-f271-45dc-90d4-8c0666180552', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KbpgVdLw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74743) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 17:52:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-6e5360c5-bdc5-4299-853c-ab51e58b4133 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:52:20 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5360c5-bdc5-4299-853c-ab51e58b4133 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23463353938623337', 'path': '/dev/sdc'} {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:52:20 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e5360c5-bdc5-4299-853c-ab51e58b4133 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 668be004-de85-4eb4-9037-1b232245c561] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463353938623337', 'path': '/dev/sdc'} {{(pid=74743) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 17:52:20 user nova-compute[74743]: DEBUG nova.objects.instance [None req-6e5360c5-bdc5-4299-853c-ab51e58b4133 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lazy-loading 'flavor' on Instance uuid 668be004-de85-4eb4-9037-1b232245c561 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:52:20 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-6e5360c5-bdc5-4299-853c-ab51e58b4133 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 17:52:20 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:52:20 user nova-compute[74743]:   <source dev="/dev/sdc"/>
Nov 18 17:52:20 user nova-compute[74743]:   <target dev="vdc" bus="virtio"/>
Nov 18 17:52:20 user nova-compute[74743]:   <serial>731e9b94-f271-45dc-90d4-8c0666180552</serial>
Nov 18 17:52:20 user nova-compute[74743]: </disk>
Nov 18 17:52:20 user nova-compute[74743]:  {{(pid=74743) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 17:52:20 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-6e5360c5-bdc5-4299-853c-ab51e58b4133 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] No BDM found with device name vda, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:52:20 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-6e5360c5-bdc5-4299-853c-ab51e58b4133 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:52:20 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-6e5360c5-bdc5-4299-853c-ab51e58b4133 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74743) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 17:52:20 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-6e5360c5-bdc5-4299-853c-ab51e58b4133 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] No VIF found with MAC fa:16:3e:2b:89:d7, not building metadata {{(pid=74743) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 17:52:20 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-6e5360c5-bdc5-4299-853c-ab51e58b4133 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "668be004-de85-4eb4-9037-1b232245c561" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.422s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:52:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d263e82c-4ea9-4624-875f-62ffc637cc97 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Acquiring lock "668be004-de85-4eb4-9037-1b232245c561" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:52:21 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d263e82c-4ea9-4624-875f-62ffc637cc97 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "668be004-de85-4eb4-9037-1b232245c561" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:52:21 user nova-compute[74743]: INFO nova.compute.manager [None req-d263e82c-4ea9-4624-875f-62ffc637cc97 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 668be004-de85-4eb4-9037-1b232245c561] Detaching volume 45680174-3907-4340-96e8-1439c5dba041
Nov 18 17:52:21 user nova-compute[74743]: INFO nova.virt.block_device [None req-d263e82c-4ea9-4624-875f-62ffc637cc97 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 668be004-de85-4eb4-9037-1b232245c561] Attempting to driver detach volume 45680174-3907-4340-96e8-1439c5dba041 from mountpoint /dev/vdb
Nov 18 17:52:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d263e82c-4ea9-4624-875f-62ffc637cc97 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Attempting to detach device vdb from instance 668be004-de85-4eb4-9037-1b232245c561 from the persistent domain config. {{(pid=74743) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 17:52:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-d263e82c-4ea9-4624-875f-62ffc637cc97 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 17:52:21 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:52:21 user nova-compute[74743]:   <source dev="/dev/sdb"/>
Nov 18 17:52:21 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:52:21 user nova-compute[74743]:   <serial>45680174-3907-4340-96e8-1439c5dba041</serial>
Nov 18 17:52:21 user nova-compute[74743]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 17:52:21 user nova-compute[74743]: </disk>
Nov 18 17:52:21 user nova-compute[74743]:  {{(pid=74743) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 17:52:21 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-d263e82c-4ea9-4624-875f-62ffc637cc97 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Successfully detached device vdb from instance 668be004-de85-4eb4-9037-1b232245c561 from the persistent domain config.
Nov 18 17:52:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d263e82c-4ea9-4624-875f-62ffc637cc97 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 668be004-de85-4eb4-9037-1b232245c561 from the live domain config. {{(pid=74743) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 17:52:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-d263e82c-4ea9-4624-875f-62ffc637cc97 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 17:52:21 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:52:21 user nova-compute[74743]:   <source dev="/dev/sdb"/>
Nov 18 17:52:21 user nova-compute[74743]:   <target dev="vdb" bus="virtio"/>
Nov 18 17:52:21 user nova-compute[74743]:   <serial>45680174-3907-4340-96e8-1439c5dba041</serial>
Nov 18 17:52:21 user nova-compute[74743]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 17:52:21 user nova-compute[74743]: </disk>
Nov 18 17:52:21 user nova-compute[74743]:  {{(pid=74743) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 17:52:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:52:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:52:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74743) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 17:52:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:52:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:52:21 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:52:21 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-d263e82c-4ea9-4624-875f-62ffc637cc97 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 668be004-de85-4eb4-9037-1b232245c561 {{(pid=74743) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 17:52:25 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:52:26 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:52:30 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:52:31 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:52:36 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:52:36 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:52:36 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74743) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 17:52:36 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:52:36 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:52:36 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:52:41 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:52:41 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-d263e82c-4ea9-4624-875f-62ffc637cc97 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 668be004-de85-4eb4-9037-1b232245c561 is timed out.
Nov 18 17:52:41 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-d263e82c-4ea9-4624-875f-62ffc637cc97 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Successfully detached device vdb from instance 668be004-de85-4eb4-9037-1b232245c561 from the live domain config.
Nov 18 17:52:41 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d263e82c-4ea9-4624-875f-62ffc637cc97 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 668be004-de85-4eb4-9037-1b232245c561] calling os-brick to detach iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 17:52:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d263e82c-4ea9-4624-875f-62ffc637cc97 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, {'target_iqn': 'iqn.2010-10.org.openstack:45680174-3907-4340-96e8-1439c5dba041', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nsZgJthW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:52:41 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-d263e82c-4ea9-4624-875f-62ffc637cc97 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:52:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-d263e82c-4ea9-4624-875f-62ffc637cc97 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:52:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-d263e82c-4ea9-4624-875f-62ffc637cc97 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:52:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:52:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:52:41 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa9465d-792b-4540-ada4-d8a7ce5a6356]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:45680174-3907-4340-96e8-1439c5dba041\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:731e9b94-f271-45dc-90d4-8c0666180552\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:52:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d263e82c-4ea9-4624-875f-62ffc637cc97 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 17:52:41 user nova-compute[74743]: No targets found.
Nov 18 17:52:41 user nova-compute[74743]: iSNS:
Nov 18 17:52:41 user nova-compute[74743]: No targets found.
Nov 18 17:52:41 user nova-compute[74743]: STATIC:
Nov 18 17:52:41 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:45680174-3907-4340-96e8-1439c5dba041
Nov 18 17:52:41 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:52:41 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:52:41 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:731e9b94-f271-45dc-90d4-8c0666180552
Nov 18 17:52:41 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:52:41 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:52:41 user nova-compute[74743]: FIRMWARE:
Nov 18 17:52:41 user nova-compute[74743]: No targets found.
Nov 18 17:52:41 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:52:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d263e82c-4ea9-4624-875f-62ffc637cc97 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 17:52:41 user nova-compute[74743]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 17:52:41 user nova-compute[74743]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74743) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 17:52:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d263e82c-4ea9-4624-875f-62ffc637cc97 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45680174-3907-4340-96e8-1439c5dba041', 0)] {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 17:52:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:52:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:52:41 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5a21d8-6b73-40f0-9379-c18ecf07ee1b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45680174-3907-4340-96e8-1439c5dba041\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:731e9b94-f271-45dc-90d4-8c0666180552\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:52:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:52:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:52:41 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5d87b2-ddd3-460d-a64b-2d1581b8b1f3]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45680174-3907-4340-96e8-1439c5dba041 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731e9b94-f271-45dc-90d4-8c0666180552 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:52:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d263e82c-4ea9-4624-875f-62ffc637cc97 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45680174-3907-4340-96e8-1439c5dba041 (non-flash)
Nov 18 17:52:41 user nova-compute[74743]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731e9b94-f271-45dc-90d4-8c0666180552 (non-flash)
Nov 18 17:52:41 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:52:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d263e82c-4ea9-4624-875f-62ffc637cc97 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45680174-3907-4340-96e8-1439c5dba041 (non-flash)
Nov 18 17:52:41 user nova-compute[74743]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731e9b94-f271-45dc-90d4-8c0666180552 (non-flash)
Nov 18 17:52:41 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:52:41 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d263e82c-4ea9-4624-875f-62ffc637cc97 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb08276320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45680174-3907-4340-96e8-1439c5dba041'): ({'sdb'}, set())}) {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 17:52:41 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-d263e82c-4ea9-4624-875f-62ffc637cc97 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Removing single pathed devices sdb {{(pid=74743) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 17:52:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:52:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:52:41 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0692b31a-cf35-428f-bf96-f6b37f4aecb2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:52:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:52:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:52:41 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a70d5e-6b47-4e7d-9efd-e1e2e19c2e77]: (4, ('ok\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:52:41 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-d263e82c-4ea9-4624-875f-62ffc637cc97 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Flushing IO for device /dev/sdb {{(pid=74743) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 17:52:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:52:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:52:41 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f28a828-114d-4100-aa1b-abb47a1185e4]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:52:41 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-d263e82c-4ea9-4624-875f-62ffc637cc97 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74743) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 17:52:41 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:52:42 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:52:42 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[4952d889-a9c6-403e-b1eb-81c91551fdfe]: (4, ('1', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:52:42 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-d263e82c-4ea9-4624-875f-62ffc637cc97 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 17:52:42 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-d263e82c-4ea9-4624-875f-62ffc637cc97 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] SCSI volumes sdb have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 17:52:42 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d263e82c-4ea9-4624-875f-62ffc637cc97 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45680174-3907-4340-96e8-1439c5dba041')] {{(pid=74743) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 17:52:42 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45680174-3907-4340-96e8-1439c5dba041 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:52:42 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45680174-3907-4340-96e8-1439c5dba041 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:52:42 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b4a823-3741-4431-bb9e-cef49bdbcfb6]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:52:42 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d263e82c-4ea9-4624-875f-62ffc637cc97 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:52:42 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45680174-3907-4340-96e8-1439c5dba041 -p 172.16.0.220:3260 --logout {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:52:42 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45680174-3907-4340-96e8-1439c5dba041 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:52:42 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a09a9d-8e81-4037-91eb-5c22ffebba96]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:45680174-3907-4340-96e8-1439c5dba041, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:45680174-3907-4340-96e8-1439c5dba041, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:52:42 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d263e82c-4ea9-4624-875f-62ffc637cc97 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:45680174-3907-4340-96e8-1439c5dba041, portal: 172.16.0.220,3260]
Nov 18 17:52:42 user nova-compute[74743]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:45680174-3907-4340-96e8-1439c5dba041, portal: 172.16.0.220,3260] successful.
Nov 18 17:52:42 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:52:42 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45680174-3907-4340-96e8-1439c5dba041 -p 172.16.0.220:3260 --op delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:52:42 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45680174-3907-4340-96e8-1439c5dba041 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:52:42 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[413bd8ae-b8fc-4111-97f8-738281243a0c]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:52:42 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d263e82c-4ea9-4624-875f-62ffc637cc97 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:52:42 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-d263e82c-4ea9-4624-875f-62ffc637cc97 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:52:42 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-d263e82c-4ea9-4624-875f-62ffc637cc97 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] <== disconnect_volume: return (306ms) None {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:52:42 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d263e82c-4ea9-4624-875f-62ffc637cc97 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 668be004-de85-4eb4-9037-1b232245c561] Disconnected iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 17:52:42 user nova-compute[74743]: DEBUG nova.objects.instance [None req-d263e82c-4ea9-4624-875f-62ffc637cc97 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lazy-loading 'flavor' on Instance uuid 668be004-de85-4eb4-9037-1b232245c561 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:52:42 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-d263e82c-4ea9-4624-875f-62ffc637cc97 tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "668be004-de85-4eb4-9037-1b232245c561" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.635s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:52:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-54683385-0221-48cb-b1fc-97e6fdd6fdce tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Acquiring lock "668be004-de85-4eb4-9037-1b232245c561" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:52:43 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-54683385-0221-48cb-b1fc-97e6fdd6fdce tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "668be004-de85-4eb4-9037-1b232245c561" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:52:43 user nova-compute[74743]: INFO nova.compute.manager [None req-54683385-0221-48cb-b1fc-97e6fdd6fdce tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 668be004-de85-4eb4-9037-1b232245c561] Detaching volume 731e9b94-f271-45dc-90d4-8c0666180552
Nov 18 17:52:44 user nova-compute[74743]: INFO nova.virt.block_device [None req-54683385-0221-48cb-b1fc-97e6fdd6fdce tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 668be004-de85-4eb4-9037-1b232245c561] Attempting to driver detach volume 731e9b94-f271-45dc-90d4-8c0666180552 from mountpoint /dev/vdc
Nov 18 17:52:44 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-54683385-0221-48cb-b1fc-97e6fdd6fdce tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Attempting to detach device vdc from instance 668be004-de85-4eb4-9037-1b232245c561 from the persistent domain config. {{(pid=74743) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 17:52:44 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-54683385-0221-48cb-b1fc-97e6fdd6fdce tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 17:52:44 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:52:44 user nova-compute[74743]:   <source dev="/dev/sdc"/>
Nov 18 17:52:44 user nova-compute[74743]:   <target dev="vdc" bus="virtio"/>
Nov 18 17:52:44 user nova-compute[74743]:   <serial>731e9b94-f271-45dc-90d4-8c0666180552</serial>
Nov 18 17:52:44 user nova-compute[74743]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 18 17:52:44 user nova-compute[74743]: </disk>
Nov 18 17:52:44 user nova-compute[74743]:  {{(pid=74743) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 17:52:44 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-54683385-0221-48cb-b1fc-97e6fdd6fdce tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Successfully detached device vdc from instance 668be004-de85-4eb4-9037-1b232245c561 from the persistent domain config.
Nov 18 17:52:44 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-54683385-0221-48cb-b1fc-97e6fdd6fdce tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 668be004-de85-4eb4-9037-1b232245c561 from the live domain config. {{(pid=74743) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 17:52:44 user nova-compute[74743]: DEBUG nova.virt.libvirt.guest [None req-54683385-0221-48cb-b1fc-97e6fdd6fdce tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 17:52:44 user nova-compute[74743]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 17:52:44 user nova-compute[74743]:   <source dev="/dev/sdc"/>
Nov 18 17:52:44 user nova-compute[74743]:   <target dev="vdc" bus="virtio"/>
Nov 18 17:52:44 user nova-compute[74743]:   <serial>731e9b94-f271-45dc-90d4-8c0666180552</serial>
Nov 18 17:52:44 user nova-compute[74743]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 18 17:52:44 user nova-compute[74743]: </disk>
Nov 18 17:52:44 user nova-compute[74743]:  {{(pid=74743) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 17:52:44 user nova-compute[74743]: DEBUG nova.virt.libvirt.driver [None req-54683385-0221-48cb-b1fc-97e6fdd6fdce tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 668be004-de85-4eb4-9037-1b232245c561 {{(pid=74743) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 17:52:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:52:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:52:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74743) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 17:52:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:52:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:52:46 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:52:51 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:52:56 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:52:57 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:52:58 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:52:58 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:52:58 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74743) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 17:53:00 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:53:01 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:53:01 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:53:01 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74743) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 17:53:01 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:53:01 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:53:01 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:53:02 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:53:03 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:53:04 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-54683385-0221-48cb-b1fc-97e6fdd6fdce tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 668be004-de85-4eb4-9037-1b232245c561 is timed out.
Nov 18 17:53:04 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-54683385-0221-48cb-b1fc-97e6fdd6fdce tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Successfully detached device vdc from instance 668be004-de85-4eb4-9037-1b232245c561 from the live domain config.
Nov 18 17:53:04 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54683385-0221-48cb-b1fc-97e6fdd6fdce tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 668be004-de85-4eb4-9037-1b232245c561] calling os-brick to detach iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 17:53:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-54683385-0221-48cb-b1fc-97e6fdd6fdce tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffb28496c20>, {'target_iqn': 'iqn.2010-10.org.openstack:731e9b94-f271-45dc-90d4-8c0666180552', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KbpgVdLw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 17:53:04 user nova-compute[74743]: WARNING os_brick.initiator.connectors.base [None req-54683385-0221-48cb-b1fc-97e6fdd6fdce tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 17:53:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-54683385-0221-48cb-b1fc-97e6fdd6fdce tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 17:53:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-54683385-0221-48cb-b1fc-97e6fdd6fdce tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 17:53:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:53:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:53:04 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a48e3a7-bdfc-4aa3-9f33-5d9880712a6d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:731e9b94-f271-45dc-90d4-8c0666180552\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:53:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-54683385-0221-48cb-b1fc-97e6fdd6fdce tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 17:53:04 user nova-compute[74743]: No targets found.
Nov 18 17:53:04 user nova-compute[74743]: iSNS:
Nov 18 17:53:04 user nova-compute[74743]: No targets found.
Nov 18 17:53:04 user nova-compute[74743]: STATIC:
Nov 18 17:53:04 user nova-compute[74743]: Target: iqn.2010-10.org.openstack:731e9b94-f271-45dc-90d4-8c0666180552
Nov 18 17:53:04 user nova-compute[74743]:         Portal: 172.16.0.220:3260,-1
Nov 18 17:53:04 user nova-compute[74743]:                 Iface Name: default
Nov 18 17:53:04 user nova-compute[74743]: FIRMWARE:
Nov 18 17:53:04 user nova-compute[74743]: No targets found.
Nov 18 17:53:04 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:53:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-54683385-0221-48cb-b1fc-97e6fdd6fdce tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 17:53:04 user nova-compute[74743]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 17:53:04 user nova-compute[74743]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74743) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 17:53:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-54683385-0221-48cb-b1fc-97e6fdd6fdce tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:731e9b94-f271-45dc-90d4-8c0666180552', 0)] {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 17:53:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:53:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:53:04 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[919bcf0c-4b47-4e2e-b748-9d569b70a24f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:731e9b94-f271-45dc-90d4-8c0666180552\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:53:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:53:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:53:04 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[118237ec-397a-4d94-93f0-9f0e78236d10]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731e9b94-f271-45dc-90d4-8c0666180552 (non-flash)\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:53:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-54683385-0221-48cb-b1fc-97e6fdd6fdce tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731e9b94-f271-45dc-90d4-8c0666180552 (non-flash)
Nov 18 17:53:04 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 17:53:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-54683385-0221-48cb-b1fc-97e6fdd6fdce tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731e9b94-f271-45dc-90d4-8c0666180552 (non-flash)
Nov 18 17:53:04 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 17:53:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-54683385-0221-48cb-b1fc-97e6fdd6fdce tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffb284a25f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:731e9b94-f271-45dc-90d4-8c0666180552'): ({'sdc'}, set())}) {{(pid=74743) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 17:53:04 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-54683385-0221-48cb-b1fc-97e6fdd6fdce tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Removing single pathed devices sdc {{(pid=74743) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 17:53:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:53:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:53:04 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[146bf7b2-f958-46e8-9064-0bd174ef94a7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:53:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:53:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:53:04 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[94830f6c-14fa-46b1-85fa-501f90cb910c]: (4, ('ok\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:53:04 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-54683385-0221-48cb-b1fc-97e6fdd6fdce tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Flushing IO for device /dev/sdc {{(pid=74743) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 17:53:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:53:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:53:04 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c108618-9844-41cd-830a-3a4e6cec32f3]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:53:04 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-54683385-0221-48cb-b1fc-97e6fdd6fdce tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74743) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 17:53:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:53:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:53:04 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[64488e6c-b374-4a99-96a0-7bc5e031fdf5]: (4, ('1', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:53:04 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-54683385-0221-48cb-b1fc-97e6fdd6fdce tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 17:53:04 user nova-compute[74743]: DEBUG os_brick.initiator.linuxscsi [None req-54683385-0221-48cb-b1fc-97e6fdd6fdce tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] SCSI volumes sdc have been removed. {{(pid=74743) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 17:53:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-54683385-0221-48cb-b1fc-97e6fdd6fdce tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:731e9b94-f271-45dc-90d4-8c0666180552')] {{(pid=74743) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 17:53:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:731e9b94-f271-45dc-90d4-8c0666180552 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:53:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:731e9b94-f271-45dc-90d4-8c0666180552 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:53:04 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2c11ce-cde8-42a4-af5c-c8797304e060]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:53:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-54683385-0221-48cb-b1fc-97e6fdd6fdce tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:53:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:731e9b94-f271-45dc-90d4-8c0666180552 -p 172.16.0.220:3260 --logout {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:53:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:731e9b94-f271-45dc-90d4-8c0666180552 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:53:04 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2ce38e-fe74-409b-820c-e30c0645e5dd]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:731e9b94-f271-45dc-90d4-8c0666180552, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:731e9b94-f271-45dc-90d4-8c0666180552, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:53:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-54683385-0221-48cb-b1fc-97e6fdd6fdce tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:731e9b94-f271-45dc-90d4-8c0666180552, portal: 172.16.0.220,3260]
Nov 18 17:53:04 user nova-compute[74743]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:731e9b94-f271-45dc-90d4-8c0666180552, portal: 172.16.0.220,3260] successful.
Nov 18 17:53:04 user nova-compute[74743]:  stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:53:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:731e9b94-f271-45dc-90d4-8c0666180552 -p 172.16.0.220:3260 --op delete {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:53:04 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:731e9b94-f271-45dc-90d4-8c0666180552 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:53:04 user nova-compute[74743]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a38d620-51ed-4633-9cc2-d7a6569233a2]: (4, ('', '')) {{(pid=85244) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 17:53:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-54683385-0221-48cb-b1fc-97e6fdd6fdce tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74743) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 17:53:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.base [None req-54683385-0221-48cb-b1fc-97e6fdd6fdce tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.269s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 17:53:04 user nova-compute[74743]: DEBUG os_brick.initiator.connectors.iscsi [None req-54683385-0221-48cb-b1fc-97e6fdd6fdce tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] <== disconnect_volume: return (270ms) None {{(pid=74743) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 17:53:04 user nova-compute[74743]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54683385-0221-48cb-b1fc-97e6fdd6fdce tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 668be004-de85-4eb4-9037-1b232245c561] Disconnected iSCSI Volume {{(pid=74743) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 17:53:05 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:53:05 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:53:05 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:53:05 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:53:05 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Auditing locally available compute resources for user (node: user) {{(pid=74743) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 17:53:05 user nova-compute[74743]: DEBUG nova.objects.instance [None req-54683385-0221-48cb-b1fc-97e6fdd6fdce tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lazy-loading 'flavor' on Instance uuid 668be004-de85-4eb4-9037-1b232245c561 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:53:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668be004-de85-4eb4-9037-1b232245c561/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:53:05 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-54683385-0221-48cb-b1fc-97e6fdd6fdce tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "668be004-de85-4eb4-9037-1b232245c561" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.683s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:53:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668be004-de85-4eb4-9037-1b232245c561/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:53:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668be004-de85-4eb4-9037-1b232245c561/disk --force-share --output=json {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 17:53:05 user nova-compute[74743]: DEBUG oslo_concurrency.processutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/668be004-de85-4eb4-9037-1b232245c561/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74743) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 17:53:06 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:53:06 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:53:06 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Hypervisor/Node resource view: name=user free_ram=8974MB free_disk=25.23294448852539GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74743) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 17:53:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:53:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:53:06 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Instance 668be004-de85-4eb4-9037-1b232245c561 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74743) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 17:53:06 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 17:53:06 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 17:53:06 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:53:06 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:53:06 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Compute_service record updated for user:user {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 17:53:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.174s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:53:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:53:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4d7e7b14-10ef-4bd6-90d6-c3f799eba3bc tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Acquiring lock "668be004-de85-4eb4-9037-1b232245c561" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:53:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4d7e7b14-10ef-4bd6-90d6-c3f799eba3bc tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "668be004-de85-4eb4-9037-1b232245c561" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:53:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4d7e7b14-10ef-4bd6-90d6-c3f799eba3bc tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Acquiring lock "668be004-de85-4eb4-9037-1b232245c561-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:53:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4d7e7b14-10ef-4bd6-90d6-c3f799eba3bc tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "668be004-de85-4eb4-9037-1b232245c561-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:53:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4d7e7b14-10ef-4bd6-90d6-c3f799eba3bc tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "668be004-de85-4eb4-9037-1b232245c561-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:53:06 user nova-compute[74743]: INFO nova.compute.manager [None req-4d7e7b14-10ef-4bd6-90d6-c3f799eba3bc tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 668be004-de85-4eb4-9037-1b232245c561] Terminating instance
Nov 18 17:53:06 user nova-compute[74743]: DEBUG nova.compute.manager [None req-4d7e7b14-10ef-4bd6-90d6-c3f799eba3bc tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 668be004-de85-4eb4-9037-1b232245c561] Start destroying the instance on the hypervisor. {{(pid=74743) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 17:53:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:53:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:53:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:53:06 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:53:07 user nova-compute[74743]: DEBUG nova.compute.manager [req-fd7aa29c-59cc-4853-a557-f0984ee22671 req-c6580837-0f73-46ca-a9ec-f01d618bee96 service nova] [instance: 668be004-de85-4eb4-9037-1b232245c561] Received event network-vif-unplugged-a69113f5-77da-415b-8738-f46c120221c1 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:53:07 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-fd7aa29c-59cc-4853-a557-f0984ee22671 req-c6580837-0f73-46ca-a9ec-f01d618bee96 service nova] Acquiring lock "668be004-de85-4eb4-9037-1b232245c561-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:53:07 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-fd7aa29c-59cc-4853-a557-f0984ee22671 req-c6580837-0f73-46ca-a9ec-f01d618bee96 service nova] Lock "668be004-de85-4eb4-9037-1b232245c561-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:53:07 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-fd7aa29c-59cc-4853-a557-f0984ee22671 req-c6580837-0f73-46ca-a9ec-f01d618bee96 service nova] Lock "668be004-de85-4eb4-9037-1b232245c561-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:53:07 user nova-compute[74743]: DEBUG nova.compute.manager [req-fd7aa29c-59cc-4853-a557-f0984ee22671 req-c6580837-0f73-46ca-a9ec-f01d618bee96 service nova] [instance: 668be004-de85-4eb4-9037-1b232245c561] No waiting events found dispatching network-vif-unplugged-a69113f5-77da-415b-8738-f46c120221c1 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:53:07 user nova-compute[74743]: DEBUG nova.compute.manager [req-fd7aa29c-59cc-4853-a557-f0984ee22671 req-c6580837-0f73-46ca-a9ec-f01d618bee96 service nova] [instance: 668be004-de85-4eb4-9037-1b232245c561] Received event network-vif-unplugged-a69113f5-77da-415b-8738-f46c120221c1 for instance with task_state deleting. {{(pid=74743) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 17:53:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:53:07 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:53:07 user nova-compute[74743]: INFO nova.virt.libvirt.driver [-] [instance: 668be004-de85-4eb4-9037-1b232245c561] Instance destroyed successfully.
Nov 18 17:53:07 user nova-compute[74743]: DEBUG nova.objects.instance [None req-4d7e7b14-10ef-4bd6-90d6-c3f799eba3bc tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lazy-loading 'resources' on Instance uuid 668be004-de85-4eb4-9037-1b232245c561 {{(pid=74743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 17:53:07 user nova-compute[74743]: DEBUG nova.virt.libvirt.vif [None req-4d7e7b14-10ef-4bd6-90d6-c3f799eba3bc tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T17:50:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-70674154',display_name='tempest-AttachVolumeTestJSON-server-70674154',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-70674154',id=51,image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+iv0TJ3kWY7P7r3h9yOxtBVyXtBugt+Qu78sfKg/4ijI+YTuFuq0BIMmHIdHbkxSDRUjIJE/6/ZlFzlGEj15fgt1hRwmzv2sOeENIMlV8T1Mr7IsUBtZc8Gr7TO5FvWw==',key_name='tempest-keypair-700447340',keypairs=<?>,launch_index=0,launched_at=2023-11-18T17:50:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='790f602c532d41289c52985c8fab91d4',ramdisk_id='',reservation_id='r-5w81mvye',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9536f6cf-95c4-40e2-864a-09a91525678a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1207996855',owner_user_name='tempest-AttachVolumeTestJSON-1207996855-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T17:50:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b9d8b543f4946b2918bd38c4a3c835f',uuid=668be004-de85-4eb4-9037-1b232245c561,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a69113f5-77da-415b-8738-f46c120221c1", "address": "fa:16:3e:2b:89:d7", "network": {"id": "7cf1258c-5feb-472e-9f3f-69d95360b050", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-628054528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "790f602c532d41289c52985c8fab91d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa69113f5-77", "ovs_interfaceid": "a69113f5-77da-415b-8738-f46c120221c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 17:53:07 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-4d7e7b14-10ef-4bd6-90d6-c3f799eba3bc tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Converting VIF {"id": "a69113f5-77da-415b-8738-f46c120221c1", "address": "fa:16:3e:2b:89:d7", "network": {"id": "7cf1258c-5feb-472e-9f3f-69d95360b050", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-628054528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "790f602c532d41289c52985c8fab91d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa69113f5-77", "ovs_interfaceid": "a69113f5-77da-415b-8738-f46c120221c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 17:53:07 user nova-compute[74743]: DEBUG nova.network.os_vif_util [None req-4d7e7b14-10ef-4bd6-90d6-c3f799eba3bc tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:89:d7,bridge_name='br-int',has_traffic_filtering=True,id=a69113f5-77da-415b-8738-f46c120221c1,network=Network(7cf1258c-5feb-472e-9f3f-69d95360b050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa69113f5-77') {{(pid=74743) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 17:53:07 user nova-compute[74743]: DEBUG os_vif [None req-4d7e7b14-10ef-4bd6-90d6-c3f799eba3bc tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:89:d7,bridge_name='br-int',has_traffic_filtering=True,id=a69113f5-77da-415b-8738-f46c120221c1,network=Network(7cf1258c-5feb-472e-9f3f-69d95360b050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa69113f5-77') {{(pid=74743) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 17:53:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:53:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa69113f5-77, bridge=br-int, if_exists=True) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:53:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:53:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:53:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:53:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4268f614-f833-46a4-8e4f-96e23f723802) {{(pid=74743) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 17:53:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:53:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:53:07 user nova-compute[74743]: INFO os_vif [None req-4d7e7b14-10ef-4bd6-90d6-c3f799eba3bc tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:89:d7,bridge_name='br-int',has_traffic_filtering=True,id=a69113f5-77da-415b-8738-f46c120221c1,network=Network(7cf1258c-5feb-472e-9f3f-69d95360b050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa69113f5-77')
Nov 18 17:53:07 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-4d7e7b14-10ef-4bd6-90d6-c3f799eba3bc tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 668be004-de85-4eb4-9037-1b232245c561] Deleting instance files /opt/stack/data/nova/instances/668be004-de85-4eb4-9037-1b232245c561_del
Nov 18 17:53:07 user nova-compute[74743]: INFO nova.virt.libvirt.driver [None req-4d7e7b14-10ef-4bd6-90d6-c3f799eba3bc tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 668be004-de85-4eb4-9037-1b232245c561] Deletion of /opt/stack/data/nova/instances/668be004-de85-4eb4-9037-1b232245c561_del complete
Nov 18 17:53:07 user nova-compute[74743]: INFO nova.compute.manager [None req-4d7e7b14-10ef-4bd6-90d6-c3f799eba3bc tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] [instance: 668be004-de85-4eb4-9037-1b232245c561] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 18 17:53:07 user nova-compute[74743]: DEBUG oslo.service.loopingcall [None req-4d7e7b14-10ef-4bd6-90d6-c3f799eba3bc tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74743) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 17:53:07 user nova-compute[74743]: DEBUG nova.compute.manager [-] [instance: 668be004-de85-4eb4-9037-1b232245c561] Deallocating network for instance {{(pid=74743) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 17:53:07 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 668be004-de85-4eb4-9037-1b232245c561] deallocate_for_instance() {{(pid=74743) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 17:53:08 user nova-compute[74743]: DEBUG nova.network.neutron [-] [instance: 668be004-de85-4eb4-9037-1b232245c561] Updating instance_info_cache with network_info: [] {{(pid=74743) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 17:53:08 user nova-compute[74743]: INFO nova.compute.manager [-] [instance: 668be004-de85-4eb4-9037-1b232245c561] Took 1.14 seconds to deallocate network for instance.
Nov 18 17:53:08 user nova-compute[74743]: DEBUG nova.compute.manager [req-cbdfafe2-c709-48f9-b0d9-04434c469dd7 req-f176cd02-c485-47e7-82c0-27a5d92ff7bc service nova] [instance: 668be004-de85-4eb4-9037-1b232245c561] Received event network-vif-deleted-a69113f5-77da-415b-8738-f46c120221c1 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:53:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4d7e7b14-10ef-4bd6-90d6-c3f799eba3bc tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:53:08 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4d7e7b14-10ef-4bd6-90d6-c3f799eba3bc tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:53:08 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-4d7e7b14-10ef-4bd6-90d6-c3f799eba3bc tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:53:09 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-4d7e7b14-10ef-4bd6-90d6-c3f799eba3bc tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:53:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4d7e7b14-10ef-4bd6-90d6-c3f799eba3bc tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.131s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:53:09 user nova-compute[74743]: INFO nova.scheduler.client.report [None req-4d7e7b14-10ef-4bd6-90d6-c3f799eba3bc tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Deleted allocations for instance 668be004-de85-4eb4-9037-1b232245c561
Nov 18 17:53:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-4d7e7b14-10ef-4bd6-90d6-c3f799eba3bc tempest-AttachVolumeTestJSON-1207996855 tempest-AttachVolumeTestJSON-1207996855-project-member] Lock "668be004-de85-4eb4-9037-1b232245c561" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.309s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:53:09 user nova-compute[74743]: DEBUG nova.compute.manager [req-3a84f43a-1c3c-4c47-b3ba-37405bda6194 req-6fc84bc9-0ab7-4354-bfe0-73eb25ad282e service nova] [instance: 668be004-de85-4eb4-9037-1b232245c561] Received event network-vif-plugged-a69113f5-77da-415b-8738-f46c120221c1 {{(pid=74743) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 17:53:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3a84f43a-1c3c-4c47-b3ba-37405bda6194 req-6fc84bc9-0ab7-4354-bfe0-73eb25ad282e service nova] Acquiring lock "668be004-de85-4eb4-9037-1b232245c561-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:53:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3a84f43a-1c3c-4c47-b3ba-37405bda6194 req-6fc84bc9-0ab7-4354-bfe0-73eb25ad282e service nova] Lock "668be004-de85-4eb4-9037-1b232245c561-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:53:09 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [req-3a84f43a-1c3c-4c47-b3ba-37405bda6194 req-6fc84bc9-0ab7-4354-bfe0-73eb25ad282e service nova] Lock "668be004-de85-4eb4-9037-1b232245c561-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:53:09 user nova-compute[74743]: DEBUG nova.compute.manager [req-3a84f43a-1c3c-4c47-b3ba-37405bda6194 req-6fc84bc9-0ab7-4354-bfe0-73eb25ad282e service nova] [instance: 668be004-de85-4eb4-9037-1b232245c561] No waiting events found dispatching network-vif-plugged-a69113f5-77da-415b-8738-f46c120221c1 {{(pid=74743) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 17:53:09 user nova-compute[74743]: WARNING nova.compute.manager [req-3a84f43a-1c3c-4c47-b3ba-37405bda6194 req-6fc84bc9-0ab7-4354-bfe0-73eb25ad282e service nova] [instance: 668be004-de85-4eb4-9037-1b232245c561] Received unexpected event network-vif-plugged-a69113f5-77da-415b-8738-f46c120221c1 for instance with vm_state deleted and task_state None.
Nov 18 17:53:12 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:53:13 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:53:13 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Starting heal instance info cache {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 17:53:13 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Rebuilding the list of instances to heal {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 17:53:13 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Didn't find any instances for network info cache update. {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 18 17:53:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:53:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:53:27 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:53:32 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:53:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:53:42 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:53:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:53:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:53:57 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:53:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:53:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:53:59 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:53:59 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:53:59 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74743) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 17:54:00 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:54:02 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:54:02 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:54:02 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:54:02 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74743) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 17:54:02 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:54:02 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74743) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 17:54:02 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:54:05 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:54:06 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:54:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:54:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:54:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:54:06 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Auditing locally available compute resources for user (node: user) {{(pid=74743) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 17:54:06 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:54:06 user nova-compute[74743]: WARNING nova.virt.libvirt.driver [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 17:54:06 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Hypervisor/Node resource view: name=user free_ram=9118MB free_disk=25.259723663330078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74743) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 17:54:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 17:54:06 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 17:54:06 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 17:54:06 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74743) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 17:54:06 user nova-compute[74743]: DEBUG nova.compute.provider_tree [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed in ProviderTree for provider: 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 {{(pid=74743) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 17:54:06 user nova-compute[74743]: DEBUG nova.scheduler.client.report [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Inventory has not changed for provider 30e4d58a-2a6d-4032-8d01-e33007f4b2c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74743) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 17:54:07 user nova-compute[74743]: DEBUG nova.compute.resource_tracker [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Compute_service record updated for user:user {{(pid=74743) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 17:54:07 user nova-compute[74743]: DEBUG oslo_concurrency.lockutils [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.176s {{(pid=74743) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 17:54:07 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:54:08 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:54:08 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:54:09 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:54:12 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:54:14 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:54:14 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Starting heal instance info cache {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 17:54:14 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Rebuilding the list of instances to heal {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 17:54:14 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Didn't find any instances for network info cache update. {{(pid=74743) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 18 17:54:17 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:54:22 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:54:27 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:54:32 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:54:37 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:54:42 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:54:47 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:54:52 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:54:57 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:54:57 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 17:54:59 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:54:59 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:54:59 user nova-compute[74743]: DEBUG nova.compute.manager [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74743) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 17:55:01 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 17:55:02 user nova-compute[74743]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74743) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 17:55:04 user nova-compute[74743]: DEBUG oslo_service.periodic_task [None req-cff06b20-188d-4b83-bfe6-259eada1ff1d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74743) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}